[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:58:23.902685   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34253
I20260709 12:58:23.904331   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:58:23.905459   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:23.927058   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:23.927944   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:23.928687   431 server_base.cc:1061] running on GCE node
W20260709 12:58:23.928788   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:25.139374   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:25.139655   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:25.139827   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601905139808 us; error 0 us; skew 500 ppm
I20260709 12:58:25.140767   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:25.148967   431 webserver.cc:533] Webserver started at http://127.0.107.254:34679/ using document root <none> and password file <none>
I20260709 12:58:25.150096   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:25.150343   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:25.150823   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:25.157419   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/master-0-root/instance:
uuid: "fde28bcf6ac44bb998c04105ba37d0ab"
format_stamp: "Formatted at 2026-07-09 12:58:25 on dist-test-slave-nr1f"
I20260709 12:58:25.166098   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:58:25.171937   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.173185   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:58:25.173575   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/master-0-root
uuid: "fde28bcf6ac44bb998c04105ba37d0ab"
format_stamp: "Formatted at 2026-07-09 12:58:25 on dist-test-slave-nr1f"
I20260709 12:58:25.173933   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:25.224087   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:25.226014   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:58:25.226565   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:25.305614   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34253
I20260709 12:58:25.305678   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34253 every 8 connection(s)
I20260709 12:58:25.313922   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:25.338156   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab: Bootstrap starting.
I20260709 12:58:25.344259   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.346091   498 log.cc:826] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab: Log is configured to *not* fsync() on all Append() calls
I20260709 12:58:25.350868   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab: No bootstrap required, opened a new log
I20260709 12:58:25.371711   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde28bcf6ac44bb998c04105ba37d0ab" member_type: VOTER }
I20260709 12:58:25.372263   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.372458   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fde28bcf6ac44bb998c04105ba37d0ab, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.373274   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde28bcf6ac44bb998c04105ba37d0ab" member_type: VOTER }
I20260709 12:58:25.373729   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:25.373965   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:25.374272   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.378701   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde28bcf6ac44bb998c04105ba37d0ab" member_type: VOTER }
I20260709 12:58:25.379388   498 leader_election.cc:304] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fde28bcf6ac44bb998c04105ba37d0ab; no voters: 
I20260709 12:58:25.381021   498 leader_election.cc:290] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:25.381971   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.384773   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [term 1 LEADER]: Becoming Leader. State: Replica: fde28bcf6ac44bb998c04105ba37d0ab, State: Running, Role: LEADER
I20260709 12:58:25.385644   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde28bcf6ac44bb998c04105ba37d0ab" member_type: VOTER }
I20260709 12:58:25.385921   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:25.399008   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fde28bcf6ac44bb998c04105ba37d0ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde28bcf6ac44bb998c04105ba37d0ab" member_type: VOTER } }
I20260709 12:58:25.399842   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:25.400319   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader fde28bcf6ac44bb998c04105ba37d0ab. Latest consensus state: current_term: 1 leader_uuid: "fde28bcf6ac44bb998c04105ba37d0ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fde28bcf6ac44bb998c04105ba37d0ab" member_type: VOTER } }
I20260709 12:58:25.401352   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:25.403553   511 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:25.413848   511 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:25.422786   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:25.432475   511 catalog_manager.cc:1383] Generated new cluster ID: a0375ec618004873ae69973da21dc711
I20260709 12:58:25.432789   511 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:25.454672   511 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:25.456228   511 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:25.471817   511 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab: Generated new TSK 0
I20260709 12:58:25.472818   511 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:25.495011   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:25.506090   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:25.507853   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:25.512374   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:25.512501   431 server_base.cc:1061] running on GCE node
I20260709 12:58:25.513304   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:25.513481   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:25.513696   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601905513660 us; error 0 us; skew 500 ppm
I20260709 12:58:25.514380   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:25.519155   431 webserver.cc:533] Webserver started at http://127.0.107.193:46149/ using document root <none> and password file <none>
I20260709 12:58:25.519690   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:25.519881   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:25.520184   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:25.521278   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-0-root/instance:
uuid: "9a6aab69a8c54e1180d19ed2a43af960"
format_stamp: "Formatted at 2026-07-09 12:58:25 on dist-test-slave-nr1f"
I20260709 12:58:25.527691   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.008s
I20260709 12:58:25.532120   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.533390   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:58:25.533690   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-0-root
uuid: "9a6aab69a8c54e1180d19ed2a43af960"
format_stamp: "Formatted at 2026-07-09 12:58:25 on dist-test-slave-nr1f"
I20260709 12:58:25.533958   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:25.551012   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:25.552374   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:25.555450   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:25.560493   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:25.560730   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.561071   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:25.561228   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.678143   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40113
I20260709 12:58:25.678218   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40113 every 8 connection(s)
I20260709 12:58:25.686077   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:25.703758   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:25.708194   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:25.711799   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:25.718837   431 server_base.cc:1061] running on GCE node
I20260709 12:58:25.719851   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:25.720151   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:25.720371   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601905720351 us; error 0 us; skew 500 ppm
I20260709 12:58:25.721272   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:25.723788   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34253
I20260709 12:58:25.724277   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:25.725526   431 webserver.cc:533] Webserver started at http://127.0.107.194:37571/ using document root <none> and password file <none>
I20260709 12:58:25.725996   591 heartbeater.cc:507] Master 127.0.107.254:34253 requested a full tablet report, sending...
I20260709 12:58:25.726228   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:25.726585   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:25.726898   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:25.728318   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-1-root/instance:
uuid: "c930d6e99df448358342ff6f74b5ab79"
format_stamp: "Formatted at 2026-07-09 12:58:25 on dist-test-slave-nr1f"
I20260709 12:58:25.729661   463 ts_manager.cc:194] Registered new tserver with Master: 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113)
I20260709 12:58:25.733233   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57234
I20260709 12:58:25.736178   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.006s
I20260709 12:58:25.741008   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.741957   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:58:25.742319   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-1-root
uuid: "c930d6e99df448358342ff6f74b5ab79"
format_stamp: "Formatted at 2026-07-09 12:58:25 on dist-test-slave-nr1f"
I20260709 12:58:25.742664   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:25.761215   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:25.763185   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:25.765812   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:25.769709   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:25.769908   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.770274   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:25.770421   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.882295   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39515
I20260709 12:58:25.882398   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39515 every 8 connection(s)
I20260709 12:58:25.889665   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:25.899320   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:25.903038   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:25.906498   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:25.907562   431 server_base.cc:1061] running on GCE node
I20260709 12:58:25.908851   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:25.909168   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:25.909387   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601905909368 us; error 0 us; skew 500 ppm
I20260709 12:58:25.909510   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34253
I20260709 12:58:25.909940   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:25.910307   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:25.910812   666 heartbeater.cc:507] Master 127.0.107.254:34253 requested a full tablet report, sending...
I20260709 12:58:25.912868   463 ts_manager.cc:194] Registered new tserver with Master: c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:25.913715   431 webserver.cc:533] Webserver started at http://127.0.107.195:45699/ using document root <none> and password file <none>
I20260709 12:58:25.914369   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:25.914407   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57242
I20260709 12:58:25.914672   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:25.915032   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:25.916565   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-2-root/instance:
uuid: "9215735813c6433e9c1d88f46c555861"
format_stamp: "Formatted at 2026-07-09 12:58:25 on dist-test-slave-nr1f"
I20260709 12:58:25.922356   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:58:25.926466   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.927338   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:58:25.927673   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-2-root
uuid: "9215735813c6433e9c1d88f46c555861"
format_stamp: "Formatted at 2026-07-09 12:58:25 on dist-test-slave-nr1f"
I20260709 12:58:25.928041   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601903731679-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:25.954521   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:25.956171   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:25.958650   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:25.962710   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:25.962977   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:25.963258   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:25.963457   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:26.056798   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:40231
I20260709 12:58:26.056864   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:40231 every 8 connection(s)
I20260709 12:58:26.075332   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34253
I20260709 12:58:26.075727   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:26.076505   740 heartbeater.cc:507] Master 127.0.107.254:34253 requested a full tablet report, sending...
I20260709 12:58:26.078482   463 ts_manager.cc:194] Registered new tserver with Master: 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:26.078814   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015661935s
I20260709 12:58:26.080156   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57250
I20260709 12:58:26.135826   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57256:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:26.139963   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:26.237962   705 tablet_service.cc:1511] Processing CreateTablet for tablet 06213c1b8d434ca0aa9563e607648123 (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:26.240218   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06213c1b8d434ca0aa9563e607648123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.242177   704 tablet_service.cc:1511] Processing CreateTablet for tablet 414d2c172c3241a49ae162341268225a (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:26.245329   703 tablet_service.cc:1511] Processing CreateTablet for tablet 935debb7c90c4810823d4e1772635f8b (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:26.247927   702 tablet_service.cc:1511] Processing CreateTablet for tablet 5b49575d5ffb4dadbcf251692c419c49 (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:26.250161   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414d2c172c3241a49ae162341268225a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.251240   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b49575d5ffb4dadbcf251692c419c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.254182   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935debb7c90c4810823d4e1772635f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.258533   701 tablet_service.cc:1511] Processing CreateTablet for tablet 78c389fa6a364a1bb54cd8837064a69a (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:26.262776   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c389fa6a364a1bb54cd8837064a69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.269594   700 tablet_service.cc:1511] Processing CreateTablet for tablet e5300a48709d49cfb5b5547135952e12 (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:26.272328   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5300a48709d49cfb5b5547135952e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.291483   631 tablet_service.cc:1511] Processing CreateTablet for tablet 06213c1b8d434ca0aa9563e607648123 (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:26.294567   699 tablet_service.cc:1511] Processing CreateTablet for tablet fbbe4e2b4be247c6a883fd767c0848ac (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:26.295957   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbe4e2b4be247c6a883fd767c0848ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.297724   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06213c1b8d434ca0aa9563e607648123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.330549   698 tablet_service.cc:1511] Processing CreateTablet for tablet 7274e6d8864f4cb48f1c61921e53edba (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:26.332461   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7274e6d8864f4cb48f1c61921e53edba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.350936   556 tablet_service.cc:1511] Processing CreateTablet for tablet 06213c1b8d434ca0aa9563e607648123 (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:58:26.352368   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06213c1b8d434ca0aa9563e607648123. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.375393   630 tablet_service.cc:1511] Processing CreateTablet for tablet 414d2c172c3241a49ae162341268225a (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:26.380471   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414d2c172c3241a49ae162341268225a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.379616   555 tablet_service.cc:1511] Processing CreateTablet for tablet 414d2c172c3241a49ae162341268225a (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:58:26.381265   629 tablet_service.cc:1511] Processing CreateTablet for tablet 935debb7c90c4810823d4e1772635f8b (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:26.382869   554 tablet_service.cc:1511] Processing CreateTablet for tablet 935debb7c90c4810823d4e1772635f8b (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:58:26.406232   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414d2c172c3241a49ae162341268225a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.398509   551 tablet_service.cc:1511] Processing CreateTablet for tablet e5300a48709d49cfb5b5547135952e12 (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:26.419164   550 tablet_service.cc:1511] Processing CreateTablet for tablet fbbe4e2b4be247c6a883fd767c0848ac (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:26.420837   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935debb7c90c4810823d4e1772635f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.401911   552 tablet_service.cc:1511] Processing CreateTablet for tablet 78c389fa6a364a1bb54cd8837064a69a (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:26.422098   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935debb7c90c4810823d4e1772635f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.416224   628 tablet_service.cc:1511] Processing CreateTablet for tablet 5b49575d5ffb4dadbcf251692c419c49 (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
W20260709 12:58:26.443831   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:26.444528   699 tablet_service.cc:1511] Processing CreateTablet for tablet f7b70fc85d6a41eebbe6184695221a56 (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:26.449812   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b70fc85d6a41eebbe6184695221a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.456820   548 tablet_service.cc:1511] Processing CreateTablet for tablet f7b70fc85d6a41eebbe6184695221a56 (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:26.437055   549 tablet_service.cc:1511] Processing CreateTablet for tablet 7274e6d8864f4cb48f1c61921e53edba (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:26.451494   624 tablet_service.cc:1511] Processing CreateTablet for tablet 7274e6d8864f4cb48f1c61921e53edba (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:58:26.444465   553 tablet_service.cc:1511] Processing CreateTablet for tablet 5b49575d5ffb4dadbcf251692c419c49 (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:58:26.465474   757 tablet_bootstrap.cc:492] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861: Bootstrap starting.
I20260709 12:58:26.461639   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5300a48709d49cfb5b5547135952e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.466732   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b49575d5ffb4dadbcf251692c419c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.473342   627 tablet_service.cc:1511] Processing CreateTablet for tablet 78c389fa6a364a1bb54cd8837064a69a (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:58:26.477506   626 tablet_service.cc:1511] Processing CreateTablet for tablet e5300a48709d49cfb5b5547135952e12 (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:58:26.480203   625 tablet_service.cc:1511] Processing CreateTablet for tablet fbbe4e2b4be247c6a883fd767c0848ac (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:58:26.473289   623 tablet_service.cc:1511] Processing CreateTablet for tablet f7b70fc85d6a41eebbe6184695221a56 (DEFAULT_TABLE table=test-workload [id=70d9508543e74c8abb7391f7c350fd8d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:58:26.486941   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c389fa6a364a1bb54cd8837064a69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.492832   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7274e6d8864f4cb48f1c61921e53edba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.491415   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c389fa6a364a1bb54cd8837064a69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.499805   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5300a48709d49cfb5b5547135952e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.501308   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b49575d5ffb4dadbcf251692c419c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.504985   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b70fc85d6a41eebbe6184695221a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.502175   758 tablet_bootstrap.cc:492] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960: Bootstrap starting.
I20260709 12:58:26.512287   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbe4e2b4be247c6a883fd767c0848ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.510435   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7274e6d8864f4cb48f1c61921e53edba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.526119   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b70fc85d6a41eebbe6184695221a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.528932   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbe4e2b4be247c6a883fd767c0848ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:26.551399   757 tablet_bootstrap.cc:654] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.553822   759 tablet_bootstrap.cc:492] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79: Bootstrap starting.
I20260709 12:58:26.625144   759 tablet_bootstrap.cc:654] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.628309   758 tablet_bootstrap.cc:654] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.643913   757 tablet_bootstrap.cc:492] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861: No bootstrap required, opened a new log
I20260709 12:58:26.644433   757 ts_tablet_manager.cc:1403] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861: Time spent bootstrapping tablet: real 0.185s	user 0.014s	sys 0.015s
I20260709 12:58:26.645418   759 tablet_bootstrap.cc:492] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79: No bootstrap required, opened a new log
I20260709 12:58:26.647138   759 ts_tablet_manager.cc:1403] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79: Time spent bootstrapping tablet: real 0.100s	user 0.007s	sys 0.020s
I20260709 12:58:26.648362   757 raft_consensus.cc:359] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.649122   757 raft_consensus.cc:385] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.649438   757 raft_consensus.cc:740] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.649253   759 raft_consensus.cc:359] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } }
I20260709 12:58:26.650173   759 raft_consensus.cc:385] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.650731   759 raft_consensus.cc:740] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.650283   757 consensus_queue.cc:260] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.651625   759 consensus_queue.cc:260] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } }
I20260709 12:58:26.653627   758 tablet_bootstrap.cc:492] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960: No bootstrap required, opened a new log
I20260709 12:58:26.654647   758 ts_tablet_manager.cc:1403] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960: Time spent bootstrapping tablet: real 0.162s	user 0.012s	sys 0.007s
I20260709 12:58:26.657687   666 heartbeater.cc:499] Master 127.0.107.254:34253 was elected leader, sending a full tablet report...
I20260709 12:58:26.658084   758 raft_consensus.cc:359] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } }
I20260709 12:58:26.658751   758 raft_consensus.cc:385] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.659025   758 raft_consensus.cc:740] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.660545   758 consensus_queue.cc:260] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } }
I20260709 12:58:26.662370   759 ts_tablet_manager.cc:1434] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.009s
I20260709 12:58:26.663642   759 tablet_bootstrap.cc:492] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79: Bootstrap starting.
I20260709 12:58:26.671486   740 heartbeater.cc:499] Master 127.0.107.254:34253 was elected leader, sending a full tablet report...
I20260709 12:58:26.673333   759 tablet_bootstrap.cc:654] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.676061   591 heartbeater.cc:499] Master 127.0.107.254:34253 was elected leader, sending a full tablet report...
I20260709 12:58:26.678897   765 raft_consensus.cc:493] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.679360   765 raft_consensus.cc:515] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } }
I20260709 12:58:26.680012   757 ts_tablet_manager.cc:1434] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861: Time spent starting tablet: real 0.035s	user 0.001s	sys 0.009s
I20260709 12:58:26.681764   758 ts_tablet_manager.cc:1434] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960: Time spent starting tablet: real 0.027s	user 0.014s	sys 0.002s
I20260709 12:58:26.682998   765 leader_election.cc:290] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231), c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:26.684335   757 tablet_bootstrap.cc:492] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861: Bootstrap starting.
W20260709 12:58:26.687247   592 tablet.cc:2406] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:58:26.689728   758 tablet_bootstrap.cc:492] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960: Bootstrap starting.
I20260709 12:58:26.691672   759 tablet_bootstrap.cc:492] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79: No bootstrap required, opened a new log
I20260709 12:58:26.693158   759 ts_tablet_manager.cc:1403] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.009s
I20260709 12:58:26.696977   759 raft_consensus.cc:359] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.697760   759 raft_consensus.cc:385] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.698082   759 raft_consensus.cc:740] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.699033   759 consensus_queue.cc:260] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.702729   759 ts_tablet_manager.cc:1434] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.005s
I20260709 12:58:26.703691   759 tablet_bootstrap.cc:492] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79: Bootstrap starting.
I20260709 12:58:26.704386   758 tablet_bootstrap.cc:654] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.711338   759 tablet_bootstrap.cc:654] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.714859   758 tablet_bootstrap.cc:492] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960: No bootstrap required, opened a new log
I20260709 12:58:26.715487   758 ts_tablet_manager.cc:1403] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.001s
I20260709 12:58:26.719178   758 raft_consensus.cc:359] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.720132   758 raft_consensus.cc:385] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.723459   759 tablet_bootstrap.cc:492] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79: No bootstrap required, opened a new log
I20260709 12:58:26.724339   764 raft_consensus.cc:493] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.724908   764 raft_consensus.cc:515] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.723932   759 ts_tablet_manager.cc:1403] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:58:26.728435   764 leader_election.cc:290] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:26.729573   758 raft_consensus.cc:740] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.734809   757 tablet_bootstrap.cc:654] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.740057   758 consensus_queue.cc:260] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.753134   759 raft_consensus.cc:359] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.759286   759 raft_consensus.cc:385] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.760121   759 raft_consensus.cc:740] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.754958   758 ts_tablet_manager.cc:1434] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:58:26.761497   759 consensus_queue.cc:260] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.762970   758 tablet_bootstrap.cc:492] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960: Bootstrap starting.
I20260709 12:58:26.769723   759 ts_tablet_manager.cc:1434] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:58:26.771114   759 tablet_bootstrap.cc:492] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79: Bootstrap starting.
I20260709 12:58:26.786540   757 tablet_bootstrap.cc:492] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861: No bootstrap required, opened a new log
I20260709 12:58:26.787156   757 ts_tablet_manager.cc:1403] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.009s
I20260709 12:58:26.787586   758 tablet_bootstrap.cc:654] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.792371   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06213c1b8d434ca0aa9563e607648123" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861" is_pre_election: true
W20260709 12:58:26.796437   531 leader_election.cc:343] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:26.801189   757 raft_consensus.cc:359] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.801926   757 raft_consensus.cc:385] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.804608   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414d2c172c3241a49ae162341268225a" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960" is_pre_election: true
I20260709 12:58:26.805742   757 raft_consensus.cc:740] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Initialized, Role: FOLLOWER
W20260709 12:58:26.807643   606 leader_election.cc:343] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:26.811038   759 tablet_bootstrap.cc:654] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.812695   757 consensus_queue.cc:260] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.815467   757 ts_tablet_manager.cc:1434] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:58:26.816776   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06213c1b8d434ca0aa9563e607648123" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79" is_pre_election: true
I20260709 12:58:26.819789   641 raft_consensus.cc:2468] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 0.
I20260709 12:58:26.820470   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414d2c172c3241a49ae162341268225a" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861" is_pre_election: true
I20260709 12:58:26.822183   531 leader_election.cc:304] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 9215735813c6433e9c1d88f46c555861
I20260709 12:58:26.823446   765 raft_consensus.cc:2804] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:26.823802   765 raft_consensus.cc:493] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.824148   765 raft_consensus.cc:3060] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:26.826304   606 leader_election.cc:343] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:26.826767   606 leader_election.cc:304] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c930d6e99df448358342ff6f74b5ab79; no voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960
I20260709 12:58:26.827577   757 tablet_bootstrap.cc:492] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861: Bootstrap starting.
I20260709 12:58:26.828272   764 raft_consensus.cc:2749] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:26.835911   757 tablet_bootstrap.cc:654] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.841421   758 tablet_bootstrap.cc:492] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960: No bootstrap required, opened a new log
I20260709 12:58:26.841931   758 ts_tablet_manager.cc:1403] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.006s
I20260709 12:58:26.843591   765 raft_consensus.cc:515] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } }
I20260709 12:58:26.845474   758 raft_consensus.cc:359] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.846240   758 raft_consensus.cc:385] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.847136   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06213c1b8d434ca0aa9563e607648123" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:26.847707   641 raft_consensus.cc:3060] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.847764   759 tablet_bootstrap.cc:492] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79: No bootstrap required, opened a new log
I20260709 12:58:26.848444   759 ts_tablet_manager.cc:1403] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.018s
I20260709 12:58:26.850936   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06213c1b8d434ca0aa9563e607648123" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861"
W20260709 12:58:26.852432   531 leader_election.cc:343] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:26.852588   759 raft_consensus.cc:359] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.853549   759 raft_consensus.cc:385] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.854105   765 leader_election.cc:290] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 election: Requested vote from peers 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231), c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:26.853919   759 raft_consensus.cc:740] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.855659   759 consensus_queue.cc:260] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.858635   641 raft_consensus.cc:2468] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 1.
I20260709 12:58:26.859724   759 ts_tablet_manager.cc:1434] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:58:26.860031   531 leader_election.cc:304] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 9215735813c6433e9c1d88f46c555861
I20260709 12:58:26.860306   757 tablet_bootstrap.cc:492] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861: No bootstrap required, opened a new log
I20260709 12:58:26.860652   759 tablet_bootstrap.cc:492] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79: Bootstrap starting.
I20260709 12:58:26.860831   765 raft_consensus.cc:2804] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:26.869957   759 tablet_bootstrap.cc:654] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.846537   758 raft_consensus.cc:740] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.873742   758 consensus_queue.cc:260] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.866844   757 ts_tablet_manager.cc:1403] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.011s
I20260709 12:58:26.879007   758 ts_tablet_manager.cc:1434] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 12:58:26.879225   757 raft_consensus.cc:359] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.880249   757 raft_consensus.cc:385] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.880616   758 tablet_bootstrap.cc:492] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960: Bootstrap starting.
I20260709 12:58:26.880724   757 raft_consensus.cc:740] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.881923   757 consensus_queue.cc:260] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.884147   765 raft_consensus.cc:697] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Becoming Leader. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:26.885103   765 consensus_queue.cc:237] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } }
I20260709 12:58:26.886395   757 ts_tablet_manager.cc:1434] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.005s
I20260709 12:58:26.887485   757 tablet_bootstrap.cc:492] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861: Bootstrap starting.
I20260709 12:58:26.889846   764 raft_consensus.cc:493] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.890342   764 raft_consensus.cc:515] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.892802   764 leader_election.cc:290] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:26.894881   757 tablet_bootstrap.cc:654] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.895699   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861" is_pre_election: true
I20260709 12:58:26.896378   715 raft_consensus.cc:2468] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 0.
I20260709 12:58:26.897912   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960" is_pre_election: true
I20260709 12:58:26.898850   759 tablet_bootstrap.cc:492] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79: No bootstrap required, opened a new log
I20260709 12:58:26.899302   759 ts_tablet_manager.cc:1403] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.002s
W20260709 12:58:26.899844   606 leader_election.cc:343] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:26.900552   606 leader_election.cc:304] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, c930d6e99df448358342ff6f74b5ab79; no voters: 9a6aab69a8c54e1180d19ed2a43af960
I20260709 12:58:26.904313   764 raft_consensus.cc:2804] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:26.905248   764 raft_consensus.cc:493] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.905663   764 raft_consensus.cc:3060] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.902226   759 raft_consensus.cc:359] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.902945   758 tablet_bootstrap.cc:654] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.906312   759 raft_consensus.cc:385] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.906726   759 raft_consensus.cc:740] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.907517   759 consensus_queue.cc:260] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.911180   757 tablet_bootstrap.cc:492] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861: No bootstrap required, opened a new log
I20260709 12:58:26.911851   757 ts_tablet_manager.cc:1403] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.006s
I20260709 12:58:26.918072   758 tablet_bootstrap.cc:492] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960: No bootstrap required, opened a new log
I20260709 12:58:26.918560   758 ts_tablet_manager.cc:1403] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.009s
I20260709 12:58:26.921368   764 raft_consensus.cc:515] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.930744   764 leader_election.cc:290] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:26.932610   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:26.933249   715 raft_consensus.cc:3060] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.922289   758 raft_consensus.cc:359] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.934000   758 raft_consensus.cc:385] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.934386   758 raft_consensus.cc:740] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.935122   758 consensus_queue.cc:260] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.937501   758 ts_tablet_manager.cc:1434] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 12:58:26.938506   758 tablet_bootstrap.cc:492] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960: Bootstrap starting.
I20260709 12:58:26.938426   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
W20260709 12:58:26.939916   606 leader_election.cc:343] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:26.922833   757 raft_consensus.cc:359] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.940737   757 raft_consensus.cc:385] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.941064   757 raft_consensus.cc:740] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.941792   757 consensus_queue.cc:260] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.925920   759 ts_tablet_manager.cc:1434] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.012s
I20260709 12:58:26.945222   759 tablet_bootstrap.cc:492] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79: Bootstrap starting.
I20260709 12:58:26.941959   463 catalog_manager.cc:5697] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9a6aab69a8c54e1180d19ed2a43af960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.946238   757 ts_tablet_manager.cc:1434] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:58:26.954370   715 raft_consensus.cc:2468] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 1.
I20260709 12:58:26.955664   606 leader_election.cc:304] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, c930d6e99df448358342ff6f74b5ab79; no voters: 9a6aab69a8c54e1180d19ed2a43af960
I20260709 12:58:26.956316   759 tablet_bootstrap.cc:654] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.956418   757 tablet_bootstrap.cc:492] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861: Bootstrap starting.
I20260709 12:58:26.965982   757 tablet_bootstrap.cc:654] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.959623   758 tablet_bootstrap.cc:654] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.970203   764 raft_consensus.cc:2804] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:26.970969   764 raft_consensus.cc:697] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Becoming Leader. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:26.971861   764 consensus_queue.cc:237] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.978016   759 tablet_bootstrap.cc:492] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79: No bootstrap required, opened a new log
I20260709 12:58:26.978566   759 ts_tablet_manager.cc:1403] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79: Time spent bootstrapping tablet: real 0.034s	user 0.026s	sys 0.001s
I20260709 12:58:26.979138   763 raft_consensus.cc:493] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.979782   765 raft_consensus.cc:493] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.979902   763 raft_consensus.cc:515] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.985124   765 raft_consensus.cc:515] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.990417   758 tablet_bootstrap.cc:492] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960: No bootstrap required, opened a new log
I20260709 12:58:26.991187   758 ts_tablet_manager.cc:1403] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.005s
I20260709 12:58:26.992529   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414d2c172c3241a49ae162341268225a" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79" is_pre_election: true
I20260709 12:58:26.993194   641 raft_consensus.cc:2468] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 0.
I20260709 12:58:26.994264   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414d2c172c3241a49ae162341268225a" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861" is_pre_election: true
I20260709 12:58:26.995646   531 leader_election.cc:304] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:26.996049   758 raft_consensus.cc:359] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:26.996716   778 raft_consensus.cc:2804] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:26.997104   758 raft_consensus.cc:385] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.997677   758 raft_consensus.cc:740] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.997154   778 raft_consensus.cc:493] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.998520   778 raft_consensus.cc:3060] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.998682   758 consensus_queue.cc:260] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.002265   758 ts_tablet_manager.cc:1434] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:58:26.990485   765 leader_election.cc:290] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.003041   759 raft_consensus.cc:359] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
W20260709 12:58:27.003789   531 leader_election.cc:343] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:27.004030   759 raft_consensus.cc:385] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.004456   759 raft_consensus.cc:740] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Initialized, Role: FOLLOWER
I20260709 12:58:27.005431   759 consensus_queue.cc:260] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.008404   759 ts_tablet_manager.cc:1434] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:58:27.009677   778 raft_consensus.cc:515] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.012209   778 leader_election.cc:290] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 election: Requested vote from peers c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.013406   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414d2c172c3241a49ae162341268225a" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:27.014160   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414d2c172c3241a49ae162341268225a" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:27.009670   759 tablet_bootstrap.cc:492] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79: Bootstrap starting.
I20260709 12:58:27.018796   763 leader_election.cc:290] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:27.016678   641 raft_consensus.cc:3060] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.017952   758 tablet_bootstrap.cc:492] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960: Bootstrap starting.
W20260709 12:58:27.022691   531 leader_election.cc:343] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:27.025892   757 tablet_bootstrap.cc:492] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861: No bootstrap required, opened a new log
I20260709 12:58:27.027024   757 ts_tablet_manager.cc:1403] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861: Time spent bootstrapping tablet: real 0.072s	user 0.002s	sys 0.013s
I20260709 12:58:27.031860   759 tablet_bootstrap.cc:654] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:27.027725   462 catalog_manager.cc:5697] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c930d6e99df448358342ff6f74b5ab79 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c930d6e99df448358342ff6f74b5ab79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:27.040560   641 raft_consensus.cc:2468] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 1.
I20260709 12:58:27.042156   531 leader_election.cc:304] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 9215735813c6433e9c1d88f46c555861
I20260709 12:58:27.043051   778 raft_consensus.cc:2804] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:27.043779   778 raft_consensus.cc:697] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Becoming Leader. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:27.044898   778 consensus_queue.cc:237] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.049153   757 raft_consensus.cc:359] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.052764   757 raft_consensus.cc:385] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.053097   757 raft_consensus.cc:740] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Initialized, Role: FOLLOWER
I20260709 12:58:27.055104   757 consensus_queue.cc:260] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.056427   758 tablet_bootstrap.cc:654] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:27.061856   757 ts_tablet_manager.cc:1434] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.005s
I20260709 12:58:27.063212   757 tablet_bootstrap.cc:492] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861: Bootstrap starting.
I20260709 12:58:27.064649   759 tablet_bootstrap.cc:492] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79: No bootstrap required, opened a new log
I20260709 12:58:27.065217   759 ts_tablet_manager.cc:1403] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.005s
I20260709 12:58:27.068704   759 raft_consensus.cc:359] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.068333   778 raft_consensus.cc:493] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.071832   778 raft_consensus.cc:515] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.073633   764 raft_consensus.cc:493] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.073843   778 leader_election.cc:290] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.074133   764 raft_consensus.cc:515] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.075050   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935debb7c90c4810823d4e1772635f8b" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79" is_pre_election: true
I20260709 12:58:27.075713   641 raft_consensus.cc:2468] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 0.
I20260709 12:58:27.076268   764 leader_election.cc:290] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.077656   763 raft_consensus.cc:493] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.069522   759 raft_consensus.cc:385] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.078159   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935debb7c90c4810823d4e1772635f8b" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861" is_pre_election: true
I20260709 12:58:27.078197   763 raft_consensus.cc:515] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.078879   715 raft_consensus.cc:2468] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 0.
I20260709 12:58:27.079413   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960" is_pre_election: true
I20260709 12:58:27.079998   566 raft_consensus.cc:2468] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 0.
I20260709 12:58:27.080291   763 leader_election.cc:290] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:27.081017   531 leader_election.cc:304] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:27.081358   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861" is_pre_election: true
I20260709 12:58:27.081831   778 raft_consensus.cc:2804] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:27.082329   778 raft_consensus.cc:493] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.082690   778 raft_consensus.cc:3060] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.084614   758 tablet_bootstrap.cc:492] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960: No bootstrap required, opened a new log
I20260709 12:58:27.085207   758 ts_tablet_manager.cc:1403] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.001s
I20260709 12:58:27.078222   759 raft_consensus.cc:740] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Initialized, Role: FOLLOWER
I20260709 12:58:27.085880   606 leader_election.cc:304] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:27.086602   759 consensus_queue.cc:260] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.088208   784 raft_consensus.cc:2804] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:27.088608   784 raft_consensus.cc:493] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.088944   784 raft_consensus.cc:3060] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.081920   715 raft_consensus.cc:2468] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 0.
I20260709 12:58:27.089488   759 ts_tablet_manager.cc:1434] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:58:27.093477   759 tablet_bootstrap.cc:492] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79: Bootstrap starting.
I20260709 12:58:27.098696   778 raft_consensus.cc:515] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.098917   784 raft_consensus.cc:515] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.089445   758 raft_consensus.cc:359] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.105720   757 tablet_bootstrap.cc:654] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:27.102871   758 raft_consensus.cc:385] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.107110   758 raft_consensus.cc:740] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Initialized, Role: FOLLOWER
I20260709 12:58:27.108709   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935debb7c90c4810823d4e1772635f8b" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:27.109380   641 raft_consensus.cc:3060] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.113531   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:27.114856   566 raft_consensus.cc:3060] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.109351   758 consensus_queue.cc:260] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.119742   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960" is_pre_election: true
I20260709 12:58:27.120889   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:27.119168   784 leader_election.cc:290] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.120299   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7274e6d8864f4cb48f1c61921e53edba" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960" is_pre_election: true
I20260709 12:58:27.123083   715 raft_consensus.cc:3060] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.125658   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935debb7c90c4810823d4e1772635f8b" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:27.126739   714 raft_consensus.cc:3060] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.120482   778 leader_election.cc:290] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 election: Requested vote from peers c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.133846   715 raft_consensus.cc:2468] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 1.
I20260709 12:58:27.135941   759 tablet_bootstrap.cc:654] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:27.137840   680 leader_election.cc:343] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:27.141173   641 raft_consensus.cc:2468] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 1.
I20260709 12:58:27.142616   531 leader_election.cc:304] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:27.143503   778 raft_consensus.cc:2804] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:27.144219   778 raft_consensus.cc:697] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Becoming Leader. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:27.145135   778 consensus_queue.cc:237] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.149230   566 raft_consensus.cc:2468] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 1.
I20260709 12:58:27.150808   606 leader_election.cc:304] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:27.155243   714 raft_consensus.cc:2468] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 1.
I20260709 12:58:27.163174   764 raft_consensus.cc:493] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.163646   764 raft_consensus.cc:515] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.159782   784 raft_consensus.cc:2804] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:27.166342   764 leader_election.cc:290] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.169771   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79" is_pre_election: true
I20260709 12:58:27.175801   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5300a48709d49cfb5b5547135952e12" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861" is_pre_election: true
I20260709 12:58:27.176419   758 ts_tablet_manager.cc:1434] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.002s
I20260709 12:58:27.176178   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7274e6d8864f4cb48f1c61921e53edba" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79" is_pre_election: true
I20260709 12:58:27.176934   784 raft_consensus.cc:697] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Becoming Leader. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
W20260709 12:58:27.178390   680 leader_election.cc:343] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:27.178062   784 consensus_queue.cc:237] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.177870   463 catalog_manager.cc:5697] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9a6aab69a8c54e1180d19ed2a43af960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:27.178828   680 leader_election.cc:304] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9215735813c6433e9c1d88f46c555861; no voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79
I20260709 12:58:27.180109   763 raft_consensus.cc:2749] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:27.182449   606 leader_election.cc:343] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:27.182572   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5300a48709d49cfb5b5547135952e12" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960" is_pre_election: true
I20260709 12:58:27.183655   757 tablet_bootstrap.cc:492] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861: No bootstrap required, opened a new log
W20260709 12:58:27.183897   606 leader_election.cc:343] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:27.184109   757 ts_tablet_manager.cc:1403] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.018s
I20260709 12:58:27.184309   606 leader_election.cc:304] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c930d6e99df448358342ff6f74b5ab79; no voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960
I20260709 12:58:27.184649   758 tablet_bootstrap.cc:492] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960: Bootstrap starting.
I20260709 12:58:27.185349   764 raft_consensus.cc:2749] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:27.187412   757 raft_consensus.cc:359] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } }
I20260709 12:58:27.189461   757 raft_consensus.cc:385] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.191406   757 raft_consensus.cc:740] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Initialized, Role: FOLLOWER
I20260709 12:58:27.199254   757 consensus_queue.cc:260] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } }
I20260709 12:58:27.211452   680 leader_election.cc:304] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9215735813c6433e9c1d88f46c555861; no voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79
I20260709 12:58:27.212978   763 raft_consensus.cc:2749] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:27.211380   758 tablet_bootstrap.cc:654] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:27.218736   757 ts_tablet_manager.cc:1434] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:58:27.219722   757 tablet_bootstrap.cc:492] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861: Bootstrap starting.
I20260709 12:58:27.225143   759 tablet_bootstrap.cc:492] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79: No bootstrap required, opened a new log
I20260709 12:58:27.225063   778 raft_consensus.cc:493] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.225633   759 ts_tablet_manager.cc:1403] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79: Time spent bootstrapping tablet: real 0.132s	user 0.016s	sys 0.020s
I20260709 12:58:27.225587   778 raft_consensus.cc:515] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.231971   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861" is_pre_election: true
I20260709 12:58:27.232165   759 raft_consensus.cc:359] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.232963   759 raft_consensus.cc:385] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.233383   759 raft_consensus.cc:740] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Initialized, Role: FOLLOWER
I20260709 12:58:27.228971   778 leader_election.cc:290] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.230907   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79" is_pre_election: true
I20260709 12:58:27.234126   759 consensus_queue.cc:260] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.233215   714 raft_consensus.cc:2393] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a6aab69a8c54e1180d19ed2a43af960 in current term 1: Already voted for candidate c930d6e99df448358342ff6f74b5ab79 in this term.
I20260709 12:58:27.232170   463 catalog_manager.cc:5697] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c930d6e99df448358342ff6f74b5ab79 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c930d6e99df448358342ff6f74b5ab79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:27.238098   759 ts_tablet_manager.cc:1434] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:58:27.238962   759 tablet_bootstrap.cc:492] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79: Bootstrap starting.
I20260709 12:58:27.238826   531 leader_election.cc:304] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960; no voters: 9215735813c6433e9c1d88f46c555861, c930d6e99df448358342ff6f74b5ab79
I20260709 12:58:27.239688   778 raft_consensus.cc:3060] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.239495   758 tablet_bootstrap.cc:492] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960: No bootstrap required, opened a new log
I20260709 12:58:27.237115   461 catalog_manager.cc:5697] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9a6aab69a8c54e1180d19ed2a43af960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:27.250660   763 raft_consensus.cc:493] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.250903   758 ts_tablet_manager.cc:1403] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.018s
I20260709 12:58:27.251562   763 raft_consensus.cc:515] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.252945   757 tablet_bootstrap.cc:654] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:27.253218   778 raft_consensus.cc:2749] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:27.254680   763 leader_election.cc:290] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:27.255945   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbe4e2b4be247c6a883fd767c0848ac" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960" is_pre_election: true
I20260709 12:58:27.256583   566 raft_consensus.cc:2468] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 0.
I20260709 12:58:27.258194   680 leader_election.cc:304] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960; no voters: 
I20260709 12:58:27.258213   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbe4e2b4be247c6a883fd767c0848ac" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79" is_pre_election: true
I20260709 12:58:27.260469   763 raft_consensus.cc:2804] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:27.260926   763 raft_consensus.cc:493] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.261358   763 raft_consensus.cc:3060] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.261837   759 tablet_bootstrap.cc:654] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:27.262657   680 leader_election.cc:343] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:27.267160   758 raft_consensus.cc:359] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.268193   758 raft_consensus.cc:385] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.268620   758 raft_consensus.cc:740] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Initialized, Role: FOLLOWER
I20260709 12:58:27.269487   758 consensus_queue.cc:260] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.276465   758 ts_tablet_manager.cc:1434] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:58:27.277540   757 tablet_bootstrap.cc:492] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861: No bootstrap required, opened a new log
I20260709 12:58:27.278311   757 ts_tablet_manager.cc:1403] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.016s
I20260709 12:58:27.281585   758 tablet_bootstrap.cc:492] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960: Bootstrap starting.
I20260709 12:58:27.283871   763 raft_consensus.cc:515] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.291447   778 consensus_queue.cc:1048] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:27.293190   763 leader_election.cc:290] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:27.294725   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbe4e2b4be247c6a883fd767c0848ac" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:27.295305   566 raft_consensus.cc:3060] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.296995   758 tablet_bootstrap.cc:654] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:27.297559   759 tablet_bootstrap.cc:492] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79: No bootstrap required, opened a new log
I20260709 12:58:27.298074   759 ts_tablet_manager.cc:1403] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.023s
I20260709 12:58:27.298189   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbe4e2b4be247c6a883fd767c0848ac" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:27.299505   757 raft_consensus.cc:359] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.300205   757 raft_consensus.cc:385] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.300501   757 raft_consensus.cc:740] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Initialized, Role: FOLLOWER
W20260709 12:58:27.300948   680 leader_election.cc:343] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:27.300868   759 raft_consensus.cc:359] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.301944   784 raft_consensus.cc:493] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.302608   784 raft_consensus.cc:515] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.302997   757 consensus_queue.cc:260] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.304800   784 leader_election.cc:290] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.305253   757 ts_tablet_manager.cc:1434] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.005s
I20260709 12:58:27.306286   757 tablet_bootstrap.cc:492] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861: Bootstrap starting.
I20260709 12:58:27.307245   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b70fc85d6a41eebbe6184695221a56" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861" is_pre_election: true
I20260709 12:58:27.307355   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b70fc85d6a41eebbe6184695221a56" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960" is_pre_election: true
W20260709 12:58:27.308738   606 leader_election.cc:343] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:27.309402   606 leader_election.cc:343] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:27.309799   606 leader_election.cc:304] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c930d6e99df448358342ff6f74b5ab79; no voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960
I20260709 12:58:27.310920   784 raft_consensus.cc:2749] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:27.311146   566 raft_consensus.cc:2468] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 1.
I20260709 12:58:27.302150   759 raft_consensus.cc:385] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.311908   759 raft_consensus.cc:740] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Initialized, Role: FOLLOWER
I20260709 12:58:27.312358   680 leader_election.cc:304] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960; no voters: c930d6e99df448358342ff6f74b5ab79
I20260709 12:58:27.312860   757 tablet_bootstrap.cc:654] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:27.312613   759 consensus_queue.cc:260] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.313277   763 raft_consensus.cc:2804] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:27.314779   759 ts_tablet_manager.cc:1434] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 12:58:27.324985   784 raft_consensus.cc:493] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.326015   763 raft_consensus.cc:697] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 1 LEADER]: Becoming Leader. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Running, Role: LEADER
I20260709 12:58:27.329608   758 tablet_bootstrap.cc:492] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960: No bootstrap required, opened a new log
I20260709 12:58:27.330065   758 ts_tablet_manager.cc:1403] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.002s
I20260709 12:58:27.329872   763 consensus_queue.cc:237] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.332628   758 raft_consensus.cc:359] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.333278   758 raft_consensus.cc:385] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.333557   758 raft_consensus.cc:740] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Initialized, Role: FOLLOWER
I20260709 12:58:27.334172   758 consensus_queue.cc:260] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.336269   714 raft_consensus.cc:3060] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.337141   758 ts_tablet_manager.cc:1434] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:27.337980   758 tablet_bootstrap.cc:492] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960: Bootstrap starting.
I20260709 12:58:27.343772   758 tablet_bootstrap.cc:654] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:27.345384   784 raft_consensus.cc:515] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.351007   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7274e6d8864f4cb48f1c61921e53edba" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960" is_pre_election: true
I20260709 12:58:27.351631   566 raft_consensus.cc:2468] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 0.
I20260709 12:58:27.352967   606 leader_election.cc:304] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:27.354317   799 raft_consensus.cc:2804] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:27.354677   799 raft_consensus.cc:493] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.355003   799 raft_consensus.cc:3060] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.355505   758 tablet_bootstrap.cc:492] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960: No bootstrap required, opened a new log
I20260709 12:58:27.356221   758 ts_tablet_manager.cc:1403] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:58:27.357092   764 consensus_queue.cc:1048] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:27.358767   758 raft_consensus.cc:359] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.360318   758 raft_consensus.cc:385] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.360594   758 raft_consensus.cc:740] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Initialized, Role: FOLLOWER
I20260709 12:58:27.361198   758 consensus_queue.cc:260] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.363351   758 ts_tablet_manager.cc:1434] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:27.363894   799 raft_consensus.cc:515] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.366799   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7274e6d8864f4cb48f1c61921e53edba" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:27.367229   564 raft_consensus.cc:3060] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.371652   784 leader_election.cc:290] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.375180   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7274e6d8864f4cb48f1c61921e53edba" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861" is_pre_election: true
I20260709 12:58:27.375512   564 raft_consensus.cc:2468] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 1.
I20260709 12:58:27.375846   715 raft_consensus.cc:2468] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 0.
I20260709 12:58:27.379253   757 tablet_bootstrap.cc:492] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861: No bootstrap required, opened a new log
I20260709 12:58:27.379824   757 ts_tablet_manager.cc:1403] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.013s
I20260709 12:58:27.382496   780 consensus_queue.cc:1048] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:27.382750   757 raft_consensus.cc:359] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.383373   757 raft_consensus.cc:385] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.383651   757 raft_consensus.cc:740] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Initialized, Role: FOLLOWER
I20260709 12:58:27.385881   757 consensus_queue.cc:260] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.387835   757 ts_tablet_manager.cc:1434] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:27.388720   757 tablet_bootstrap.cc:492] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861: Bootstrap starting.
I20260709 12:58:27.383564   606 leader_election.cc:304] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:27.397974   463 catalog_manager.cc:5697] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9215735813c6433e9c1d88f46c555861 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9215735813c6433e9c1d88f46c555861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:27.405047   784 raft_consensus.cc:2804] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:27.411269   818 consensus_queue.cc:1048] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:27.413915   757 tablet_bootstrap.cc:654] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:27.410831   780 raft_consensus.cc:493] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.417843   780 raft_consensus.cc:515] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.420095   780 leader_election.cc:290] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.421887   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5300a48709d49cfb5b5547135952e12" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861" is_pre_election: true
I20260709 12:58:27.422536   799 leader_election.cc:290] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.422569   714 raft_consensus.cc:2468] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 0.
I20260709 12:58:27.423434   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5300a48709d49cfb5b5547135952e12" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79" is_pre_election: true
I20260709 12:58:27.425232   640 raft_consensus.cc:2468] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 0.
I20260709 12:58:27.427354   531 leader_election.cc:304] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960; no voters: 
I20260709 12:58:27.428916   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7274e6d8864f4cb48f1c61921e53edba" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:27.429514   714 raft_consensus.cc:3060] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.427080   784 raft_consensus.cc:697] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Becoming Leader. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:27.430656   780 raft_consensus.cc:2804] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:27.435091   780 raft_consensus.cc:493] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.435490   780 raft_consensus.cc:3060] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.436829   784 consensus_queue.cc:237] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.464183   714 raft_consensus.cc:2468] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 1.
I20260709 12:58:27.475689   780 raft_consensus.cc:515] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.478480   780 leader_election.cc:290] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 election: Requested vote from peers c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.486606   818 raft_consensus.cc:493] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.488168   818 raft_consensus.cc:515] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.490522   780 consensus_queue.cc:1048] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:58:27.494058   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5300a48709d49cfb5b5547135952e12" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:27.494884   640 raft_consensus.cc:3060] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.496245   757 tablet_bootstrap.cc:492] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861: No bootstrap required, opened a new log
I20260709 12:58:27.496852   757 ts_tablet_manager.cc:1403] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861: Time spent bootstrapping tablet: real 0.108s	user 0.029s	sys 0.011s
I20260709 12:58:27.496591   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5300a48709d49cfb5b5547135952e12" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861"
W20260709 12:58:27.494446   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:27.500064   714 raft_consensus.cc:3060] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.500914   818 leader_election.cc:290] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.501689   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbe4e2b4be247c6a883fd767c0848ac" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960" is_pre_election: true
I20260709 12:58:27.502851   564 raft_consensus.cc:2393] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c930d6e99df448358342ff6f74b5ab79 in current term 1: Already voted for candidate 9215735813c6433e9c1d88f46c555861 in this term.
I20260709 12:58:27.506656   757 raft_consensus.cc:359] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.507155   757 raft_consensus.cc:385] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:27.507318   757 raft_consensus.cc:740] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Initialized, Role: FOLLOWER
I20260709 12:58:27.507813   757 consensus_queue.cc:260] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.513473   757 ts_tablet_manager.cc:1434] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:58:27.515277   462 catalog_manager.cc:5697] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c930d6e99df448358342ff6f74b5ab79 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c930d6e99df448358342ff6f74b5ab79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:27.520651   714 raft_consensus.cc:2468] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 1.
I20260709 12:58:27.521425   640 raft_consensus.cc:2468] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 1.
I20260709 12:58:27.521754   531 leader_election.cc:304] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960; no voters: 
I20260709 12:58:27.521761   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbe4e2b4be247c6a883fd767c0848ac" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9215735813c6433e9c1d88f46c555861" is_pre_election: true
I20260709 12:58:27.526412   606 leader_election.cc:304] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c930d6e99df448358342ff6f74b5ab79; no voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960
I20260709 12:58:27.527482   780 raft_consensus.cc:2804] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:27.527961   780 raft_consensus.cc:697] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Becoming Leader. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:27.528739   780 consensus_queue.cc:237] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.530938   784 raft_consensus.cc:3060] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.544055   784 raft_consensus.cc:2749] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:27.545132   763 raft_consensus.cc:493] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.545657   763 raft_consensus.cc:515] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.549775   715 raft_consensus.cc:3060] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.550968   763 leader_election.cc:290] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:27.549609   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b70fc85d6a41eebbe6184695221a56" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960" is_pre_election: true
I20260709 12:58:27.554246   564 raft_consensus.cc:2468] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 0.
I20260709 12:58:27.551757   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b70fc85d6a41eebbe6184695221a56" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79" is_pre_election: true
I20260709 12:58:27.555868   680 leader_election.cc:304] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960; no voters: 
I20260709 12:58:27.556515   641 raft_consensus.cc:2468] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 0.
I20260709 12:58:27.557076   763 raft_consensus.cc:2804] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:27.557536   763 raft_consensus.cc:493] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.557873   763 raft_consensus.cc:3060] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.560267   780 consensus_queue.cc:1048] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:27.563483   763 raft_consensus.cc:515] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.566929   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b70fc85d6a41eebbe6184695221a56" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:27.567510   564 raft_consensus.cc:3060] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.567700   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b70fc85d6a41eebbe6184695221a56" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:27.567168   462 catalog_manager.cc:5697] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9a6aab69a8c54e1180d19ed2a43af960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:27.568445   641 raft_consensus.cc:3060] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.575593   564 raft_consensus.cc:2468] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 1.
I20260709 12:58:27.575930   641 raft_consensus.cc:2468] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 1.
I20260709 12:58:27.576357   763 leader_election.cc:290] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:27.578970   680 leader_election.cc:304] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960; no voters: 
I20260709 12:58:27.579757   763 raft_consensus.cc:2804] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:27.580263   763 raft_consensus.cc:697] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 1 LEADER]: Becoming Leader. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Running, Role: LEADER
I20260709 12:58:27.581005   763 consensus_queue.cc:237] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.596136   462 catalog_manager.cc:5697] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9215735813c6433e9c1d88f46c555861 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9215735813c6433e9c1d88f46c555861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:27.671061   780 consensus_queue.cc:1048] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:27.683158   784 consensus_queue.cc:1048] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:27.690971   778 consensus_queue.cc:1048] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:27.703955   784 consensus_queue.cc:1048] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:27.742548   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
mode: GRACEFUL
new_leader_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
 from {username='slave'} at 127.0.0.1:35514
I20260709 12:58:27.743146   641 raft_consensus.cc:606] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Received request to transfer leadership to TS 9a6aab69a8c54e1180d19ed2a43af960
I20260709 12:58:27.760727   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5300a48709d49cfb5b5547135952e12"
dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
mode: GRACEFUL
new_leader_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:40346
I20260709 12:58:27.761363   564 raft_consensus.cc:606] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Received request to transfer leadership to TS c930d6e99df448358342ff6f74b5ab79
I20260709 12:58:27.772708   763 consensus_queue.cc:1048] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:27.778350   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbbe4e2b4be247c6a883fd767c0848ac"
dest_uuid: "9215735813c6433e9c1d88f46c555861"
mode: GRACEFUL
new_leader_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:60984
I20260709 12:58:27.778949   714 raft_consensus.cc:606] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 1 LEADER]: Received request to transfer leadership to TS c930d6e99df448358342ff6f74b5ab79
I20260709 12:58:27.787109   808 consensus_queue.cc:1048] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:27.798645   808 raft_consensus.cc:993] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861: : Instructing follower c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:27.799118   808 raft_consensus.cc:1081] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 1 LEADER]: Signalling peer c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:27.800931   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbbe4e2b4be247c6a883fd767c0848ac"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:35512
I20260709 12:58:27.801455   641 raft_consensus.cc:493] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:27.801790   641 raft_consensus.cc:3060] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:27.806348   641 raft_consensus.cc:515] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.809652   641 leader_election.cc:290] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 2 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:27.810684   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbe4e2b4be247c6a883fd767c0848ac" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:27.810768   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbe4e2b4be247c6a883fd767c0848ac" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:27.811368   564 raft_consensus.cc:3060] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:27.811442   714 raft_consensus.cc:3055] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:27.811831   714 raft_consensus.cc:740] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Running, Role: LEADER
I20260709 12:58:27.812606   714 consensus_queue.cc:260] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.813951   714 raft_consensus.cc:3060] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:27.820019   564 raft_consensus.cc:2468] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 2.
I20260709 12:58:27.820636   714 raft_consensus.cc:2468] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 2.
I20260709 12:58:27.821190   606 leader_election.cc:304] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:27.822016   784 raft_consensus.cc:2804] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:27.822937   784 raft_consensus.cc:697] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 2 LEADER]: Becoming Leader. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:27.823634   784 consensus_queue.cc:237] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:27.830128   462 catalog_manager.cc:5697] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 reported cstate change: term changed from 1 to 2, leader changed from 9215735813c6433e9c1d88f46c555861 (127.0.107.195) to c930d6e99df448358342ff6f74b5ab79 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c930d6e99df448358342ff6f74b5ab79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:28.003867   763 consensus_queue.cc:1048] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:28.015323   808 consensus_queue.cc:1048] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:28.034930   784 consensus_queue.cc:1048] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:28.046924   784 consensus_queue.cc:1048] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:28.115602   778 consensus_queue.cc:1048] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:28.124490   780 consensus_queue.cc:1048] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:28.137748   826 raft_consensus.cc:993] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960: : Instructing follower c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:28.138264   765 raft_consensus.cc:1081] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Signalling peer c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:28.139665   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5300a48709d49cfb5b5547135952e12"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:35510
I20260709 12:58:28.140165   641 raft_consensus.cc:493] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:28.140530   641 raft_consensus.cc:3060] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:28.145668   641 raft_consensus.cc:515] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:28.147541   641 leader_election.cc:290] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 2 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:28.148636   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5300a48709d49cfb5b5547135952e12" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:28.149041   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5300a48709d49cfb5b5547135952e12" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:28.149220   564 raft_consensus.cc:3055] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:28.149590   564 raft_consensus.cc:740] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:28.149602   714 raft_consensus.cc:3060] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:28.150449   564 consensus_queue.cc:260] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:28.151636   564 raft_consensus.cc:3060] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:28.156948   714 raft_consensus.cc:2468] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 2.
I20260709 12:58:28.158419   564 raft_consensus.cc:2468] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 2.
I20260709 12:58:28.158340   606 leader_election.cc:304] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:28.159375   784 raft_consensus.cc:2804] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:28.159858   784 raft_consensus.cc:697] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 2 LEADER]: Becoming Leader. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:28.160673   784 consensus_queue.cc:237] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:28.167121   463 catalog_manager.cc:5697] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 reported cstate change: term changed from 1 to 2, leader changed from 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193) to c930d6e99df448358342ff6f74b5ab79 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c930d6e99df448358342ff6f74b5ab79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:28.261826   818 raft_consensus.cc:993] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79: : Instructing follower 9a6aab69a8c54e1180d19ed2a43af960 to start an election
I20260709 12:58:28.262341   784 raft_consensus.cc:1081] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Signalling peer 9a6aab69a8c54e1180d19ed2a43af960 to start an election
I20260709 12:58:28.263718   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49"
dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
 from {username='slave'} at 127.0.0.1:40326
I20260709 12:58:28.264212   564 raft_consensus.cc:493] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:28.264523   564 raft_consensus.cc:3060] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:28.269049   564 raft_consensus.cc:515] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:28.271169   564 leader_election.cc:290] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 2 election: Requested vote from peers c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:28.271677   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:28.272240   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:28.272588   641 raft_consensus.cc:3055] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:28.272831   714 raft_consensus.cc:3060] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:28.272962   641 raft_consensus.cc:740] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:28.273968   641 consensus_queue.cc:260] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:28.274927   641 raft_consensus.cc:3060] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:28.279786   641 raft_consensus.cc:2468] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 2.
I20260709 12:58:28.279789   714 raft_consensus.cc:2468] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 2.
I20260709 12:58:28.281136   531 leader_election.cc:304] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960; no voters: 
I20260709 12:58:28.281896   765 raft_consensus.cc:2804] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:28.282374   765 raft_consensus.cc:697] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 LEADER]: Becoming Leader. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:28.283118   765 consensus_queue.cc:237] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:28.290019   463 catalog_manager.cc:5697] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 reported cstate change: term changed from 1 to 2, leader changed from c930d6e99df448358342ff6f74b5ab79 (127.0.107.194) to 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "9a6aab69a8c54e1180d19ed2a43af960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:28.341611   714 raft_consensus.cc:1275] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:28.342978   784 consensus_queue.cc:1048] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.351673   564 raft_consensus.cc:1275] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:28.353356   784 consensus_queue.cc:1048] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.546859   564 raft_consensus.cc:1275] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:28.548012   784 consensus_queue.cc:1048] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.555683   714 raft_consensus.cc:1275] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:28.557436   784 consensus_queue.cc:1048] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.702935   714 raft_consensus.cc:1275] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Refusing update from remote peer 9a6aab69a8c54e1180d19ed2a43af960: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:28.704135   765 consensus_queue.cc:1048] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.713562   641 raft_consensus.cc:1275] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Refusing update from remote peer 9a6aab69a8c54e1180d19ed2a43af960: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:28.715870   765 consensus_queue.cc:1048] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:30.817600   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:58:30.818413   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:30.838099   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "414d2c172c3241a49ae162341268225a"
dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
mode: GRACEFUL
new_leader_uuid: "9215735813c6433e9c1d88f46c555861"
 from {username='slave'} at 127.0.0.1:49720
I20260709 12:58:30.838646   564 raft_consensus.cc:606] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Received request to transfer leadership to TS 9215735813c6433e9c1d88f46c555861
I20260709 12:58:30.849503   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
mode: GRACEFUL
new_leader_uuid: "9215735813c6433e9c1d88f46c555861"
 from {username='slave'} at 127.0.0.1:59618
I20260709 12:58:30.850090   641 raft_consensus.cc:606] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Received request to transfer leadership to TS 9215735813c6433e9c1d88f46c555861
I20260709 12:58:30.851224   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:58:30.851635   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:31.008248   856 raft_consensus.cc:993] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960: : Instructing follower 9215735813c6433e9c1d88f46c555861 to start an election
I20260709 12:58:31.008740   852 raft_consensus.cc:1081] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Signalling peer 9215735813c6433e9c1d88f46c555861 to start an election
I20260709 12:58:31.010218   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "414d2c172c3241a49ae162341268225a"
dest_uuid: "9215735813c6433e9c1d88f46c555861"
 from {username='slave'} at 127.0.0.1:60960
I20260709 12:58:31.010787   715 raft_consensus.cc:493] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:31.011112   715 raft_consensus.cc:3060] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:31.015978   715 raft_consensus.cc:515] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:31.017997   715 leader_election.cc:290] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 2 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:31.018755   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414d2c172c3241a49ae162341268225a" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:31.019119   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414d2c172c3241a49ae162341268225a" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:31.019374   564 raft_consensus.cc:3055] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:31.019666   641 raft_consensus.cc:3060] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:31.019718   564 raft_consensus.cc:740] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:31.020931   564 consensus_queue.cc:260] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:31.022171   564 raft_consensus.cc:3060] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:31.026546   641 raft_consensus.cc:2468] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 2.
I20260709 12:58:31.027788   680 leader_election.cc:304] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:31.028623   848 raft_consensus.cc:2804] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:31.028823   564 raft_consensus.cc:2468] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 2.
I20260709 12:58:31.030189   848 raft_consensus.cc:697] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 2 LEADER]: Becoming Leader. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Running, Role: LEADER
I20260709 12:58:31.031203   848 consensus_queue.cc:237] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:31.040678   463 catalog_manager.cc:5697] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 reported cstate change: term changed from 1 to 2, leader changed from 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193) to 9215735813c6433e9c1d88f46c555861 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "9215735813c6433e9c1d88f46c555861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:31.122767   784 raft_consensus.cc:993] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79: : Instructing follower 9215735813c6433e9c1d88f46c555861 to start an election
I20260709 12:58:31.123306   863 raft_consensus.cc:1081] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Signalling peer 9215735813c6433e9c1d88f46c555861 to start an election
I20260709 12:58:31.125077   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a"
dest_uuid: "9215735813c6433e9c1d88f46c555861"
 from {username='slave'} at 127.0.0.1:60972
I20260709 12:58:31.125499   715 raft_consensus.cc:493] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:31.125747   715 raft_consensus.cc:3060] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:31.129978   715 raft_consensus.cc:515] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:31.131989   715 leader_election.cc:290] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 2 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:31.132627   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:31.133123   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:31.133255   564 raft_consensus.cc:3060] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:31.133701   641 raft_consensus.cc:3055] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:31.133997   641 raft_consensus.cc:740] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:31.134655   641 consensus_queue.cc:260] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:31.135519   641 raft_consensus.cc:3060] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:31.138257   564 raft_consensus.cc:2468] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 2.
I20260709 12:58:31.139348   680 leader_election.cc:304] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960; no voters: 
I20260709 12:58:31.140105   848 raft_consensus.cc:2804] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:31.140295   641 raft_consensus.cc:2468] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 2.
I20260709 12:58:31.140516   848 raft_consensus.cc:697] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 2 LEADER]: Becoming Leader. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Running, Role: LEADER
I20260709 12:58:31.141407   848 consensus_queue.cc:237] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:31.150288   463 catalog_manager.cc:5697] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 reported cstate change: term changed from 1 to 2, leader changed from c930d6e99df448358342ff6f74b5ab79 (127.0.107.194) to 9215735813c6433e9c1d88f46c555861 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "9215735813c6433e9c1d88f46c555861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:31.606956   641 raft_consensus.cc:1275] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Refusing update from remote peer 9215735813c6433e9c1d88f46c555861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:31.608258   848 consensus_queue.cc:1048] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:31.617409   564 raft_consensus.cc:1275] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Refusing update from remote peer 9215735813c6433e9c1d88f46c555861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:31.618960   848 consensus_queue.cc:1048] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:31.628518   564 raft_consensus.cc:1275] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Refusing update from remote peer 9215735813c6433e9c1d88f46c555861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:31.629765   857 consensus_queue.cc:1048] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:31.638520   641 raft_consensus.cc:1275] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Refusing update from remote peer 9215735813c6433e9c1d88f46c555861: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:31.640455   871 consensus_queue.cc:1048] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:31.852432   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:31.861985   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06213c1b8d434ca0aa9563e607648123"
dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
mode: GRACEFUL
new_leader_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:40346
I20260709 12:58:31.862571   564 raft_consensus.cc:606] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Received request to transfer leadership to TS c930d6e99df448358342ff6f74b5ab79
I20260709 12:58:31.868068   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "414d2c172c3241a49ae162341268225a"
dest_uuid: "9215735813c6433e9c1d88f46c555861"
mode: GRACEFUL
new_leader_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:60984
I20260709 12:58:31.868685   715 raft_consensus.cc:606] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 2 LEADER]: Received request to transfer leadership to TS c930d6e99df448358342ff6f74b5ab79
I20260709 12:58:31.873618   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "935debb7c90c4810823d4e1772635f8b"
dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
mode: GRACEFUL
new_leader_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:40346
I20260709 12:58:31.874156   564 raft_consensus.cc:606] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Received request to transfer leadership to TS c930d6e99df448358342ff6f74b5ab79
I20260709 12:58:31.878679   564 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49"
dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
mode: GRACEFUL
new_leader_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:40346
I20260709 12:58:31.879179   564 raft_consensus.cc:606] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 LEADER]: Received request to transfer leadership to TS c930d6e99df448358342ff6f74b5ab79
I20260709 12:58:31.884151   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a"
dest_uuid: "9215735813c6433e9c1d88f46c555861"
mode: GRACEFUL
new_leader_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:60984
I20260709 12:58:31.884693   715 raft_consensus.cc:606] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 2 LEADER]: Received request to transfer leadership to TS c930d6e99df448358342ff6f74b5ab79
I20260709 12:58:31.953514   852 raft_consensus.cc:993] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960: : Instructing follower c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:31.953971   874 raft_consensus.cc:1081] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Signalling peer c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:31.955356   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "935debb7c90c4810823d4e1772635f8b"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:35510
I20260709 12:58:31.955816   641 raft_consensus.cc:493] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:31.956108   641 raft_consensus.cc:3060] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:31.959959   641 raft_consensus.cc:515] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:31.961261   641 leader_election.cc:290] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 2 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:31.962168   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935debb7c90c4810823d4e1772635f8b" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:31.962316   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935debb7c90c4810823d4e1772635f8b" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:31.962692   564 raft_consensus.cc:3055] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:31.962841   715 raft_consensus.cc:3060] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:31.962944   564 raft_consensus.cc:740] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:31.963747   564 consensus_queue.cc:260] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:31.964533   564 raft_consensus.cc:3060] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:31.967790   715 raft_consensus.cc:2468] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 2.
I20260709 12:58:31.968734   564 raft_consensus.cc:2468] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 2.
I20260709 12:58:31.968856   606 leader_election.cc:304] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:31.969642   872 raft_consensus.cc:2804] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:31.969977   872 raft_consensus.cc:697] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 2 LEADER]: Becoming Leader. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:31.970736   872 consensus_queue.cc:237] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:31.976992   461 catalog_manager.cc:5697] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 reported cstate change: term changed from 1 to 2, leader changed from 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193) to c930d6e99df448358342ff6f74b5ab79 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c930d6e99df448358342ff6f74b5ab79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.091764   848 raft_consensus.cc:993] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861: : Instructing follower c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:32.092270   871 raft_consensus.cc:1081] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 2 LEADER]: Signalling peer c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:32.093761   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:35512
I20260709 12:58:32.094338   641 raft_consensus.cc:493] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:32.094691   641 raft_consensus.cc:3060] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:32.099208   641 raft_consensus.cc:515] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:32.100734   641 leader_election.cc:290] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 3 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:32.101514   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:32.101963   564 raft_consensus.cc:3060] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:32.101975   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:32.102764   715 raft_consensus.cc:3055] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:32.103142   715 raft_consensus.cc:740] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Running, Role: LEADER
I20260709 12:58:32.103905   715 consensus_queue.cc:260] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:32.104887   715 raft_consensus.cc:3060] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:32.106336   564 raft_consensus.cc:2468] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 3.
I20260709 12:58:32.107280   606 leader_election.cc:304] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:32.108147   872 raft_consensus.cc:2804] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:32.108558   872 raft_consensus.cc:697] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Becoming Leader. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:32.109227   872 consensus_queue.cc:237] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:32.110916   715 raft_consensus.cc:2468] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 3.
I20260709 12:58:32.115993   461 catalog_manager.cc:5697] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 reported cstate change: term changed from 2 to 3, leader changed from 9215735813c6433e9c1d88f46c555861 (127.0.107.195) to c930d6e99df448358342ff6f74b5ab79 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c930d6e99df448358342ff6f74b5ab79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.129143   852 raft_consensus.cc:993] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960: : Instructing follower c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:32.129637   874 raft_consensus.cc:1081] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Signalling peer c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:32.131057   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06213c1b8d434ca0aa9563e607648123"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:35510
I20260709 12:58:32.131501   641 raft_consensus.cc:493] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:32.131762   641 raft_consensus.cc:3060] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:32.135882   641 raft_consensus.cc:515] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } }
I20260709 12:58:32.137353   641 leader_election.cc:290] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 2 election: Requested vote from peers 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231), 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113)
I20260709 12:58:32.138100   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06213c1b8d434ca0aa9563e607648123" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:32.138545   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06213c1b8d434ca0aa9563e607648123" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:32.138693   715 raft_consensus.cc:3060] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:32.139092   564 raft_consensus.cc:3055] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:32.139438   564 raft_consensus.cc:740] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:32.140112   564 consensus_queue.cc:260] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } }
I20260709 12:58:32.140967   564 raft_consensus.cc:3060] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:32.143777   715 raft_consensus.cc:2468] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 2.
I20260709 12:58:32.144856   606 leader_election.cc:304] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:32.145380   564 raft_consensus.cc:2468] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 2.
I20260709 12:58:32.145509   872 raft_consensus.cc:2804] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:32.145992   872 raft_consensus.cc:697] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 2 LEADER]: Becoming Leader. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:32.146842   872 consensus_queue.cc:237] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } }
I20260709 12:58:32.153543   463 catalog_manager.cc:5697] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 reported cstate change: term changed from 1 to 2, leader changed from 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193) to c930d6e99df448358342ff6f74b5ab79 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c930d6e99df448358342ff6f74b5ab79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.214038   857 raft_consensus.cc:993] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861: : Instructing follower c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:32.214468   871 raft_consensus.cc:1081] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 2 LEADER]: Signalling peer c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:32.215950   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "414d2c172c3241a49ae162341268225a"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:35512
I20260709 12:58:32.216333   641 raft_consensus.cc:493] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:32.216553   641 raft_consensus.cc:3060] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:32.220412   641 raft_consensus.cc:515] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:32.221695   641 leader_election.cc:290] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 3 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:32.222523   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414d2c172c3241a49ae162341268225a" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:32.222723   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414d2c172c3241a49ae162341268225a" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:32.223104   564 raft_consensus.cc:3060] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:32.223307   715 raft_consensus.cc:3055] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:32.223630   715 raft_consensus.cc:740] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Running, Role: LEADER
I20260709 12:58:32.224236   715 consensus_queue.cc:260] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:32.225039   715 raft_consensus.cc:3060] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:32.227224   564 raft_consensus.cc:2468] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 3.
I20260709 12:58:32.228077   606 leader_election.cc:304] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:32.228727   872 raft_consensus.cc:2804] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:32.228838   715 raft_consensus.cc:2468] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 3.
I20260709 12:58:32.229175   872 raft_consensus.cc:697] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Becoming Leader. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:32.230000   872 consensus_queue.cc:237] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:32.236073   463 catalog_manager.cc:5697] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 reported cstate change: term changed from 2 to 3, leader changed from 9215735813c6433e9c1d88f46c555861 (127.0.107.195) to c930d6e99df448358342ff6f74b5ab79 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c930d6e99df448358342ff6f74b5ab79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.304905   852 raft_consensus.cc:993] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960: : Instructing follower c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:32.305418   874 raft_consensus.cc:1081] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 LEADER]: Signalling peer c930d6e99df448358342ff6f74b5ab79 to start an election
I20260709 12:58:32.306851   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
 from {username='slave'} at 127.0.0.1:35510
I20260709 12:58:32.307238   641 raft_consensus.cc:493] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:32.307453   641 raft_consensus.cc:3060] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:32.311534   641 raft_consensus.cc:515] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:32.312966   641 leader_election.cc:290] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 3 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:32.314047   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:32.314061   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49" candidate_uuid: "c930d6e99df448358342ff6f74b5ab79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:32.314776   715 raft_consensus.cc:3060] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:32.314833   564 raft_consensus.cc:3055] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:32.315232   564 raft_consensus.cc:740] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:32.315905   564 consensus_queue.cc:260] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:32.316927   564 raft_consensus.cc:3060] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:32.320645   715 raft_consensus.cc:2468] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 3.
I20260709 12:58:32.321672   606 leader_election.cc:304] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:32.322376   872 raft_consensus.cc:2804] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:32.322338   564 raft_consensus.cc:2468] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c930d6e99df448358342ff6f74b5ab79 in term 3.
I20260709 12:58:32.322932   872 raft_consensus.cc:697] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Becoming Leader. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:32.323747   872 consensus_queue.cc:237] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:32.330592   463 catalog_manager.cc:5697] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 reported cstate change: term changed from 2 to 3, leader changed from 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193) to c930d6e99df448358342ff6f74b5ab79 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c930d6e99df448358342ff6f74b5ab79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.539175   715 raft_consensus.cc:1275] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:32.540365   872 consensus_queue.cc:1048] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.543884   564 raft_consensus.cc:1275] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:32.545588   872 consensus_queue.cc:1048] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.596515   715 raft_consensus.cc:1275] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:32.598140   885 consensus_queue.cc:1048] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:32.605196   564 raft_consensus.cc:1275] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:32.606491   863 consensus_queue.cc:1048] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:32.631270   564 raft_consensus.cc:1275] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:32.632503   863 consensus_queue.cc:1048] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:32.640321   715 raft_consensus.cc:1275] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:32.641639   885 consensus_queue.cc:1048] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:32.677265   715 raft_consensus.cc:1275] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:32.678368   885 consensus_queue.cc:1048] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.686141   564 raft_consensus.cc:1275] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:32.687778   863 consensus_queue.cc:1048] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.797591   715 raft_consensus.cc:1275] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:32.798796   863 consensus_queue.cc:1048] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:32.807539   564 raft_consensus.cc:1275] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Refusing update from remote peer c930d6e99df448358342ff6f74b5ab79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:32.809667   885 consensus_queue.cc:1048] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:34.896700   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:34.903748   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "414d2c172c3241a49ae162341268225a"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
mode: GRACEFUL
new_leader_uuid: "9215735813c6433e9c1d88f46c555861"
 from {username='slave'} at 127.0.0.1:59618
I20260709 12:58:34.904415   641 raft_consensus.cc:606] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Received request to transfer leadership to TS 9215735813c6433e9c1d88f46c555861
I20260709 12:58:34.907020   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
mode: GRACEFUL
new_leader_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
 from {username='slave'} at 127.0.0.1:59618
I20260709 12:58:34.907439   641 raft_consensus.cc:606] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Received request to transfer leadership to TS 9a6aab69a8c54e1180d19ed2a43af960
I20260709 12:58:34.909525   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7274e6d8864f4cb48f1c61921e53edba"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
mode: GRACEFUL
new_leader_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
 from {username='slave'} at 127.0.0.1:59618
I20260709 12:58:34.909935   641 raft_consensus.cc:606] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Received request to transfer leadership to TS 9a6aab69a8c54e1180d19ed2a43af960
I20260709 12:58:34.912081   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
mode: GRACEFUL
new_leader_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
 from {username='slave'} at 127.0.0.1:59618
I20260709 12:58:34.912477   641 raft_consensus.cc:606] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Received request to transfer leadership to TS 9a6aab69a8c54e1180d19ed2a43af960
I20260709 12:58:34.914646   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "935debb7c90c4810823d4e1772635f8b"
dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
mode: GRACEFUL
new_leader_uuid: "9215735813c6433e9c1d88f46c555861"
 from {username='slave'} at 127.0.0.1:59618
I20260709 12:58:34.915136   641 raft_consensus.cc:606] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 2 LEADER]: Received request to transfer leadership to TS 9215735813c6433e9c1d88f46c555861
I20260709 12:58:34.916213   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:34.916677   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:34.917778   863 raft_consensus.cc:993] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79: : Instructing follower 9215735813c6433e9c1d88f46c555861 to start an election
I20260709 12:58:34.918255   894 raft_consensus.cc:1081] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 2 LEADER]: Signalling peer 9215735813c6433e9c1d88f46c555861 to start an election
I20260709 12:58:34.919684   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "935debb7c90c4810823d4e1772635f8b"
dest_uuid: "9215735813c6433e9c1d88f46c555861"
 from {username='slave'} at 127.0.0.1:60972
I20260709 12:58:34.920187   714 raft_consensus.cc:493] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:34.920466   714 raft_consensus.cc:3060] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:34.925866   714 raft_consensus.cc:515] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:34.927469   714 leader_election.cc:290] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 3 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:34.928507   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935debb7c90c4810823d4e1772635f8b" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:34.928527   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935debb7c90c4810823d4e1772635f8b" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:34.929248   564 raft_consensus.cc:3060] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:34.929276   641 raft_consensus.cc:3055] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:34.929633   641 raft_consensus.cc:740] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:34.930323   641 consensus_queue.cc:260] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:34.931213   641 raft_consensus.cc:3060] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:34.934119   564 raft_consensus.cc:2468] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 3.
I20260709 12:58:34.935570   680 leader_election.cc:304] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960; no voters: 
I20260709 12:58:34.936411   641 raft_consensus.cc:2468] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 3.
I20260709 12:58:34.936524   871 raft_consensus.cc:2804] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:34.938832   871 raft_consensus.cc:697] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 3 LEADER]: Becoming Leader. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Running, Role: LEADER
I20260709 12:58:34.939720   871 consensus_queue.cc:237] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:34.947579   461 catalog_manager.cc:5697] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 reported cstate change: term changed from 2 to 3, leader changed from c930d6e99df448358342ff6f74b5ab79 (127.0.107.194) to 9215735813c6433e9c1d88f46c555861 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "9215735813c6433e9c1d88f46c555861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:35.020869   863 raft_consensus.cc:993] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79: : Instructing follower 9215735813c6433e9c1d88f46c555861 to start an election
I20260709 12:58:35.021373   894 raft_consensus.cc:1081] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Signalling peer 9215735813c6433e9c1d88f46c555861 to start an election
I20260709 12:58:35.022917   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "414d2c172c3241a49ae162341268225a"
dest_uuid: "9215735813c6433e9c1d88f46c555861"
 from {username='slave'} at 127.0.0.1:60972
I20260709 12:58:35.023464   714 raft_consensus.cc:493] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:35.023772   714 raft_consensus.cc:3060] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:35.028703   714 raft_consensus.cc:515] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:35.031122   714 leader_election.cc:290] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 4 election: Requested vote from peers 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113), c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515)
I20260709 12:58:35.032290   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414d2c172c3241a49ae162341268225a" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
I20260709 12:58:35.032843   564 raft_consensus.cc:3060] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:35.037251   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "414d2c172c3241a49ae162341268225a" candidate_uuid: "9215735813c6433e9c1d88f46c555861" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:35.037899   641 raft_consensus.cc:3055] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:35.038174   641 raft_consensus.cc:740] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:35.038843   641 consensus_queue.cc:260] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:35.039981   641 raft_consensus.cc:3060] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:35.040341   564 raft_consensus.cc:2468] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 4.
I20260709 12:58:35.041519   680 leader_election.cc:304] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960; no voters: 
I20260709 12:58:35.042374   871 raft_consensus.cc:2804] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:35.042835   871 raft_consensus.cc:697] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 4 LEADER]: Becoming Leader. State: Replica: 9215735813c6433e9c1d88f46c555861, State: Running, Role: LEADER
I20260709 12:58:35.043727   871 consensus_queue.cc:237] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:35.046484   641 raft_consensus.cc:2468] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9215735813c6433e9c1d88f46c555861 in term 4.
I20260709 12:58:35.051106   461 catalog_manager.cc:5697] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 reported cstate change: term changed from 3 to 4, leader changed from c930d6e99df448358342ff6f74b5ab79 (127.0.107.194) to 9215735813c6433e9c1d88f46c555861 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "9215735813c6433e9c1d88f46c555861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:35.182783   863 raft_consensus.cc:993] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79: : Instructing follower 9a6aab69a8c54e1180d19ed2a43af960 to start an election
I20260709 12:58:35.183205   894 raft_consensus.cc:1081] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Signalling peer 9a6aab69a8c54e1180d19ed2a43af960 to start an election
I20260709 12:58:35.184597   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49"
dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
 from {username='slave'} at 127.0.0.1:40326
I20260709 12:58:35.185040   564 raft_consensus.cc:493] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:35.185395   564 raft_consensus.cc:3060] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:35.189471   564 raft_consensus.cc:515] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:35.190919   564 leader_election.cc:290] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 4 election: Requested vote from peers c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:35.191851   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:35.192191   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b49575d5ffb4dadbcf251692c419c49" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:35.192411   641 raft_consensus.cc:3055] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:35.192708   641 raft_consensus.cc:740] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:35.192732   714 raft_consensus.cc:3060] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:35.193650   641 consensus_queue.cc:260] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:35.194856   641 raft_consensus.cc:3060] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:35.199640   714 raft_consensus.cc:2468] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 4.
I20260709 12:58:35.200845   641 raft_consensus.cc:2468] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 4.
I20260709 12:58:35.201035   531 leader_election.cc:304] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960; no voters: 
I20260709 12:58:35.202804   903 raft_consensus.cc:2804] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:35.203778   903 raft_consensus.cc:697] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 LEADER]: Becoming Leader. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:35.204504   903 consensus_queue.cc:237] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:35.210999   461 catalog_manager.cc:5697] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 reported cstate change: term changed from 3 to 4, leader changed from c930d6e99df448358342ff6f74b5ab79 (127.0.107.194) to 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "9a6aab69a8c54e1180d19ed2a43af960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:35.219359   863 raft_consensus.cc:993] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79: : Instructing follower 9a6aab69a8c54e1180d19ed2a43af960 to start an election
I20260709 12:58:35.219764   863 raft_consensus.cc:1081] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Signalling peer 9a6aab69a8c54e1180d19ed2a43af960 to start an election
I20260709 12:58:35.221134   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a"
dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
 from {username='slave'} at 127.0.0.1:40326
I20260709 12:58:35.221516   564 raft_consensus.cc:493] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:35.221729   564 raft_consensus.cc:3060] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:35.226303   894 raft_consensus.cc:993] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79: : Instructing follower 9a6aab69a8c54e1180d19ed2a43af960 to start an election
I20260709 12:58:35.226711   863 raft_consensus.cc:1081] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Signalling peer 9a6aab69a8c54e1180d19ed2a43af960 to start an election
I20260709 12:58:35.226779   564 raft_consensus.cc:515] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:35.228348   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7274e6d8864f4cb48f1c61921e53edba"
dest_uuid: "9a6aab69a8c54e1180d19ed2a43af960"
 from {username='slave'} at 127.0.0.1:40326
I20260709 12:58:35.228559   564 leader_election.cc:290] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 4 election: Requested vote from peers c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:35.228860   566 raft_consensus.cc:493] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:35.229238   566 raft_consensus.cc:3060] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.229094   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:35.229539   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c389fa6a364a1bb54cd8837064a69a" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:35.229920   641 raft_consensus.cc:3055] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:35.230106   714 raft_consensus.cc:3060] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:35.230224   641 raft_consensus.cc:740] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:35.230990   641 consensus_queue.cc:260] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:35.231736   641 raft_consensus.cc:3060] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:35.235845   641 raft_consensus.cc:2468] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 4.
I20260709 12:58:35.235944   566 raft_consensus.cc:515] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:35.236323   714 raft_consensus.cc:2468] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 4.
I20260709 12:58:35.237089   531 leader_election.cc:304] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a6aab69a8c54e1180d19ed2a43af960, c930d6e99df448358342ff6f74b5ab79; no voters: 
I20260709 12:58:35.237917   903 raft_consensus.cc:2804] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:35.238103   566 leader_election.cc:290] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 2 election: Requested vote from peers c930d6e99df448358342ff6f74b5ab79 (127.0.107.194:39515), 9215735813c6433e9c1d88f46c555861 (127.0.107.195:40231)
I20260709 12:58:35.238406   903 raft_consensus.cc:697] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 LEADER]: Becoming Leader. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:35.238914   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7274e6d8864f4cb48f1c61921e53edba" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c930d6e99df448358342ff6f74b5ab79"
I20260709 12:58:35.239225   903 consensus_queue.cc:237] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:35.239764   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7274e6d8864f4cb48f1c61921e53edba" candidate_uuid: "9a6aab69a8c54e1180d19ed2a43af960" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9215735813c6433e9c1d88f46c555861"
I20260709 12:58:35.239463   641 raft_consensus.cc:3055] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:35.240319   714 raft_consensus.cc:3060] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.240300   641 raft_consensus.cc:740] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c930d6e99df448358342ff6f74b5ab79, State: Running, Role: LEADER
I20260709 12:58:35.241269   641 consensus_queue.cc:260] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:35.242442   641 raft_consensus.cc:3060] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:35.246922   714 raft_consensus.cc:2468] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 2.
I20260709 12:58:35.247550   641 raft_consensus.cc:2468] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a6aab69a8c54e1180d19ed2a43af960 in term 2.
I20260709 12:58:35.248080   531 leader_election.cc:304] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9215735813c6433e9c1d88f46c555861, 9a6aab69a8c54e1180d19ed2a43af960; no voters: 
I20260709 12:58:35.247638   461 catalog_manager.cc:5697] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 reported cstate change: term changed from 3 to 4, leader changed from c930d6e99df448358342ff6f74b5ab79 (127.0.107.194) to 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "9a6aab69a8c54e1180d19ed2a43af960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:35.248924   903 raft_consensus.cc:2804] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:35.249369   903 raft_consensus.cc:697] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 LEADER]: Becoming Leader. State: Replica: 9a6aab69a8c54e1180d19ed2a43af960, State: Running, Role: LEADER
I20260709 12:58:35.250093   903 consensus_queue.cc:237] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } }
I20260709 12:58:35.260285   461 catalog_manager.cc:5697] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 reported cstate change: term changed from 1 to 2, leader changed from c930d6e99df448358342ff6f74b5ab79 (127.0.107.194) to 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "9a6aab69a8c54e1180d19ed2a43af960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:35.454447   641 raft_consensus.cc:1275] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 4 FOLLOWER]: Refusing update from remote peer 9215735813c6433e9c1d88f46c555861: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:35.455868   896 consensus_queue.cc:1048] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:35.460628   566 raft_consensus.cc:1275] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Refusing update from remote peer 9215735813c6433e9c1d88f46c555861: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:35.462635   896 consensus_queue.cc:1048] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:35.468979   564 raft_consensus.cc:1275] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 FOLLOWER]: Refusing update from remote peer 9215735813c6433e9c1d88f46c555861: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:35.471010   909 consensus_queue.cc:1048] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a6aab69a8c54e1180d19ed2a43af960" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:35.480880   640 raft_consensus.cc:1275] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Refusing update from remote peer 9215735813c6433e9c1d88f46c555861: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:35.482522   871 consensus_queue.cc:1048] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:35.625280   640 raft_consensus.cc:1275] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 4 FOLLOWER]: Refusing update from remote peer 9a6aab69a8c54e1180d19ed2a43af960: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:35.626502   903 consensus_queue.cc:1048] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:35.635430   714 raft_consensus.cc:1275] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 4 FOLLOWER]: Refusing update from remote peer 9a6aab69a8c54e1180d19ed2a43af960: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:35.637527   918 consensus_queue.cc:1048] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:35.721114   714 raft_consensus.cc:1275] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 4 FOLLOWER]: Refusing update from remote peer 9a6aab69a8c54e1180d19ed2a43af960: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:35.722481   918 consensus_queue.cc:1048] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:35.731494   640 raft_consensus.cc:1275] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 4 FOLLOWER]: Refusing update from remote peer 9a6aab69a8c54e1180d19ed2a43af960: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:35.732872   918 consensus_queue.cc:1048] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:35.839749   714 raft_consensus.cc:1275] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Refusing update from remote peer 9a6aab69a8c54e1180d19ed2a43af960: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:35.840857   903 consensus_queue.cc:1048] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9215735813c6433e9c1d88f46c555861" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:35.849594   640 raft_consensus.cc:1275] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Refusing update from remote peer 9a6aab69a8c54e1180d19ed2a43af960: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:35.851219   904 consensus_queue.cc:1048] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c930d6e99df448358342ff6f74b5ab79" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:35.917683   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:35.923010   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:58:35.945555   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:35.946360   431 tablet_replica.cc:333] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960: stopping tablet replica
I20260709 12:58:35.947134   431 raft_consensus.cc:2243] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:35.947678   431 raft_consensus.cc:2272] T e5300a48709d49cfb5b5547135952e12 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:35.949911   431 tablet_replica.cc:333] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960: stopping tablet replica
I20260709 12:58:35.950439   431 raft_consensus.cc:2243] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:35.950793   431 raft_consensus.cc:2272] T fbbe4e2b4be247c6a883fd767c0848ac P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:35.952281   431 tablet_replica.cc:333] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960: stopping tablet replica
I20260709 12:58:35.952699   431 raft_consensus.cc:2243] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:35.953323   431 raft_consensus.cc:2272] T 5b49575d5ffb4dadbcf251692c419c49 P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:35.955101   431 tablet_replica.cc:333] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960: stopping tablet replica
I20260709 12:58:35.955540   431 raft_consensus.cc:2243] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:35.955868   431 raft_consensus.cc:2272] T 414d2c172c3241a49ae162341268225a P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:35.957901   431 tablet_replica.cc:333] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960: stopping tablet replica
I20260709 12:58:35.958412   431 raft_consensus.cc:2243] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:35.958724   431 raft_consensus.cc:2272] T f7b70fc85d6a41eebbe6184695221a56 P 9a6aab69a8c54e1180d19ed2a43af960 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:35.960384   431 tablet_replica.cc:333] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960: stopping tablet replica
I20260709 12:58:35.960791   431 raft_consensus.cc:2243] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:35.961117   431 raft_consensus.cc:2272] T 935debb7c90c4810823d4e1772635f8b P 9a6aab69a8c54e1180d19ed2a43af960 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:35.963176   431 tablet_replica.cc:333] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960: stopping tablet replica
I20260709 12:58:35.963646   431 raft_consensus.cc:2243] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:35.964272   431 raft_consensus.cc:2272] T 78c389fa6a364a1bb54cd8837064a69a P 9a6aab69a8c54e1180d19ed2a43af960 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:35.965894   431 tablet_replica.cc:333] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960: stopping tablet replica
I20260709 12:58:35.966521   431 raft_consensus.cc:2243] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:35.967242   431 raft_consensus.cc:2272] T 7274e6d8864f4cb48f1c61921e53edba P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:35.969035   431 tablet_replica.cc:333] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960: stopping tablet replica
I20260709 12:58:35.969470   431 raft_consensus.cc:2243] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:35.969861   431 raft_consensus.cc:2272] T 06213c1b8d434ca0aa9563e607648123 P 9a6aab69a8c54e1180d19ed2a43af960 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:35.975705   680 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:58:35.979079   680 consensus_peers.cc:597] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 -> Peer 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113): Couldn't send request to peer 9a6aab69a8c54e1180d19ed2a43af960. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:35.979514   606 consensus_peers.cc:597] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 -> Peer 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113): Couldn't send request to peer 9a6aab69a8c54e1180d19ed2a43af960. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:36.073313   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:58:36.073968   680 consensus_peers.cc:597] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 -> Peer 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113): Couldn't send request to peer 9a6aab69a8c54e1180d19ed2a43af960. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:36.091277   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:58:36.113408   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:36.114271   431 tablet_replica.cc:333] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79: stopping tablet replica
I20260709 12:58:36.114894   431 raft_consensus.cc:2243] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:36.115774   431 raft_consensus.cc:2272] T fbbe4e2b4be247c6a883fd767c0848ac P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.117626   431 tablet_replica.cc:333] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79: stopping tablet replica
I20260709 12:58:36.118422   431 raft_consensus.cc:2243] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.118830   431 raft_consensus.cc:2272] T 5b49575d5ffb4dadbcf251692c419c49 P c930d6e99df448358342ff6f74b5ab79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.121127   431 tablet_replica.cc:333] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79: stopping tablet replica
W20260709 12:58:36.121387   606 consensus_peers.cc:597] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 -> Peer 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113): Couldn't send request to peer 9a6aab69a8c54e1180d19ed2a43af960. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:36.121727   431 raft_consensus.cc:2243] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:36.122527   431 raft_consensus.cc:2272] T e5300a48709d49cfb5b5547135952e12 P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.124161   431 tablet_replica.cc:333] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79: stopping tablet replica
I20260709 12:58:36.124656   431 raft_consensus.cc:2243] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.125046   431 raft_consensus.cc:2272] T f7b70fc85d6a41eebbe6184695221a56 P c930d6e99df448358342ff6f74b5ab79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.126578   431 tablet_replica.cc:333] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79: stopping tablet replica
I20260709 12:58:36.127034   431 raft_consensus.cc:2243] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.127405   431 raft_consensus.cc:2272] T 935debb7c90c4810823d4e1772635f8b P c930d6e99df448358342ff6f74b5ab79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.130002   431 tablet_replica.cc:333] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79: stopping tablet replica
I20260709 12:58:36.130550   431 raft_consensus.cc:2243] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.130951   431 raft_consensus.cc:2272] T 414d2c172c3241a49ae162341268225a P c930d6e99df448358342ff6f74b5ab79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.132843   431 tablet_replica.cc:333] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79: stopping tablet replica
I20260709 12:58:36.133322   431 raft_consensus.cc:2243] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.133708   431 raft_consensus.cc:2272] T 78c389fa6a364a1bb54cd8837064a69a P c930d6e99df448358342ff6f74b5ab79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.135746   431 tablet_replica.cc:333] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79: stopping tablet replica
I20260709 12:58:36.136225   431 raft_consensus.cc:2243] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.136612   431 raft_consensus.cc:2272] T 7274e6d8864f4cb48f1c61921e53edba P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.138710   431 tablet_replica.cc:333] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79: stopping tablet replica
I20260709 12:58:36.139158   431 raft_consensus.cc:2243] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:36.139866   431 raft_consensus.cc:2272] T 06213c1b8d434ca0aa9563e607648123 P c930d6e99df448358342ff6f74b5ab79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.167999   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 12:58:36.169039   680 consensus_peers.cc:597] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 -> Peer 9a6aab69a8c54e1180d19ed2a43af960 (127.0.107.193:40113): Couldn't send request to peer 9a6aab69a8c54e1180d19ed2a43af960. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40113: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:36.184639   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:58:36.207022   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:36.207783   431 tablet_replica.cc:333] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861: stopping tablet replica
I20260709 12:58:36.208405   431 raft_consensus.cc:2243] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:36.209156   431 raft_consensus.cc:2272] T 414d2c172c3241a49ae162341268225a P 9215735813c6433e9c1d88f46c555861 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.211858   431 tablet_replica.cc:333] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861: stopping tablet replica
I20260709 12:58:36.212440   431 raft_consensus.cc:2243] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.212888   431 raft_consensus.cc:2272] T e5300a48709d49cfb5b5547135952e12 P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.214545   431 tablet_replica.cc:333] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861: stopping tablet replica
I20260709 12:58:36.215024   431 raft_consensus.cc:2243] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.215430   431 raft_consensus.cc:2272] T 06213c1b8d434ca0aa9563e607648123 P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.216943   431 tablet_replica.cc:333] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861: stopping tablet replica
I20260709 12:58:36.217398   431 raft_consensus.cc:2243] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.217769   431 raft_consensus.cc:2272] T 7274e6d8864f4cb48f1c61921e53edba P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.220733   431 tablet_replica.cc:333] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861: stopping tablet replica
I20260709 12:58:36.221244   431 raft_consensus.cc:2243] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:36.221956   431 raft_consensus.cc:2272] T f7b70fc85d6a41eebbe6184695221a56 P 9215735813c6433e9c1d88f46c555861 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.223680   431 tablet_replica.cc:333] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861: stopping tablet replica
I20260709 12:58:36.224145   431 raft_consensus.cc:2243] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:36.224795   431 raft_consensus.cc:2272] T 935debb7c90c4810823d4e1772635f8b P 9215735813c6433e9c1d88f46c555861 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.226514   431 tablet_replica.cc:333] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861: stopping tablet replica
I20260709 12:58:36.226991   431 raft_consensus.cc:2243] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.227396   431 raft_consensus.cc:2272] T 5b49575d5ffb4dadbcf251692c419c49 P 9215735813c6433e9c1d88f46c555861 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.229202   431 tablet_replica.cc:333] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861: stopping tablet replica
I20260709 12:58:36.229653   431 raft_consensus.cc:2243] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.230160   431 raft_consensus.cc:2272] T fbbe4e2b4be247c6a883fd767c0848ac P 9215735813c6433e9c1d88f46c555861 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.231611   431 tablet_replica.cc:333] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861: stopping tablet replica
I20260709 12:58:36.232055   431 raft_consensus.cc:2243] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.232540   431 raft_consensus.cc:2272] T 78c389fa6a364a1bb54cd8837064a69a P 9215735813c6433e9c1d88f46c555861 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.258425   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:58:36.274987   431 master.cc:562] Master@127.0.107.254:34253 shutting down...
I20260709 12:58:36.413820   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:36.414362   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.414655   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P fde28bcf6ac44bb998c04105ba37d0ab: stopping tablet replica
I20260709 12:58:36.433061   431 master.cc:584] Master@127.0.107.254:34253 shutdown complete.
9215735813c6433e9c1d88f46c555861  1
9a6aab69a8c54e1180d19ed2a43af960  4
c930d6e99df448358342ff6f74b5ab79  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12575 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:58:36.473474   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:45365
I20260709 12:58:36.474668   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:36.479894   928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:36.480626   929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:36.482934   431 server_base.cc:1061] running on GCE node
W20260709 12:58:36.482987   931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:36.484066   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:36.484262   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:36.484375   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601916484364 us; error 0 us; skew 500 ppm
I20260709 12:58:36.484823   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:36.487272   431 webserver.cc:533] Webserver started at http://127.0.107.254:34453/ using document root <none> and password file <none>
I20260709 12:58:36.487717   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:36.487867   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:36.488087   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:36.489142   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/master-0-root/instance:
uuid: "5ab9f7ca62e542e9a5351f4a4149bdd6"
format_stamp: "Formatted at 2026-07-09 12:58:36 on dist-test-slave-nr1f"
I20260709 12:58:36.493682   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:58:36.496999   936 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:36.497730   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:58:36.498080   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/master-0-root
uuid: "5ab9f7ca62e542e9a5351f4a4149bdd6"
format_stamp: "Formatted at 2026-07-09 12:58:36 on dist-test-slave-nr1f"
I20260709 12:58:36.498380   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:36.513885   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:36.515203   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:36.555642   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:45365
I20260709 12:58:36.555742   987 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:45365 every 8 connection(s)
I20260709 12:58:36.559445   988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.569391   988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6: Bootstrap starting.
I20260709 12:58:36.576321   988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:36.580833   988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6: No bootstrap required, opened a new log
I20260709 12:58:36.583146   988 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab9f7ca62e542e9a5351f4a4149bdd6" member_type: VOTER }
I20260709 12:58:36.583540   988 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:36.583822   988 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ab9f7ca62e542e9a5351f4a4149bdd6, State: Initialized, Role: FOLLOWER
I20260709 12:58:36.584450   988 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab9f7ca62e542e9a5351f4a4149bdd6" member_type: VOTER }
I20260709 12:58:36.584995   988 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:36.585258   988 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:36.585510   988 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:36.591226   988 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab9f7ca62e542e9a5351f4a4149bdd6" member_type: VOTER }
I20260709 12:58:36.591970   988 leader_election.cc:304] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ab9f7ca62e542e9a5351f4a4149bdd6; no voters: 
I20260709 12:58:36.593155   988 leader_election.cc:290] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:36.593510   991 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:36.594926   991 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [term 1 LEADER]: Becoming Leader. State: Replica: 5ab9f7ca62e542e9a5351f4a4149bdd6, State: Running, Role: LEADER
I20260709 12:58:36.595597   991 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab9f7ca62e542e9a5351f4a4149bdd6" member_type: VOTER }
I20260709 12:58:36.596150   988 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:36.601475   993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ab9f7ca62e542e9a5351f4a4149bdd6. Latest consensus state: current_term: 1 leader_uuid: "5ab9f7ca62e542e9a5351f4a4149bdd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab9f7ca62e542e9a5351f4a4149bdd6" member_type: VOTER } }
I20260709 12:58:36.601497   992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ab9f7ca62e542e9a5351f4a4149bdd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab9f7ca62e542e9a5351f4a4149bdd6" member_type: VOTER } }
I20260709 12:58:36.602420   993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:36.602481   992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:36.606192   997 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:36.613612   997 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:36.616292   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:36.623252   997 catalog_manager.cc:1383] Generated new cluster ID: d21a7d6cc9bf49ff86d14097178962af
I20260709 12:58:36.623672   997 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:36.643985   997 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:36.645323   997 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:36.660880   997 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6: Generated new TSK 0
I20260709 12:58:36.661491   997 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:36.683351   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:36.689333  1009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:36.690439  1010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:36.692327   431 server_base.cc:1061] running on GCE node
W20260709 12:58:36.692265  1012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:36.693537   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:36.693789   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:36.693966   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601916693942 us; error 0 us; skew 500 ppm
I20260709 12:58:36.694571   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:36.697885   431 webserver.cc:533] Webserver started at http://127.0.107.193:38813/ using document root <none> and password file <none>
I20260709 12:58:36.698601   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:36.698777   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:36.698989   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:36.700047   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-0-root/instance:
uuid: "ef47514919a2475ba9284a0131e88971"
format_stamp: "Formatted at 2026-07-09 12:58:36 on dist-test-slave-nr1f"
I20260709 12:58:36.704867   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:58:36.708246  1017 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:36.709036   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:58:36.709344   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-0-root
uuid: "ef47514919a2475ba9284a0131e88971"
format_stamp: "Formatted at 2026-07-09 12:58:36 on dist-test-slave-nr1f"
I20260709 12:58:36.709627   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:36.729657   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:36.731079   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:36.732613   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:36.735262   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:36.735486   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:36.735747   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:36.735931   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:36.778277   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33647
I20260709 12:58:36.778379  1079 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33647 every 8 connection(s)
I20260709 12:58:36.783281   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:36.790705  1084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:36.791196  1085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:36.794315  1087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:36.795112   431 server_base.cc:1061] running on GCE node
I20260709 12:58:36.796000   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:36.796181   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:36.796391   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601916796370 us; error 0 us; skew 500 ppm
I20260709 12:58:36.796967   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:36.800151  1080 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45365
I20260709 12:58:36.800558  1080 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:36.800921   431 webserver.cc:533] Webserver started at http://127.0.107.194:41983/ using document root <none> and password file <none>
I20260709 12:58:36.801357  1080 heartbeater.cc:507] Master 127.0.107.254:45365 requested a full tablet report, sending...
I20260709 12:58:36.801580   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:36.801774   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:36.801986   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:36.803408   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-1-root/instance:
uuid: "61595b36500942c2995078f771f47d30"
format_stamp: "Formatted at 2026-07-09 12:58:36 on dist-test-slave-nr1f"
I20260709 12:58:36.803500   953 ts_manager.cc:194] Registered new tserver with Master: ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647)
I20260709 12:58:36.805310   953 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46840
I20260709 12:58:36.808929   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:58:36.812685  1092 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:36.813479   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:58:36.813817   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-1-root
uuid: "61595b36500942c2995078f771f47d30"
format_stamp: "Formatted at 2026-07-09 12:58:36 on dist-test-slave-nr1f"
I20260709 12:58:36.814198   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:36.831700   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:36.832973   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:36.835011   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:36.837266   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:36.837510   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:36.837826   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:36.838001   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:36.878453   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:42231
I20260709 12:58:36.878545  1154 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:42231 every 8 connection(s)
I20260709 12:58:36.883461   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:36.892200  1159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:36.892620  1158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:36.896222  1161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:36.896312   431 server_base.cc:1061] running on GCE node
I20260709 12:58:36.896714  1155 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45365
I20260709 12:58:36.897202  1155 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:36.897691   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:36.898010   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:36.898034  1155 heartbeater.cc:507] Master 127.0.107.254:45365 requested a full tablet report, sending...
I20260709 12:58:36.898317   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601916898297 us; error 0 us; skew 500 ppm
I20260709 12:58:36.898972   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:36.900373   953 ts_manager.cc:194] Registered new tserver with Master: 61595b36500942c2995078f771f47d30 (127.0.107.194:42231)
I20260709 12:58:36.901685   431 webserver.cc:533] Webserver started at http://127.0.107.195:37719/ using document root <none> and password file <none>
I20260709 12:58:36.901919   953 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46848
I20260709 12:58:36.902303   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:36.902566   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:36.902882   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:36.904099   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-2-root/instance:
uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
format_stamp: "Formatted at 2026-07-09 12:58:36 on dist-test-slave-nr1f"
I20260709 12:58:36.908474   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:58:36.912083  1166 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:36.912883   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:58:36.913244   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-2-root
uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
format_stamp: "Formatted at 2026-07-09 12:58:36 on dist-test-slave-nr1f"
I20260709 12:58:36.913523   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601903731679-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:36.930437   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:36.931758   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:36.933243   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:36.935559   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:36.935807   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:36.936066   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:36.936247   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:36.974833   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:36615
I20260709 12:58:36.974926  1228 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:36615 every 8 connection(s)
I20260709 12:58:36.988404  1229 heartbeater.cc:344] Connected to a master server at 127.0.107.254:45365
I20260709 12:58:36.988801  1229 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:36.989523  1229 heartbeater.cc:507] Master 127.0.107.254:45365 requested a full tablet report, sending...
I20260709 12:58:36.991459   953 ts_manager.cc:194] Registered new tserver with Master: f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:36.992296   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014358791s
I20260709 12:58:36.992933   953 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46860
I20260709 12:58:37.017884   953 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46870:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:37.020848   953 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:37.095829  1119 tablet_service.cc:1511] Processing CreateTablet for tablet f3ce4dad1b144419ad69bd9bd2405d8a (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:37.096319  1118 tablet_service.cc:1511] Processing CreateTablet for tablet 3df455257c324ff390d443c9a248c963 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:37.097435  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ce4dad1b144419ad69bd9bd2405d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.098757  1120 tablet_service.cc:1511] Processing CreateTablet for tablet f60c40b307a140ce9d49c32c64620e53 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:37.100045  1120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f60c40b307a140ce9d49c32c64620e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.096319  1117 tablet_service.cc:1511] Processing CreateTablet for tablet dce01a46b5df4a2b996dfd754dedb6c3 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:37.105345  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce01a46b5df4a2b996dfd754dedb6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.110003  1045 tablet_service.cc:1511] Processing CreateTablet for tablet f60c40b307a140ce9d49c32c64620e53 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:37.111402  1045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f60c40b307a140ce9d49c32c64620e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.115233  1115 tablet_service.cc:1511] Processing CreateTablet for tablet 5d1b0ff806d9410196d41bdca6e0b39a (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:37.115724  1044 tablet_service.cc:1511] Processing CreateTablet for tablet f3ce4dad1b144419ad69bd9bd2405d8a (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:37.116609  1115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d1b0ff806d9410196d41bdca6e0b39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.117403  1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ce4dad1b144419ad69bd9bd2405d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.119462  1043 tablet_service.cc:1511] Processing CreateTablet for tablet 3df455257c324ff390d443c9a248c963 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:37.119958  1114 tablet_service.cc:1511] Processing CreateTablet for tablet ff57948d58634f6db9676cbcaafd3952 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:37.113897  1116 tablet_service.cc:1511] Processing CreateTablet for tablet eacd61673e2046a8b502edd6e3c096ce (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:37.121613  1244 tablet_bootstrap.cc:492] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30: Bootstrap starting.
I20260709 12:58:37.122069  1041 tablet_service.cc:1511] Processing CreateTablet for tablet eacd61673e2046a8b502edd6e3c096ce (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:37.122531  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff57948d58634f6db9676cbcaafd3952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.124168  1040 tablet_service.cc:1511] Processing CreateTablet for tablet 5d1b0ff806d9410196d41bdca6e0b39a (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:37.125977  1118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df455257c324ff390d443c9a248c963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.126629  1116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eacd61673e2046a8b502edd6e3c096ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.126757  1042 tablet_service.cc:1511] Processing CreateTablet for tablet dce01a46b5df4a2b996dfd754dedb6c3 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:37.128249  1244 tablet_bootstrap.cc:654] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.131856  1119 tablet_service.cc:1511] Processing CreateTablet for tablet 82aaec4518d141679ec9a860fa5512fc (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:37.132580  1113 tablet_service.cc:1511] Processing CreateTablet for tablet 1d89a21c0d7c4051ba60c3d034d288e8 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:37.133128  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aaec4518d141679ec9a860fa5512fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.133850  1113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d89a21c0d7c4051ba60c3d034d288e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.133634  1039 tablet_service.cc:1511] Processing CreateTablet for tablet ff57948d58634f6db9676cbcaafd3952 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:37.135759  1038 tablet_service.cc:1511] Processing CreateTablet for tablet 82aaec4518d141679ec9a860fa5512fc (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:37.138410  1037 tablet_service.cc:1511] Processing CreateTablet for tablet 1d89a21c0d7c4051ba60c3d034d288e8 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:37.139676  1112 tablet_service.cc:1511] Processing CreateTablet for tablet 224c37f9dea24f5da495a7a7231df9d8 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:37.140957  1112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 224c37f9dea24f5da495a7a7231df9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.141059  1036 tablet_service.cc:1511] Processing CreateTablet for tablet 224c37f9dea24f5da495a7a7231df9d8 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:37.149442  1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df455257c324ff390d443c9a248c963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.154351  1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d89a21c0d7c4051ba60c3d034d288e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.155659  1244 tablet_bootstrap.cc:492] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30: No bootstrap required, opened a new log
I20260709 12:58:37.156149  1244 ts_tablet_manager.cc:1403] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.005s
I20260709 12:58:37.158344  1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d1b0ff806d9410196d41bdca6e0b39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.159078  1244 raft_consensus.cc:359] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.160068  1244 raft_consensus.cc:385] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.160415  1244 raft_consensus.cc:740] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.161314  1244 consensus_queue.cc:260] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.167503  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce01a46b5df4a2b996dfd754dedb6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.169896  1155 heartbeater.cc:499] Master 127.0.107.254:45365 was elected leader, sending a full tablet report...
I20260709 12:58:37.170367  1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eacd61673e2046a8b502edd6e3c096ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.170991  1244 ts_tablet_manager.cc:1434] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 12:58:37.171921  1244 tablet_bootstrap.cc:492] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30: Bootstrap starting.
I20260709 12:58:37.174362  1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aaec4518d141679ec9a860fa5512fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.178368  1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 224c37f9dea24f5da495a7a7231df9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.182370  1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff57948d58634f6db9676cbcaafd3952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.178368  1244 tablet_bootstrap.cc:654] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.223210  1244 tablet_bootstrap.cc:492] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30: No bootstrap required, opened a new log
I20260709 12:58:37.223676  1244 ts_tablet_manager.cc:1403] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.002s
I20260709 12:58:37.227571  1244 raft_consensus.cc:359] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.229681  1244 raft_consensus.cc:385] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.230077  1244 raft_consensus.cc:740] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.230914  1244 consensus_queue.cc:260] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.238493  1244 ts_tablet_manager.cc:1434] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:58:37.239427  1244 tablet_bootstrap.cc:492] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30: Bootstrap starting.
I20260709 12:58:37.240774  1247 tablet_bootstrap.cc:492] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971: Bootstrap starting.
I20260709 12:58:37.241708  1194 tablet_service.cc:1511] Processing CreateTablet for tablet f60c40b307a140ce9d49c32c64620e53 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:37.243012  1194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f60c40b307a140ce9d49c32c64620e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.245543  1244 tablet_bootstrap.cc:654] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.247825  1247 tablet_bootstrap.cc:654] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.249884  1193 tablet_service.cc:1511] Processing CreateTablet for tablet f3ce4dad1b144419ad69bd9bd2405d8a (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:37.250385  1244 tablet_bootstrap.cc:492] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30: No bootstrap required, opened a new log
I20260709 12:58:37.250880  1244 ts_tablet_manager.cc:1403] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:58:37.251240  1193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ce4dad1b144419ad69bd9bd2405d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.252776  1185 tablet_service.cc:1511] Processing CreateTablet for tablet 224c37f9dea24f5da495a7a7231df9d8 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:37.254127  1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 224c37f9dea24f5da495a7a7231df9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.253898  1244 raft_consensus.cc:359] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.254704  1244 raft_consensus.cc:385] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.255007  1244 raft_consensus.cc:740] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.255297  1192 tablet_service.cc:1511] Processing CreateTablet for tablet 3df455257c324ff390d443c9a248c963 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:37.256770  1192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3df455257c324ff390d443c9a248c963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.259465  1191 tablet_service.cc:1511] Processing CreateTablet for tablet dce01a46b5df4a2b996dfd754dedb6c3 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:37.261274  1191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dce01a46b5df4a2b996dfd754dedb6c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.263655  1190 tablet_service.cc:1511] Processing CreateTablet for tablet eacd61673e2046a8b502edd6e3c096ce (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:37.265417  1190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eacd61673e2046a8b502edd6e3c096ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.267490  1189 tablet_service.cc:1511] Processing CreateTablet for tablet 5d1b0ff806d9410196d41bdca6e0b39a (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:37.269183  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d1b0ff806d9410196d41bdca6e0b39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.271468  1188 tablet_service.cc:1511] Processing CreateTablet for tablet ff57948d58634f6db9676cbcaafd3952 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:37.273116  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff57948d58634f6db9676cbcaafd3952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.275667  1187 tablet_service.cc:1511] Processing CreateTablet for tablet 82aaec4518d141679ec9a860fa5512fc (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:37.277334  1187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aaec4518d141679ec9a860fa5512fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.279757  1186 tablet_service.cc:1511] Processing CreateTablet for tablet 1d89a21c0d7c4051ba60c3d034d288e8 (DEFAULT_TABLE table=test-workload [id=65085f8202b84a488963b4ef21d39ffa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:37.281430  1186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d89a21c0d7c4051ba60c3d034d288e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:37.292575  1244 consensus_queue.cc:260] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.295043  1244 ts_tablet_manager.cc:1434] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.033s
I20260709 12:58:37.296072  1244 tablet_bootstrap.cc:492] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30: Bootstrap starting.
I20260709 12:58:37.317852  1246 raft_consensus.cc:493] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.318653  1246 raft_consensus.cc:515] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.322351  1244 tablet_bootstrap.cc:654] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.326272  1246 leader_election.cc:290] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.336102  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971" is_pre_election: true
W20260709 12:58:37.337787  1095 leader_election.cc:343] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.344045  1244 tablet_bootstrap.cc:492] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30: No bootstrap required, opened a new log
I20260709 12:58:37.344574  1244 ts_tablet_manager.cc:1403] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.016s
I20260709 12:58:37.347520  1244 raft_consensus.cc:359] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.348242  1244 raft_consensus.cc:385] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.348536  1244 raft_consensus.cc:740] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.349305  1244 consensus_queue.cc:260] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
W20260709 12:58:37.350641  1093 leader_election.cc:343] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Not found: Tablet not found: 82aaec4518d141679ec9a860fa5512fc
I20260709 12:58:37.351079  1093 leader_election.cc:304] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61595b36500942c2995078f771f47d30; no voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:37.351503  1244 ts_tablet_manager.cc:1434] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:37.352165  1246 raft_consensus.cc:2749] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:37.352792  1246 raft_consensus.cc:493] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.353248  1246 raft_consensus.cc:515] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.354235  1244 tablet_bootstrap.cc:492] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30: Bootstrap starting.
I20260709 12:58:37.356009  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971" is_pre_election: true
W20260709 12:58:37.357266  1095 leader_election.cc:343] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.357648  1246 leader_election.cc:290] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
W20260709 12:58:37.359879  1093 leader_election.cc:343] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Not found: Tablet not found: f3ce4dad1b144419ad69bd9bd2405d8a
I20260709 12:58:37.360311  1093 leader_election.cc:304] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61595b36500942c2995078f771f47d30; no voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:37.360929  1244 tablet_bootstrap.cc:654] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.361373  1246 raft_consensus.cc:2749] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:37.372575  1247 tablet_bootstrap.cc:492] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971: No bootstrap required, opened a new log
I20260709 12:58:37.373060  1247 ts_tablet_manager.cc:1403] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.000s
I20260709 12:58:37.375918  1247 raft_consensus.cc:359] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.376595  1247 raft_consensus.cc:385] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.376876  1247 raft_consensus.cc:740] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.379451  1244 tablet_bootstrap.cc:492] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30: No bootstrap required, opened a new log
I20260709 12:58:37.379315  1247 consensus_queue.cc:260] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.379922  1244 ts_tablet_manager.cc:1403] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 12:58:37.383563  1244 raft_consensus.cc:359] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.384316  1244 raft_consensus.cc:385] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.385406  1244 raft_consensus.cc:740] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.386407  1244 consensus_queue.cc:260] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.389469  1244 ts_tablet_manager.cc:1434] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:58:37.406137  1250 tablet_bootstrap.cc:492] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Bootstrap starting.
I20260709 12:58:37.416179  1250 tablet_bootstrap.cc:654] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.419852  1244 tablet_bootstrap.cc:492] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30: Bootstrap starting.
I20260709 12:58:37.432308  1244 tablet_bootstrap.cc:654] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.435143  1247 ts_tablet_manager.cc:1434] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971: Time spent starting tablet: real 0.062s	user 0.016s	sys 0.031s
I20260709 12:58:37.435535  1080 heartbeater.cc:499] Master 127.0.107.254:45365 was elected leader, sending a full tablet report...
I20260709 12:58:37.436067  1247 tablet_bootstrap.cc:492] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971: Bootstrap starting.
I20260709 12:58:37.436519  1250 tablet_bootstrap.cc:492] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80: No bootstrap required, opened a new log
I20260709 12:58:37.436981  1250 ts_tablet_manager.cc:1403] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.010s
I20260709 12:58:37.440267  1250 raft_consensus.cc:359] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.441064  1250 raft_consensus.cc:385] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.441443  1250 raft_consensus.cc:740] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.442446  1250 consensus_queue.cc:260] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.443084  1247 tablet_bootstrap.cc:654] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.452203  1250 ts_tablet_manager.cc:1434] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.007s
I20260709 12:58:37.453063  1229 heartbeater.cc:499] Master 127.0.107.254:45365 was elected leader, sending a full tablet report...
I20260709 12:58:37.460645  1250 tablet_bootstrap.cc:492] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Bootstrap starting.
I20260709 12:58:37.465531  1254 raft_consensus.cc:493] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.466104  1254 raft_consensus.cc:515] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.468575  1254 leader_election.cc:290] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.469094  1247 tablet_bootstrap.cc:492] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971: No bootstrap required, opened a new log
I20260709 12:58:37.469436  1250 tablet_bootstrap.cc:654] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.469595  1247 ts_tablet_manager.cc:1403] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.015s
I20260709 12:58:37.469843  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224c37f9dea24f5da495a7a7231df9d8" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971" is_pre_election: true
I20260709 12:58:37.471470  1244 tablet_bootstrap.cc:492] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30: No bootstrap required, opened a new log
I20260709 12:58:37.471733  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224c37f9dea24f5da495a7a7231df9d8" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:37.472085  1244 ts_tablet_manager.cc:1403] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.015s
I20260709 12:58:37.472772  1247 raft_consensus.cc:359] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
W20260709 12:58:37.473570  1093 leader_election.cc:343] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.473743  1247 raft_consensus.cc:385] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.474225  1247 raft_consensus.cc:740] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Initialized, Role: FOLLOWER
W20260709 12:58:37.474939  1095 leader_election.cc:343] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.475466  1095 leader_election.cc:304] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61595b36500942c2995078f771f47d30; no voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:37.475205  1247 consensus_queue.cc:260] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.476773  1254 raft_consensus.cc:2749] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:37.478152  1247 ts_tablet_manager.cc:1434] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 12:58:37.479362  1247 tablet_bootstrap.cc:492] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971: Bootstrap starting.
I20260709 12:58:37.476100  1244 raft_consensus.cc:359] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.481413  1244 raft_consensus.cc:385] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.481824  1244 raft_consensus.cc:740] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.482749  1244 consensus_queue.cc:260] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.486832  1244 ts_tablet_manager.cc:1434] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:58:37.488106  1247 tablet_bootstrap.cc:654] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.488487  1244 tablet_bootstrap.cc:492] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30: Bootstrap starting.
I20260709 12:58:37.491669  1250 tablet_bootstrap.cc:492] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80: No bootstrap required, opened a new log
I20260709 12:58:37.492293  1250 ts_tablet_manager.cc:1403] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.013s
I20260709 12:58:37.496471  1244 tablet_bootstrap.cc:654] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.496304  1250 raft_consensus.cc:359] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.497545  1250 raft_consensus.cc:385] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.497938  1250 raft_consensus.cc:740] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.499068  1250 consensus_queue.cc:260] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.502375  1250 ts_tablet_manager.cc:1434] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 12:58:37.503644  1250 tablet_bootstrap.cc:492] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80: Bootstrap starting.
I20260709 12:58:37.509256  1244 tablet_bootstrap.cc:492] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30: No bootstrap required, opened a new log
I20260709 12:58:37.510388  1244 ts_tablet_manager.cc:1403] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.015s
I20260709 12:58:37.515429  1250 tablet_bootstrap.cc:654] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.515079  1244 raft_consensus.cc:359] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.516150  1244 raft_consensus.cc:385] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.516539  1244 raft_consensus.cc:740] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.516999  1247 tablet_bootstrap.cc:492] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971: No bootstrap required, opened a new log
I20260709 12:58:37.517484  1247 ts_tablet_manager.cc:1403] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.016s
I20260709 12:58:37.517540  1244 consensus_queue.cc:260] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.520179  1244 ts_tablet_manager.cc:1434] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:37.521283  1244 tablet_bootstrap.cc:492] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30: Bootstrap starting.
I20260709 12:58:37.520902  1247 raft_consensus.cc:359] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.521777  1247 raft_consensus.cc:385] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.522186  1247 raft_consensus.cc:740] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.523092  1247 consensus_queue.cc:260] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.526276  1247 ts_tablet_manager.cc:1434] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:58:37.527503  1247 tablet_bootstrap.cc:492] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971: Bootstrap starting.
I20260709 12:58:37.529042  1244 tablet_bootstrap.cc:654] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.536125  1247 tablet_bootstrap.cc:654] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.547956  1256 raft_consensus.cc:493] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.548684  1256 raft_consensus.cc:515] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.549376  1247 tablet_bootstrap.cc:492] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971: No bootstrap required, opened a new log
I20260709 12:58:37.550062  1247 ts_tablet_manager.cc:1403] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 12:58:37.556144  1256 leader_election.cc:290] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.560556  1247 raft_consensus.cc:359] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.561612  1247 raft_consensus.cc:385] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.561991  1247 raft_consensus.cc:740] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.562935  1247 consensus_queue.cc:260] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.566897  1250 tablet_bootstrap.cc:492] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80: No bootstrap required, opened a new log
I20260709 12:58:37.567198  1247 ts_tablet_manager.cc:1434] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:58:37.567389  1250 ts_tablet_manager.cc:1403] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent bootstrapping tablet: real 0.064s	user 0.027s	sys 0.031s
I20260709 12:58:37.569069  1247 tablet_bootstrap.cc:492] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971: Bootstrap starting.
I20260709 12:58:37.572638  1250 raft_consensus.cc:359] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.576393  1256 raft_consensus.cc:493] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.576861  1256 raft_consensus.cc:515] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.578794  1256 leader_election.cc:290] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.580413  1250 raft_consensus.cc:385] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.580857  1250 raft_consensus.cc:740] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.581815  1250 consensus_queue.cc:260] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.588392  1244 tablet_bootstrap.cc:492] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30: No bootstrap required, opened a new log
I20260709 12:58:37.588904  1244 ts_tablet_manager.cc:1403] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30: Time spent bootstrapping tablet: real 0.068s	user 0.032s	sys 0.028s
I20260709 12:58:37.589622  1250 ts_tablet_manager.cc:1434] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:58:37.590638  1250 tablet_bootstrap.cc:492] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80: Bootstrap starting.
I20260709 12:58:37.591764  1244 raft_consensus.cc:359] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.594396  1244 raft_consensus.cc:385] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.594726  1244 raft_consensus.cc:740] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.595546  1244 consensus_queue.cc:260] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.585438  1247 tablet_bootstrap.cc:654] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.598542  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:37.599255  1129 raft_consensus.cc:2468] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 0.
I20260709 12:58:37.600216  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df455257c324ff390d443c9a248c963" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:37.601176  1018 leader_election.cc:304] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:37.602308  1256 raft_consensus.cc:2804] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.602751  1256 raft_consensus.cc:493] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.603192  1256 raft_consensus.cc:3060] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.604013  1244 ts_tablet_manager.cc:1434] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:58:37.604990  1244 tablet_bootstrap.cc:492] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30: Bootstrap starting.
I20260709 12:58:37.610999  1244 tablet_bootstrap.cc:654] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:37.613049  1001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:58:37.618245  1018 leader_election.cc:343] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61595b36500942c2995078f771f47d30 (127.0.107.194:42231): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.618728  1247 tablet_bootstrap.cc:492] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971: No bootstrap required, opened a new log
I20260709 12:58:37.619208  1247 ts_tablet_manager.cc:1403] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.020s
I20260709 12:58:37.618392  1256 raft_consensus.cc:515] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.619606  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df455257c324ff390d443c9a248c963" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:37.621591  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:37.621522  1256 leader_election.cc:290] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.622131  1247 raft_consensus.cc:359] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.622835  1247 raft_consensus.cc:385] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.623131  1247 raft_consensus.cc:740] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.623299  1244 tablet_bootstrap.cc:492] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30: No bootstrap required, opened a new log
I20260709 12:58:37.623900  1244 ts_tablet_manager.cc:1403] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:58:37.623869  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:37.623819  1247 consensus_queue.cc:260] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.624498  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:37.624650  1130 raft_consensus.cc:3060] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.626125  1247 ts_tablet_manager.cc:1434] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:58:37.627025  1247 tablet_bootstrap.cc:492] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971: Bootstrap starting.
I20260709 12:58:37.626911  1244 raft_consensus.cc:359] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.627694  1244 raft_consensus.cc:385] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.628028  1244 raft_consensus.cc:740] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Initialized, Role: FOLLOWER
W20260709 12:58:37.625814  1018 leader_election.cc:343] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.629225  1018 leader_election.cc:304] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef47514919a2475ba9284a0131e88971; no voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:37.631385  1250 tablet_bootstrap.cc:654] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.631801  1256 raft_consensus.cc:2749] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:37.633297  1244 consensus_queue.cc:260] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.635536  1244 ts_tablet_manager.cc:1434] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:58:37.636410  1244 tablet_bootstrap.cc:492] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30: Bootstrap starting.
I20260709 12:58:37.637704  1247 tablet_bootstrap.cc:654] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.645334  1250 tablet_bootstrap.cc:492] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80: No bootstrap required, opened a new log
W20260709 12:58:37.645220  1018 leader_election.cc:343] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.645726  1130 raft_consensus.cc:2468] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 1.
I20260709 12:58:37.646145  1244 tablet_bootstrap.cc:654] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:37.646281  1018 leader_election.cc:343] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.650372  1018 leader_election.cc:304] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:37.645831  1250 ts_tablet_manager.cc:1403] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.002s
I20260709 12:58:37.651226  1271 raft_consensus.cc:2804] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.651754  1271 raft_consensus.cc:697] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:37.652552  1271 consensus_queue.cc:237] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.654554  1250 raft_consensus.cc:359] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.655273  1250 raft_consensus.cc:385] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.655560  1250 raft_consensus.cc:740] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.656605  1247 tablet_bootstrap.cc:492] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971: No bootstrap required, opened a new log
I20260709 12:58:37.656430  1250 consensus_queue.cc:260] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.657459  1247 ts_tablet_manager.cc:1403] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.013s
I20260709 12:58:37.658957  1250 ts_tablet_manager.cc:1434] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:37.660346  1250 tablet_bootstrap.cc:492] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Bootstrap starting.
I20260709 12:58:37.662009  1247 raft_consensus.cc:359] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.663691  1247 raft_consensus.cc:385] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.664047  1247 raft_consensus.cc:740] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.664332  1254 raft_consensus.cc:493] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.664793  1254 raft_consensus.cc:515] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.666664  1244 tablet_bootstrap.cc:492] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30: No bootstrap required, opened a new log
I20260709 12:58:37.667902  1244 ts_tablet_manager.cc:1403] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.006s
I20260709 12:58:37.667752  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f60c40b307a140ce9d49c32c64620e53" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971" is_pre_election: true
I20260709 12:58:37.668125  1250 tablet_bootstrap.cc:654] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.667138  1254 leader_election.cc:290] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.664796  1247 consensus_queue.cc:260] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
W20260709 12:58:37.669219  1095 leader_election.cc:343] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.670284  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f60c40b307a140ce9d49c32c64620e53" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:37.670936  1204 raft_consensus.cc:2468] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 0.
I20260709 12:58:37.671443  1247 ts_tablet_manager.cc:1434] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:58:37.671075  1244 raft_consensus.cc:359] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.672011  1244 raft_consensus.cc:385] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.672454  1247 tablet_bootstrap.cc:492] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971: Bootstrap starting.
I20260709 12:58:37.672281  1093 leader_election.cc:304] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: ef47514919a2475ba9284a0131e88971
I20260709 12:58:37.672376  1244 raft_consensus.cc:740] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.673627  1244 consensus_queue.cc:260] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.674222  1254 raft_consensus.cc:2804] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.674636  1254 raft_consensus.cc:493] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.675089  1254 raft_consensus.cc:3060] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.679608  1244 ts_tablet_manager.cc:1434] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:58:37.680047  1247 tablet_bootstrap.cc:654] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.689495  1254 raft_consensus.cc:515] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.692669  1254 leader_election.cc:290] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.694700  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f60c40b307a140ce9d49c32c64620e53" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:37.696231  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f60c40b307a140ce9d49c32c64620e53" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:37.696974  1204 raft_consensus.cc:3060] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.698273   953 catalog_manager.cc:5697] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:37.700515  1095 leader_election.cc:343] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.702682  1259 raft_consensus.cc:493] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.703303  1259 raft_consensus.cc:515] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.706569  1247 tablet_bootstrap.cc:492] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971: No bootstrap required, opened a new log
I20260709 12:58:37.707281  1247 ts_tablet_manager.cc:1403] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.013s
I20260709 12:58:37.708694  1204 raft_consensus.cc:2468] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 1.
I20260709 12:58:37.710544  1093 leader_election.cc:304] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: ef47514919a2475ba9284a0131e88971
I20260709 12:58:37.711354  1250 tablet_bootstrap.cc:492] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80: No bootstrap required, opened a new log
I20260709 12:58:37.712142  1250 ts_tablet_manager.cc:1403] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.019s
I20260709 12:58:37.711316  1247 raft_consensus.cc:359] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.712697  1247 raft_consensus.cc:385] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.713152  1247 raft_consensus.cc:740] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.714529  1247 consensus_queue.cc:260] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.717859  1247 ts_tablet_manager.cc:1434] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:58:37.715883  1254 raft_consensus.cc:2804] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.718858  1254 raft_consensus.cc:697] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 1 LEADER]: Becoming Leader. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:37.719797  1259 leader_election.cc:290] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), 61595b36500942c2995078f771f47d30 (127.0.107.194:42231)
I20260709 12:58:37.720954  1247 tablet_bootstrap.cc:492] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971: Bootstrap starting.
I20260709 12:58:37.721279  1259 raft_consensus.cc:493] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.721968  1250 raft_consensus.cc:359] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.722939  1250 raft_consensus.cc:385] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.723291  1250 raft_consensus.cc:740] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.719826  1254 consensus_queue.cc:237] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.724016  1250 consensus_queue.cc:260] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.721871  1259 raft_consensus.cc:515] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.728818  1259 leader_election.cc:290] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), 61595b36500942c2995078f771f47d30 (127.0.107.194:42231)
I20260709 12:58:37.729346  1271 raft_consensus.cc:493] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.729912  1271 raft_consensus.cc:515] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.731128  1247 tablet_bootstrap.cc:654] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.732244  1271 leader_election.cc:290] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.732718  1250 ts_tablet_manager.cc:1434] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:58:37.733810  1250 tablet_bootstrap.cc:492] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Bootstrap starting.
I20260709 12:58:37.734926  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d89a21c0d7c4051ba60c3d034d288e8" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:37.735798  1130 raft_consensus.cc:2468] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 0.
I20260709 12:58:37.737682  1018 leader_election.cc:304] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:37.740401  1271 raft_consensus.cc:2804] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.741042  1271 raft_consensus.cc:493] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.741580  1271 raft_consensus.cc:3060] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.742930  1250 tablet_bootstrap.cc:654] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.752835  1271 raft_consensus.cc:515] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.754703  1250 tablet_bootstrap.cc:492] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80: No bootstrap required, opened a new log
I20260709 12:58:37.759061  1250 ts_tablet_manager.cc:1403] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.009s
I20260709 12:58:37.760282  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d89a21c0d7c4051ba60c3d034d288e8" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:37.760933  1204 raft_consensus.cc:2468] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 0.
I20260709 12:58:37.763664  1250 raft_consensus.cc:359] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.768026  1250 raft_consensus.cc:385] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.769097  1250 raft_consensus.cc:740] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.770793  1250 consensus_queue.cc:260] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.767410  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d89a21c0d7c4051ba60c3d034d288e8" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:37.773934  1130 raft_consensus.cc:3060] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.774709  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224c37f9dea24f5da495a7a7231df9d8" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971" is_pre_election: true
I20260709 12:58:37.776235  1250 ts_tablet_manager.cc:1434] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.005s
I20260709 12:58:37.776500  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971" is_pre_election: true
I20260709 12:58:37.777112  1055 raft_consensus.cc:2468] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 0.
I20260709 12:58:37.777927  1250 tablet_bootstrap.cc:492] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Bootstrap starting.
I20260709 12:58:37.758737   952 catalog_manager.cc:5697] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61595b36500942c2995078f771f47d30 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "61595b36500942c2995078f771f47d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:37.766894  1271 leader_election.cc:290] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.772600  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d89a21c0d7c4051ba60c3d034d288e8" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:37.780637  1204 raft_consensus.cc:3060] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.783205  1130 raft_consensus.cc:2468] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 1.
I20260709 12:58:37.787820  1018 leader_election.cc:304] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:37.788122  1250 tablet_bootstrap.cc:654] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.788676  1271 raft_consensus.cc:2804] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:58:37.789064  1169 leader_election.cc:343] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.789273  1271 raft_consensus.cc:697] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:37.790313  1271 consensus_queue.cc:237] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.790050  1169 leader_election.cc:304] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:37.792943  1204 raft_consensus.cc:2468] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 1.
I20260709 12:58:37.794144  1281 raft_consensus.cc:2804] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.794504  1281 raft_consensus.cc:493] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.794857  1281 raft_consensus.cc:3060] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.797943  1247 tablet_bootstrap.cc:492] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971: No bootstrap required, opened a new log
I20260709 12:58:37.799062  1247 ts_tablet_manager.cc:1403] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.042s
I20260709 12:58:37.803683  1247 raft_consensus.cc:359] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.809211  1247 raft_consensus.cc:385] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:37.810328  1247 raft_consensus.cc:740] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Initialized, Role: FOLLOWER
I20260709 12:58:37.812170  1247 consensus_queue.cc:260] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.813335  1254 raft_consensus.cc:493] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.815209  1254 raft_consensus.cc:515] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.817902  1247 ts_tablet_manager.cc:1434] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:58:37.819998  1254 leader_election.cc:290] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.821386  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df455257c324ff390d443c9a248c963" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971" is_pre_election: true
I20260709 12:58:37.822290  1055 raft_consensus.cc:2468] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 0.
I20260709 12:58:37.823199  1247 tablet_bootstrap.cc:492] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971: Bootstrap starting.
I20260709 12:58:37.823994  1095 leader_election.cc:304] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:37.825107  1246 raft_consensus.cc:493] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.825711  1246 raft_consensus.cc:515] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.828382  1246 leader_election.cc:290] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.829027  1246 raft_consensus.cc:2804] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.829434  1246 raft_consensus.cc:493] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.831749  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
W20260709 12:58:37.833621  1093 leader_election.cc:343] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.835556  1256 raft_consensus.cc:493] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.836172  1256 raft_consensus.cc:515] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.839478  1256 leader_election.cc:290] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.840574  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971" is_pre_election: true
I20260709 12:58:37.841420  1055 raft_consensus.cc:2468] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 0.
I20260709 12:58:37.829849  1246 raft_consensus.cc:3060] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.845093  1247 tablet_bootstrap.cc:654] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:37.847375  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:37.847749  1095 leader_election.cc:304] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:37.848018  1130 raft_consensus.cc:2468] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 0.
I20260709 12:58:37.849396  1018 leader_election.cc:304] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:37.850922  1254 raft_consensus.cc:2804] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.851421  1254 raft_consensus.cc:493] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.851846  1254 raft_consensus.cc:3060] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.854259  1256 raft_consensus.cc:2804] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:37.854801  1256 raft_consensus.cc:493] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:37.855234  1256 raft_consensus.cc:3060] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.870584  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df455257c324ff390d443c9a248c963" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:37.871472  1204 raft_consensus.cc:2468] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 0.
I20260709 12:58:37.809824  1281 raft_consensus.cc:515] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.889138  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:37.889757  1055 raft_consensus.cc:3060] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:37.891672  1254 raft_consensus.cc:515] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.894753  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:37.896224  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:37.896689  1055 raft_consensus.cc:2468] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 1.
W20260709 12:58:37.897485  1018 leader_election.cc:343] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.899531  1169 leader_election.cc:304] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:37.900594  1289 raft_consensus.cc:493] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.903421  1289 raft_consensus.cc:515] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.909287  1256 raft_consensus.cc:515] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.910076  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f60c40b307a140ce9d49c32c64620e53" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:37.912358  1246 raft_consensus.cc:515] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.914295  1259 raft_consensus.cc:2804] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:37.916177  1289 leader_election.cc:290] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.918689  1289 raft_consensus.cc:493] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.920377  1289 raft_consensus.cc:515] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.950042  1291 raft_consensus.cc:493] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.950826  1291 raft_consensus.cc:515] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.960455  1289 leader_election.cc:290] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.957175  1259 raft_consensus.cc:697] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 LEADER]: Becoming Leader. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Running, Role: LEADER
I20260709 12:58:37.976872  1054 raft_consensus.cc:2393] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61595b36500942c2995078f771f47d30 in current term 1: Already voted for candidate ef47514919a2475ba9284a0131e88971 in this term.
I20260709 12:58:37.976765  1259 consensus_queue.cc:237] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:37.966063  1281 leader_election.cc:290] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), 61595b36500942c2995078f771f47d30 (127.0.107.194:42231)
I20260709 12:58:37.984658  1254 leader_election.cc:290] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.987250  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f60c40b307a140ce9d49c32c64620e53" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:37.990190  1254 raft_consensus.cc:493] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.990581  1204 raft_consensus.cc:2393] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef47514919a2475ba9284a0131e88971 in current term 1: Already voted for candidate 61595b36500942c2995078f771f47d30 in this term.
I20260709 12:58:37.990329  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:37.990794  1254 raft_consensus.cc:515] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
W20260709 12:58:37.991743  1093 leader_election.cc:343] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:37.992230  1093 leader_election.cc:304] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61595b36500942c2995078f771f47d30; no voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:37.992699  1256 leader_election.cc:290] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.993498  1250 tablet_bootstrap.cc:492] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80: No bootstrap required, opened a new log
I20260709 12:58:37.993645  1254 leader_election.cc:290] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.993526  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:37.994236  1250 ts_tablet_manager.cc:1403] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent bootstrapping tablet: real 0.217s	user 0.078s	sys 0.112s
I20260709 12:58:37.994498  1130 raft_consensus.cc:2468] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 0.
I20260709 12:58:37.994843  1246 leader_election.cc:290] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:37.996677  1018 leader_election.cc:304] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:37.998916  1294 raft_consensus.cc:2749] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:37.999905  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971" is_pre_election: true
I20260709 12:58:38.001384  1256 raft_consensus.cc:2804] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.003794  1256 raft_consensus.cc:493] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.004199  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:38.005131  1130 raft_consensus.cc:2393] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ef47514919a2475ba9284a0131e88971 in current term 1: Already voted for candidate 61595b36500942c2995078f771f47d30 in this term.
I20260709 12:58:38.004926  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:38.005266  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:38.006006  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df455257c324ff390d443c9a248c963" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:38.006165  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:38.006546  1055 raft_consensus.cc:3060] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.007658  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df455257c324ff390d443c9a248c963" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:38.008260  1203 raft_consensus.cc:3060] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.009272  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971" is_pre_election: true
I20260709 12:58:38.009420  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:38.010357  1247 tablet_bootstrap.cc:492] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971: No bootstrap required, opened a new log
I20260709 12:58:38.010946  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:38.010185  1128 raft_consensus.cc:3060] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.011297  1018 leader_election.cc:304] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef47514919a2475ba9284a0131e88971; no voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:38.012177  1247 ts_tablet_manager.cc:1403] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971: Time spent bootstrapping tablet: real 0.191s	user 0.031s	sys 0.042s
I20260709 12:58:38.004220  1256 raft_consensus.cc:3060] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.000905  1250 raft_consensus.cc:359] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.015285  1250 raft_consensus.cc:385] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.016022  1250 raft_consensus.cc:740] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Initialized, Role: FOLLOWER
W20260709 12:58:38.011104  1095 leader_election.cc:343] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.016970  1250 consensus_queue.cc:260] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
W20260709 12:58:38.017695  1093 leader_election.cc:343] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.017961  1247 raft_consensus.cc:359] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.018421  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224c37f9dea24f5da495a7a7231df9d8" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:38.018770  1247 raft_consensus.cc:385] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.019186  1247 raft_consensus.cc:740] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.019140  1130 raft_consensus.cc:2468] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 0.
I20260709 12:58:38.019944  1250 ts_tablet_manager.cc:1434] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 12:58:38.020634  1247 consensus_queue.cc:260] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.021068  1250 tablet_bootstrap.cc:492] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Bootstrap starting.
I20260709 12:58:38.022985  1247 ts_tablet_manager.cc:1434] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:58:38.023905  1247 tablet_bootstrap.cc:492] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971: Bootstrap starting.
I20260709 12:58:38.026237  1291 leader_election.cc:290] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), 61595b36500942c2995078f771f47d30 (127.0.107.194:42231)
I20260709 12:58:38.028292  1289 raft_consensus.cc:3060] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.029744  1295 raft_consensus.cc:493] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.032127  1256 raft_consensus.cc:515] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.033183  1250 tablet_bootstrap.cc:654] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.037982  1256 leader_election.cc:290] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:38.039098  1289 raft_consensus.cc:2749] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:38.040166  1018 leader_election.cc:343] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.040050   951 catalog_manager.cc:5697] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:38.041145  1018 leader_election.cc:343] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.020030  1093 leader_election.cc:304] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61595b36500942c2995078f771f47d30; no voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:38.042748  1294 raft_consensus.cc:2749] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.042812  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:38.043497  1130 raft_consensus.cc:3060] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.044186  1167 leader_election.cc:304] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: ef47514919a2475ba9284a0131e88971
I20260709 12:58:38.045714  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:38.045900  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:38.046619  1129 raft_consensus.cc:2393] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in current term 1: Already voted for candidate ef47514919a2475ba9284a0131e88971 in this term.
I20260709 12:58:38.047022  1291 raft_consensus.cc:2804] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.047228  1128 raft_consensus.cc:2468] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 1.
I20260709 12:58:38.047384  1291 raft_consensus.cc:493] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.047780  1291 raft_consensus.cc:3060] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.051172  1055 raft_consensus.cc:2468] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 1.
I20260709 12:58:38.058377  1167 leader_election.cc:304] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971
I20260709 12:58:38.059122  1018 leader_election.cc:304] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef47514919a2475ba9284a0131e88971; no voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:38.060755  1289 raft_consensus.cc:2749] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.054829   953 catalog_manager.cc:5697] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.061249  1095 leader_election.cc:304] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:38.061570  1259 raft_consensus.cc:3060] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.059177  1256 raft_consensus.cc:493] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.062139  1294 raft_consensus.cc:2804] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.062664  1294 raft_consensus.cc:697] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 1 LEADER]: Becoming Leader. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:38.062350  1256 raft_consensus.cc:515] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.063855  1294 consensus_queue.cc:237] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.057744  1291 raft_consensus.cc:515] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.065212  1256 leader_election.cc:290] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:38.053864  1130 raft_consensus.cc:2468] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 1.
W20260709 12:58:38.069738  1018 leader_election.cc:343] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:38.071147  1259 raft_consensus.cc:2749] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.071732  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:38.072865  1204 raft_consensus.cc:2468] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 0.
I20260709 12:58:38.072981  1018 leader_election.cc:304] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:38.074177  1291 leader_election.cc:290] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), 61595b36500942c2995078f771f47d30 (127.0.107.194:42231)
I20260709 12:58:38.071759  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:38.076376  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224c37f9dea24f5da495a7a7231df9d8" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:38.076874  1018 leader_election.cc:304] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:38.078483  1256 raft_consensus.cc:2804] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.079144  1128 raft_consensus.cc:3060] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.082227  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "224c37f9dea24f5da495a7a7231df9d8" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:38.082841  1055 raft_consensus.cc:3060] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.086164  1256 raft_consensus.cc:697] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:38.086807  1290 raft_consensus.cc:2804] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.088351  1290 raft_consensus.cc:493] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.088678  1290 raft_consensus.cc:3060] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.092784  1247 tablet_bootstrap.cc:654] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.092937  1128 raft_consensus.cc:2468] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 1.
I20260709 12:58:38.094396  1167 leader_election.cc:304] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:38.095551  1291 raft_consensus.cc:2804] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.096392  1291 raft_consensus.cc:697] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 LEADER]: Becoming Leader. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Running, Role: LEADER
I20260709 12:58:38.039623  1295 raft_consensus.cc:515] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.097481  1291 consensus_queue.cc:237] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.086333  1289 consensus_queue.cc:1048] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:58:38.098306  1055 raft_consensus.cc:2468] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 1.
I20260709 12:58:38.098466  1290 raft_consensus.cc:515] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.106119  1256 consensus_queue.cc:237] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.104952  1130 raft_consensus.cc:2468] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 0.
I20260709 12:58:38.111150   952 catalog_manager.cc:5697] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61595b36500942c2995078f771f47d30 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "61595b36500942c2995078f771f47d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.124620  1203 raft_consensus.cc:2468] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 1.
I20260709 12:58:38.125176  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971" is_pre_election: true
I20260709 12:58:38.125247  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:38.126046  1055 raft_consensus.cc:2393] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61595b36500942c2995078f771f47d30 in current term 1: Already voted for candidate ef47514919a2475ba9284a0131e88971 in this term.
I20260709 12:58:38.126142  1204 raft_consensus.cc:2468] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 0.
I20260709 12:58:38.127422  1290 leader_election.cc:290] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:38.127934  1295 leader_election.cc:290] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:38.128696  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:38.129491  1128 raft_consensus.cc:3060] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.130926  1093 leader_election.cc:304] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: ef47514919a2475ba9284a0131e88971
I20260709 12:58:38.136633  1250 tablet_bootstrap.cc:492] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80: No bootstrap required, opened a new log
I20260709 12:58:38.137066  1250 ts_tablet_manager.cc:1403] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent bootstrapping tablet: real 0.116s	user 0.026s	sys 0.002s
I20260709 12:58:38.138345  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:38.138880  1204 raft_consensus.cc:3060] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.139575  1250 raft_consensus.cc:359] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.140213  1250 raft_consensus.cc:385] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.140489  1250 raft_consensus.cc:740] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.141268  1250 consensus_queue.cc:260] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.143406  1250 ts_tablet_manager.cc:1434] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:58:38.142324   951 catalog_manager.cc:5697] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.144325  1250 tablet_bootstrap.cc:492] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80: Bootstrap starting.
I20260709 12:58:38.149889  1250 tablet_bootstrap.cc:654] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.156610  1247 tablet_bootstrap.cc:492] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971: No bootstrap required, opened a new log
I20260709 12:58:38.156901  1250 tablet_bootstrap.cc:492] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80: No bootstrap required, opened a new log
I20260709 12:58:38.157063  1247 ts_tablet_manager.cc:1403] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971: Time spent bootstrapping tablet: real 0.133s	user 0.014s	sys 0.003s
I20260709 12:58:38.157301  1250 ts_tablet_manager.cc:1403] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:58:38.159678  1247 raft_consensus.cc:359] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.159801  1250 raft_consensus.cc:359] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.160379  1247 raft_consensus.cc:385] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.160490  1250 raft_consensus.cc:385] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.160825  1250 raft_consensus.cc:740] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.161001  1128 raft_consensus.cc:2468] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 1.
I20260709 12:58:38.161468  1295 raft_consensus.cc:2764] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:58:38.161669  1250 consensus_queue.cc:260] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.162938  1256 consensus_queue.cc:1048] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:38.164202  1250 ts_tablet_manager.cc:1434] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:38.164561  1018 leader_election.cc:304] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:38.165154  1250 tablet_bootstrap.cc:492] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80: Bootstrap starting.
I20260709 12:58:38.166085  1256 raft_consensus.cc:2804] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.166719  1256 raft_consensus.cc:697] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:38.167507  1256 consensus_queue.cc:237] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.172125  1250 tablet_bootstrap.cc:654] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:38.149818  1204 raft_consensus.cc:2468] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 1.
I20260709 12:58:38.173055   953 catalog_manager.cc:5697] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 reported cstate change: term changed from 0 to 1, leader changed from <none> to f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:38.160684  1247 raft_consensus.cc:740] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.181713  1247 consensus_queue.cc:260] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.184705  1247 ts_tablet_manager.cc:1434] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:58:38.185120   951 catalog_manager.cc:5697] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.207327  1250 tablet_bootstrap.cc:492] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80: No bootstrap required, opened a new log
I20260709 12:58:38.207971  1250 ts_tablet_manager.cc:1403] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.014s
I20260709 12:58:38.212976  1250 raft_consensus.cc:359] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.213692  1250 raft_consensus.cc:385] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:38.213961  1250 raft_consensus.cc:740] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Initialized, Role: FOLLOWER
I20260709 12:58:38.214686  1250 consensus_queue.cc:260] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.216883  1250 ts_tablet_manager.cc:1434] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:58:38.232621  1289 raft_consensus.cc:493] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.233139  1289 raft_consensus.cc:515] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.234907  1289 leader_election.cc:290] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:38.235723  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:38.235971  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:38.236270  1130 raft_consensus.cc:2468] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 0.
I20260709 12:58:38.236527  1203 raft_consensus.cc:2468] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 0.
I20260709 12:58:38.237239  1018 leader_election.cc:304] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:38.237965  1289 raft_consensus.cc:2804] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:38.238336  1289 raft_consensus.cc:493] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.238636  1289 raft_consensus.cc:3060] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.243192  1289 raft_consensus.cc:515] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.244894  1289 leader_election.cc:290] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:38.245637  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:38.245980  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:38.246295  1130 raft_consensus.cc:3060] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.246541  1203 raft_consensus.cc:3060] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.253041  1203 raft_consensus.cc:2468] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 1.
I20260709 12:58:38.253036  1130 raft_consensus.cc:2468] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 1.
I20260709 12:58:38.254326  1018 leader_election.cc:304] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:38.255038  1289 raft_consensus.cc:2804] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:38.255548  1289 raft_consensus.cc:697] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:38.256158  1289 consensus_queue.cc:237] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.263669   953 catalog_manager.cc:5697] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:38.284363  1295 consensus_queue.cc:1048] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.288029  1295 consensus_queue.cc:1048] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.300879  1289 consensus_queue.cc:1048] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:38.315282  1256 consensus_queue.cc:1048] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.460919  1254 consensus_queue.cc:1048] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.470984  1294 consensus_queue.cc:1048] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.506687  1291 consensus_queue.cc:1048] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.517445  1291 consensus_queue.cc:1048] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.527251  1291 consensus_queue.cc:1048] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.537251  1259 consensus_queue.cc:1048] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.608994  1256 consensus_queue.cc:1048] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.611152  1259 raft_consensus.cc:493] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.611797  1259 raft_consensus.cc:515] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:38.614631  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef47514919a2475ba9284a0131e88971" is_pre_election: true
I20260709 12:58:38.615458  1054 raft_consensus.cc:2393] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in current term 1: Already voted for candidate ef47514919a2475ba9284a0131e88971 in this term.
I20260709 12:58:38.617280  1204 raft_consensus.cc:3060] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:38.622058  1001 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:38.624017  1259 leader_election.cc:290] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), 61595b36500942c2995078f771f47d30 (127.0.107.194:42231)
I20260709 12:58:38.624740  1290 consensus_queue.cc:1048] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.624989  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:38.625701  1130 raft_consensus.cc:2393] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in current term 1: Already voted for candidate 61595b36500942c2995078f771f47d30 in this term.
I20260709 12:58:38.626890  1167 leader_election.cc:304] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971
I20260709 12:58:38.628245  1259 raft_consensus.cc:3060] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:38.630622  1290 consensus_queue.cc:1048] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.634788  1259 raft_consensus.cc:2749] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:38.642393  1271 consensus_queue.cc:1048] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.725621  1271 consensus_queue.cc:1048] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:38.735972  1289 consensus_queue.cc:1048] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:39.578832  1289 raft_consensus.cc:493] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.579316  1289 raft_consensus.cc:515] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.580935  1289 leader_election.cc:290] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:39.581799  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30" is_pre_election: true
I20260709 12:58:39.582216  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" is_pre_election: true
I20260709 12:58:39.582479  1130 raft_consensus.cc:2468] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 1.
I20260709 12:58:39.582798  1204 raft_consensus.cc:2468] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 1.
I20260709 12:58:39.583606  1018 leader_election.cc:304] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:39.584233  1289 raft_consensus.cc:2804] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:39.584556  1289 raft_consensus.cc:493] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.584822  1289 raft_consensus.cc:3060] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.589298  1289 raft_consensus.cc:515] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.590919  1289 leader_election.cc:290] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 2 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:39.591869  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:39.592121  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:39.592392  1130 raft_consensus.cc:3060] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.592651  1204 raft_consensus.cc:3060] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.597985  1130 raft_consensus.cc:2468] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 2.
I20260709 12:58:39.598151  1204 raft_consensus.cc:2468] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 2.
I20260709 12:58:39.599188  1018 leader_election.cc:304] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:39.599793  1289 raft_consensus.cc:2804] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:39.600229  1289 raft_consensus.cc:697] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:39.601014  1289 consensus_queue.cc:237] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.607650   953 catalog_manager.cc:5697] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 0 to 2, leader changed from <none> to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.811729  1130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f60c40b307a140ce9d49c32c64620e53"
dest_uuid: "61595b36500942c2995078f771f47d30"
mode: GRACEFUL
new_leader_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:44284
I20260709 12:58:39.812288  1130 raft_consensus.cc:606] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 1 LEADER]: Received request to transfer leadership to TS ef47514919a2475ba9284a0131e88971
I20260709 12:58:39.828334  1204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a"
dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
mode: GRACEFUL
new_leader_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:51772
I20260709 12:58:39.828960  1204 raft_consensus.cc:606] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 LEADER]: Received request to transfer leadership to TS ef47514919a2475ba9284a0131e88971
I20260709 12:58:39.833927  1130 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3df455257c324ff390d443c9a248c963"
dest_uuid: "61595b36500942c2995078f771f47d30"
mode: GRACEFUL
new_leader_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:44284
I20260709 12:58:39.834519  1130 raft_consensus.cc:606] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 1 LEADER]: Received request to transfer leadership to TS ef47514919a2475ba9284a0131e88971
I20260709 12:58:39.846400  1336 raft_consensus.cc:993] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30: : Instructing follower ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:39.846897  1254 raft_consensus.cc:1081] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 1 LEADER]: Signalling peer ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:39.848547  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f60c40b307a140ce9d49c32c64620e53"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:37466
I20260709 12:58:39.849028  1054 raft_consensus.cc:493] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:39.849406  1054 raft_consensus.cc:3060] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.854477  1055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
mode: GRACEFUL
new_leader_uuid: "61595b36500942c2995078f771f47d30"
 from {username='slave'} at 127.0.0.1:37490
I20260709 12:58:39.854766  1054 raft_consensus.cc:515] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.855114  1055 raft_consensus.cc:606] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Received request to transfer leadership to TS 61595b36500942c2995078f771f47d30
I20260709 12:58:39.856734  1054 leader_election.cc:290] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 2 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:39.857734  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f60c40b307a140ce9d49c32c64620e53" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:39.857829  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f60c40b307a140ce9d49c32c64620e53" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:39.858349  1130 raft_consensus.cc:3055] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:39.858402  1204 raft_consensus.cc:3060] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.858755  1130 raft_consensus.cc:740] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:39.859529  1130 consensus_queue.cc:260] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.860615  1130 raft_consensus.cc:3060] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.861140  1054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
mode: GRACEFUL
new_leader_uuid: "61595b36500942c2995078f771f47d30"
 from {username='slave'} at 127.0.0.1:37490
I20260709 12:58:39.861701  1054 raft_consensus.cc:606] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Received request to transfer leadership to TS 61595b36500942c2995078f771f47d30
I20260709 12:58:39.864693  1204 raft_consensus.cc:2468] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 2.
I20260709 12:58:39.866605  1018 leader_election.cc:304] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:39.867316  1289 raft_consensus.cc:2804] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:39.867573  1055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
mode: GRACEFUL
new_leader_uuid: "61595b36500942c2995078f771f47d30"
 from {username='slave'} at 127.0.0.1:37490
I20260709 12:58:39.867830  1289 raft_consensus.cc:697] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:39.868230  1055 raft_consensus.cc:606] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Received request to transfer leadership to TS 61595b36500942c2995078f771f47d30
I20260709 12:58:39.868631  1130 raft_consensus.cc:2468] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 2.
I20260709 12:58:39.868688  1289 consensus_queue.cc:237] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.873651  1055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d89a21c0d7c4051ba60c3d034d288e8"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
mode: GRACEFUL
new_leader_uuid: "61595b36500942c2995078f771f47d30"
 from {username='slave'} at 127.0.0.1:37490
I20260709 12:58:39.874200  1055 raft_consensus.cc:606] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Received request to transfer leadership to TS 61595b36500942c2995078f771f47d30
I20260709 12:58:39.876209   953 catalog_manager.cc:5697] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 1 to 2, leader changed from 61595b36500942c2995078f771f47d30 (127.0.107.194) to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.884991  1271 raft_consensus.cc:993] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971: : Instructing follower 61595b36500942c2995078f771f47d30 to start an election
I20260709 12:58:39.885392  1289 raft_consensus.cc:1081] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Signalling peer 61595b36500942c2995078f771f47d30 to start an election
I20260709 12:58:39.886745  1130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a"
dest_uuid: "61595b36500942c2995078f771f47d30"
 from {username='slave'} at 127.0.0.1:44260
I20260709 12:58:39.887151  1130 raft_consensus.cc:493] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:39.887405  1130 raft_consensus.cc:3060] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.891795  1130 raft_consensus.cc:515] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.893479  1130 leader_election.cc:290] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 2 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:39.894151  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:39.894521  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:39.894767  1055 raft_consensus.cc:3055] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:39.895083  1055 raft_consensus.cc:740] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:39.895117  1204 raft_consensus.cc:3060] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.895830  1055 consensus_queue.cc:260] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.896785  1055 raft_consensus.cc:3060] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.901311  1055 raft_consensus.cc:2468] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 2.
I20260709 12:58:39.901381  1204 raft_consensus.cc:2468] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 2.
I20260709 12:58:39.902467  1093 leader_election.cc:304] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:39.903131  1254 raft_consensus.cc:2804] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:39.903551  1254 raft_consensus.cc:697] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 2 LEADER]: Becoming Leader. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:39.904176  1254 consensus_queue.cc:237] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.911259   953 catalog_manager.cc:5697] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 reported cstate change: term changed from 1 to 2, leader changed from ef47514919a2475ba9284a0131e88971 (127.0.107.193) to 61595b36500942c2995078f771f47d30 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "61595b36500942c2995078f771f47d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.964919  1336 raft_consensus.cc:993] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30: : Instructing follower ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:39.965342  1254 raft_consensus.cc:1081] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 1 LEADER]: Signalling peer ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:39.966799  1055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3df455257c324ff390d443c9a248c963"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:37466
I20260709 12:58:39.967317  1055 raft_consensus.cc:493] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:39.967705  1055 raft_consensus.cc:3060] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.970461  1271 raft_consensus.cc:993] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971: : Instructing follower 61595b36500942c2995078f771f47d30 to start an election
I20260709 12:58:39.970939  1271 raft_consensus.cc:1081] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Signalling peer 61595b36500942c2995078f771f47d30 to start an election
I20260709 12:58:39.972406  1130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc"
dest_uuid: "61595b36500942c2995078f771f47d30"
 from {username='slave'} at 127.0.0.1:44260
I20260709 12:58:39.972895  1130 raft_consensus.cc:493] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:39.972820  1055 raft_consensus.cc:515] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.973237  1130 raft_consensus.cc:3060] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.974694  1055 leader_election.cc:290] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 2 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:39.975335  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df455257c324ff390d443c9a248c963" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:39.975626  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df455257c324ff390d443c9a248c963" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:39.975900  1128 raft_consensus.cc:3055] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:39.976194  1204 raft_consensus.cc:3060] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.976285  1128 raft_consensus.cc:740] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:39.977187  1128 consensus_queue.cc:260] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.978479  1128 raft_consensus.cc:3060] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.979722  1130 raft_consensus.cc:515] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.981355  1204 raft_consensus.cc:2468] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 2.
I20260709 12:58:39.981845  1130 leader_election.cc:290] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 2 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:39.982668  1018 leader_election.cc:304] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:39.983004  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:39.983592  1204 raft_consensus.cc:3060] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.984365  1271 raft_consensus.cc:2804] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:39.984498  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:39.984928  1271 raft_consensus.cc:697] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:39.985033  1055 raft_consensus.cc:3055] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:39.985368  1055 raft_consensus.cc:740] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:39.985780  1271 consensus_queue.cc:237] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.986483  1128 raft_consensus.cc:2468] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 2.
I20260709 12:58:39.986255  1055 consensus_queue.cc:260] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.987434  1055 raft_consensus.cc:3060] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:39.989568  1204 raft_consensus.cc:2468] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 2.
I20260709 12:58:39.990688  1093 leader_election.cc:304] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:39.991641  1254 raft_consensus.cc:2804] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:39.992120  1254 raft_consensus.cc:697] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 2 LEADER]: Becoming Leader. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:39.992914  1254 consensus_queue.cc:237] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:39.995816   953 catalog_manager.cc:5697] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 1 to 2, leader changed from 61595b36500942c2995078f771f47d30 (127.0.107.194) to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.997712  1055 raft_consensus.cc:2468] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 2.
I20260709 12:58:40.000737   951 catalog_manager.cc:5697] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 reported cstate change: term changed from 1 to 2, leader changed from ef47514919a2475ba9284a0131e88971 (127.0.107.193) to 61595b36500942c2995078f771f47d30 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "61595b36500942c2995078f771f47d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.037907  1259 raft_consensus.cc:993] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80: : Instructing follower ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:40.038336  1342 raft_consensus.cc:1081] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 LEADER]: Signalling peer ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:40.039806  1055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:37474
I20260709 12:58:40.040222  1055 raft_consensus.cc:493] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:40.040481  1055 raft_consensus.cc:3060] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.044812  1055 raft_consensus.cc:515] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:40.046368  1055 leader_election.cc:290] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 2 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:40.047186  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:40.047489  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:40.047801  1128 raft_consensus.cc:3060] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.048102  1204 raft_consensus.cc:3055] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:40.048424  1204 raft_consensus.cc:740] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Running, Role: LEADER
I20260709 12:58:40.049221  1204 consensus_queue.cc:260] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:40.050446  1204 raft_consensus.cc:3060] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.054961  1128 raft_consensus.cc:2468] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 2.
I20260709 12:58:40.056330  1018 leader_election.cc:304] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:40.057060  1271 raft_consensus.cc:2804] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:40.057617  1271 raft_consensus.cc:697] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:40.057683  1204 raft_consensus.cc:2468] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 2.
I20260709 12:58:40.058642  1271 consensus_queue.cc:237] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:40.065686   951 catalog_manager.cc:5697] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 1 to 2, leader changed from f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195) to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.074332  1128 raft_consensus.cc:1275] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:40.075459  1271 consensus_queue.cc:1048] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:40.081735  1289 raft_consensus.cc:993] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971: : Instructing follower 61595b36500942c2995078f771f47d30 to start an election
I20260709 12:58:40.082204  1290 raft_consensus.cc:1081] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Signalling peer 61595b36500942c2995078f771f47d30 to start an election
I20260709 12:58:40.083882  1130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952"
dest_uuid: "61595b36500942c2995078f771f47d30"
 from {username='slave'} at 127.0.0.1:44260
I20260709 12:58:40.084437  1130 raft_consensus.cc:493] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:40.084800  1130 raft_consensus.cc:3060] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.085829  1204 raft_consensus.cc:1275] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:40.087318  1271 consensus_queue.cc:1048] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:40.090984  1130 raft_consensus.cc:515] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:40.092195  1128 raft_consensus.cc:1240] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Rejecting Update request from peer ef47514919a2475ba9284a0131e88971 for earlier term 2. Current term is 3. Ops: []
I20260709 12:58:40.094811  1130 leader_election.cc:290] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 3 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:40.096166  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:40.098299  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:40.098842  1271 consensus_queue.cc:1059] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:40.101143  1055 raft_consensus.cc:3055] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:40.101553  1055 raft_consensus.cc:740] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:40.102329  1055 consensus_queue.cc:260] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:40.103271  1055 raft_consensus.cc:3060] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.109783  1055 raft_consensus.cc:2468] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 3.
W20260709 12:58:40.110363  1290 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:58:40.110975  1095 leader_election.cc:304] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:40.111907  1254 raft_consensus.cc:2804] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:40.112447  1254 raft_consensus.cc:697] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 3 LEADER]: Becoming Leader. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:40.113224  1254 consensus_queue.cc:237] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:40.119791   951 catalog_manager.cc:5697] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 reported cstate change: term changed from 2 to 3, leader changed from ef47514919a2475ba9284a0131e88971 (127.0.107.193) to 61595b36500942c2995078f771f47d30 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "61595b36500942c2995078f771f47d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.283807  1204 raft_consensus.cc:1275] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.285077  1290 consensus_queue.cc:1048] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:40.293382  1128 raft_consensus.cc:1275] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.295291  1290 consensus_queue.cc:1048] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:40.330139  1271 raft_consensus.cc:993] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971: : Instructing follower 61595b36500942c2995078f771f47d30 to start an election
I20260709 12:58:40.330569  1290 raft_consensus.cc:1081] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Signalling peer 61595b36500942c2995078f771f47d30 to start an election
I20260709 12:58:40.331939  1128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d89a21c0d7c4051ba60c3d034d288e8"
dest_uuid: "61595b36500942c2995078f771f47d30"
 from {username='slave'} at 127.0.0.1:44260
I20260709 12:58:40.332471  1128 raft_consensus.cc:493] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:40.332729  1128 raft_consensus.cc:3060] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.337088  1128 raft_consensus.cc:515] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:40.338696  1128 leader_election.cc:290] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 2 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:40.339661  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d89a21c0d7c4051ba60c3d034d288e8" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:40.339772  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d89a21c0d7c4051ba60c3d034d288e8" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:40.340194  1055 raft_consensus.cc:3055] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:40.340268  1204 raft_consensus.cc:3060] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.340500  1055 raft_consensus.cc:740] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:40.341295  1055 consensus_queue.cc:260] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:40.342439  1055 raft_consensus.cc:3060] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:40.345470  1204 raft_consensus.cc:2468] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 2.
I20260709 12:58:40.346303  1093 leader_election.cc:304] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:40.346971  1254 raft_consensus.cc:2804] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:40.347385  1254 raft_consensus.cc:697] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 2 LEADER]: Becoming Leader. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:40.347774  1055 raft_consensus.cc:2468] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 2.
I20260709 12:58:40.348100  1254 consensus_queue.cc:237] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:40.355429   953 catalog_manager.cc:5697] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 reported cstate change: term changed from 1 to 2, leader changed from ef47514919a2475ba9284a0131e88971 (127.0.107.193) to 61595b36500942c2995078f771f47d30 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "61595b36500942c2995078f771f47d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:40.390816  1128 raft_consensus.cc:1275] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.391907  1290 consensus_queue.cc:1048] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:40.403026  1204 raft_consensus.cc:1275] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.404203  1353 consensus_queue.cc:1048] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:40.429497  1204 raft_consensus.cc:1275] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Refusing update from remote peer 61595b36500942c2995078f771f47d30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.430862  1254 consensus_queue.cc:1048] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:40.439152  1055 raft_consensus.cc:1275] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Refusing update from remote peer 61595b36500942c2995078f771f47d30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.440831  1356 consensus_queue.cc:1048] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:40.454201  1055 raft_consensus.cc:1275] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Refusing update from remote peer 61595b36500942c2995078f771f47d30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.455562  1356 consensus_queue.cc:1048] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:40.464088  1204 raft_consensus.cc:1275] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Refusing update from remote peer 61595b36500942c2995078f771f47d30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.465626  1254 consensus_queue.cc:1048] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:40.477826  1128 raft_consensus.cc:1275] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.479099  1353 consensus_queue.cc:1048] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:40.488720  1204 raft_consensus.cc:1275] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.490660  1290 consensus_queue.cc:1048] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:40.680119  1055 raft_consensus.cc:1275] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Refusing update from remote peer 61595b36500942c2995078f771f47d30: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:40.681465  1204 raft_consensus.cc:3060] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:40.681475  1254 consensus_queue.cc:1048] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:40.687242  1204 raft_consensus.cc:1275] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Refusing update from remote peer 61595b36500942c2995078f771f47d30: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:40.690061  1336 consensus_queue.cc:1048] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:40.867671  1203 raft_consensus.cc:1275] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Refusing update from remote peer 61595b36500942c2995078f771f47d30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.869417  1336 consensus_queue.cc:1048] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:40.878480  1055 raft_consensus.cc:1275] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Refusing update from remote peer 61595b36500942c2995078f771f47d30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:40.879861  1254 consensus_queue.cc:1048] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.909039   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:58:42.909701   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:42.933454  1054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
mode: GRACEFUL
new_leader_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
 from {username='slave'} at 127.0.0.1:51322
I20260709 12:58:42.934012  1054 raft_consensus.cc:606] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Received request to transfer leadership to TS f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:42.936666  1054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
mode: GRACEFUL
new_leader_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
 from {username='slave'} at 127.0.0.1:51322
I20260709 12:58:42.937183  1054 raft_consensus.cc:606] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Received request to transfer leadership to TS f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:42.938722   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:58:42.939224   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:43.044137  1289 raft_consensus.cc:993] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971: : Instructing follower f2ce6ee0a56b423d90a2b52ee2ac3d80 to start an election
I20260709 12:58:43.044574  1289 raft_consensus.cc:1081] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Signalling peer f2ce6ee0a56b423d90a2b52ee2ac3d80 to start an election
I20260709 12:58:43.045902  1203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce"
dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:58:43.046396  1203 raft_consensus.cc:493] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:43.046736  1203 raft_consensus.cc:3060] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.082209  1203 raft_consensus.cc:515] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:43.084599  1203 leader_election.cc:290] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 2 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), 61595b36500942c2995078f771f47d30 (127.0.107.194:42231)
I20260709 12:58:43.085481  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:43.086012  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:43.086652  1054 raft_consensus.cc:3055] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:43.086737  1128 raft_consensus.cc:3060] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.087080  1054 raft_consensus.cc:740] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:43.087886  1054 consensus_queue.cc:260] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:43.088798  1054 raft_consensus.cc:3060] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.167830  1054 raft_consensus.cc:2468] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 2.
I20260709 12:58:43.167836  1128 raft_consensus.cc:2468] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 2.
I20260709 12:58:43.169310  1169 leader_election.cc:304] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:43.170295  1342 raft_consensus.cc:2804] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:43.171346  1342 raft_consensus.cc:697] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 LEADER]: Becoming Leader. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Running, Role: LEADER
I20260709 12:58:43.172188  1342 consensus_queue.cc:237] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:43.178795   953 catalog_manager.cc:5697] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 reported cstate change: term changed from 1 to 2, leader changed from ef47514919a2475ba9284a0131e88971 (127.0.107.193) to f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.334823  1290 raft_consensus.cc:993] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971: : Instructing follower f2ce6ee0a56b423d90a2b52ee2ac3d80 to start an election
I20260709 12:58:43.335274  1289 raft_consensus.cc:1081] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Signalling peer f2ce6ee0a56b423d90a2b52ee2ac3d80 to start an election
I20260709 12:58:43.336587  1203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3"
dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:58:43.337066  1203 raft_consensus.cc:493] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:43.337389  1203 raft_consensus.cc:3060] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.342507  1203 raft_consensus.cc:515] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:43.344100  1203 leader_election.cc:290] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 2 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), 61595b36500942c2995078f771f47d30 (127.0.107.194:42231)
I20260709 12:58:43.344962  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:43.345183  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:43.345580  1054 raft_consensus.cc:3055] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:43.345698  1128 raft_consensus.cc:3060] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.345935  1054 raft_consensus.cc:740] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:43.346776  1054 consensus_queue.cc:260] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:43.347952  1054 raft_consensus.cc:3060] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:43.352811  1128 raft_consensus.cc:2468] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 2.
I20260709 12:58:43.354130  1167 leader_election.cc:304] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:43.354619  1054 raft_consensus.cc:2468] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 2.
I20260709 12:58:43.354809  1342 raft_consensus.cc:2804] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:43.355365  1342 raft_consensus.cc:697] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 LEADER]: Becoming Leader. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Running, Role: LEADER
I20260709 12:58:43.356132  1342 consensus_queue.cc:237] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:43.363767   953 catalog_manager.cc:5697] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 reported cstate change: term changed from 1 to 2, leader changed from ef47514919a2475ba9284a0131e88971 (127.0.107.193) to f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.685245  1054 raft_consensus.cc:1275] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Refusing update from remote peer f2ce6ee0a56b423d90a2b52ee2ac3d80: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:43.686709  1342 consensus_queue.cc:1048] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:43.695775  1128 raft_consensus.cc:1275] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Refusing update from remote peer f2ce6ee0a56b423d90a2b52ee2ac3d80: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:43.697348  1342 consensus_queue.cc:1048] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:43.876528  1128 raft_consensus.cc:1275] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Refusing update from remote peer f2ce6ee0a56b423d90a2b52ee2ac3d80: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:43.877904  1342 consensus_queue.cc:1048] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:43.886268  1054 raft_consensus.cc:1275] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Refusing update from remote peer f2ce6ee0a56b423d90a2b52ee2ac3d80: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:43.888818  1380 consensus_queue.cc:1048] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:43.940104   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:43.957543  1204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3"
dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
mode: GRACEFUL
new_leader_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:51772
I20260709 12:58:43.958055  1204 raft_consensus.cc:606] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 LEADER]: Received request to transfer leadership to TS ef47514919a2475ba9284a0131e88971
I20260709 12:58:43.995200  1204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce"
dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
mode: GRACEFUL
new_leader_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:51772
I20260709 12:58:43.996088  1204 raft_consensus.cc:606] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 LEADER]: Received request to transfer leadership to TS ef47514919a2475ba9284a0131e88971
I20260709 12:58:44.003146  1128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a"
dest_uuid: "61595b36500942c2995078f771f47d30"
mode: GRACEFUL
new_leader_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:44284
I20260709 12:58:44.004053  1128 raft_consensus.cc:606] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 2 LEADER]: Received request to transfer leadership to TS ef47514919a2475ba9284a0131e88971
I20260709 12:58:44.009965  1128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952"
dest_uuid: "61595b36500942c2995078f771f47d30"
mode: GRACEFUL
new_leader_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:44284
I20260709 12:58:44.010617  1128 raft_consensus.cc:606] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 3 LEADER]: Received request to transfer leadership to TS ef47514919a2475ba9284a0131e88971
I20260709 12:58:44.016173  1128 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc"
dest_uuid: "61595b36500942c2995078f771f47d30"
mode: GRACEFUL
new_leader_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:44284
I20260709 12:58:44.016708  1128 raft_consensus.cc:606] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 2 LEADER]: Received request to transfer leadership to TS ef47514919a2475ba9284a0131e88971
I20260709 12:58:44.023072  1383 raft_consensus.cc:993] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30: : Instructing follower ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:44.023877  1372 raft_consensus.cc:1081] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 3 LEADER]: Signalling peer ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:44.026046  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:37466
I20260709 12:58:44.026614  1054 raft_consensus.cc:493] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:44.026984  1054 raft_consensus.cc:3060] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:44.033185  1054 raft_consensus.cc:515] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.035095  1054 leader_election.cc:290] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 4 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:44.036221  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:44.036190  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff57948d58634f6db9676cbcaafd3952" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:44.037094  1204 raft_consensus.cc:3060] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:44.037094  1128 raft_consensus.cc:3055] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:44.037575  1128 raft_consensus.cc:740] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:44.038468  1128 consensus_queue.cc:260] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.039592  1128 raft_consensus.cc:3060] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:44.043193  1204 raft_consensus.cc:2468] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 4.
I20260709 12:58:44.044353  1018 leader_election.cc:304] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:44.044977  1128 raft_consensus.cc:2468] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 4.
I20260709 12:58:44.045378  1290 raft_consensus.cc:2804] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:44.045915  1290 raft_consensus.cc:697] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 4 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:44.047137  1290 consensus_queue.cc:237] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.055501   953 catalog_manager.cc:5697] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 3 to 4, leader changed from 61595b36500942c2995078f771f47d30 (127.0.107.194) to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.293753  1366 raft_consensus.cc:993] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80: : Instructing follower ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:44.294256  1380 raft_consensus.cc:1081] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 LEADER]: Signalling peer ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:44.295606  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:37474
I20260709 12:58:44.296002  1054 raft_consensus.cc:493] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:44.296234  1054 raft_consensus.cc:3060] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.300913  1054 raft_consensus.cc:515] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.302527  1054 leader_election.cc:290] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 3 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:44.303135  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:44.303435  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:44.303678  1128 raft_consensus.cc:3060] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.303992  1204 raft_consensus.cc:3055] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.304237  1204 raft_consensus.cc:740] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Running, Role: LEADER
I20260709 12:58:44.304894  1204 consensus_queue.cc:260] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.305819  1204 raft_consensus.cc:3060] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.308713  1128 raft_consensus.cc:2468] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 3.
I20260709 12:58:44.309710  1018 leader_election.cc:304] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:44.310345  1290 raft_consensus.cc:2804] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.310820  1290 raft_consensus.cc:697] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:44.311990  1204 raft_consensus.cc:2468] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 3.
I20260709 12:58:44.311913  1290 consensus_queue.cc:237] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.319463  1366 raft_consensus.cc:993] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80: : Instructing follower ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:44.319991  1380 raft_consensus.cc:1081] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 LEADER]: Signalling peer ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:44.319614   953 catalog_manager.cc:5697] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 2 to 3, leader changed from f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195) to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.321631  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:37474
I20260709 12:58:44.322163  1054 raft_consensus.cc:493] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:44.322549  1054 raft_consensus.cc:3060] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.329190  1054 raft_consensus.cc:515] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.331050  1054 leader_election.cc:290] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 3 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:44.331717  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:44.332201  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dce01a46b5df4a2b996dfd754dedb6c3" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:44.332258  1128 raft_consensus.cc:3060] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.332647  1204 raft_consensus.cc:3055] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.332876  1204 raft_consensus.cc:740] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Running, Role: LEADER
I20260709 12:58:44.333528  1204 consensus_queue.cc:260] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.334458  1204 raft_consensus.cc:3060] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.336457  1128 raft_consensus.cc:2468] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 3.
I20260709 12:58:44.337256  1018 leader_election.cc:304] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, ef47514919a2475ba9284a0131e88971; no voters: 
I20260709 12:58:44.337944  1289 raft_consensus.cc:2804] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.338353  1289 raft_consensus.cc:697] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:44.338649  1204 raft_consensus.cc:2468] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 3.
I20260709 12:58:44.339061  1289 consensus_queue.cc:237] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.344877   953 catalog_manager.cc:5697] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 2 to 3, leader changed from f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195) to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.417702  1383 raft_consensus.cc:993] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30: : Instructing follower ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:44.419039  1383 raft_consensus.cc:1081] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 2 LEADER]: Signalling peer ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:44.420861  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:37466
I20260709 12:58:44.421368  1054 raft_consensus.cc:493] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:44.421689  1054 raft_consensus.cc:3060] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.421847  1388 raft_consensus.cc:993] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30: : Instructing follower ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:44.422418  1383 raft_consensus.cc:1081] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 2 LEADER]: Signalling peer ef47514919a2475ba9284a0131e88971 to start an election
I20260709 12:58:44.423949  1055 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
 from {username='slave'} at 127.0.0.1:37466
I20260709 12:58:44.424355  1055 raft_consensus.cc:493] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:44.424597  1055 raft_consensus.cc:3060] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.427242  1054 raft_consensus.cc:515] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.428988  1054 leader_election.cc:290] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 3 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:44.429003  1055 raft_consensus.cc:515] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.429754  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:44.430260  1128 raft_consensus.cc:3055] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.430544  1128 raft_consensus.cc:740] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:44.430644  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d1b0ff806d9410196d41bdca6e0b39a" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:44.431069  1055 leader_election.cc:290] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 3 election: Requested vote from peers 61595b36500942c2995078f771f47d30 (127.0.107.194:42231), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:44.431178  1204 raft_consensus.cc:3060] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.431484  1128 consensus_queue.cc:260] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.432282  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:44.432691  1128 raft_consensus.cc:3060] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.432807  1130 raft_consensus.cc:3055] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:44.433126  1130 raft_consensus.cc:740] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:44.433269  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc" candidate_uuid: "ef47514919a2475ba9284a0131e88971" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:44.433873  1203 raft_consensus.cc:3060] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.433965  1130 consensus_queue.cc:260] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.435282  1130 raft_consensus.cc:3060] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:44.437988  1204 raft_consensus.cc:2468] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 3.
I20260709 12:58:44.439074  1128 raft_consensus.cc:2468] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 3.
I20260709 12:58:44.440423  1018 leader_election.cc:304] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:44.440893  1203 raft_consensus.cc:2468] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 3.
I20260709 12:58:44.441233  1289 raft_consensus.cc:2804] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.441286  1130 raft_consensus.cc:2468] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef47514919a2475ba9284a0131e88971 in term 3.
I20260709 12:58:44.441807  1289 raft_consensus.cc:697] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:44.442144  1018 leader_election.cc:304] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef47514919a2475ba9284a0131e88971, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:44.442816  1290 raft_consensus.cc:2804] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:44.442706  1289 consensus_queue.cc:237] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.443936  1290 raft_consensus.cc:697] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Becoming Leader. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:44.444772  1290 consensus_queue.cc:237] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:44.449426   953 catalog_manager.cc:5697] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 2 to 3, leader changed from 61595b36500942c2995078f771f47d30 (127.0.107.194) to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.460399   953 catalog_manager.cc:5697] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 reported cstate change: term changed from 2 to 3, leader changed from 61595b36500942c2995078f771f47d30 (127.0.107.194) to ef47514919a2475ba9284a0131e88971 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "ef47514919a2475ba9284a0131e88971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.552368  1130 raft_consensus.cc:1275] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 4 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:44.553504  1290 consensus_queue.cc:1048] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.564476  1203 raft_consensus.cc:1275] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 4 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:58:44.565843  1289 consensus_queue.cc:1048] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.759132  1203 raft_consensus.cc:1275] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:44.760634  1389 consensus_queue.cc:1048] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:44.769212  1130 raft_consensus.cc:1275] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:44.771286  1290 consensus_queue.cc:1048] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.781491  1130 raft_consensus.cc:1275] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:44.782701  1290 consensus_queue.cc:1048] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.790130  1203 raft_consensus.cc:1275] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:44.791850  1289 consensus_queue.cc:1048] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.971331  1130 raft_consensus.cc:1275] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:44.972553  1289 consensus_queue.cc:1048] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.981495  1203 raft_consensus.cc:1275] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:44.983140  1290 consensus_queue.cc:1048] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:45.062175  1203 raft_consensus.cc:1275] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:45.063342  1290 consensus_queue.cc:1048] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:45.069161  1130 raft_consensus.cc:1275] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Refusing update from remote peer ef47514919a2475ba9284a0131e88971: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:45.070945  1290 consensus_queue.cc:1048] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:47.025673   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:47.035480  1055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3df455257c324ff390d443c9a248c963"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
mode: GRACEFUL
new_leader_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
 from {username='slave'} at 127.0.0.1:51322
I20260709 12:58:47.036056  1055 raft_consensus.cc:606] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Received request to transfer leadership to TS f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:47.038908  1055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
mode: GRACEFUL
new_leader_uuid: "61595b36500942c2995078f771f47d30"
 from {username='slave'} at 127.0.0.1:51322
I20260709 12:58:47.039387  1055 raft_consensus.cc:606] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Received request to transfer leadership to TS 61595b36500942c2995078f771f47d30
I20260709 12:58:47.041496  1055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
mode: GRACEFUL
new_leader_uuid: "61595b36500942c2995078f771f47d30"
 from {username='slave'} at 127.0.0.1:51322
I20260709 12:58:47.041961  1055 raft_consensus.cc:606] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Received request to transfer leadership to TS 61595b36500942c2995078f771f47d30
I20260709 12:58:47.043951  1055 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a"
dest_uuid: "ef47514919a2475ba9284a0131e88971"
mode: GRACEFUL
new_leader_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
 from {username='slave'} at 127.0.0.1:51322
I20260709 12:58:47.044376  1055 raft_consensus.cc:606] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Received request to transfer leadership to TS f2ce6ee0a56b423d90a2b52ee2ac3d80
I20260709 12:58:47.045338   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:58:47.045802   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:47.054957  1389 raft_consensus.cc:993] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971: : Instructing follower 61595b36500942c2995078f771f47d30 to start an election
I20260709 12:58:47.055384  1406 raft_consensus.cc:1081] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Signalling peer 61595b36500942c2995078f771f47d30 to start an election
I20260709 12:58:47.056619  1130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc"
dest_uuid: "61595b36500942c2995078f771f47d30"
 from {username='slave'} at 127.0.0.1:44260
I20260709 12:58:47.056979  1130 raft_consensus.cc:493] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:47.057214  1130 raft_consensus.cc:3060] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.061232  1130 raft_consensus.cc:515] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:47.063277  1130 leader_election.cc:290] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 4 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:47.063586  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:47.063823  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aaec4518d141679ec9a860fa5512fc" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:47.064175  1055 raft_consensus.cc:3055] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:47.064334  1204 raft_consensus.cc:3060] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.064549  1055 raft_consensus.cc:740] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:47.065207  1055 consensus_queue.cc:260] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:47.065985  1055 raft_consensus.cc:3060] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.068826  1204 raft_consensus.cc:2468] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 4.
I20260709 12:58:47.069813  1093 leader_election.cc:304] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:47.070080  1055 raft_consensus.cc:2468] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 4.
I20260709 12:58:47.070575  1402 raft_consensus.cc:2804] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:47.071508  1402 raft_consensus.cc:697] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 4 LEADER]: Becoming Leader. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:47.072309  1402 consensus_queue.cc:237] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:47.077966   953 catalog_manager.cc:5697] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 reported cstate change: term changed from 3 to 4, leader changed from ef47514919a2475ba9284a0131e88971 (127.0.107.193) to 61595b36500942c2995078f771f47d30 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "61595b36500942c2995078f771f47d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.082820  1389 raft_consensus.cc:993] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971: : Instructing follower 61595b36500942c2995078f771f47d30 to start an election
I20260709 12:58:47.083312  1406 raft_consensus.cc:1081] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Signalling peer 61595b36500942c2995078f771f47d30 to start an election
I20260709 12:58:47.084810  1130 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce"
dest_uuid: "61595b36500942c2995078f771f47d30"
 from {username='slave'} at 127.0.0.1:44260
I20260709 12:58:47.085342  1130 raft_consensus.cc:493] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:47.085752  1130 raft_consensus.cc:3060] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.091147  1130 raft_consensus.cc:515] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:47.092463  1130 leader_election.cc:290] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 4 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195:36615)
I20260709 12:58:47.093175  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:47.093488  1204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eacd61673e2046a8b502edd6e3c096ce" candidate_uuid: "61595b36500942c2995078f771f47d30" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
I20260709 12:58:47.093741  1055 raft_consensus.cc:3055] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:47.093973  1204 raft_consensus.cc:3060] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.094081  1055 raft_consensus.cc:740] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:47.094846  1055 consensus_queue.cc:260] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:47.095878  1055 raft_consensus.cc:3060] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:47.099990  1204 raft_consensus.cc:2468] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 4.
I20260709 12:58:47.101104  1093 leader_election.cc:304] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:47.101441  1055 raft_consensus.cc:2468] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61595b36500942c2995078f771f47d30 in term 4.
I20260709 12:58:47.101789  1402 raft_consensus.cc:2804] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:47.102277  1402 raft_consensus.cc:697] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 4 LEADER]: Becoming Leader. State: Replica: 61595b36500942c2995078f771f47d30, State: Running, Role: LEADER
I20260709 12:58:47.103011  1402 consensus_queue.cc:237] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:47.109105   953 catalog_manager.cc:5697] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 reported cstate change: term changed from 3 to 4, leader changed from ef47514919a2475ba9284a0131e88971 (127.0.107.193) to 61595b36500942c2995078f771f47d30 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "61595b36500942c2995078f771f47d30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:47.267300  1389 raft_consensus.cc:993] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971: : Instructing follower f2ce6ee0a56b423d90a2b52ee2ac3d80 to start an election
I20260709 12:58:47.267750  1389 raft_consensus.cc:1081] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Signalling peer f2ce6ee0a56b423d90a2b52ee2ac3d80 to start an election
I20260709 12:58:47.269034  1204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3df455257c324ff390d443c9a248c963"
dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:58:47.269537  1204 raft_consensus.cc:493] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:47.269846  1204 raft_consensus.cc:3060] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.273804  1204 raft_consensus.cc:515] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:47.275207  1204 leader_election.cc:290] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 3 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), 61595b36500942c2995078f771f47d30 (127.0.107.194:42231)
I20260709 12:58:47.276042  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df455257c324ff390d443c9a248c963" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:47.276281  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3df455257c324ff390d443c9a248c963" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:47.276587  1055 raft_consensus.cc:3055] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:47.276732  1130 raft_consensus.cc:3060] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.276902  1055 raft_consensus.cc:740] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:47.277623  1055 consensus_queue.cc:260] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:47.278754  1055 raft_consensus.cc:3060] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.282684  1130 raft_consensus.cc:2468] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 3.
I20260709 12:58:47.284021  1167 leader_election.cc:304] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:47.284714  1055 raft_consensus.cc:2468] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 3.
I20260709 12:58:47.284852  1405 raft_consensus.cc:2804] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:47.286216  1405 raft_consensus.cc:697] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 LEADER]: Becoming Leader. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Running, Role: LEADER
I20260709 12:58:47.286981  1405 consensus_queue.cc:237] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:47.293558   953 catalog_manager.cc:5697] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 reported cstate change: term changed from 2 to 3, leader changed from ef47514919a2475ba9284a0131e88971 (127.0.107.193) to f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:47.397151  1406 raft_consensus.cc:993] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971: : Instructing follower f2ce6ee0a56b423d90a2b52ee2ac3d80 to start an election
I20260709 12:58:47.397719  1406 raft_consensus.cc:1081] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Signalling peer f2ce6ee0a56b423d90a2b52ee2ac3d80 to start an election
I20260709 12:58:47.399242  1204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a"
dest_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80"
 from {username='slave'} at 127.0.0.1:51760
I20260709 12:58:47.399703  1204 raft_consensus.cc:493] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:47.399983  1204 raft_consensus.cc:3060] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.404400  1204 raft_consensus.cc:515] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:47.406383  1204 leader_election.cc:290] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 3 election: Requested vote from peers ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647), 61595b36500942c2995078f771f47d30 (127.0.107.194:42231)
I20260709 12:58:47.407369  1130 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "61595b36500942c2995078f771f47d30"
I20260709 12:58:47.407512  1055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ce4dad1b144419ad69bd9bd2405d8a" candidate_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef47514919a2475ba9284a0131e88971"
I20260709 12:58:47.407953  1130 raft_consensus.cc:3060] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.408026  1055 raft_consensus.cc:3055] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:47.408394  1055 raft_consensus.cc:740] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef47514919a2475ba9284a0131e88971, State: Running, Role: LEADER
I20260709 12:58:47.409032  1055 consensus_queue.cc:260] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:47.409871  1055 raft_consensus.cc:3060] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:47.412715  1130 raft_consensus.cc:2468] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 3.
I20260709 12:58:47.413754  1167 leader_election.cc:304] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61595b36500942c2995078f771f47d30, f2ce6ee0a56b423d90a2b52ee2ac3d80; no voters: 
I20260709 12:58:47.414613  1405 raft_consensus.cc:2804] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:47.414662  1055 raft_consensus.cc:2468] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2ce6ee0a56b423d90a2b52ee2ac3d80 in term 3.
I20260709 12:58:47.415181  1405 raft_consensus.cc:697] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 LEADER]: Becoming Leader. State: Replica: f2ce6ee0a56b423d90a2b52ee2ac3d80, State: Running, Role: LEADER
I20260709 12:58:47.416077  1405 consensus_queue.cc:237] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } }
I20260709 12:58:47.423202   953 catalog_manager.cc:5697] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 reported cstate change: term changed from 2 to 3, leader changed from ef47514919a2475ba9284a0131e88971 (127.0.107.193) to f2ce6ee0a56b423d90a2b52ee2ac3d80 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:47.493271  1204 raft_consensus.cc:1275] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 4 FOLLOWER]: Refusing update from remote peer 61595b36500942c2995078f771f47d30: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:47.494606  1402 consensus_queue.cc:1048] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:47.507452  1055 raft_consensus.cc:1275] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 4 FOLLOWER]: Refusing update from remote peer 61595b36500942c2995078f771f47d30: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:47.509392  1421 consensus_queue.cc:1048] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:47.549548  1204 raft_consensus.cc:1275] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 4 FOLLOWER]: Refusing update from remote peer 61595b36500942c2995078f771f47d30: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:47.550952  1421 consensus_queue.cc:1048] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2ce6ee0a56b423d90a2b52ee2ac3d80" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:47.560046  1055 raft_consensus.cc:1275] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 4 FOLLOWER]: Refusing update from remote peer 61595b36500942c2995078f771f47d30: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:47.561439  1402 consensus_queue.cc:1048] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:47.707018  1130 raft_consensus.cc:1275] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Refusing update from remote peer f2ce6ee0a56b423d90a2b52ee2ac3d80: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:47.708175  1405 consensus_queue.cc:1048] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:47.721282  1055 raft_consensus.cc:1275] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Refusing update from remote peer f2ce6ee0a56b423d90a2b52ee2ac3d80: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:47.722853  1414 consensus_queue.cc:1048] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:47.833750  1130 raft_consensus.cc:1275] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Refusing update from remote peer f2ce6ee0a56b423d90a2b52ee2ac3d80: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:47.835002  1414 consensus_queue.cc:1048] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61595b36500942c2995078f771f47d30" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:47.839428  1055 raft_consensus.cc:1275] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Refusing update from remote peer f2ce6ee0a56b423d90a2b52ee2ac3d80: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:47.840827  1414 consensus_queue.cc:1048] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef47514919a2475ba9284a0131e88971" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.046576   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:48.052924   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:58:48.076434   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:48.077307   431 tablet_replica.cc:333] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971: stopping tablet replica
I20260709 12:58:48.077962   431 raft_consensus.cc:2243] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:48.078788   431 raft_consensus.cc:2272] T 5d1b0ff806d9410196d41bdca6e0b39a P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.080698   431 tablet_replica.cc:333] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971: stopping tablet replica
I20260709 12:58:48.081332   431 raft_consensus.cc:2243] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:48.082111   431 raft_consensus.cc:2272] T f60c40b307a140ce9d49c32c64620e53 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.083827   431 tablet_replica.cc:333] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971: stopping tablet replica
I20260709 12:58:48.084317   431 raft_consensus.cc:2243] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:48.084954   431 raft_consensus.cc:2272] T ff57948d58634f6db9676cbcaafd3952 P ef47514919a2475ba9284a0131e88971 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.086830   431 tablet_replica.cc:333] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971: stopping tablet replica
I20260709 12:58:48.087417   431 raft_consensus.cc:2243] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:48.088076   431 raft_consensus.cc:2272] T dce01a46b5df4a2b996dfd754dedb6c3 P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.089952   431 tablet_replica.cc:333] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971: stopping tablet replica
I20260709 12:58:48.090526   431 raft_consensus.cc:2243] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.090927   431 raft_consensus.cc:2272] T 224c37f9dea24f5da495a7a7231df9d8 P ef47514919a2475ba9284a0131e88971 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.092506   431 tablet_replica.cc:333] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971: stopping tablet replica
I20260709 12:58:48.092993   431 raft_consensus.cc:2243] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.093417   431 raft_consensus.cc:2272] T f3ce4dad1b144419ad69bd9bd2405d8a P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.095678   431 tablet_replica.cc:333] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971: stopping tablet replica
I20260709 12:58:48.096117   431 raft_consensus.cc:2243] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.096460   431 raft_consensus.cc:2272] T eacd61673e2046a8b502edd6e3c096ce P ef47514919a2475ba9284a0131e88971 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.098752   431 tablet_replica.cc:333] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971: stopping tablet replica
I20260709 12:58:48.099212   431 raft_consensus.cc:2243] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.099612   431 raft_consensus.cc:2272] T 82aaec4518d141679ec9a860fa5512fc P ef47514919a2475ba9284a0131e88971 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.101675   431 tablet_replica.cc:333] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971: stopping tablet replica
I20260709 12:58:48.102257   431 raft_consensus.cc:2243] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.102705   431 raft_consensus.cc:2272] T 3df455257c324ff390d443c9a248c963 P ef47514919a2475ba9284a0131e88971 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.104909   431 tablet_replica.cc:333] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971: stopping tablet replica
I20260709 12:58:48.105384   431 raft_consensus.cc:2243] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.105824   431 raft_consensus.cc:2272] T 1d89a21c0d7c4051ba60c3d034d288e8 P ef47514919a2475ba9284a0131e88971 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.137247   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:58:48.137622  1169 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33647: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260709 12:58:48.142094  1169 consensus_peers.cc:597] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 -> Peer ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647): Couldn't send request to peer ef47514919a2475ba9284a0131e88971. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:48.156487   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:58:48.181903   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:48.182647   431 tablet_replica.cc:333] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30: stopping tablet replica
I20260709 12:58:48.183293   431 raft_consensus.cc:2243] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.183770   431 raft_consensus.cc:2272] T dce01a46b5df4a2b996dfd754dedb6c3 P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.185496   431 tablet_replica.cc:333] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30: stopping tablet replica
I20260709 12:58:48.186079   431 raft_consensus.cc:2243] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.186489   431 raft_consensus.cc:2272] T 5d1b0ff806d9410196d41bdca6e0b39a P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.188035   431 tablet_replica.cc:333] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30: stopping tablet replica
I20260709 12:58:48.188534   431 raft_consensus.cc:2243] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:48.189244   431 raft_consensus.cc:2272] T eacd61673e2046a8b502edd6e3c096ce P 61595b36500942c2995078f771f47d30 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.191327   431 tablet_replica.cc:333] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30: stopping tablet replica
I20260709 12:58:48.191852   431 raft_consensus.cc:2243] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.192245   431 raft_consensus.cc:2272] T ff57948d58634f6db9676cbcaafd3952 P 61595b36500942c2995078f771f47d30 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.193809   431 tablet_replica.cc:333] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30: stopping tablet replica
I20260709 12:58:48.194299   431 raft_consensus.cc:2243] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.194695   431 raft_consensus.cc:2272] T f3ce4dad1b144419ad69bd9bd2405d8a P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.196758   431 tablet_replica.cc:333] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30: stopping tablet replica
I20260709 12:58:48.197264   431 raft_consensus.cc:2243] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.197599   431 raft_consensus.cc:2272] T 224c37f9dea24f5da495a7a7231df9d8 P 61595b36500942c2995078f771f47d30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.199252   431 tablet_replica.cc:333] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30: stopping tablet replica
I20260709 12:58:48.199750   431 raft_consensus.cc:2243] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.200192   431 raft_consensus.cc:2272] T 3df455257c324ff390d443c9a248c963 P 61595b36500942c2995078f771f47d30 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.202375   431 tablet_replica.cc:333] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30: stopping tablet replica
I20260709 12:58:48.202874   431 raft_consensus.cc:2243] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:48.203603   431 raft_consensus.cc:2272] T 1d89a21c0d7c4051ba60c3d034d288e8 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.205088   431 tablet_replica.cc:333] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30: stopping tablet replica
I20260709 12:58:48.205547   431 raft_consensus.cc:2243] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:48.206250   431 raft_consensus.cc:2272] T 82aaec4518d141679ec9a860fa5512fc P 61595b36500942c2995078f771f47d30 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.208065   431 tablet_replica.cc:333] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30: stopping tablet replica
I20260709 12:58:48.208510   431 raft_consensus.cc:2243] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.208895   431 raft_consensus.cc:2272] T f60c40b307a140ce9d49c32c64620e53 P 61595b36500942c2995078f771f47d30 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:48.239290  1169 consensus_peers.cc:597] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 -> Peer ef47514919a2475ba9284a0131e88971 (127.0.107.193:33647): Couldn't send request to peer ef47514919a2475ba9284a0131e88971. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33647: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:48.239706   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:58:48.259248   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:58:48.286154   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:48.286844   431 tablet_replica.cc:333] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80: stopping tablet replica
I20260709 12:58:48.287453   431 raft_consensus.cc:2243] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.287914   431 raft_consensus.cc:2272] T 5d1b0ff806d9410196d41bdca6e0b39a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.289532   431 tablet_replica.cc:333] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80: stopping tablet replica
I20260709 12:58:48.290105   431 raft_consensus.cc:2243] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.290499   431 raft_consensus.cc:2272] T ff57948d58634f6db9676cbcaafd3952 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.292029   431 tablet_replica.cc:333] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80: stopping tablet replica
I20260709 12:58:48.292514   431 raft_consensus.cc:2243] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.292897   431 raft_consensus.cc:2272] T dce01a46b5df4a2b996dfd754dedb6c3 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.294548   431 tablet_replica.cc:333] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80: stopping tablet replica
I20260709 12:58:48.295018   431 raft_consensus.cc:2243] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.295403   431 raft_consensus.cc:2272] T eacd61673e2046a8b502edd6e3c096ce P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.298014   431 tablet_replica.cc:333] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80: stopping tablet replica
I20260709 12:58:48.298573   431 raft_consensus.cc:2243] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.298981   431 raft_consensus.cc:2272] T 82aaec4518d141679ec9a860fa5512fc P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.301098   431 tablet_replica.cc:333] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80: stopping tablet replica
I20260709 12:58:48.301586   431 raft_consensus.cc:2243] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:48.302520   431 raft_consensus.cc:2272] T 3df455257c324ff390d443c9a248c963 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.304343   431 tablet_replica.cc:333] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80: stopping tablet replica
I20260709 12:58:48.304818   431 raft_consensus.cc:2243] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.305203   431 raft_consensus.cc:2272] T 1d89a21c0d7c4051ba60c3d034d288e8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.306743   431 tablet_replica.cc:333] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80: stopping tablet replica
I20260709 12:58:48.307194   431 raft_consensus.cc:2243] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:48.307922   431 raft_consensus.cc:2272] T 224c37f9dea24f5da495a7a7231df9d8 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.309505   431 tablet_replica.cc:333] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80: stopping tablet replica
I20260709 12:58:48.309995   431 raft_consensus.cc:2243] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:48.310792   431 raft_consensus.cc:2272] T f3ce4dad1b144419ad69bd9bd2405d8a P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.312669   431 tablet_replica.cc:333] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80: stopping tablet replica
I20260709 12:58:48.313117   431 raft_consensus.cc:2243] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:48.313495   431 raft_consensus.cc:2272] T f60c40b307a140ce9d49c32c64620e53 P f2ce6ee0a56b423d90a2b52ee2ac3d80 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.341100   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:58:48.359432   431 master.cc:562] Master@127.0.107.254:45365 shutting down...
I20260709 12:58:48.381799   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:48.382440   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:48.382776   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5ab9f7ca62e542e9a5351f4a4149bdd6: stopping tablet replica
I20260709 12:58:48.403810   431 master.cc:584] Master@127.0.107.254:45365 shutdown complete.
61595b36500942c2995078f771f47d30  4
ef47514919a2475ba9284a0131e88971  5
f2ce6ee0a56b423d90a2b52ee2ac3d80  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11974 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:58:48.448524   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:36797
I20260709 12:58:48.449905   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:48.456624  1434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:48.456789  1433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:48.458599  1436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:48.459896   431 server_base.cc:1061] running on GCE node
I20260709 12:58:48.460650   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:48.460825   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:48.460965   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601928460953 us; error 0 us; skew 500 ppm
I20260709 12:58:48.461421   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:48.463748   431 webserver.cc:533] Webserver started at http://127.0.107.254:43159/ using document root <none> and password file <none>
I20260709 12:58:48.464198   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:48.464375   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:48.464596   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:48.465636   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/master-0-root/instance:
uuid: "72b78a86b5e34075b0982caa9c5426ab"
format_stamp: "Formatted at 2026-07-09 12:58:48 on dist-test-slave-nr1f"
I20260709 12:58:48.470199   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:58:48.473486  1441 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:48.474709   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:58:48.475035   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/master-0-root
uuid: "72b78a86b5e34075b0982caa9c5426ab"
format_stamp: "Formatted at 2026-07-09 12:58:48 on dist-test-slave-nr1f"
I20260709 12:58:48.475304   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:48.484233   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:48.485487   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:48.525405   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:36797
I20260709 12:58:48.525506  1492 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:36797 every 8 connection(s)
I20260709 12:58:48.529403  1493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:48.540725  1493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Bootstrap starting.
I20260709 12:58:48.545961  1493 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:48.550812  1493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: No bootstrap required, opened a new log
I20260709 12:58:48.553207  1493 raft_consensus.cc:359] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72b78a86b5e34075b0982caa9c5426ab" member_type: VOTER }
I20260709 12:58:48.553615  1493 raft_consensus.cc:385] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:48.553867  1493 raft_consensus.cc:740] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72b78a86b5e34075b0982caa9c5426ab, State: Initialized, Role: FOLLOWER
I20260709 12:58:48.554649  1493 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72b78a86b5e34075b0982caa9c5426ab" member_type: VOTER }
I20260709 12:58:48.555127  1493 raft_consensus.cc:399] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:48.555435  1493 raft_consensus.cc:493] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:48.555797  1493 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:48.633901  1493 raft_consensus.cc:515] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72b78a86b5e34075b0982caa9c5426ab" member_type: VOTER }
I20260709 12:58:48.634946  1493 leader_election.cc:304] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72b78a86b5e34075b0982caa9c5426ab; no voters: 
I20260709 12:58:48.636456  1493 leader_election.cc:290] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:48.636956  1496 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:48.638849  1496 raft_consensus.cc:697] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [term 1 LEADER]: Becoming Leader. State: Replica: 72b78a86b5e34075b0982caa9c5426ab, State: Running, Role: LEADER
I20260709 12:58:48.639882  1493 sys_catalog.cc:565] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:48.639856  1496 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72b78a86b5e34075b0982caa9c5426ab" member_type: VOTER }
I20260709 12:58:48.645996  1498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72b78a86b5e34075b0982caa9c5426ab. Latest consensus state: current_term: 1 leader_uuid: "72b78a86b5e34075b0982caa9c5426ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72b78a86b5e34075b0982caa9c5426ab" member_type: VOTER } }
I20260709 12:58:48.645917  1497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72b78a86b5e34075b0982caa9c5426ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72b78a86b5e34075b0982caa9c5426ab" member_type: VOTER } }
I20260709 12:58:48.646710  1497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:48.646694  1498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:48.651304  1503 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:48.657639  1503 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:48.659039   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:48.667372  1503 catalog_manager.cc:1383] Generated new cluster ID: 1134a28a711d47f2b4d72250a6ab3753
I20260709 12:58:48.667708  1503 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:48.687264  1503 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:48.688681  1503 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:48.704878  1503 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Generated new TSK 0
I20260709 12:58:48.705555  1503 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:48.726199   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:48.732615  1514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:48.733515  1515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:48.735309  1517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:48.735442   431 server_base.cc:1061] running on GCE node
I20260709 12:58:48.736420   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:48.736629   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:48.736807   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601928736774 us; error 0 us; skew 500 ppm
I20260709 12:58:48.737402   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:48.740151   431 webserver.cc:533] Webserver started at http://127.0.107.193:42959/ using document root <none> and password file <none>
I20260709 12:58:48.740664   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:48.740860   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:48.741117   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:48.742307   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/instance:
uuid: "87144ea1a4a14ab8b942fb426159f031"
format_stamp: "Formatted at 2026-07-09 12:58:48 on dist-test-slave-nr1f"
I20260709 12:58:48.746834   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:58:48.750434  1522 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:48.751262   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:58:48.751576   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root
uuid: "87144ea1a4a14ab8b942fb426159f031"
format_stamp: "Formatted at 2026-07-09 12:58:48 on dist-test-slave-nr1f"
I20260709 12:58:48.751904   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:48.762713   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:48.763990   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:48.765519   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:48.767961   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:48.768184   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:48.768433   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:48.768628   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:48.809145   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39635
I20260709 12:58:48.809270  1584 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39635 every 8 connection(s)
I20260709 12:58:48.814368   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:48.821705  1589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:48.824182  1590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:48.825460   431 server_base.cc:1061] running on GCE node
W20260709 12:58:48.827245  1592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:48.828495   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:48.828824   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:48.829092   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601928829071 us; error 0 us; skew 500 ppm
I20260709 12:58:48.830003   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:48.831624  1585 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36797
I20260709 12:58:48.832027  1585 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:48.832860  1585 heartbeater.cc:507] Master 127.0.107.254:36797 requested a full tablet report, sending...
I20260709 12:58:48.833065   431 webserver.cc:533] Webserver started at http://127.0.107.194:36039/ using document root <none> and password file <none>
I20260709 12:58:48.833662   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:48.833882   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:48.834193   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:48.835314  1458 ts_manager.cc:194] Registered new tserver with Master: 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:58:48.835347   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/instance:
uuid: "7e99891af85f4b10aa1cc2da6aa33082"
format_stamp: "Formatted at 2026-07-09 12:58:48 on dist-test-slave-nr1f"
I20260709 12:58:48.837457  1458 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35556
I20260709 12:58:48.840399   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:58:48.844244  1597 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:48.845243   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:58:48.845570   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root
uuid: "7e99891af85f4b10aa1cc2da6aa33082"
format_stamp: "Formatted at 2026-07-09 12:58:48 on dist-test-slave-nr1f"
I20260709 12:58:48.845849   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:48.867856   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:48.869092   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:48.871155   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:48.873783   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:48.873986   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:48.874357   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:48.874527   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:48.919451   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39441
I20260709 12:58:48.919543  1659 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39441 every 8 connection(s)
I20260709 12:58:48.924744   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:48.933372  1663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:48.934885  1664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:48.937814  1666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:48.938987   431 server_base.cc:1061] running on GCE node
I20260709 12:58:48.938930  1660 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36797
I20260709 12:58:48.939599  1660 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:48.940179   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:48.940448   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:48.940474  1660 heartbeater.cc:507] Master 127.0.107.254:36797 requested a full tablet report, sending...
I20260709 12:58:48.940752   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601928940730 us; error 0 us; skew 500 ppm
I20260709 12:58:48.941537   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:48.943049  1458 ts_manager.cc:194] Registered new tserver with Master: 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:48.944490   431 webserver.cc:533] Webserver started at http://127.0.107.195:36699/ using document root <none> and password file <none>
I20260709 12:58:48.945042  1458 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35568
I20260709 12:58:48.945181   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:48.945470   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:48.945797   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:48.947583   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/instance:
uuid: "4f1725fe36e349ac85405627f9c93d95"
format_stamp: "Formatted at 2026-07-09 12:58:48 on dist-test-slave-nr1f"
I20260709 12:58:48.953188   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:58:48.956832  1671 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:48.957590   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:58:48.957864   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root
uuid: "4f1725fe36e349ac85405627f9c93d95"
format_stamp: "Formatted at 2026-07-09 12:58:48 on dist-test-slave-nr1f"
I20260709 12:58:48.958138   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:48.981038   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:48.982894   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:48.984129   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:48.986527   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:48.986713   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:48.987025   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:48.987167   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:49.027580   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:45513
I20260709 12:58:49.027695  1733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:45513 every 8 connection(s)
I20260709 12:58:49.048305  1734 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36797
I20260709 12:58:49.048727  1734 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:49.050351  1734 heartbeater.cc:507] Master 127.0.107.254:36797 requested a full tablet report, sending...
I20260709 12:58:49.052704  1458 ts_manager.cc:194] Registered new tserver with Master: 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:49.052901   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015054719s
I20260709 12:58:49.054503  1458 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35578
I20260709 12:58:49.079102  1458 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35586:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:49.086885  1458 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:49.293895  1624 tablet_service.cc:1511] Processing CreateTablet for tablet d6b0ca7e03c249ebad5c6f720df4efca (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:49.295428  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b0ca7e03c249ebad5c6f720df4efca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.295202  1623 tablet_service.cc:1511] Processing CreateTablet for tablet 5332d0582c2b46f598be9871f6cfdcf7 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:49.299387  1625 tablet_service.cc:1511] Processing CreateTablet for tablet 56d2e4b816a44719af0c86481062c407 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:49.300765  1625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d2e4b816a44719af0c86481062c407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.303419  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 88018a232de842fc8fcd30e124b7c4d7 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:49.303752  1621 tablet_service.cc:1511] Processing CreateTablet for tablet 845a9ac484f44da5a4a18f3ffa7030e5 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:49.304836  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88018a232de842fc8fcd30e124b7c4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.305778  1621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845a9ac484f44da5a4a18f3ffa7030e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.308667  1550 tablet_service.cc:1511] Processing CreateTablet for tablet 56d2e4b816a44719af0c86481062c407 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:49.310024  1550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d2e4b816a44719af0c86481062c407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.314595  1620 tablet_service.cc:1511] Processing CreateTablet for tablet 423fad3d086c4c18b5d84ecfeeb2957a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:49.311213  1549 tablet_service.cc:1511] Processing CreateTablet for tablet d6b0ca7e03c249ebad5c6f720df4efca (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:49.318312  1619 tablet_service.cc:1511] Processing CreateTablet for tablet ff5a03f3312f4e6bac9383280b5b9131 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:49.319525  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b0ca7e03c249ebad5c6f720df4efca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.321200  1618 tablet_service.cc:1511] Processing CreateTablet for tablet 4afefd9972704c7ba44201033b7d2e6b (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:49.312510  1548 tablet_service.cc:1511] Processing CreateTablet for tablet 5332d0582c2b46f598be9871f6cfdcf7 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:49.324090  1548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5332d0582c2b46f598be9871f6cfdcf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.323997  1617 tablet_service.cc:1511] Processing CreateTablet for tablet d44a8411cf4642829994ec97173d358a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:49.312899  1623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5332d0582c2b46f598be9871f6cfdcf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.326735  1616 tablet_service.cc:1511] Processing CreateTablet for tablet 05f358a33737477ba11488ec75b16050 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:49.328020  1616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f358a33737477ba11488ec75b16050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.330380  1618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afefd9972704c7ba44201033b7d2e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.332489  1547 tablet_service.cc:1511] Processing CreateTablet for tablet 88018a232de842fc8fcd30e124b7c4d7 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:49.345713  1546 tablet_service.cc:1511] Processing CreateTablet for tablet 845a9ac484f44da5a4a18f3ffa7030e5 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:49.347556  1617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44a8411cf4642829994ec97173d358a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.348238  1619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5a03f3312f4e6bac9383280b5b9131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.348125  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 423fad3d086c4c18b5d84ecfeeb2957a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:49.350476  1544 tablet_service.cc:1511] Processing CreateTablet for tablet ff5a03f3312f4e6bac9383280b5b9131 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:49.351714  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423fad3d086c4c18b5d84ecfeeb2957a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.337481  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88018a232de842fc8fcd30e124b7c4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.353315  1541 tablet_service.cc:1511] Processing CreateTablet for tablet 05f358a33737477ba11488ec75b16050 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:49.358630  1541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f358a33737477ba11488ec75b16050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.356120  1543 tablet_service.cc:1511] Processing CreateTablet for tablet 4afefd9972704c7ba44201033b7d2e6b (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:49.360951  1543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afefd9972704c7ba44201033b7d2e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.355333  1542 tablet_service.cc:1511] Processing CreateTablet for tablet d44a8411cf4642829994ec97173d358a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:49.363430  1542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44a8411cf4642829994ec97173d358a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.366456  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423fad3d086c4c18b5d84ecfeeb2957a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.370469  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5a03f3312f4e6bac9383280b5b9131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.371631  1699 tablet_service.cc:1511] Processing CreateTablet for tablet 56d2e4b816a44719af0c86481062c407 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:49.372977  1699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56d2e4b816a44719af0c86481062c407. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.374423  1749 tablet_bootstrap.cc:492] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:49.374191  1692 tablet_service.cc:1511] Processing CreateTablet for tablet 4afefd9972704c7ba44201033b7d2e6b (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:49.376199  1692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afefd9972704c7ba44201033b7d2e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.376721  1625 tablet_service.cc:1511] Processing CreateTablet for tablet b699c6ee183d45208fccb5d51557fe41 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:49.375231  1697 tablet_service.cc:1511] Processing CreateTablet for tablet 5332d0582c2b46f598be9871f6cfdcf7 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:49.378566  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5332d0582c2b46f598be9871f6cfdcf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.381413  1749 tablet_bootstrap.cc:654] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.383149  1696 tablet_service.cc:1511] Processing CreateTablet for tablet 88018a232de842fc8fcd30e124b7c4d7 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:49.385679  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88018a232de842fc8fcd30e124b7c4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.386365  1690 tablet_service.cc:1511] Processing CreateTablet for tablet 05f358a33737477ba11488ec75b16050 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:49.387656  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f358a33737477ba11488ec75b16050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.391162  1694 tablet_service.cc:1511] Processing CreateTablet for tablet 423fad3d086c4c18b5d84ecfeeb2957a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:49.391240  1693 tablet_service.cc:1511] Processing CreateTablet for tablet ff5a03f3312f4e6bac9383280b5b9131 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:49.392984  1698 tablet_service.cc:1511] Processing CreateTablet for tablet d6b0ca7e03c249ebad5c6f720df4efca (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:49.393596  1694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423fad3d086c4c18b5d84ecfeeb2957a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.395474  1698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b0ca7e03c249ebad5c6f720df4efca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.396103  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 845a9ac484f44da5a4a18f3ffa7030e5 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:49.399135  1691 tablet_service.cc:1511] Processing CreateTablet for tablet d44a8411cf4642829994ec97173d358a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:49.402596  1693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5a03f3312f4e6bac9383280b5b9131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.395816  1623 tablet_service.cc:1511] Processing CreateTablet for tablet dbfb4dc01d084c658bb8ff2ae985e80a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:49.406811  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845a9ac484f44da5a4a18f3ffa7030e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.411746  1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44a8411cf4642829994ec97173d358a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.412102  1546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845a9ac484f44da5a4a18f3ffa7030e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.450470  1625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b699c6ee183d45208fccb5d51557fe41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.467309  1617 tablet_service.cc:1511] Processing CreateTablet for tablet 1ce7dbd8e7cf45808506e02da2925882 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:49.468699  1617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ce7dbd8e7cf45808506e02da2925882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.478533  1542 tablet_service.cc:1511] Processing CreateTablet for tablet 2b113b168afa40cfaab164f8317e42c1 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:49.479859  1616 tablet_service.cc:1511] Processing CreateTablet for tablet 2b113b168afa40cfaab164f8317e42c1 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:49.480839  1623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbfb4dc01d084c658bb8ff2ae985e80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.492323  1616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b113b168afa40cfaab164f8317e42c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.479838  1542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b113b168afa40cfaab164f8317e42c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.498008  1547 tablet_service.cc:1511] Processing CreateTablet for tablet b699c6ee183d45208fccb5d51557fe41 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:49.507992  1624 tablet_service.cc:1511] Processing CreateTablet for tablet 461e1b446c454dbfa1bd2a8ae75ae2c4 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:49.509389  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 461e1b446c454dbfa1bd2a8ae75ae2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.521276  1548 tablet_service.cc:1511] Processing CreateTablet for tablet dbfb4dc01d084c658bb8ff2ae985e80a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:49.522601  1548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbfb4dc01d084c658bb8ff2ae985e80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.524320  1550 tablet_service.cc:1511] Processing CreateTablet for tablet 41e0e763e6004147b0d7ea0abb37c886 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:49.525636  1550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e0e763e6004147b0d7ea0abb37c886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.527467  1620 tablet_service.cc:1511] Processing CreateTablet for tablet d0ab32967f744404a0f736900b1d7b9a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:49.528836  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ab32967f744404a0f736900b1d7b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.533627  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b699c6ee183d45208fccb5d51557fe41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.535079  1546 tablet_service.cc:1511] Processing CreateTablet for tablet 1ce7dbd8e7cf45808506e02da2925882 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:49.536312  1546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ce7dbd8e7cf45808506e02da2925882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.533432  1697 tablet_service.cc:1511] Processing CreateTablet for tablet 2b113b168afa40cfaab164f8317e42c1 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:49.538762  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b113b168afa40cfaab164f8317e42c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.542222  1616 tablet_service.cc:1511] Processing CreateTablet for tablet 793edbca26c648ccab7933d6e1c299e5 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:49.543504  1616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793edbca26c648ccab7933d6e1c299e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.465896  1618 tablet_service.cc:1511] Processing CreateTablet for tablet 41e0e763e6004147b0d7ea0abb37c886 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:49.546968  1618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e0e763e6004147b0d7ea0abb37c886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.560222  1749 tablet_bootstrap.cc:492] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:49.560910  1749 ts_tablet_manager.cc:1403] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.187s	user 0.038s	sys 0.036s
I20260709 12:58:49.576611  1749 raft_consensus.cc:359] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:49.577613  1749 raft_consensus.cc:385] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.579129  1694 tablet_service.cc:1511] Processing CreateTablet for tablet b699c6ee183d45208fccb5d51557fe41 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:49.580554  1694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b699c6ee183d45208fccb5d51557fe41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.525801  1621 tablet_service.cc:1511] Processing CreateTablet for tablet f52157fbf77948c283b3ba328c6ebcdd (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:49.586947  1621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52157fbf77948c283b3ba328c6ebcdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.603735  1619 tablet_service.cc:1511] Processing CreateTablet for tablet c546ee055ea8417b8c1054e545eee77c (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:49.605527  1619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c546ee055ea8417b8c1054e545eee77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.610067  1749 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.610836  1751 tablet_bootstrap.cc:492] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:49.611312  1749 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:49.614969  1660 heartbeater.cc:499] Master 127.0.107.254:36797 was elected leader, sending a full tablet report...
I20260709 12:58:49.616304  1749 ts_tablet_manager.cc:1434] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 12:58:49.617241  1749 tablet_bootstrap.cc:492] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:49.624320  1749 tablet_bootstrap.cc:654] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.625589  1620 tablet_service.cc:1511] Processing CreateTablet for tablet 207df21ae856459f9637b16a0feb2796 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:49.628825  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207df21ae856459f9637b16a0feb2796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.631524  1548 tablet_service.cc:1511] Processing CreateTablet for tablet 461e1b446c454dbfa1bd2a8ae75ae2c4 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:49.632997  1548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 461e1b446c454dbfa1bd2a8ae75ae2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.593364  1544 tablet_service.cc:1511] Processing CreateTablet for tablet d0ab32967f744404a0f736900b1d7b9a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:49.634992  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ab32967f744404a0f736900b1d7b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.636137  1690 tablet_service.cc:1511] Processing CreateTablet for tablet dbfb4dc01d084c658bb8ff2ae985e80a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:49.637395  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbfb4dc01d084c658bb8ff2ae985e80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.638777  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 6d65ebb9a940495b98325fe3474babd1 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:49.639551  1541 tablet_service.cc:1511] Processing CreateTablet for tablet f52157fbf77948c283b3ba328c6ebcdd (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:49.640793  1541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52157fbf77948c283b3ba328c6ebcdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.643289  1698 tablet_service.cc:1511] Processing CreateTablet for tablet 41e0e763e6004147b0d7ea0abb37c886 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:49.644562  1698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e0e763e6004147b0d7ea0abb37c886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.644991  1547 tablet_service.cc:1511] Processing CreateTablet for tablet c546ee055ea8417b8c1054e545eee77c (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:49.646528  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c546ee055ea8417b8c1054e545eee77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.643355  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 793edbca26c648ccab7933d6e1c299e5 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:49.647452  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793edbca26c648ccab7933d6e1c299e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.649147  1692 tablet_service.cc:1511] Processing CreateTablet for tablet 1ce7dbd8e7cf45808506e02da2925882 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:49.643461  1549 tablet_service.cc:1511] Processing CreateTablet for tablet 6d65ebb9a940495b98325fe3474babd1 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:49.650925  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d65ebb9a940495b98325fe3474babd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.654773  1693 tablet_service.cc:1511] Processing CreateTablet for tablet d0ab32967f744404a0f736900b1d7b9a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:49.661296  1692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ce7dbd8e7cf45808506e02da2925882. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.673123  1546 tablet_service.cc:1511] Processing CreateTablet for tablet 207df21ae856459f9637b16a0feb2796 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 12:58:49.685343  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:49.688169  1616 tablet_service.cc:1511] Processing CreateTablet for tablet 64ca31f55ece4416bc4225ea16dc1728 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:49.678002  1542 tablet_service.cc:1511] Processing CreateTablet for tablet 64ca31f55ece4416bc4225ea16dc1728 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:49.692548  1696 tablet_service.cc:1511] Processing CreateTablet for tablet 461e1b446c454dbfa1bd2a8ae75ae2c4 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:49.695629  1693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ab32967f744404a0f736900b1d7b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.695279  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 793edbca26c648ccab7933d6e1c299e5 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:49.739850  1545 tablet_service.cc:1511] Processing CreateTablet for tablet db8014a9a7494e619e862cbd380cb262 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:49.740803  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793edbca26c648ccab7933d6e1c299e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.702171  1753 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.741411  1753 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:49.695281  1697 tablet_service.cc:1511] Processing CreateTablet for tablet f52157fbf77948c283b3ba328c6ebcdd (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:49.742174  1619 tablet_service.cc:1511] Processing CreateTablet for tablet db8014a9a7494e619e862cbd380cb262 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:49.743345  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52157fbf77948c283b3ba328c6ebcdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.744308  1753 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:49.746304  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 461e1b446c454dbfa1bd2a8ae75ae2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.697016  1543 tablet_service.cc:1511] Processing CreateTablet for tablet dc48c88f26dc4e35ae381c821f0a805d (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:49.767506  1625 tablet_service.cc:1511] Processing CreateTablet for tablet 7270b72e069f42daa3f82eaa77d9e299 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:49.704484  1691 tablet_service.cc:1511] Processing CreateTablet for tablet 6d65ebb9a940495b98325fe3474babd1 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:49.770009  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:49.725018  1749 tablet_bootstrap.cc:492] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:49.771363  1749 ts_tablet_manager.cc:1403] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.154s	user 0.012s	sys 0.004s
I20260709 12:58:49.772431  1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d65ebb9a940495b98325fe3474babd1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:49.776844  1601 leader_election.cc:343] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.713991  1699 tablet_service.cc:1511] Processing CreateTablet for tablet c546ee055ea8417b8c1054e545eee77c (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:49.692057  1546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207df21ae856459f9637b16a0feb2796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.778165  1699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c546ee055ea8417b8c1054e545eee77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.781309  1543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc48c88f26dc4e35ae381c821f0a805d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.774351  1749 raft_consensus.cc:359] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:49.731092  1544 tablet_service.cc:1511] Processing CreateTablet for tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:49.782814  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.784225  1542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ca31f55ece4416bc4225ea16dc1728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.784969  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8014a9a7494e619e862cbd380cb262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.719170  1624 tablet_service.cc:1511] Processing CreateTablet for tablet dc48c88f26dc4e35ae381c821f0a805d (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:49.787801  1749 raft_consensus.cc:385] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.789299  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d65ebb9a940495b98325fe3474babd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.789958  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc48c88f26dc4e35ae381c821f0a805d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.790758  1690 tablet_service.cc:1511] Processing CreateTablet for tablet 64ca31f55ece4416bc4225ea16dc1728 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:49.814863  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ca31f55ece4416bc4225ea16dc1728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.734134  1752 tablet_bootstrap.cc:492] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:49.792001  1616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ca31f55ece4416bc4225ea16dc1728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.793148  1547 tablet_service.cc:1511] Processing CreateTablet for tablet 95ea20fae86647d4bbf85d9c0864f5f1 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:49.818081  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ea20fae86647d4bbf85d9c0864f5f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.789104  1749 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:49.795563  1549 tablet_service.cc:1511] Processing CreateTablet for tablet d45e74819157464ca3f225e90c8b6a9e (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:49.822840  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45e74819157464ca3f225e90c8b6a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.822719  1623 tablet_service.cc:1511] Processing CreateTablet for tablet 95ea20fae86647d4bbf85d9c0864f5f1 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:49.826666  1749 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:49.828720  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:49.830083  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.831681  1749 ts_tablet_manager.cc:1434] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.003s
I20260709 12:58:49.832775  1749 tablet_bootstrap.cc:492] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:49.837064  1696 tablet_service.cc:1511] Processing CreateTablet for tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:49.805874  1617 tablet_service.cc:1511] Processing CreateTablet for tablet d45e74819157464ca3f225e90c8b6a9e (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:49.812656  1548 tablet_service.cc:1511] Processing CreateTablet for tablet eda09757c25a4279a4c93c29eeff416a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:49.881036  1548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda09757c25a4279a4c93c29eeff416a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.728363  1621 tablet_service.cc:1511] Processing CreateTablet for tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:49.892721  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:49.891880  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:49.896643  1600 leader_election.cc:343] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:49.897183  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:49.839650  1550 tablet_service.cc:1511] Processing CreateTablet for tablet 2f6a8ad007074cfe96f8430d622f5f80 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:49.840659  1585 heartbeater.cc:499] Master 127.0.107.254:36797 was elected leader, sending a full tablet report...
I20260709 12:58:49.898483  1753 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:49.901700  1752 tablet_bootstrap.cc:654] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.842519  1698 tablet_service.cc:1511] Processing CreateTablet for tablet db8014a9a7494e619e862cbd380cb262 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:49.843448  1692 tablet_service.cc:1511] Processing CreateTablet for tablet dc48c88f26dc4e35ae381c821f0a805d (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:49.845419  1541 tablet_service.cc:1511] Processing CreateTablet for tablet 7270b72e069f42daa3f82eaa77d9e299 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:49.847962  1619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8014a9a7494e619e862cbd380cb262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.906965  1692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc48c88f26dc4e35ae381c821f0a805d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.910538  1621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.919348  1541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7270b72e069f42daa3f82eaa77d9e299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.920332  1618 tablet_service.cc:1511] Processing CreateTablet for tablet eda09757c25a4279a4c93c29eeff416a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:49.921718  1618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda09757c25a4279a4c93c29eeff416a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.924091  1544 tablet_service.cc:1511] Processing CreateTablet for tablet 86aa6466101d44fc98160eb3586dc176 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:49.925680  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86aa6466101d44fc98160eb3586dc176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.779659  1694 tablet_service.cc:1511] Processing CreateTablet for tablet 207df21ae856459f9637b16a0feb2796 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:49.928768  1694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207df21ae856459f9637b16a0feb2796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.928886  1624 tablet_service.cc:1511] Processing CreateTablet for tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:49.864781  1695 tablet_service.cc:1511] Processing CreateTablet for tablet 7270b72e069f42daa3f82eaa77d9e299 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:49.801780  1751 tablet_bootstrap.cc:654] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.938109  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7270b72e069f42daa3f82eaa77d9e299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.939173  1698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8014a9a7494e619e862cbd380cb262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.939795  1617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45e74819157464ca3f225e90c8b6a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.942369  1625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7270b72e069f42daa3f82eaa77d9e299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.946434  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.950366  1623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ea20fae86647d4bbf85d9c0864f5f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.951107  1749 tablet_bootstrap.cc:654] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:49.871095  1693 tablet_service.cc:1511] Processing CreateTablet for tablet 95ea20fae86647d4bbf85d9c0864f5f1 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:49.954115  1550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6a8ad007074cfe96f8430d622f5f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.954989  1693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ea20fae86647d4bbf85d9c0864f5f1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:49.959954  1443 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 53262.2us
W20260709 12:58:49.960909  1445 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 95490.8us
I20260709 12:58:49.961452  1620 tablet_service.cc:1511] Processing CreateTablet for tablet 2f6a8ad007074cfe96f8430d622f5f80 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:49.963865  1546 tablet_service.cc:1511] Processing CreateTablet for tablet f981c1c6e2c5466395ecd385d6b24151 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:49.972252  1752 tablet_bootstrap.cc:492] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:49.972836  1752 ts_tablet_manager.cc:1403] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.240s	user 0.011s	sys 0.003s
I20260709 12:58:49.984582  1752 raft_consensus.cc:359] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:49.985415  1752 raft_consensus.cc:385] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:49.990597  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6a8ad007074cfe96f8430d622f5f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:49.997989  1625 tablet_service.cc:1511] Processing CreateTablet for tablet 86aa6466101d44fc98160eb3586dc176 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:49.999492  1625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86aa6466101d44fc98160eb3586dc176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.006811  1692 tablet_service.cc:1511] Processing CreateTablet for tablet eda09757c25a4279a4c93c29eeff416a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:50.008293  1692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda09757c25a4279a4c93c29eeff416a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.008323  1546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f981c1c6e2c5466395ecd385d6b24151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.011468  1691 tablet_service.cc:1511] Processing CreateTablet for tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:50.024078  1753 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.985760  1752 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.024866  1753 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.029767  1751 tablet_bootstrap.cc:492] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:50.030081  1753 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:50.030390  1751 ts_tablet_manager.cc:1403] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.420s	user 0.008s	sys 0.013s
I20260709 12:58:50.031159  1752 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.031699  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:50.033258  1600 leader_election.cc:343] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.023288  1698 tablet_service.cc:1511] Processing CreateTablet for tablet 2f6a8ad007074cfe96f8430d622f5f80 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:50.037019  1751 raft_consensus.cc:359] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.042622  1751 raft_consensus.cc:385] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.043943  1751 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.038676  1622 tablet_service.cc:1511] Processing CreateTablet for tablet f981c1c6e2c5466395ecd385d6b24151 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:50.046126  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f981c1c6e2c5466395ecd385d6b24151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.050870  1697 tablet_service.cc:1511] Processing CreateTablet for tablet d45e74819157464ca3f225e90c8b6a9e (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:50.047405  1542 tablet_service.cc:1511] Processing CreateTablet for tablet fcdd2749ff424225974f40bab0aaff25 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:50.046970  1751 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.057139  1734 heartbeater.cc:499] Master 127.0.107.254:36797 was elected leader, sending a full tablet report...
I20260709 12:58:50.060245  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:50.075424  1601 leader_election.cc:343] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.075908  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:50.078202  1753 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:50.088515  1544 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:50.089875  1542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcdd2749ff424225974f40bab0aaff25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.094209  1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.094575  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.104126  1699 tablet_service.cc:1511] Processing CreateTablet for tablet 86aa6466101d44fc98160eb3586dc176 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:50.106428  1699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86aa6466101d44fc98160eb3586dc176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.108268  1752 ts_tablet_manager.cc:1434] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.135s	user 0.011s	sys 0.001s
I20260709 12:58:50.108456  1698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6a8ad007074cfe96f8430d622f5f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.120132  1624 tablet_service.cc:1511] Processing CreateTablet for tablet fcdd2749ff424225974f40bab0aaff25 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:50.121567  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcdd2749ff424225974f40bab0aaff25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.126830  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45e74819157464ca3f225e90c8b6a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.127144  1752 tablet_bootstrap.cc:492] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:50.132575  1692 tablet_service.cc:1511] Processing CreateTablet for tablet f981c1c6e2c5466395ecd385d6b24151 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:50.143049  1696 tablet_service.cc:1511] Processing CreateTablet for tablet 6ffd1be44d384b0d9dfc0986195efbd1 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:50.146703  1692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f981c1c6e2c5466395ecd385d6b24151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.158893  1546 tablet_service.cc:1511] Processing CreateTablet for tablet 02b42bc07b3d4b49afb7d3e929183dd2 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:50.160243  1546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b42bc07b3d4b49afb7d3e929183dd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.085001  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 6ffd1be44d384b0d9dfc0986195efbd1 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:50.165805  1543 tablet_service.cc:1511] Processing CreateTablet for tablet 44fa411feaaf4e2d91d23edd17e19ae0 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:50.166921  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ffd1be44d384b0d9dfc0986195efbd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.167881  1543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fa411feaaf4e2d91d23edd17e19ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.183351  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ffd1be44d384b0d9dfc0986195efbd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.183990  1690 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:50.184442  1617 tablet_service.cc:1511] Processing CreateTablet for tablet 02b42bc07b3d4b49afb7d3e929183dd2 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:50.192404  1694 tablet_service.cc:1511] Processing CreateTablet for tablet 02b42bc07b3d4b49afb7d3e929183dd2 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:50.167380  1621 tablet_service.cc:1511] Processing CreateTablet for tablet 6ffd1be44d384b0d9dfc0986195efbd1 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:50.194743  1621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ffd1be44d384b0d9dfc0986195efbd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.194643  1625 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:50.185355  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.199631  1548 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddb83400fc244a9ba5283309591785d (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:50.202375  1617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b42bc07b3d4b49afb7d3e929183dd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.203092  1550 tablet_service.cc:1511] Processing CreateTablet for tablet b8fae2aaea9349b488e73c3574050a18 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:50.204005  1625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.204041  1694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b42bc07b3d4b49afb7d3e929183dd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.204411  1619 tablet_service.cc:1511] Processing CreateTablet for tablet 44fa411feaaf4e2d91d23edd17e19ae0 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:50.205737  1619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fa411feaaf4e2d91d23edd17e19ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.216405  1752 tablet_bootstrap.cc:654] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.206983  1693 tablet_service.cc:1511] Processing CreateTablet for tablet 44fa411feaaf4e2d91d23edd17e19ae0 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:50.221280  1749 tablet_bootstrap.cc:492] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:50.221092  1691 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddb83400fc244a9ba5283309591785d (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:50.210063  1618 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddb83400fc244a9ba5283309591785d (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:50.214835  1548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddb83400fc244a9ba5283309591785d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.220125  1751 ts_tablet_manager.cc:1434] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.186s	user 0.036s	sys 0.019s
I20260709 12:58:50.221783  1749 ts_tablet_manager.cc:1403] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.389s	user 0.059s	sys 0.031s
I20260709 12:58:50.222338  1693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fa411feaaf4e2d91d23edd17e19ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.228506  1550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fae2aaea9349b488e73c3574050a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.232436  1749 raft_consensus.cc:359] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.233170  1749 raft_consensus.cc:385] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.233496  1749 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.234259  1749 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.235725  1618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddb83400fc244a9ba5283309591785d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.239125  1549 tablet_service.cc:1511] Processing CreateTablet for tablet 447b9d1298e947858fa3d05e918d4a08 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:50.240161  1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddb83400fc244a9ba5283309591785d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.240463  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447b9d1298e947858fa3d05e918d4a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.243330  1541 tablet_service.cc:1511] Processing CreateTablet for tablet 660b57178c7f4ffebd30c42df43b303a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:50.229372  1751 tablet_bootstrap.cc:492] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:50.244585  1541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660b57178c7f4ffebd30c42df43b303a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.244437  1623 tablet_service.cc:1511] Processing CreateTablet for tablet b8fae2aaea9349b488e73c3574050a18 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:50.245838  1623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fae2aaea9349b488e73c3574050a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.243302  1699 tablet_service.cc:1511] Processing CreateTablet for tablet b8fae2aaea9349b488e73c3574050a18 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:50.248435  1616 tablet_service.cc:1511] Processing CreateTablet for tablet 660b57178c7f4ffebd30c42df43b303a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:50.248874  1699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fae2aaea9349b488e73c3574050a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.249676  1616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660b57178c7f4ffebd30c42df43b303a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.259620  1749 ts_tablet_manager.cc:1434] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 12:58:50.260594  1749 tablet_bootstrap.cc:492] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:50.260947  1751 tablet_bootstrap.cc:654] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.273012  1760 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.273564  1760 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.275095  1749 tablet_bootstrap.cc:654] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.276315  1760 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:50.265596  1697 tablet_service.cc:1511] Processing CreateTablet for tablet 660b57178c7f4ffebd30c42df43b303a (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:50.301208  1625 tablet_service.cc:1511] Processing CreateTablet for tablet 447b9d1298e947858fa3d05e918d4a08 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:50.302662  1625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447b9d1298e947858fa3d05e918d4a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.221877  1695 tablet_service.cc:1511] Processing CreateTablet for tablet fcdd2749ff424225974f40bab0aaff25 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:50.330186  1547 tablet_service.cc:1511] Processing CreateTablet for tablet 44a80c9a41a3498da7aa33d70b18ace6 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:50.331542  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a80c9a41a3498da7aa33d70b18ace6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.339522  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 44a80c9a41a3498da7aa33d70b18ace6 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:50.340750  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a80c9a41a3498da7aa33d70b18ace6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.341305  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660b57178c7f4ffebd30c42df43b303a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.351593  1542 tablet_service.cc:1511] Processing CreateTablet for tablet 8e325950f4164ab99442980dc2c53386 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:50.352933  1542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e325950f4164ab99442980dc2c53386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.353948  1624 tablet_service.cc:1511] Processing CreateTablet for tablet 8e325950f4164ab99442980dc2c53386 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:50.355216  1624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e325950f4164ab99442980dc2c53386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.359359  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcdd2749ff424225974f40bab0aaff25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.360777  1549 tablet_service.cc:1511] Processing CreateTablet for tablet af202c0dfac940fb86d9d9d0a9124f44 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:50.361995  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af202c0dfac940fb86d9d9d0a9124f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.362877  1620 tablet_service.cc:1511] Processing CreateTablet for tablet af202c0dfac940fb86d9d9d0a9124f44 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:50.364073  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af202c0dfac940fb86d9d9d0a9124f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.381178  1751 tablet_bootstrap.cc:492] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:50.381677  1751 ts_tablet_manager.cc:1403] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.027s
I20260709 12:58:50.395401  1544 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab2c76ce9ba4519b8beb7decd86314d (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:50.395579  1692 tablet_service.cc:1511] Processing CreateTablet for tablet 8e325950f4164ab99442980dc2c53386 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:50.396687  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab2c76ce9ba4519b8beb7decd86314d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.396843  1692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e325950f4164ab99442980dc2c53386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.407078  1698 tablet_service.cc:1511] Processing CreateTablet for tablet 447b9d1298e947858fa3d05e918d4a08 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:50.408365  1698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447b9d1298e947858fa3d05e918d4a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.365794  1699 tablet_service.cc:1511] Processing CreateTablet for tablet 44a80c9a41a3498da7aa33d70b18ace6 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:50.415913  1699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a80c9a41a3498da7aa33d70b18ace6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.441785  1749 tablet_bootstrap.cc:492] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:50.442389  1749 ts_tablet_manager.cc:1403] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.182s	user 0.013s	sys 0.004s
I20260709 12:58:50.445236  1749 raft_consensus.cc:359] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.445991  1749 raft_consensus.cc:385] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.446301  1749 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.447366  1749 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.449116  1620 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab2c76ce9ba4519b8beb7decd86314d (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:50.450388  1749 ts_tablet_manager.cc:1434] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:50.451840  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 12ca9a7e99a249b3820b6df8c497bfde (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:50.452848  1541 tablet_service.cc:1511] Processing CreateTablet for tablet 12ca9a7e99a249b3820b6df8c497bfde (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:50.453840  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:50.454126  1541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ca9a7e99a249b3820b6df8c497bfde. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:50.456197  1673 leader_election.cc:343] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.447225  1694 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab2c76ce9ba4519b8beb7decd86314d (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:50.457803  1694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab2c76ce9ba4519b8beb7decd86314d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.466622  1690 tablet_service.cc:1511] Processing CreateTablet for tablet af202c0dfac940fb86d9d9d0a9124f44 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:50.470433  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab2c76ce9ba4519b8beb7decd86314d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.462685  1549 tablet_service.cc:1511] Processing CreateTablet for tablet a5f195a66bf8449c96e58c306dec48a5 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:50.473138  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f195a66bf8449c96e58c306dec48a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.473883  1761 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.474969  1749 tablet_bootstrap.cc:492] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:50.486775  1761 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.489025  1751 raft_consensus.cc:359] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.489782  1751 raft_consensus.cc:385] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.490103  1751 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.491006  1761 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:50.491945  1697 tablet_service.cc:1511] Processing CreateTablet for tablet 12ca9a7e99a249b3820b6df8c497bfde (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:50.495455  1752 tablet_bootstrap.cc:492] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:50.496073  1752 ts_tablet_manager.cc:1403] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.369s	user 0.016s	sys 0.007s
I20260709 12:58:50.482372  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af202c0dfac940fb86d9d9d0a9124f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.506748  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ca9a7e99a249b3820b6df8c497bfde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.507843  1547 tablet_service.cc:1511] Processing CreateTablet for tablet a45da2e3894b42dc93ed11eb2c31220c (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:50.508674  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ca9a7e99a249b3820b6df8c497bfde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.503211  1696 tablet_service.cc:1511] Processing CreateTablet for tablet a5f195a66bf8449c96e58c306dec48a5 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:50.519683  1752 raft_consensus.cc:359] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.520607  1752 raft_consensus.cc:385] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.520929  1752 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.522626  1618 tablet_service.cc:1511] Processing CreateTablet for tablet a45da2e3894b42dc93ed11eb2c31220c (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:50.515529  1625 tablet_service.cc:1511] Processing CreateTablet for tablet a5f195a66bf8449c96e58c306dec48a5 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:50.511857  1751 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.535367  1753 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.541759  1753 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.542106  1548 tablet_service.cc:1511] Processing CreateTablet for tablet 9ffc7074d09d4b0a8caf498542f3e843 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:50.544207  1753 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:50.546039  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:50.546350  1696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f195a66bf8449c96e58c306dec48a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.546437  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:50.547573  1601 leader_election.cc:343] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:50.548058  1600 leader_election.cc:343] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.548493  1600 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:50.549747  1753 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:50.550802  1618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a45da2e3894b42dc93ed11eb2c31220c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.544788  1695 tablet_service.cc:1511] Processing CreateTablet for tablet a45da2e3894b42dc93ed11eb2c31220c (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:50.552409  1695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a45da2e3894b42dc93ed11eb2c31220c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.556974  1547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a45da2e3894b42dc93ed11eb2c31220c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.557256  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:50.558815  1621 tablet_service.cc:1511] Processing CreateTablet for tablet 9ffc7074d09d4b0a8caf498542f3e843 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:50.560109  1621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffc7074d09d4b0a8caf498542f3e843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.561091  1751 ts_tablet_manager.cc:1434] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.179s	user 0.010s	sys 0.002s
I20260709 12:58:50.562050  1548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffc7074d09d4b0a8caf498542f3e843. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:50.573053  1524 leader_election.cc:343] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.575131  1749 tablet_bootstrap.cc:654] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.581137  1751 tablet_bootstrap.cc:492] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:50.587116  1690 tablet_service.cc:1511] Processing CreateTablet for tablet 9ffc7074d09d4b0a8caf498542f3e843 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:50.595767  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:50.596621  1621 tablet_service.cc:1511] Processing CreateTablet for tablet 9b989fc00ec242a59fb2167b2255b3a8 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:50.597986  1544 tablet_service.cc:1511] Processing CreateTablet for tablet 9b989fc00ec242a59fb2167b2255b3a8 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:50.600520  1751 tablet_bootstrap.cc:654] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.601907  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb004c86c654110bd570a13f623ed9f (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 12:58:50.603338  1674 leader_election.cc:343] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.603885  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:50.604208  1698 tablet_service.cc:1511] Processing CreateTablet for tablet 9b989fc00ec242a59fb2167b2255b3a8 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:50.603139  1623 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb004c86c654110bd570a13f623ed9f (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:50.605525  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffc7074d09d4b0a8caf498542f3e843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.607821  1623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb004c86c654110bd570a13f623ed9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.608774  1699 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb004c86c654110bd570a13f623ed9f (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:50.609748  1543 tablet_service.cc:1511] Processing CreateTablet for tablet 323bbbd0be5249329755d7e00ed71324 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:50.610510  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b989fc00ec242a59fb2167b2255b3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.611119  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb004c86c654110bd570a13f623ed9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.613454  1617 tablet_service.cc:1511] Processing CreateTablet for tablet 323bbbd0be5249329755d7e00ed71324 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:50.614708  1621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b989fc00ec242a59fb2167b2255b3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.615293  1617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323bbbd0be5249329755d7e00ed71324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.616380  1543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323bbbd0be5249329755d7e00ed71324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.556260  1752 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.638259  1760 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.638748  1760 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.639401  1772 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:50.639528  1691 tablet_service.cc:1511] Processing CreateTablet for tablet 323bbbd0be5249329755d7e00ed71324 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:50.636238  1699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb004c86c654110bd570a13f623ed9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.640331  1549 tablet_service.cc:1511] Processing CreateTablet for tablet 01508a4751a04c12a68c8570eb4d2e7f (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:50.641994  1549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01508a4751a04c12a68c8570eb4d2e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.644583  1760 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:50.650365  1691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323bbbd0be5249329755d7e00ed71324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.656390  1698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b989fc00ec242a59fb2167b2255b3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.664947  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:50.665625  1635 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:50.667779  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:50.669332  1760 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:50.669693  1760 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.670090  1760 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.670267  1749 tablet_bootstrap.cc:492] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:50.670811  1749 ts_tablet_manager.cc:1403] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.196s	user 0.013s	sys 0.005s
I20260709 12:58:50.673225  1622 tablet_service.cc:1511] Processing CreateTablet for tablet 01508a4751a04c12a68c8570eb4d2e7f (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:50.674463  1693 tablet_service.cc:1511] Processing CreateTablet for tablet 01508a4751a04c12a68c8570eb4d2e7f (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:50.674817  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:50.675710  1693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01508a4751a04c12a68c8570eb4d2e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.677316  1625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f195a66bf8449c96e58c306dec48a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.677911  1622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01508a4751a04c12a68c8570eb4d2e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.689710  1620 tablet_service.cc:1511] Processing CreateTablet for tablet 5336feea1c174b498bc0252f726f9461 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:50.690279  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 5336feea1c174b498bc0252f726f9461 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:50.691329  1620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5336feea1c174b498bc0252f726f9461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.691560  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5336feea1c174b498bc0252f726f9461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.673712  1749 raft_consensus.cc:359] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.702407  1749 raft_consensus.cc:385] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.702761  1749 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.703505  1749 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.705417  1694 tablet_service.cc:1511] Processing CreateTablet for tablet 5336feea1c174b498bc0252f726f9461 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:50.713653  1694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5336feea1c174b498bc0252f726f9461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.714890  1698 tablet_service.cc:1511] Processing CreateTablet for tablet 8129c29801c142749490f0df95b71485 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:50.716164  1698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8129c29801c142749490f0df95b71485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.717197  1618 tablet_service.cc:1511] Processing CreateTablet for tablet 2c340bead2014c39bd9825dce2602d61 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:50.718458  1618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c340bead2014c39bd9825dce2602d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.706049  1749 ts_tablet_manager.cc:1434] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:58:50.707507  1544 tablet_service.cc:1511] Processing CreateTablet for tablet 8129c29801c142749490f0df95b71485 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:50.720387  1544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8129c29801c142749490f0df95b71485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.711277  1623 tablet_service.cc:1511] Processing CreateTablet for tablet 8129c29801c142749490f0df95b71485 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 12:58:50.722200  1674 leader_election.cc:343] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.722973  1623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8129c29801c142749490f0df95b71485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.731137  1545 tablet_service.cc:1511] Processing CreateTablet for tablet 2c340bead2014c39bd9825dce2602d61 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:50.732426  1545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c340bead2014c39bd9825dce2602d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.723569  1752 ts_tablet_manager.cc:1434] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.227s	user 0.012s	sys 0.001s
W20260709 12:58:50.728355  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:50.740631  1752 tablet_bootstrap.cc:492] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:50.742662  1749 tablet_bootstrap.cc:492] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:50.742439  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:50.742837  1543 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe250573e1c4fdd9d93dbaaa494b367 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:50.744140  1543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe250573e1c4fdd9d93dbaaa494b367. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:50.743994  1526 leader_election.cc:343] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.744884  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:50.746300  1761 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:50.747223  1697 tablet_service.cc:1511] Processing CreateTablet for tablet 2c340bead2014c39bd9825dce2602d61 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:50.748656  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c340bead2014c39bd9825dce2602d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.754978  1752 tablet_bootstrap.cc:654] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.740789  1760 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.756575  1616 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe250573e1c4fdd9d93dbaaa494b367 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:50.758090  1616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe250573e1c4fdd9d93dbaaa494b367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.766882  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 12:58:50.768594  1674 leader_election.cc:343] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.771221  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:50.771844  1635 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.777467  1760 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:50.785301  1635 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:50.795012  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:50.796322  1760 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:50.797621  1760 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:50.799162  1760 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.802301  1749 tablet_bootstrap.cc:654] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.807669  1692 tablet_service.cc:1511] Processing CreateTablet for tablet 3fe250573e1c4fdd9d93dbaaa494b367 (DEFAULT_TABLE table=test-workload [id=c888126390e24065b80c176a28a9339c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:50.826210  1692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe250573e1c4fdd9d93dbaaa494b367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:50.836064  1751 tablet_bootstrap.cc:492] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:50.836799  1751 ts_tablet_manager.cc:1403] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.256s	user 0.042s	sys 0.036s
I20260709 12:58:50.867784  1751 raft_consensus.cc:359] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.868908  1751 raft_consensus.cc:385] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.869393  1751 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.870550  1751 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.873256  1751 ts_tablet_manager.cc:1434] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 12:58:50.874513  1751 tablet_bootstrap.cc:492] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:50.876883  1752 tablet_bootstrap.cc:492] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:50.877588  1752 ts_tablet_manager.cc:1403] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.137s	user 0.018s	sys 0.026s
I20260709 12:58:50.882145  1751 tablet_bootstrap.cc:654] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.881515  1752 raft_consensus.cc:359] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.882536  1752 raft_consensus.cc:385] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.882892  1752 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.883769  1752 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.886101  1752 ts_tablet_manager.cc:1434] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.001s
I20260709 12:58:50.887226  1752 tablet_bootstrap.cc:492] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:50.894204  1749 tablet_bootstrap.cc:492] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:50.894987  1749 ts_tablet_manager.cc:1403] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.153s	user 0.017s	sys 0.016s
I20260709 12:58:50.895782  1752 tablet_bootstrap.cc:654] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.895143  1458 catalog_manager.cc:5697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:50.899569  1749 raft_consensus.cc:359] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.900205  1749 raft_consensus.cc:385] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.900482  1749 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.901696  1749 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.902587  1751 tablet_bootstrap.cc:492] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:50.903699  1751 ts_tablet_manager.cc:1403] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.012s
I20260709 12:58:50.908324  1749 ts_tablet_manager.cc:1434] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:58:50.909366  1749 tablet_bootstrap.cc:492] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:50.906520  1751 raft_consensus.cc:359] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.910952  1751 raft_consensus.cc:385] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.911284  1751 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.912533  1751 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.921672  1751 ts_tablet_manager.cc:1434] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:58:50.923089  1751 tablet_bootstrap.cc:492] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:50.923707  1752 tablet_bootstrap.cc:492] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:50.926594  1752 ts_tablet_manager.cc:1403] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.016s
I20260709 12:58:50.926676  1761 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.927204  1761 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.929653  1751 tablet_bootstrap.cc:654] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.929486  1752 raft_consensus.cc:359] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.930277  1752 raft_consensus.cc:385] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.930589  1752 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.931409  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:50.935292  1749 tablet_bootstrap.cc:654] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.935564  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:50.936916  1635 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 1: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:58:50.938805  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:50.940606  1761 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:50.941421  1761 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.942323  1752 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.946399  1752 ts_tablet_manager.cc:1434] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 12:58:50.947681  1752 tablet_bootstrap.cc:492] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:50.959376  1782 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.960403  1782 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.962199  1753 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.964026  1753 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.967499  1753 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:50.969170  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:50.970096  1560 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:50.971577  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:50.972105  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:50.972509  1635 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
W20260709 12:58:50.974164  1601 leader_election.cc:343] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.974509  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:50.975659  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:50.977139  1753 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:50.977799  1753 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.977514  1784 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:50.978312  1753 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.978869  1784 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:50.979975  1784 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:50.981683  1782 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:50.982003  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:50.982699  1749 tablet_bootstrap.cc:492] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:50.983392  1749 ts_tablet_manager.cc:1403] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.019s
W20260709 12:58:50.983767  1526 leader_election.cc:343] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:50.986910  1749 raft_consensus.cc:359] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.987979  1749 raft_consensus.cc:385] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:50.988332  1749 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.963042  1752 tablet_bootstrap.cc:654] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:50.963166  1761 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:50.994834  1751 tablet_bootstrap.cc:492] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:50.994632  1753 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:50.995448  1751 ts_tablet_manager.cc:1403] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.073s	user 0.021s	sys 0.039s
I20260709 12:58:50.998593  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:50.999185  1751 raft_consensus.cc:359] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.000450  1751 raft_consensus.cc:385] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.000805  1751 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:50.989274  1749 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.001507  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:51.001708  1751 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:51.003456  1601 leader_election.cc:343] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.004621  1751 ts_tablet_manager.cc:1434] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.006s
I20260709 12:58:51.004711  1753 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:50.994065  1784 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.007787  1751 tablet_bootstrap.cc:492] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:51.009642  1560 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 1: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:58:51.012275  1761 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.012876  1761 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.016517  1751 tablet_bootstrap.cc:654] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.018143  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:51.019850  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.021932  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:58:51.023851  1526 leader_election.cc:343] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:51.025787  1524 leader_election.cc:343] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.026458  1524 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:51.027544  1782 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.029733  1761 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.033108  1784 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.036417  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:58:51.038303  1526 leader_election.cc:343] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.035511  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:51.040182  1635 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 1: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:58:51.041908  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:51.043138  1784 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.044373  1753 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.051581  1752 tablet_bootstrap.cc:492] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:51.052220  1752 ts_tablet_manager.cc:1403] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.016s
I20260709 12:58:51.053964  1751 tablet_bootstrap.cc:492] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:51.054548  1751 ts_tablet_manager.cc:1403] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.047s	user 0.025s	sys 0.019s
I20260709 12:58:51.054924  1749 ts_tablet_manager.cc:1434] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.016s
I20260709 12:58:51.055765  1752 raft_consensus.cc:359] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.056519  1752 raft_consensus.cc:385] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.057022  1752 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.058375  1751 raft_consensus.cc:359] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.059238  1749 tablet_bootstrap.cc:492] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:51.059298  1751 raft_consensus.cc:385] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.059896  1751 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.060913  1751 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.063529  1751 ts_tablet_manager.cc:1434] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:51.065238  1751 tablet_bootstrap.cc:492] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:51.067317  1749 tablet_bootstrap.cc:654] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.062420  1752 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.073091  1751 tablet_bootstrap.cc:654] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.073719  1752 ts_tablet_manager.cc:1434] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:58:51.075217  1752 tablet_bootstrap.cc:492] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:51.085237  1752 tablet_bootstrap.cc:654] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.088406  1751 tablet_bootstrap.cc:492] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:51.088922  1751 ts_tablet_manager.cc:1403] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:58:51.092288  1751 raft_consensus.cc:359] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.093106  1751 raft_consensus.cc:385] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.093477  1751 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.093787  1749 tablet_bootstrap.cc:492] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:51.094465  1749 ts_tablet_manager.cc:1403] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.012s
I20260709 12:58:51.094457  1751 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.098271  1749 raft_consensus.cc:359] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.099238  1749 raft_consensus.cc:385] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.099592  1749 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.100360  1751 ts_tablet_manager.cc:1434] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:58:51.100605  1749 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.101686  1751 tablet_bootstrap.cc:492] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:51.109855  1751 tablet_bootstrap.cc:654] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.113291  1749 ts_tablet_manager.cc:1434] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:58:51.114658  1749 tablet_bootstrap.cc:492] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:51.119822  1784 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.120869  1760 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.120563  1784 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.121352  1760 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.122452  1749 tablet_bootstrap.cc:654] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.123507  1760 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:51.125727  1784 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.125792  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:51.130429  1635 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:51.126049  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.131691  1760 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.131996  1751 tablet_bootstrap.cc:492] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:51.127593  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:51.132545  1751 ts_tablet_manager.cc:1403] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.013s
I20260709 12:58:51.132349  1760 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.132879  1560 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:51.130561  1752 tablet_bootstrap.cc:492] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:51.133991  1752 ts_tablet_manager.cc:1403] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.059s	user 0.030s	sys 0.011s
I20260709 12:58:51.136135  1751 raft_consensus.cc:359] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.136927  1751 raft_consensus.cc:385] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.137264  1751 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
W20260709 12:58:51.132558  1526 leader_election.cc:343] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.127952  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:51.138017  1751 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.139073  1634 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:51.139264  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:51.141271  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:51.137454  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:51.143015  1784 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.143467  1784 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.143844  1784 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.143939  1751 ts_tablet_manager.cc:1434] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:58:51.145116  1751 tablet_bootstrap.cc:492] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:51.145727  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:58:51.147926  1674 leader_election.cc:343] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.148856  1772 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.149376  1772 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.149796  1772 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.152014  1751 tablet_bootstrap.cc:654] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.153178  1760 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:51.146662  1635 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:51.137516  1752 raft_consensus.cc:359] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.155448  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:51.155999  1752 raft_consensus.cc:385] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.156384  1752 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.157256  1760 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.157758  1760 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.160375  1760 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.160678  1784 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.163676  1752 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.165911  1784 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.166507  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:51.167639  1635 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.167764  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:58:51.169553  1526 leader_election.cc:343] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.177871  1751 tablet_bootstrap.cc:492] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:51.178156  1749 tablet_bootstrap.cc:492] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:51.178400  1751 ts_tablet_manager.cc:1403] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 12:58:51.178670  1749 ts_tablet_manager.cc:1403] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.064s	user 0.039s	sys 0.021s
I20260709 12:58:51.180986  1751 raft_consensus.cc:359] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.182245  1751 raft_consensus.cc:385] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.181896  1749 raft_consensus.cc:359] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.182600  1751 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.182816  1749 raft_consensus.cc:385] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.183166  1749 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.183343  1751 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.183923  1749 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.184285  1772 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.188937  1751 ts_tablet_manager.cc:1434] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:58:51.189406  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:51.189862  1751 tablet_bootstrap.cc:492] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:51.189990  1560 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.195523  1751 tablet_bootstrap.cc:654] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.186172  1749 ts_tablet_manager.cc:1434] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:51.183862  1752 ts_tablet_manager.cc:1434] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.002s
I20260709 12:58:51.202651  1772 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:51.203409  1560 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:51.203858  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:51.204950  1634 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.205228  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:51.206233  1772 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.206862  1752 tablet_bootstrap.cc:492] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:51.206944  1772 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:51.208082  1772 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.181864  1635 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:51.186484  1760 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.208808  1784 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.209798  1784 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.211783  1760 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:51.212131  1784 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.213050  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 12:58:51.215062  1674 leader_election.cc:343] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.215950  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.216450  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:51.216894  1709 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:51.217154  1632 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.218262  1749 tablet_bootstrap.cc:492] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:51.218314  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:51.215912  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:51.215078  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 12:58:51.224001  1524 leader_election.cc:343] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.224934  1761 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.225148  1752 tablet_bootstrap.cc:654] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.225419  1761 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.226016  1761 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.227162  1749 tablet_bootstrap.cc:654] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.235545  1784 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.236184  1784 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:51.237138  1784 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.238421  1752 tablet_bootstrap.cc:492] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:51.238811  1787 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.239274  1752 ts_tablet_manager.cc:1403] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.033s	user 0.004s	sys 0.017s
I20260709 12:58:51.239362  1787 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.243520  1760 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:51.244837  1752 raft_consensus.cc:359] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.245667  1752 raft_consensus.cc:385] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.246062  1752 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.247293  1749 tablet_bootstrap.cc:492] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:51.246912  1752 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.247923  1749 ts_tablet_manager.cc:1403] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.007s
I20260709 12:58:51.249432  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:51.249228  1634 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:51.250327  1559 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:51.251482  1752 ts_tablet_manager.cc:1434] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:58:51.251639  1600 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:51.252488  1752 tablet_bootstrap.cc:492] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:51.252861  1753 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.252557  1749 raft_consensus.cc:359] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.253464  1753 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.253641  1749 raft_consensus.cc:385] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.254097  1753 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.254246  1749 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.255565  1749 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.225061  1751 tablet_bootstrap.cc:492] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:51.258186  1751 ts_tablet_manager.cc:1403] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.015s
I20260709 12:58:51.272915  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:51.275583  1601 leader_election.cc:343] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.270722  1787 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.285748  1632 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:51.317337  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:51.318315  1772 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:51.320097  1772 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.320664  1772 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:51.321749  1772 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.326181  1749 ts_tablet_manager.cc:1434] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.076s	user 0.034s	sys 0.017s
I20260709 12:58:51.327236  1749 tablet_bootstrap.cc:492] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:51.326943  1751 raft_consensus.cc:359] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.327687  1751 raft_consensus.cc:385] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.327986  1751 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.328686  1751 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.330868  1751 ts_tablet_manager.cc:1434] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.072s	user 0.010s	sys 0.001s
I20260709 12:58:51.332412  1761 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.333472  1753 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.334894  1761 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.336652  1753 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.336854  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:51.337426  1709 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.337613  1752 tablet_bootstrap.cc:654] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.338688  1749 tablet_bootstrap.cc:654] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.338961  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:58:51.340998  1601 leader_election.cc:343] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.341279  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:51.341984  1560 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.342665  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:51.342928  1751 tablet_bootstrap.cc:492] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:51.343263  1634 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.346701  1709 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:51.348450  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:51.349763  1753 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.317565  1456 catalog_manager.cc:5697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:51.350533  1751 tablet_bootstrap.cc:654] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.350464  1560 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:51.350335  1753 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.352469  1753 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.351930  1600 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:51.353662  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.354312  1753 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.355043  1753 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:51.354962  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:51.355754  1559 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:51.356048  1753 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.354351  1709 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:51.357193  1600 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:51.358760  1803 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.359148  1803 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.359508  1803 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.360278  1761 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.360852  1761 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:51.361744  1761 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.361385  1455 catalog_manager.cc:5697] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:51.372522  1634 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:51.374575  1787 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.375100  1787 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.377154  1787 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.379974  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:51.381562  1600 leader_election.cc:343] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.382416  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.383054  1709 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:51.384157  1601 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:51.385659  1787 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.386003  1787 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.386343  1787 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.390873  1782 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.391368  1782 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.369650  1803 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.395412  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.393906  1782 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:51.396719  1526 leader_election.cc:343] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.397543  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:51.397848  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:51.398561  1560 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.398747  1803 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:51.398904  1524 leader_election.cc:343] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.399498  1524 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:51.401944  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:51.402668  1708 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.403395  1456 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:51.406293  1782 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.411209  1560 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:51.412879  1600 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:51.414353  1814 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.415257  1814 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:51.418375  1708 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:51.416450  1814 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.423074  1787 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.423650  1457 catalog_manager.cc:5697] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:51.427788  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:51.429129  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:51.429653  1708 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:51.430229  1600 leader_election.cc:343] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.434585  1787 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.439797  1708 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:51.441021  1601 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:51.442157  1787 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.442677  1787 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:51.443480  1787 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.456674  1752 tablet_bootstrap.cc:492] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:51.457108  1752 ts_tablet_manager.cc:1403] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.205s	user 0.017s	sys 0.010s
I20260709 12:58:51.458678  1751 tablet_bootstrap.cc:492] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:51.459170  1751 ts_tablet_manager.cc:1403] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.116s	user 0.032s	sys 0.017s
I20260709 12:58:51.459204  1749 tablet_bootstrap.cc:492] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:51.459942  1749 ts_tablet_manager.cc:1403] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.133s	user 0.020s	sys 0.029s
I20260709 12:58:51.461056  1752 raft_consensus.cc:359] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.461772  1752 raft_consensus.cc:385] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.462073  1752 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.461938  1751 raft_consensus.cc:359] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.462909  1751 raft_consensus.cc:385] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.463363  1751 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.463002  1752 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.463083  1749 raft_consensus.cc:359] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.464025  1749 raft_consensus.cc:385] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.464365  1749 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.464346  1751 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.465119  1456 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:51.465435  1749 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.466722  1751 ts_tablet_manager.cc:1434] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:51.467068  1456 catalog_manager.cc:5697] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:51.468107  1749 ts_tablet_manager.cc:1434] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:58:51.469069  1749 tablet_bootstrap.cc:492] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:51.468952  1456 catalog_manager.cc:5697] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:51.474653  1752 ts_tablet_manager.cc:1434] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:58:51.476174  1749 tablet_bootstrap.cc:654] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.483191  1751 tablet_bootstrap.cc:492] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:51.484337  1752 tablet_bootstrap.cc:492] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:51.492203  1751 tablet_bootstrap.cc:654] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.492331  1752 tablet_bootstrap.cc:654] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.496461  1749 tablet_bootstrap.cc:492] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:51.497023  1749 ts_tablet_manager.cc:1403] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.012s
I20260709 12:58:51.497841  1751 tablet_bootstrap.cc:492] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:51.498307  1751 ts_tablet_manager.cc:1403] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 12:58:51.498787  1752 tablet_bootstrap.cc:492] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:51.499222  1752 ts_tablet_manager.cc:1403] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:58:51.499603  1749 raft_consensus.cc:359] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.500326  1749 raft_consensus.cc:385] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.500612  1749 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.500618  1751 raft_consensus.cc:359] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.501310  1751 raft_consensus.cc:385] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.501622  1751 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.501428  1749 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.501732  1752 raft_consensus.cc:359] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.502388  1752 raft_consensus.cc:385] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.502228  1751 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.502671  1752 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.503437  1752 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.503871  1749 ts_tablet_manager.cc:1434] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:51.504859  1751 ts_tablet_manager.cc:1434] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:51.505774  1751 tablet_bootstrap.cc:492] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:51.506198  1752 ts_tablet_manager.cc:1434] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:51.507265  1752 tablet_bootstrap.cc:492] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:51.510561  1749 tablet_bootstrap.cc:492] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:51.513293  1751 tablet_bootstrap.cc:654] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.515187  1752 tablet_bootstrap.cc:654] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.517513  1749 tablet_bootstrap.cc:654] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.521502  1772 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.522050  1772 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.523761  1752 tablet_bootstrap.cc:492] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:51.524186  1752 ts_tablet_manager.cc:1403] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 12:58:51.526157  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:51.527019  1560 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:51.527261  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:51.527920  1634 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:51.528636  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:51.529574  1760 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.529923  1760 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.530138  1782 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.530834  1782 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.528627  1752 raft_consensus.cc:359] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.531879  1752 raft_consensus.cc:385] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.532188  1752 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.532929  1752 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.530303  1760 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.534981  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.535319  1752 ts_tablet_manager.cc:1434] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:58:51.536206  1752 tablet_bootstrap.cc:492] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:51.536851  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:51.537573  1634 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 1: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:58:51.538456  1524 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:51.524150  1772 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:51.539568  1761 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.541841  1751 tablet_bootstrap.cc:492] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:51.542336  1751 ts_tablet_manager.cc:1403] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.007s
I20260709 12:58:51.540931  1782 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.545185  1751 raft_consensus.cc:359] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.545851  1751 raft_consensus.cc:385] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.546165  1751 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.545938  1760 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.546422  1749 tablet_bootstrap.cc:492] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:51.547010  1749 ts_tablet_manager.cc:1403] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.008s
I20260709 12:58:51.546842  1751 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.549154  1751 ts_tablet_manager.cc:1434] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:58:51.549358  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:51.549944  1560 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.550215  1751 tablet_bootstrap.cc:492] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:51.555534  1761 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.557904  1760 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:51.558849  1752 tablet_bootstrap.cc:654] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.559078  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:51.559725  1634 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.560685  1749 raft_consensus.cc:359] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.561350  1749 raft_consensus.cc:385] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.561240  1761 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.561726  1749 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.561959  1761 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.562444  1749 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.562789  1787 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.563361  1787 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.564400  1749 ts_tablet_manager.cc:1434] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.002s
I20260709 12:58:51.565213  1560 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:51.565434  1787 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.565565  1749 tablet_bootstrap.cc:492] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:51.566800  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:51.567430  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.568502  1708 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:51.569365  1751 tablet_bootstrap.cc:654] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.569707  1601 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:51.572916  1749 tablet_bootstrap.cc:654] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.573346  1760 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.576658  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:51.577291  1760 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 12:58:51.578052  1600 leader_election.cc:343] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.578085  1787 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:51.578528  1760 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.579252  1787 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:51.579703  1787 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.586210  1782 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.587105  1787 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.586900  1782 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.590512  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:51.591735  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:58:51.591852  1600 leader_election.cc:343] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.592154  1761 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:51.594290  1524 leader_election.cc:343] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.594364  1787 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.595126  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:51.595733  1708 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.598632  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:58:51.600095  1524 leader_election.cc:343] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.600687  1760 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.601090  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.601320  1760 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:51.602988  1526 leader_election.cc:343] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.603426  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:51.604499  1761 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.604045  1455 catalog_manager.cc:5697] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:51.605149  1760 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:51.606345  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:51.606664  1749 tablet_bootstrap.cc:492] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:51.607298  1749 ts_tablet_manager.cc:1403] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.001s
I20260709 12:58:51.607380  1632 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 1: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:58:51.606292  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:51.609836  1560 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 1: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:58:51.611277  1674 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:51.611090  1749 raft_consensus.cc:359] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.611986  1749 raft_consensus.cc:385] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.612264  1749 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.612929  1760 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.613045  1749 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.615376  1749 ts_tablet_manager.cc:1434] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:58:51.616701  1749 tablet_bootstrap.cc:492] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:51.620673  1760 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.620895  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.622670  1749 tablet_bootstrap.cc:654] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:51.622745  1526 leader_election.cc:343] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.623385  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:51.624466  1761 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.625378  1782 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.577512  1634 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:51.617592  1708 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:51.637687  1601 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:51.639551  1787 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:51.640244  1787 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:51.641364  1787 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.648864  1787 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.649550  1787 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.652498  1782 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.653055  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:51.653014  1782 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.653577  1749 tablet_bootstrap.cc:492] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:51.654248  1749 ts_tablet_manager.cc:1403] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.019s
W20260709 12:58:51.655191  1600 leader_election.cc:343] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.656538  1782 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.656809  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:51.657272  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.658012  1708 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 1: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:58:51.657873  1749 raft_consensus.cc:359] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.658854  1749 raft_consensus.cc:385] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.659128  1526 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:51.659246  1749 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.660368  1782 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.660593  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.660389  1749 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:51.662246  1601 leader_election.cc:343] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.662686  1601 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:51.663483  1814 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.663637  1749 ts_tablet_manager.cc:1434] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:58:51.664625  1787 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.667079  1749 tablet_bootstrap.cc:492] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:51.668341  1782 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.670805  1751 tablet_bootstrap.cc:492] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:51.671299  1751 ts_tablet_manager.cc:1403] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.121s	user 0.025s	sys 0.038s
I20260709 12:58:51.670260  1457 catalog_manager.cc:5697] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:51.672365  1752 tablet_bootstrap.cc:492] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:51.672797  1752 ts_tablet_manager.cc:1403] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.137s	user 0.021s	sys 0.027s
I20260709 12:58:51.674358  1751 raft_consensus.cc:359] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.675022  1751 raft_consensus.cc:385] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.675451  1749 tablet_bootstrap.cc:654] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.675289  1752 raft_consensus.cc:359] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.676230  1752 raft_consensus.cc:385] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.676504  1752 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.677430  1752 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.678925  1761 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:51.679466  1752 ts_tablet_manager.cc:1434] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:58:51.680328  1752 tablet_bootstrap.cc:492] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:51.686551  1752 tablet_bootstrap.cc:654] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.675289  1751 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.688519  1751 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.691514  1751 ts_tablet_manager.cc:1434] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
W20260709 12:58:51.698171  1526 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:51.700534  1751 tablet_bootstrap.cc:492] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:51.707809  1751 tablet_bootstrap.cc:654] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.711215  1752 tablet_bootstrap.cc:492] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:51.712275  1752 ts_tablet_manager.cc:1403] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.000s
I20260709 12:58:51.715844  1752 raft_consensus.cc:359] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.716828  1752 raft_consensus.cc:385] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.717186  1752 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.718014  1752 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.720147  1752 ts_tablet_manager.cc:1434] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:51.721352  1752 tablet_bootstrap.cc:492] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:51.725008  1751 tablet_bootstrap.cc:492] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:51.725942  1751 ts_tablet_manager.cc:1403] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 12:58:51.727572  1752 tablet_bootstrap.cc:654] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.728602  1751 raft_consensus.cc:359] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.736876  1751 raft_consensus.cc:385] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.737385  1751 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.738516  1751 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.741322  1751 ts_tablet_manager.cc:1434] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:58:51.741984  1782 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.742466  1782 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.747298  1749 tablet_bootstrap.cc:492] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:51.747738  1749 ts_tablet_manager.cc:1403] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.081s	user 0.032s	sys 0.037s
I20260709 12:58:51.747889  1708 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.749374  1751 tablet_bootstrap.cc:492] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:51.750792  1782 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.751847  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.752609  1709 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 1: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:58:51.751776  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:51.753700  1749 raft_consensus.cc:359] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.754756  1749 raft_consensus.cc:385] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.755008  1749 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.755636  1749 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.756644  1526 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:51.757723  1749 ts_tablet_manager.cc:1434] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:58:51.757781  1782 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:51.758764  1749 tablet_bootstrap.cc:492] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:51.765465  1751 tablet_bootstrap.cc:654] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.769856  1749 tablet_bootstrap.cc:654] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.769995  1782 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:51.788914  1787 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:58:51.789342  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:51.779450  1752 tablet_bootstrap.cc:492] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:51.791957  1752 ts_tablet_manager.cc:1403] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.071s	user 0.026s	sys 0.000s
I20260709 12:58:51.792717  1751 tablet_bootstrap.cc:492] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:51.793207  1751 ts_tablet_manager.cc:1403] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.044s	user 0.026s	sys 0.006s
I20260709 12:58:51.795557  1752 raft_consensus.cc:359] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.796339  1752 raft_consensus.cc:385] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.796639  1752 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.797489  1752 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.798802  1751 raft_consensus.cc:359] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.799603  1751 raft_consensus.cc:385] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.799957  1751 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.800136  1752 ts_tablet_manager.cc:1434] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:51.801153  1752 tablet_bootstrap.cc:492] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:51.802181  1749 tablet_bootstrap.cc:492] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:51.802879  1749 ts_tablet_manager.cc:1403] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.009s
I20260709 12:58:51.800827  1751 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.807855  1751 ts_tablet_manager.cc:1434] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:58:51.808595  1749 raft_consensus.cc:359] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.813069  1751 tablet_bootstrap.cc:492] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:51.813308  1749 raft_consensus.cc:385] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.813871  1749 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.813979  1796 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:51.815032  1749 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.817513  1749 ts_tablet_manager.cc:1434] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:58:51.821296  1751 tablet_bootstrap.cc:654] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.822243  1752 tablet_bootstrap.cc:654] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.835500  1752 tablet_bootstrap.cc:492] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:51.835976  1752 ts_tablet_manager.cc:1403] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.001s
I20260709 12:58:51.838552  1752 raft_consensus.cc:359] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.839295  1752 raft_consensus.cc:385] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.839561  1752 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.843026  1749 tablet_bootstrap.cc:492] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:51.840464  1752 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.850854  1752 ts_tablet_manager.cc:1434] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:58:51.852182  1752 tablet_bootstrap.cc:492] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:51.859315  1787 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.860179  1787 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.845863  1772 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:58:51.876972  1753 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:58:51.882917  1803 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:51.890164  1772 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:51.896203  1787 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:51.899642  1803 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.900235  1803 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.907282  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:51.911648  1601 leader_election.cc:343] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.912592  1751 tablet_bootstrap.cc:492] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:51.913161  1751 ts_tablet_manager.cc:1403] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.100s	user 0.007s	sys 0.028s
I20260709 12:58:51.907786  1782 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:58:51.915095  1761 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:51.914153  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:51.918818  1803 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:51.922662  1601 leader_election.cc:343] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:51.954808  1782 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.968515  1752 tablet_bootstrap.cc:654] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:51.957232  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:51.977689  1796 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:51.980675  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:51.980953  1751 raft_consensus.cc:359] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.981609  1751 raft_consensus.cc:385] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:51.981906  1751 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:51.982977  1787 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:51.982795  1751 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.966264  1782 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:51.984483  1558 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:52.040599  1556 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:52.058260  1843 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.058979  1843 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.062139  1844 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:58:52.061748  1843 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:52.067917  1751 ts_tablet_manager.cc:1434] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.154s	user 0.007s	sys 0.003s
I20260709 12:58:52.069443  1751 tablet_bootstrap.cc:492] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:52.066205  1753 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.079110  1600 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:52.080829  1814 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:52.082573  1782 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.083884  1749 tablet_bootstrap.cc:654] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.085600  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:52.086272  1635 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:52.086614  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:52.087049  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:52.087184  1634 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:52.088757  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:52.089550  1784 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:52.089906  1784 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:52.090101  1526 leader_election.cc:343] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.090325  1784 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.081750  1814 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.090734  1814 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.096638  1753 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.118857  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:52.120081  1556 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:52.123607  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:52.105451  1784 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.144505  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:52.166996  1753 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.169441  1796 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.167090  1846 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:52.158555  1787 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:52.171597  1753 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:58:52.172924  1787 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.181468  1853 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.174428  1846 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.170060  1796 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.180368  1787 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.189564  1846 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.181947  1853 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.200534  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:52.201207  1784 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:52.198894  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 56118us
I20260709 12:58:52.208664  1857 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:58:52.208936  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:52.214381  1751 tablet_bootstrap.cc:654] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.213984  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:52.216214  1853 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.218415  1814 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.219978  1752 tablet_bootstrap.cc:492] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
W20260709 12:58:52.213758  1601 leader_election.cc:343] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.244136  1752 ts_tablet_manager.cc:1403] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.392s	user 0.032s	sys 0.022s
I20260709 12:58:52.242242  1749 tablet_bootstrap.cc:492] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:52.244809  1749 ts_tablet_manager.cc:1403] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.402s	user 0.005s	sys 0.026s
I20260709 12:58:52.248065  1749 raft_consensus.cc:359] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.248806  1749 raft_consensus.cc:385] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.249087  1749 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.249948  1753 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:52.250367  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:52.256919  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:52.253114  1749 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:52.258119  1600 leader_election.cc:343] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:52.240860  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 85084.1us
I20260709 12:58:52.259333  1749 ts_tablet_manager.cc:1434] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:58:52.260273  1749 tablet_bootstrap.cc:492] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:52.260061  1846 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.261138  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:52.261749  1635 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:52.256601  1752 raft_consensus.cc:359] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.262969  1752 raft_consensus.cc:385] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.263237  1752 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.263702  1752 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.262411  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:52.264649  1796 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:52.267102  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:52.268836  1787 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.270442  1632 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 1: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:58:52.258646  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:52.272363  1862 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.275383  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:52.276207  1559 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
W20260709 12:58:52.276924  1600 leader_election.cc:343] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.262488  1772 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.307746  1772 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.307855  1844 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:52.309690  1709 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.303447  1752 ts_tablet_manager.cc:1434] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
I20260709 12:58:52.312304  1752 tablet_bootstrap.cc:492] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
W20260709 12:58:52.310781  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 43760.9us
I20260709 12:58:52.313303  1846 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:52.314631  1796 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:52.316777  1843 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.324836  1796 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:52.325510  1526 leader_election.cc:343] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.334794  1526 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:52.331943  1772 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:58:52.336730  1749 tablet_bootstrap.cc:654] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.326241  1787 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.329192  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 12:58:52.330782  1601 leader_election.cc:343] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.338703  1796 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.328648  1843 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.345587  1601 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:52.354225  1753 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.341145  1784 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.350454  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:52.350750  1843 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:52.359444  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:52.358788  1633 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.342772  1814 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.365453  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:52.371155  1559 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 1: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:58:52.361572  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:52.377835  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:52.382112  1556 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.385433  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:52.387084  1751 tablet_bootstrap.cc:492] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
W20260709 12:58:52.375140  1601 leader_election.cc:343] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.388681  1751 ts_tablet_manager.cc:1403] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.320s	user 0.023s	sys 0.021s
I20260709 12:58:52.391438  1784 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.391530  1751 raft_consensus.cc:359] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.392207  1751 raft_consensus.cc:385] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.392613  1751 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.393826  1751 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.394225  1752 tablet_bootstrap.cc:654] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.394400  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:52.391960  1784 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.395879  1751 ts_tablet_manager.cc:1434] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:52.398623  1751 tablet_bootstrap.cc:492] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:52.399477  1784 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.400174  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:52.403409  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:58:52.404842  1526 leader_election.cc:343] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.404907  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:52.404186  1632 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:52.405769  1555 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.407087  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:52.411363  1784 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:52.411464  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:52.411048  1673 leader_election.cc:343] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.419447  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:52.417372  1559 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:52.414145  1784 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.421597  1784 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.429023  1862 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:52.431835  1601 leader_election.cc:343] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.432308  1601 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:52.433223  1787 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.437754  1555 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:52.440327  1633 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:52.444567  1796 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.445075  1556 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:52.452842  1674 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:52.453902  1843 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:52.454298  1843 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.454638  1843 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.455614  1749 tablet_bootstrap.cc:492] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:52.456064  1749 ts_tablet_manager.cc:1403] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.196s	user 0.009s	sys 0.008s
I20260709 12:58:52.462746  1841 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.456437  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:52.475063  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:52.476104  1556 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.476989  1796 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:52.477882  1796 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:52.478520  1796 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:52.479650  1796 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.485870  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:52.486574  1633 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.486518  1600 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:52.487864  1753 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:52.488574  1753 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:52.489440  1753 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.489688  1843 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.492841  1751 tablet_bootstrap.cc:654] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.494285  1749 raft_consensus.cc:359] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.496286  1749 raft_consensus.cc:385] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.493888  1633 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:52.496579  1749 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.501266  1749 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.503996  1556 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:52.505504  1749 ts_tablet_manager.cc:1434] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.049s	user 0.012s	sys 0.002s
I20260709 12:58:52.506474  1749 tablet_bootstrap.cc:492] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:52.509665  1674 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:52.510962  1841 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:52.511391  1841 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:52.512180  1841 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.515839  1752 tablet_bootstrap.cc:492] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:52.516515  1752 ts_tablet_manager.cc:1403] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.204s	user 0.012s	sys 0.043s
I20260709 12:58:52.518956  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:52.519538  1556 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.525118  1556 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:52.526408  1843 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:52.527585  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:52.528162  1632 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.535202  1674 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:52.543613  1632 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:52.512805  1784 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.544580  1843 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:52.545516  1843 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:52.553485  1752 raft_consensus.cc:359] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.554327  1752 raft_consensus.cc:385] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.554585  1752 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.555220  1752 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.555961  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:52.556538  1709 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.557236  1752 ts_tablet_manager.cc:1434] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:58:52.556347  1458 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.559468  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:52.560078  1632 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.561239  1752 tablet_bootstrap.cc:492] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:52.563871  1784 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.565531  1843 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.581732  1782 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.580302  1841 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.600533  1841 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.598735  1782 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.602885  1782 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.604285  1751 tablet_bootstrap.cc:492] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:52.604694  1751 ts_tablet_manager.cc:1403] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.206s	user 0.018s	sys 0.002s
I20260709 12:58:52.603680  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:52.595080  1709 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:52.605782  1633 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:52.572044  1632 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:52.607551  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:52.609275  1752 tablet_bootstrap.cc:654] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.609254  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:58:52.609941  1526 leader_election.cc:343] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.611306  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:52.612195  1784 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:52.612360  1782 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:52.613438  1784 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:52.613552  1782 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.613956  1782 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.617300  1749 tablet_bootstrap.cc:654] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.614360  1784 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.616138  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:52.620615  1674 leader_election.cc:343] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.623072  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:58:52.624949  1673 leader_election.cc:343] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.625579  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:52.626729  1796 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.621872  1841 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:52.635082  1751 raft_consensus.cc:359] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.636049  1751 raft_consensus.cc:385] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.636391  1751 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.642436  1751 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.649231  1751 ts_tablet_manager.cc:1434] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:58:52.650621  1751 tablet_bootstrap.cc:492] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:52.664134  1751 tablet_bootstrap.cc:654] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.664026  1782 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.674248  1782 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.674962  1782 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.675596  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:52.676190  1632 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.683926  1632 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:52.675436  1782 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.686764  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:52.687603  1782 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.688184  1782 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:52.688642  1782 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:52.689358  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:52.689510  1782 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.691707  1751 tablet_bootstrap.cc:492] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:52.691569  1455 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.693028  1751 ts_tablet_manager.cc:1403] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.003s
I20260709 12:58:52.694039  1752 tablet_bootstrap.cc:492] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:52.694522  1752 ts_tablet_manager.cc:1403] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.137s	user 0.025s	sys 0.003s
I20260709 12:58:52.697700  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:52.697804  1752 raft_consensus.cc:359] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.698484  1632 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:52.698505  1752 raft_consensus.cc:385] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.699723  1752 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.699610  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:52.700309  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:52.700479  1784 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:52.701010  1709 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:52.701203  1784 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.701710  1784 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.701740  1752 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.701010  1751 raft_consensus.cc:359] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.702740  1751 raft_consensus.cc:385] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.703014  1751 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.704051  1752 ts_tablet_manager.cc:1434] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:52.703821  1751 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:52.704566  1526 leader_election.cc:343] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.705899  1751 ts_tablet_manager.cc:1434] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:58:52.706151  1752 tablet_bootstrap.cc:492] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:52.708298  1751 tablet_bootstrap.cc:492] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:52.712965  1749 tablet_bootstrap.cc:492] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:52.713462  1749 ts_tablet_manager.cc:1403] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.207s	user 0.020s	sys 0.028s
I20260709 12:58:52.714916  1751 tablet_bootstrap.cc:654] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.716230  1749 raft_consensus.cc:359] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.716882  1749 raft_consensus.cc:385] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.717135  1749 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.717785  1749 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.722376  1455 catalog_manager.cc:5697] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.723775  1749 ts_tablet_manager.cc:1434] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:58:52.724772  1749 tablet_bootstrap.cc:492] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:52.727391  1752 tablet_bootstrap.cc:654] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.730839  1749 tablet_bootstrap.cc:654] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.732718  1751 tablet_bootstrap.cc:492] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:52.733197  1751 ts_tablet_manager.cc:1403] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 12:58:52.735785  1751 raft_consensus.cc:359] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.736490  1751 raft_consensus.cc:385] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.738758  1784 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.736754  1457 catalog_manager.cc:5697] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:52.747100  1457 catalog_manager.cc:5697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:52.749903  1457 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:52.751999  1784 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.752250  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:52.752782  1632 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.736750  1751 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.754019  1751 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.757670  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:52.758443  1709 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.757747  1751 ts_tablet_manager.cc:1434] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:58:52.764954  1751 tablet_bootstrap.cc:492] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:52.771775  1632 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:58:52.772964  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:52.774435  1784 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:52.775094  1784 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:52.774943  1709 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:58:52.777017  1784 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.780793  1751 tablet_bootstrap.cc:654] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.789546  1752 tablet_bootstrap.cc:492] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:52.790067  1752 ts_tablet_manager.cc:1403] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.000s
I20260709 12:58:52.792840  1752 raft_consensus.cc:359] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.793577  1752 raft_consensus.cc:385] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.793844  1752 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.795083  1752 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.795856  1749 tablet_bootstrap.cc:492] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:52.796389  1749 ts_tablet_manager.cc:1403] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.072s	user 0.034s	sys 0.027s
I20260709 12:58:52.798830  1749 raft_consensus.cc:359] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.799567  1749 raft_consensus.cc:385] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.799106  1455 catalog_manager.cc:5697] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 2, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.799896  1749 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.801119  1749 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.802635  1749 ts_tablet_manager.cc:1434] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 12:58:52.804409  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:52.808398  1752 ts_tablet_manager.cc:1434] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:58:52.809379  1752 tablet_bootstrap.cc:492] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:52.808336  1749 tablet_bootstrap.cc:492] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:52.817519  1749 tablet_bootstrap.cc:654] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.825171  1752 tablet_bootstrap.cc:654] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.832167  1784 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.832862  1784 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.836844  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:52.837651  1632 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:52.838313  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:52.839129  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:52.840029  1782 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:52.840380  1782 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.841041  1782 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.841135  1784 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.841465  1752 tablet_bootstrap.cc:492] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
W20260709 12:58:52.840373  1526 leader_election.cc:343] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.842077  1752 ts_tablet_manager.cc:1403] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.002s
I20260709 12:58:52.844710  1752 raft_consensus.cc:359] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.845360  1752 raft_consensus.cc:385] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.845633  1752 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.846319  1752 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.848920  1782 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.851974  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:52.852553  1632 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.855439  1752 ts_tablet_manager.cc:1434] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:58:52.856986  1752 tablet_bootstrap.cc:492] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:52.860095  1632 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:52.861728  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:52.862659  1784 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:52.863142  1784 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:52.863063  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:52.864066  1784 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.864653  1752 tablet_bootstrap.cc:654] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:52.864580  1526 leader_election.cc:343] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.865061  1782 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.876269  1457 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.879148  1751 tablet_bootstrap.cc:492] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:52.879305  1749 tablet_bootstrap.cc:492] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:52.879779  1751 ts_tablet_manager.cc:1403] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.115s	user 0.031s	sys 0.025s
I20260709 12:58:52.879987  1752 tablet_bootstrap.cc:492] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:52.879920  1749 ts_tablet_manager.cc:1403] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.009s
I20260709 12:58:52.882072  1752 ts_tablet_manager.cc:1403] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.005s
I20260709 12:58:52.882975  1749 raft_consensus.cc:359] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.883777  1749 raft_consensus.cc:385] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.884516  1749 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.885275  1749 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.885589  1752 raft_consensus.cc:359] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.886418  1752 raft_consensus.cc:385] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.886751  1752 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.881784  1751 raft_consensus.cc:359] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.887317  1751 raft_consensus.cc:385] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.887606  1751 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.888074  1752 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.888329  1751 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.890151  1749 ts_tablet_manager.cc:1434] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:58:52.890542  1752 ts_tablet_manager.cc:1434] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:52.891096  1749 tablet_bootstrap.cc:492] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:52.891661  1752 tablet_bootstrap.cc:492] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:52.894198  1784 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.894765  1784 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.897547  1751 ts_tablet_manager.cc:1434] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:58:52.898542  1751 tablet_bootstrap.cc:492] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:52.898669  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:58:52.905701  1524 leader_election.cc:343] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.906116  1751 tablet_bootstrap.cc:654] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.907450  1752 tablet_bootstrap.cc:654] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.898579  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:52.909229  1749 tablet_bootstrap.cc:654] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:52.910327  1526 leader_election.cc:343] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:52.910913  1526 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:52.913046  1883 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.899608  1784 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.917975  1709 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.928320  1749 tablet_bootstrap.cc:492] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:52.928946  1749 ts_tablet_manager.cc:1403] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.004s
I20260709 12:58:52.930637  1751 tablet_bootstrap.cc:492] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:52.931090  1751 ts_tablet_manager.cc:1403] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.016s
I20260709 12:58:52.932123  1753 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.932390  1862 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:52.932663  1753 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.933013  1843 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.932669  1752 tablet_bootstrap.cc:492] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:52.933645  1843 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.933951  1752 ts_tablet_manager.cc:1403] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.010s
I20260709 12:58:52.935607  1843 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:52.937083  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:52.937871  1558 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 1: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:58:52.937705  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:52.938766  1632 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 1: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:58:52.939937  1673 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:52.940177  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:52.940737  1841 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.940728  1558 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:52.946673  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:52.947952  1753 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:52.949591  1749 raft_consensus.cc:359] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.951478  1841 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.947440  1706 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:52.953632  1751 raft_consensus.cc:359] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.951864  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:52.954442  1751 raft_consensus.cc:385] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.954761  1751 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.955376  1787 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:52.955749  1787 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:52.952206  1752 raft_consensus.cc:359] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.955482  1751 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.956081  1787 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.956247  1752 raft_consensus.cc:385] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.956674  1752 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.957474  1752 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.958433  1841 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:52.959384  1841 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.959981  1752 ts_tablet_manager.cc:1434] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:58:52.961058  1752 tablet_bootstrap.cc:492] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:52.961985  1841 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:52.962560  1749 raft_consensus.cc:385] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:52.962874  1749 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:52.963629  1749 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.965287  1751 ts_tablet_manager.cc:1434] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:58:52.966454  1751 tablet_bootstrap.cc:492] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:52.967947  1752 tablet_bootstrap.cc:654] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.969501  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:52.975123  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:52.975607  1749 ts_tablet_manager.cc:1434] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 12:58:52.975904  1632 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 1: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:58:52.977136  1749 tablet_bootstrap.cc:492] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:52.977183  1753 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:52.978153  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:52.978761  1843 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:52.980319  1796 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:52.973876  1751 tablet_bootstrap.cc:654] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.988023  1796 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:52.989640  1749 tablet_bootstrap.cc:654] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:52.997321  1844 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:53.007393  1787 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:52.998375  1843 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.012387  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:53.013059  1556 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.021013  1556 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:53.025827  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:53.026883  1862 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:53.030442  1784 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.031852  1796 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.046799  1787 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.049381  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:53.050221  1709 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.066867  1784 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.067411  1784 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.069733  1782 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:53.071031  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:53.071660  1707 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:53.072198  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:53.072887  1526 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:53.073721  1782 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.074149  1782 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.074491  1782 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.076593  1862 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 12:58:53.074908  1524 leader_election.cc:343] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.077649  1862 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.082121  1784 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.084805  1749 tablet_bootstrap.cc:492] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:53.085402  1749 ts_tablet_manager.cc:1403] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.006s
I20260709 12:58:53.089036  1709 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:53.081681  1782 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.095706  1782 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.096105  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:53.097662  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:58:53.097884  1524 leader_election.cc:343] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.098256  1707 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.099622  1749 raft_consensus.cc:359] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.100327  1749 raft_consensus.cc:385] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.099973  1843 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:53.100607  1749 raft_consensus.cc:740] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.101858  1749 consensus_queue.cc:260] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.103936  1749 ts_tablet_manager.cc:1434] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:58:53.104806  1749 tablet_bootstrap.cc:492] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:53.106465  1707 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:53.108116  1526 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:53.109154  1784 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:53.110371  1784 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:53.112151  1784 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.131075  1910 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.131721  1749 tablet_bootstrap.cc:654] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.131812  1910 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.142596  1910 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.144229  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:53.156980  1601 leader_election.cc:343] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.159781  1751 tablet_bootstrap.cc:492] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:53.160338  1751 ts_tablet_manager.cc:1403] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.194s	user 0.020s	sys 0.041s
I20260709 12:58:53.150323  1841 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:58:53.162163  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:53.163389  1751 raft_consensus.cc:359] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.173074  1751 raft_consensus.cc:385] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.173480  1751 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.174476  1752 tablet_bootstrap.cc:492] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:53.174182  1751 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.174937  1752 ts_tablet_manager.cc:1403] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.214s	user 0.060s	sys 0.060s
I20260709 12:58:53.178208  1558 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:53.183036  1751 ts_tablet_manager.cc:1434] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:58:53.184268  1751 tablet_bootstrap.cc:492] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:53.189496  1752 raft_consensus.cc:359] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.194360  1752 raft_consensus.cc:385] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.194089  1600 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:53.194832  1752 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.195283  1910 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.195713  1910 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.196157  1910 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.195935  1752 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.199075  1752 ts_tablet_manager.cc:1434] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:58:53.200302  1752 tablet_bootstrap.cc:492] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:53.210958  1749 tablet_bootstrap.cc:492] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:53.211458  1749 ts_tablet_manager.cc:1403] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.004s
I20260709 12:58:53.215178  1749 raft_consensus.cc:359] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.215868  1749 raft_consensus.cc:385] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.216150  1749 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.216763  1749 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.218904  1749 ts_tablet_manager.cc:1434] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:53.219756  1749 tablet_bootstrap.cc:492] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:53.219240  1456 catalog_manager.cc:5697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.220532  1751 tablet_bootstrap.cc:654] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.228062  1884 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:53.228368  1910 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.230427  1910 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.231200  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:53.231859  1558 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.240056  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:53.242265  1862 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.242774  1862 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.244751  1862 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.244935  1749 tablet_bootstrap.cc:654] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:53.246345  1601 leader_election.cc:343] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.247186  1558 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:53.247762  1709 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:53.248850  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:53.249509  1707 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:53.249863  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:53.250236  1752 tablet_bootstrap.cc:654] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.250511  1558 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:53.249502  1600 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:53.251603  1862 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:53.251988  1600 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:53.252473  1884 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.252936  1787 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.253639  1787 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.254236  1787 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.254606  1457 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.252496  1862 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:53.262179  1753 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.262323  1787 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.263681  1753 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.265738  1753 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.267443  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:53.269033  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:53.269600  1709 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:53.270643  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:53.270769  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:53.271641  1558 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.271791  1753 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.266770  1862 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.272230  1753 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.283308  1884 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.283954  1753 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:53.272724  1600 leader_election.cc:343] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.275322  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:53.297225  1709 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.313038  1749 tablet_bootstrap.cc:492] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:53.313524  1749 ts_tablet_manager.cc:1403] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.094s	user 0.010s	sys 0.003s
I20260709 12:58:53.315424  1749 raft_consensus.cc:359] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.316005  1749 raft_consensus.cc:385] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.316259  1749 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.316851  1749 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.319409  1751 tablet_bootstrap.cc:492] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:53.320041  1751 ts_tablet_manager.cc:1403] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.136s	user 0.018s	sys 0.023s
I20260709 12:58:53.322592  1751 raft_consensus.cc:359] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.275763  1787 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.323309  1751 raft_consensus.cc:385] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.324122  1751 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.324945  1751 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.326457  1749 ts_tablet_manager.cc:1434] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:58:53.327402  1749 tablet_bootstrap.cc:492] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:53.331274  1884 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.331768  1884 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.342896  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:53.343597  1632 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:53.344494  1751 ts_tablet_manager.cc:1434] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:58:53.347992  1751 tablet_bootstrap.cc:492] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:53.343930  1709 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:53.343918  1753 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.340844  1884 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.349771  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:53.349586  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:53.351855  1526 leader_election.cc:343] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.370692  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:53.358186  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 12:58:53.402546  1600 leader_election.cc:343] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.402851  1632 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:53.391746  1787 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:53.404461  1787 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:53.356556  1884 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.406708  1883 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:53.423177  1910 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.423923  1910 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.405326  1787 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.429734  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:53.460830  1910 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.410449  1884 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:53.472899  1600 leader_election.cc:343] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.464432  1753 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.476079  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:53.478256  1601 leader_election.cc:343] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.478879  1601 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:53.480417  1753 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.484897  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:53.486253  1784 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:53.490727  1526 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:53.485716  1709 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.464525  1884 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.527611  1558 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:53.539717  1752 tablet_bootstrap.cc:492] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:53.540197  1752 ts_tablet_manager.cc:1403] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.340s	user 0.059s	sys 0.058s
I20260709 12:58:53.546241  1749 tablet_bootstrap.cc:654] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.553742  1752 raft_consensus.cc:359] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.554628  1752 raft_consensus.cc:385] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.555038  1752 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.555794  1752 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.558421  1752 ts_tablet_manager.cc:1434] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:58:53.558919  1709 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:53.559495  1752 tablet_bootstrap.cc:492] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:53.564944  1457 catalog_manager.cc:5697] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.566284  1884 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.573928  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:53.577517  1753 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:53.578013  1753 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:53.578847  1753 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.552693  1910 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:58:53.582254  1751 tablet_bootstrap.cc:654] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.587338  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:53.588547  1631 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.591114  1884 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.601421  1784 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.604192  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:58:53.610284  1526 leader_election.cc:343] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.610256  1784 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.614135  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:53.612450  1784 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:53.616176  1526 leader_election.cc:343] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.620354  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:53.620823  1752 tablet_bootstrap.cc:654] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:53.624668  1524 leader_election.cc:343] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.625583  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:53.626523  1784 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.631443  1910 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.633503  1846 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.634019  1846 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.635563  1749 tablet_bootstrap.cc:492] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:53.636026  1749 ts_tablet_manager.cc:1403] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.309s	user 0.003s	sys 0.015s
I20260709 12:58:53.636065  1846 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:53.637053  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:53.637998  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:53.638620  1910 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.639082  1910 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.639611  1673 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:53.640692  1846 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.642411  1749 raft_consensus.cc:359] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.642539  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:53.643106  1749 raft_consensus.cc:385] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.643406  1749 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.643853  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:53.644302  1600 leader_election.cc:343] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.644071  1749 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:53.645153  1601 leader_election.cc:343] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.645576  1601 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:53.646394  1923 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.646945  1749 ts_tablet_manager.cc:1434] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 12:58:53.647233  1910 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.647846  1749 tablet_bootstrap.cc:492] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:53.653720  1631 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:53.662539  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:53.664134  1883 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:53.664726  1883 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:53.665623  1883 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.667204  1749 tablet_bootstrap.cc:654] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.672291  1910 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:53.671025  1457 catalog_manager.cc:5697] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.678215  1749 tablet_bootstrap.cc:492] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:53.677438  1457 catalog_manager.cc:5697] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.678692  1749 ts_tablet_manager.cc:1403] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.008s
I20260709 12:58:53.681269  1752 tablet_bootstrap.cc:492] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:53.681684  1752 ts_tablet_manager.cc:1403] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.003s
I20260709 12:58:53.683943  1751 tablet_bootstrap.cc:492] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:53.684569  1751 ts_tablet_manager.cc:1403] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.339s	user 0.004s	sys 0.014s
I20260709 12:58:53.684990  1752 raft_consensus.cc:359] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.685655  1752 raft_consensus.cc:385] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.685890  1752 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.686710  1752 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.689110  1751 raft_consensus.cc:359] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.689841  1751 raft_consensus.cc:385] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.690186  1751 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.690927  1751 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.691854  1752 ts_tablet_manager.cc:1434] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:58:53.692766  1752 tablet_bootstrap.cc:492] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:53.693342  1751 ts_tablet_manager.cc:1434] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:58:53.694545  1751 tablet_bootstrap.cc:492] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:53.686776  1749 raft_consensus.cc:359] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.698189  1749 raft_consensus.cc:385] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.698510  1749 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.699067  1910 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.699290  1749 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.699586  1910 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.701877  1749 ts_tablet_manager.cc:1434] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.001s
I20260709 12:58:53.702800  1749 tablet_bootstrap.cc:492] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:53.702683  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:53.703366  1751 tablet_bootstrap.cc:654] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.703374  1910 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.704095  1883 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:53.704200  1600 leader_election.cc:343] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.704651  1883 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.705550  1784 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:53.706688  1883 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.707180  1752 tablet_bootstrap.cc:654] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.707868  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:53.708580  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:58:53.709178  1601 leader_election.cc:343] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.709597  1601 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:53.709189  1631 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:53.712376  1910 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.712589  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:53.699210  1458 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.718532  1749 tablet_bootstrap.cc:654] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.723412  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:53.727455  1526 leader_election.cc:343] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.718214  1784 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.728446  1784 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.728771  1784 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.740163  1784 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.747375  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:58:53.748916  1526 leader_election.cc:343] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:53.749449  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:53.750131  1631 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.746475  1784 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.749426  1752 tablet_bootstrap.cc:492] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:53.758792  1752 ts_tablet_manager.cc:1403] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.066s	user 0.027s	sys 0.013s
I20260709 12:58:53.759477  1631 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:53.763556  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:53.764618  1782 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:53.764526  1752 raft_consensus.cc:359] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.765237  1782 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:53.765458  1752 raft_consensus.cc:385] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.765846  1752 raft_consensus.cc:740] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.766096  1782 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.769282  1752 consensus_queue.cc:260] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.770479  1749 tablet_bootstrap.cc:492] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:53.770979  1749 ts_tablet_manager.cc:1403] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.009s
I20260709 12:58:53.772084  1752 ts_tablet_manager.cc:1434] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:58:53.774678  1749 raft_consensus.cc:359] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:53.775015  1524 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:53.775626  1749 raft_consensus.cc:385] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.775972  1749 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
W20260709 12:58:53.776938  1601 consensus_peers.cc:597] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:53.776651  1749 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.778710  1752 tablet_bootstrap.cc:492] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:53.779372  1749 ts_tablet_manager.cc:1434] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:53.780280  1749 tablet_bootstrap.cc:492] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:53.785641  1752 tablet_bootstrap.cc:654] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.787169  1749 tablet_bootstrap.cc:654] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.799665  1749 tablet_bootstrap.cc:492] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:53.800201  1749 ts_tablet_manager.cc:1403] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.002s
I20260709 12:58:53.803491  1749 raft_consensus.cc:359] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.804167  1752 tablet_bootstrap.cc:492] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:53.804239  1749 raft_consensus.cc:385] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.804724  1752 ts_tablet_manager.cc:1403] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.012s
I20260709 12:58:53.804705  1749 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.805603  1749 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.807679  1749 ts_tablet_manager.cc:1434] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:53.808579  1749 tablet_bootstrap.cc:492] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:53.815707  1752 raft_consensus.cc:359] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.816391  1752 raft_consensus.cc:385] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.815940  1457 catalog_manager.cc:5697] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:53.816656  1752 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.817497  1752 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.822095  1752 ts_tablet_manager.cc:1434] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:58:53.823069  1752 tablet_bootstrap.cc:492] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:53.822192  1749 tablet_bootstrap.cc:654] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.830145  1752 tablet_bootstrap.cc:654] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.832482  1751 tablet_bootstrap.cc:492] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:53.832940  1751 ts_tablet_manager.cc:1403] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.139s	user 0.012s	sys 0.008s
I20260709 12:58:53.839148  1749 tablet_bootstrap.cc:492] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:53.839761  1749 ts_tablet_manager.cc:1403] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.007s
I20260709 12:58:53.843255  1751 raft_consensus.cc:359] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.843997  1751 raft_consensus.cc:385] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.843765  1749 raft_consensus.cc:359] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.844334  1751 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
W20260709 12:58:53.844380  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:53.844794  1749 raft_consensus.cc:385] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.845124  1749 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.845271  1751 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.845764  1749 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.847694  1752 tablet_bootstrap.cc:492] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:53.848021  1749 ts_tablet_manager.cc:1434] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:53.848109  1752 ts_tablet_manager.cc:1403] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 12:58:53.849126  1749 tablet_bootstrap.cc:492] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:53.851413  1752 raft_consensus.cc:359] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.852051  1752 raft_consensus.cc:385] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.852291  1752 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.852882  1752 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.855216  1752 ts_tablet_manager.cc:1434] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:53.855412  1749 tablet_bootstrap.cc:654] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.856405  1752 tablet_bootstrap.cc:492] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:53.861969  1752 tablet_bootstrap.cc:654] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.867880  1749 tablet_bootstrap.cc:492] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:53.868320  1749 ts_tablet_manager.cc:1403] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:58:53.869093  1751 ts_tablet_manager.cc:1434] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:58:53.870316  1751 tablet_bootstrap.cc:492] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:53.870697  1749 raft_consensus.cc:359] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.871354  1749 raft_consensus.cc:385] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.871616  1749 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.872414  1749 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.874806  1749 ts_tablet_manager.cc:1434] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:58:53.875670  1749 tablet_bootstrap.cc:492] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:53.882508  1749 tablet_bootstrap.cc:654] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.885839  1752 tablet_bootstrap.cc:492] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:53.886322  1752 ts_tablet_manager.cc:1403] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.016s
I20260709 12:58:53.888794  1752 raft_consensus.cc:359] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.889427  1752 raft_consensus.cc:385] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.889685  1752 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.890277  1751 tablet_bootstrap.cc:654] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.890297  1752 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.895309  1752 ts_tablet_manager.cc:1434] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:53.896776  1752 tablet_bootstrap.cc:492] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:53.903096  1752 tablet_bootstrap.cc:654] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.909884  1751 tablet_bootstrap.cc:492] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:53.910357  1751 ts_tablet_manager.cc:1403] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.004s
I20260709 12:58:53.913285  1751 raft_consensus.cc:359] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.914817  1841 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.915465  1841 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.914013  1751 raft_consensus.cc:385] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.917737  1751 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.919163  1923 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.919809  1923 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.920166  1751 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.920614  1709 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.923800  1751 ts_tablet_manager.cc:1434] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:58:53.923943  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:53.924757  1751 tablet_bootstrap.cc:492] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:53.926390  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:53.926932  1923 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.928522  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:53.929931  1601 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:53.930109  1841 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:53.931038  1752 tablet_bootstrap.cc:492] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:53.931211  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:53.931485  1752 ts_tablet_manager.cc:1403] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.012s
I20260709 12:58:53.931915  1631 raft_consensus.cc:2393] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 1: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:58:53.934427  1673 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:53.935081  1752 raft_consensus.cc:359] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.935703  1752 raft_consensus.cc:385] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.935957  1752 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.936297  1844 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.936555  1752 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.938315  1751 tablet_bootstrap.cc:654] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.939167  1752 ts_tablet_manager.cc:1434] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:58:53.940081  1752 tablet_bootstrap.cc:492] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:53.941849  1923 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.945359  1844 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:53.945966  1752 tablet_bootstrap.cc:654] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.963207  1749 tablet_bootstrap.cc:492] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:53.963877  1749 ts_tablet_manager.cc:1403] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.020s
I20260709 12:58:53.967975  1749 raft_consensus.cc:359] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.969197  1749 raft_consensus.cc:385] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:53.969601  1749 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:53.970578  1749 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.972846  1749 ts_tablet_manager.cc:1434] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:58:53.974152  1749 tablet_bootstrap.cc:492] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:53.982714  1923 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.983171  1749 tablet_bootstrap.cc:654] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:53.983238  1923 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.985432  1923 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:53.987385  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:53.988296  1560 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:53.990453  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:53.991683  1862 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:53.992213  1862 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.992661  1862 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:53.988422  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:53.994580  1707 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:53.999095  1752 tablet_bootstrap.cc:492] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:53.999150  1751 tablet_bootstrap.cc:492] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:53.999755  1752 ts_tablet_manager.cc:1403] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.021s
I20260709 12:58:54.002447  1752 raft_consensus.cc:359] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.003309  1752 raft_consensus.cc:385] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.003633  1752 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.003971  1923 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:54.004637  1752 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.007139  1752 ts_tablet_manager.cc:1434] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:58:54.008113  1752 tablet_bootstrap.cc:492] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:54.006505  1862 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:53.999799  1751 ts_tablet_manager.cc:1403] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.035s
I20260709 12:58:54.013005  1844 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.013832  1844 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.014496  1752 tablet_bootstrap.cc:654] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.016989  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:54.018349  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:54.019347  1631 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 1: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:58:54.021234  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:54.021698  1751 raft_consensus.cc:359] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.022337  1841 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.022473  1751 raft_consensus.cc:385] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.022804  1751 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.027667  1751 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.029515  1782 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.030449  1751 ts_tablet_manager.cc:1434] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:58:54.030220  1782 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.032954  1782 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:54.034162  1844 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:54.035885  1751 tablet_bootstrap.cc:492] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:54.036904  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:54.028952  1923 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:54.039512  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:54.040135  1631 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:54.040863  1752 tablet_bootstrap.cc:492] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:54.041348  1752 ts_tablet_manager.cc:1403] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.012s
I20260709 12:58:54.041239  1524 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:54.042670  1784 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.043030  1784 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.043558  1784 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.044730  1883 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.044551  1752 raft_consensus.cc:359] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.045370  1752 raft_consensus.cc:385] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.045257  1883 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.046298  1752 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.046015  1841 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:54.048202  1526 leader_election.cc:343] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.048499  1883 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:54.048851  1752 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.051189  1752 ts_tablet_manager.cc:1434] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:58:54.052109  1752 tablet_bootstrap.cc:492] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:54.052635  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:54.053368  1560 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.053264  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:54.053997  1709 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.058511  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:54.059523  1752 tablet_bootstrap.cc:654] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.060735  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:54.059293  1706 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:54.062481  1782 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:54.068827  1846 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.069350  1846 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.071770  1846 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:54.073730  1752 tablet_bootstrap.cc:492] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:54.074406  1752 ts_tablet_manager.cc:1403] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:58:54.074925  1782 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.075452  1782 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.077629  1752 raft_consensus.cc:359] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.078545  1752 raft_consensus.cc:385] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.078891  1752 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.079586  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:54.079599  1752 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.080310  1632 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:54.081745  1752 ts_tablet_manager.cc:1434] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:54.081461  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:54.077737  1782 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:54.082938  1752 tablet_bootstrap.cc:492] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:54.083501  1884 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:54.083870  1884 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.084200  1884 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.084771  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:54.091496  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:54.092221  1632 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:54.100292  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:54.101486  1846 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.101989  1846 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.102501  1846 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:54.106570  1674 leader_election.cc:343] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.106338  1884 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.107776  1923 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:54.061980  1560 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:54.126490  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:58:54.127578  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 59874.5us
I20260709 12:58:54.061950  1631 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:54.132565  1782 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.156529  1751 tablet_bootstrap.cc:654] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.132649  1923 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.157822  1884 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:54.145990  1844 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.161556  1844 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.150557  1862 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:54.163961  1923 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.165343  1749 tablet_bootstrap.cc:492] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:54.160995  1709 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:54.165947  1749 ts_tablet_manager.cc:1403] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.192s	user 0.012s	sys 0.008s
I20260709 12:58:54.155287  1782 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.069499  1784 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.184988  1782 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.169924  1844 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:54.174288  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:54.205181  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:54.202152  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:54.204339  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45719.7us
I20260709 12:58:54.204254  1784 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:54.206218  1709 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:54.207010  1841 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.207566  1752 tablet_bootstrap.cc:654] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.207535  1841 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.209831  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:54.210664  1709 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.212754  1749 raft_consensus.cc:359] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.213452  1749 raft_consensus.cc:385] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.213639  1749 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.214093  1749 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.208712  1862 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.217760  1862 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:54.218298  1923 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:54.265067  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:54.267802  1751 tablet_bootstrap.cc:492] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:54.283535  1751 ts_tablet_manager.cc:1403] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.252s	user 0.015s	sys 0.012s
I20260709 12:58:54.285230  1841 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:54.286448  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:54.287374  1634 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.211820  1846 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.298381  1846 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:54.300231  1862 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.302996  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:54.303766  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 136996us
I20260709 12:58:54.270743  1753 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.276005  1749 ts_tablet_manager.cc:1434] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.109s	user 0.006s	sys 0.003s
I20260709 12:58:54.306716  1753 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.307835  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:54.309420  1753 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:54.304308  1556 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:54.311245  1751 raft_consensus.cc:359] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.311548  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:54.312176  1751 raft_consensus.cc:385] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.312505  1632 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.312628  1751 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.404981  1844 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.405958  1844 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.406163  1674 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:54.406040  1751 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.308537  1749 tablet_bootstrap.cc:492] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:54.335832  1709 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:58:54.335407  1846 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.301643  1782 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:54.315857  1955 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:58:54.348878  1787 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.336464  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:58:54.341233  1601 leader_election.cc:343] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:54.334228  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44580.1us
I20260709 12:58:54.343704  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:54.345158  1705 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:54.421413  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 79057.6us
I20260709 12:58:54.428766  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:54.435751  1844 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:54.439553  1634 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:58:54.443148  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:54.446985  1784 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:54.448042  1631 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.447005  1752 tablet_bootstrap.cc:492] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:54.450184  1752 ts_tablet_manager.cc:1403] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.368s	user 0.034s	sys 0.044s
I20260709 12:58:54.431552  1846 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.430439  1787 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.459282  1787 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:54.459913  1752 raft_consensus.cc:359] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.460708  1752 raft_consensus.cc:385] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.461009  1752 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.462097  1751 ts_tablet_manager.cc:1434] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.178s	user 0.013s	sys 0.000s
I20260709 12:58:54.463480  1751 tablet_bootstrap.cc:492] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:54.460124  1846 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:54.467320  1782 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:54.470103  1752 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.460736  1708 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.477952  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:54.480680  1752 ts_tablet_manager.cc:1434] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
W20260709 12:58:54.481349  1601 leader_election.cc:343] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.481950  1752 tablet_bootstrap.cc:492] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:54.486356  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:54.486982  1709 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
W20260709 12:58:54.487573  1674 leader_election.cc:343] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.486923  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:58:54.488256  1674 leader_election.cc:343] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.488271  1633 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.491648  1749 tablet_bootstrap.cc:654] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.491611  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:54.494877  1784 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:54.495414  1784 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:54.497107  1784 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.515172  1782 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:54.516611  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 241977us
I20260709 12:58:54.539779  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:54.554342  1560 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 1: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:58:54.554173  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:54.555015  1635 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
W20260709 12:58:54.550774  1674 leader_election.cc:343] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.527217  1600 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 12:58:54.566676  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47899.9us
I20260709 12:58:54.566900  1787 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.567432  1787 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:54.567651  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:54.567973  1787 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.572031  1752 tablet_bootstrap.cc:654] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.574234  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:54.575985  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:54.576898  1629 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.564352  1632 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:54.584626  1708 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:54.578061  1601 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:54.585763  1910 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.586200  1910 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.586558  1910 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.589079  1633 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:54.582942  1966 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:54.593765  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:54.594503  1628 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 1: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:58:54.614305  1910 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.593283  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:54.616339  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:54.616593  1844 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:54.617139  1910 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:54.617478  1844 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.617899  1844 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.622478  1626 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 1: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:58:54.627223  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:54.628119  1841 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.628203  1844 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.628499  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:54.630448  1966 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:54.632812  1751 tablet_bootstrap.cc:654] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.612524  1787 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:54.608531  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 65697.7us
I20260709 12:58:54.599049  1524 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:54.647202  1841 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:54.651672  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 68253.2us
I20260709 12:58:54.651772  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:54.658478  1458 catalog_manager.cc:5697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.659505  1964 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.661855  1964 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:54.649385  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:54.664842  1964 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.664690  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:54.666347  1628 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.661682  1457 catalog_manager.cc:5697] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 2, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.657317  1844 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:54.670435  1782 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.677376  1524 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:54.678627  1884 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:54.691145  1784 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.682341  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:54.673656  1782 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.697058  1784 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:54.697829  1784 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.698447  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:54.699052  1705 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:54.706822  1972 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:58:54.692152  1787 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:54.698464  1782 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:54.718197  1674 leader_election.cc:343] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.725129  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:54.742138  1749 tablet_bootstrap.cc:492] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:54.742820  1749 ts_tablet_manager.cc:1403] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.435s	user 0.021s	sys 0.015s
W20260709 12:58:54.725550  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 48382us
W20260709 12:58:54.740865  1600 leader_election.cc:343] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.744531  1556 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.756512  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:54.756867  1628 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
W20260709 12:58:54.760313  1600 leader_election.cc:343] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.760815  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:54.761428  1751 tablet_bootstrap.cc:492] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:54.761902  1751 ts_tablet_manager.cc:1403] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.299s	user 0.028s	sys 0.031s
I20260709 12:58:54.763612  1910 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:54.772401  1629 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
W20260709 12:58:54.778554  1969 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:58:54.790524  1751 raft_consensus.cc:359] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.791652  1751 raft_consensus.cc:385] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.791988  1751 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.792668  1751 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.794399  1557 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.782789  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 12:58:54.796135  1600 leader_election.cc:343] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:54.807914  1841 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.808441  1841 raft_consensus.cc:697] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:54.809278  1841 consensus_queue.cc:237] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.815805  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:54.816406  1709 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:54.812573  1705 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:54.823236  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:58:54.824160  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46724.3us
I20260709 12:58:54.826197  1709 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:54.826707  1862 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.827473  1862 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:54.828094  1707 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:54.828352  1862 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.829419  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:54.830790  1846 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.831311  1846 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:54.832195  1846 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.834463  1751 ts_tablet_manager.cc:1434] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.001s
I20260709 12:58:54.835640  1751 tablet_bootstrap.cc:492] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:54.839074  1749 raft_consensus.cc:359] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.839814  1749 raft_consensus.cc:385] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.840090  1749 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:54.840734  1749 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.833226  1556 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:54.867787  1787 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:54.871986  1984 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:58:54.874043  1601 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:54.875451  1753 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:54.875975  1753 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:54.877030  1753 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.890038  1752 tablet_bootstrap.cc:492] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:54.890643  1752 ts_tablet_manager.cc:1403] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.409s	user 0.024s	sys 0.014s
I20260709 12:58:54.893383  1752 raft_consensus.cc:359] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.894232  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:54.894011  1752 raft_consensus.cc:385] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:54.896970  1752 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
W20260709 12:58:54.889961  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46343.8us
I20260709 12:58:54.904361  1751 tablet_bootstrap.cc:654] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:54.908680  1749 ts_tablet_manager.cc:1434] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.166s	user 0.008s	sys 0.004s
I20260709 12:58:54.917588  1752 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:54.918557  1749 tablet_bootstrap.cc:492] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:54.903503  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:54.934890  1628 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:54.937523  1964 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:54.949435  1752 ts_tablet_manager.cc:1434] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 12:58:54.953408  1752 tablet_bootstrap.cc:492] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:54.968089  1753 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:54.977325  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:54.980189  1980 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:54.996896  1749 tablet_bootstrap.cc:654] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:54.998410  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:55.000583  1752 tablet_bootstrap.cc:654] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.020344  1709 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:55.022435  1782 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:55.019636  1751 tablet_bootstrap.cc:492] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:55.023883  1751 ts_tablet_manager.cc:1403] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.188s	user 0.014s	sys 0.007s
I20260709 12:58:55.030010  1751 raft_consensus.cc:359] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.030767  1751 raft_consensus.cc:385] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.031059  1751 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.031893  1751 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.035537  1841 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.036072  1841 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.038179  1751 ts_tablet_manager.cc:1434] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:58:55.040192  1752 tablet_bootstrap.cc:492] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:55.040649  1752 ts_tablet_manager.cc:1403] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.016s
I20260709 12:58:55.042639  1841 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:55.044922  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:55.045404  1752 raft_consensus.cc:359] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.046397  1752 raft_consensus.cc:385] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.046669  1752 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
W20260709 12:58:55.047473  1673 leader_election.cc:343] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.047349  1752 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.049336  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:55.053177  1752 ts_tablet_manager.cc:1434] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
W20260709 12:58:55.051105  1674 leader_election.cc:343] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.054466  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:55.057973  1841 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:55.061347  1751 tablet_bootstrap.cc:492] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:55.062094  1752 tablet_bootstrap.cc:492] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:55.092756  1749 tablet_bootstrap.cc:492] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:55.093223  1749 ts_tablet_manager.cc:1403] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.015s
I20260709 12:58:55.095674  1749 raft_consensus.cc:359] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.101167  1749 raft_consensus.cc:385] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.101473  1749 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.101454  1782 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:55.102442  1749 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.104187  1749 ts_tablet_manager.cc:1434] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:58:55.105176  1749 tablet_bootstrap.cc:492] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:55.113443  1458 catalog_manager.cc:5697] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.115996  1458 catalog_manager.cc:5697] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.117583  1782 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.124799  1862 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.125895  1749 tablet_bootstrap.cc:654] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.125864  1862 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.127789  1751 tablet_bootstrap.cc:654] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.130342  1752 tablet_bootstrap.cc:654] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.134716  1862 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.140748  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:55.139878  1457 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.140753  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.143354  1709 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:55.145077  1601 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:55.148561  1753 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:55.148947  1753 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.149292  1753 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.147710  1457 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.151351  1964 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:55.151751  1600 leader_election.cc:343] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.165971  1749 tablet_bootstrap.cc:492] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:55.166487  1749 ts_tablet_manager.cc:1403] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.062s	user 0.005s	sys 0.010s
I20260709 12:58:55.170822  1749 raft_consensus.cc:359] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.171536  1749 raft_consensus.cc:385] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.171803  1749 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.172439  1749 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.177933  1749 ts_tablet_manager.cc:1434] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:58:55.178931  1749 tablet_bootstrap.cc:492] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:55.202365  1753 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.202900  1456 catalog_manager.cc:5697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.205355  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 12:58:55.206864  1600 leader_election.cc:343] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.211736  1964 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:55.226996  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:55.227777  1707 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.231760  1749 tablet_bootstrap.cc:654] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.245395  1707 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:55.234778  1752 tablet_bootstrap.cc:492] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:55.246418  1752 ts_tablet_manager.cc:1403] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.185s	user 0.025s	sys 0.025s
I20260709 12:58:55.246917  1601 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:55.206869  1456 catalog_manager.cc:5697] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.248036  1787 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:55.248530  1787 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:55.249366  1787 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.251983  1752 raft_consensus.cc:359] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.253518  1752 raft_consensus.cc:385] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.256196  1752 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.257277  1752 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.261587  1752 ts_tablet_manager.cc:1434] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:58:55.270359  1749 tablet_bootstrap.cc:492] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:55.270961  1749 ts_tablet_manager.cc:1403] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.092s	user 0.004s	sys 0.009s
I20260709 12:58:55.271304  1752 tablet_bootstrap.cc:492] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:55.273650  1749 raft_consensus.cc:359] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.274441  1749 raft_consensus.cc:385] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.274807  1749 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.264367  1753 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:55.267315  1674 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:55.275507  1749 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.277853  1749 ts_tablet_manager.cc:1434] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:58:55.278048  1751 tablet_bootstrap.cc:492] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:55.278918  1749 tablet_bootstrap.cc:492] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:55.279006  1751 ts_tablet_manager.cc:1403] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.218s	user 0.037s	sys 0.034s
I20260709 12:58:55.281491  1751 raft_consensus.cc:359] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.282171  1751 raft_consensus.cc:385] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.282452  1751 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.283077  1751 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.285989  1751 ts_tablet_manager.cc:1434] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:55.286886  1749 tablet_bootstrap.cc:654] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.288398  1751 tablet_bootstrap.cc:492] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:55.288403  1787 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:58:55.291523  1862 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.292141  1862 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.299568  1457 catalog_manager.cc:5697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.302562  1862 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.303723  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:55.310263  1600 leader_election.cc:343] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.306977  1752 tablet_bootstrap.cc:654] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.307682  1751 tablet_bootstrap.cc:654] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.307533  1910 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.316944  1782 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.311100  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.317472  1782 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.321892  1782 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:55.322269  1601 leader_election.cc:343] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.322743  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:55.323770  1910 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:55.325017  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.325745  1749 tablet_bootstrap.cc:492] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:55.326368  1749 ts_tablet_manager.cc:1403] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.007s
I20260709 12:58:55.326673  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:55.328838  1628 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 1: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:58:55.330624  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:55.331368  1782 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.331144  1749 raft_consensus.cc:359] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.331797  1749 raft_consensus.cc:385] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.332075  1749 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.333618  1749 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.337318  1749 ts_tablet_manager.cc:1434] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:58:55.339800  1782 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:55.353242  1749 tablet_bootstrap.cc:492] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:55.355850  1910 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:55.372817  1980 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.373554  1749 tablet_bootstrap.cc:654] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.373353  1980 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.376631  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.376758  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:55.377308  1706 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:55.377638  1628 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:55.378722  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:55.379515  1782 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:55.379838  1752 tablet_bootstrap.cc:492] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:55.379833  1782 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.380354  1752 ts_tablet_manager.cc:1403] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.006s
I20260709 12:58:55.380268  1782 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.386777  1752 raft_consensus.cc:359] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.390163  1752 raft_consensus.cc:385] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.390390  1559 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.390564  1752 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.391417  1752 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.395187  1752 ts_tablet_manager.cc:1434] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:58:55.396209  1752 tablet_bootstrap.cc:492] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:55.398319  1980 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.399991  1749 tablet_bootstrap.cc:492] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:55.400496  1749 ts_tablet_manager.cc:1403] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.008s
I20260709 12:58:55.403282  1749 raft_consensus.cc:359] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.403944  1749 raft_consensus.cc:385] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.404122  1752 tablet_bootstrap.cc:654] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.404197  1749 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.405543  1749 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.407037  1749 ts_tablet_manager.cc:1434] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:58:55.408015  1749 tablet_bootstrap.cc:492] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:55.413946  1749 tablet_bootstrap.cc:654] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.416749  1964 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.417074  1846 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.417254  1964 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.417891  1782 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.418824  1787 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.420964  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:55.421547  1707 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.422369  1964 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.423166  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.427451  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:55.428184  1634 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.430490  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:55.433558  1752 tablet_bootstrap.cc:492] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:55.437701  1752 ts_tablet_manager.cc:1403] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.010s
I20260709 12:58:55.435822  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:55.441529  1752 raft_consensus.cc:359] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.444561  1862 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.444837  1787 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.445164  1862 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.442348  1752 raft_consensus.cc:385] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.445482  1787 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.445746  1634 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:55.456171  1751 tablet_bootstrap.cc:492] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:55.456905  1751 ts_tablet_manager.cc:1403] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.169s	user 0.012s	sys 0.000s
I20260709 12:58:55.464584  1524 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:55.465380  1884 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:55.465844  1884 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:55.466753  1884 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.466858  1751 raft_consensus.cc:359] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.467873  1751 raft_consensus.cc:385] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.468286  1751 raft_consensus.cc:740] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.469203  1751 consensus_queue.cc:260] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.472112  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:55.474715  1600 leader_election.cc:343] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.476217  1749 tablet_bootstrap.cc:492] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:55.447587  1862 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.476953  1749 ts_tablet_manager.cc:1403] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.018s
I20260709 12:58:55.448730  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.449649  1964 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:55.479709  1749 raft_consensus.cc:359] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.480391  1749 raft_consensus.cc:385] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.480661  1749 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.451792  1787 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.451699  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.481379  1749 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.483042  1749 ts_tablet_manager.cc:1434] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 12:58:55.483165  1601 leader_election.cc:343] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.483588  1601 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:55.484087  1749 tablet_bootstrap.cc:492] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
W20260709 12:58:55.484733  1601 leader_election.cc:343] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.485302  1862 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:55.476274  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:55.487689  1600 leader_election.cc:343] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.488090  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:55.489161  1862 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:55.452775  1707 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:55.490815  1749 tablet_bootstrap.cc:654] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.492273  1751 ts_tablet_manager.cc:1434] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:58:55.493481  1751 tablet_bootstrap.cc:492] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:55.494657  1782 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.446527  1752 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.506319  1846 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:58:55.512790  1752 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.514709  1752 ts_tablet_manager.cc:1434] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.000s
I20260709 12:58:55.515832  1752 tablet_bootstrap.cc:492] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:55.531826  1862 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.532382  1862 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.533794  1751 tablet_bootstrap.cc:654] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.534674  1862 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:55.523262  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 55064us
I20260709 12:58:55.555033  1787 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.557921  1787 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.536237  1846 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:58:55.567878  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:55.570698  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:55.570881  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:55.574510  1601 leader_election.cc:343] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:55.578675  1600 leader_election.cc:343] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.582087  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.583376  1846 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.583879  1846 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:55.584565  1601 leader_election.cc:343] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.585009  1601 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:55.560122  1787 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.586179  1846 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:55.586685  1910 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:55.587222  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:58:55.589038  1600 leader_election.cc:343] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.589488  1600 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:55.590296  1910 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:55.590659  1673 leader_election.cc:343] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.592417  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:55.594100  1674 leader_election.cc:343] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.594568  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:55.565986  1457 catalog_manager.cc:5697] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.597507  1749 tablet_bootstrap.cc:492] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:55.597570  1966 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:55.602777  1749 ts_tablet_manager.cc:1403] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.119s	user 0.019s	sys 0.035s
I20260709 12:58:55.603943  1751 tablet_bootstrap.cc:492] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:55.604012  1752 tablet_bootstrap.cc:654] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.604473  1751 ts_tablet_manager.cc:1403] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.000s
I20260709 12:58:55.605365  1749 raft_consensus.cc:359] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.607072  1751 raft_consensus.cc:359] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.607754  1751 raft_consensus.cc:385] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.608026  1751 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.608702  1751 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.611043  1751 ts_tablet_manager.cc:1434] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:58:55.612874  1751 tablet_bootstrap.cc:492] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:55.618603  1787 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.619086  1787 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.619736  1751 tablet_bootstrap.cc:654] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.622218  1846 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.622864  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.622758  1846 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:55.624395  1601 leader_election.cc:343] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.625121  1787 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.626083  1846 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:55.626989  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:55.627127  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:55.628986  1674 leader_election.cc:343] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:55.629794  1600 leader_election.cc:343] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.630297  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:55.630223  1884 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.631137  1884 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.634078  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:55.635509  1787 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:55.640118  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:55.641065  1751 tablet_bootstrap.cc:492] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:55.641640  1751 ts_tablet_manager.cc:1403] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.000s
W20260709 12:58:55.642426  1673 leader_election.cc:343] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.643038  1673 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:55.644335  2031 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:55.647491  1752 tablet_bootstrap.cc:492] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:55.648020  1752 ts_tablet_manager.cc:1403] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.132s	user 0.017s	sys 0.001s
I20260709 12:58:55.648391  1910 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.647898  1884 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.644325  1751 raft_consensus.cc:359] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.650997  1751 raft_consensus.cc:385] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.651288  1751 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.652153  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.651894  1751 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.653705  1749 raft_consensus.cc:385] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.654084  1749 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.654835  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:55.655742  1751 ts_tablet_manager.cc:1434] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:58:55.656960  1884 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:55.657871  1751 tablet_bootstrap.cc:492] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:55.656672  1749 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.664244  1752 raft_consensus.cc:359] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.664891  1752 raft_consensus.cc:385] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.665146  1752 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.666179  1749 ts_tablet_manager.cc:1434] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.002s
I20260709 12:58:55.665786  1752 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.667573  1749 tablet_bootstrap.cc:492] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:55.670694  1752 ts_tablet_manager.cc:1434] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:58:55.671751  1752 tablet_bootstrap.cc:492] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:55.688946  1751 tablet_bootstrap.cc:654] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.694250  1749 tablet_bootstrap.cc:654] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.701248  1752 tablet_bootstrap.cc:654] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.704865  1556 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.705977  1749 tablet_bootstrap.cc:492] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:55.706470  1749 ts_tablet_manager.cc:1403] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.039s	user 0.005s	sys 0.006s
W20260709 12:58:55.706571  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:55.709157  1749 raft_consensus.cc:359] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.712456  1752 tablet_bootstrap.cc:492] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:55.712953  1752 ts_tablet_manager.cc:1403] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.000s
I20260709 12:58:55.715590  1752 raft_consensus.cc:359] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.716239  1752 raft_consensus.cc:385] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.716502  1752 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.717089  1752 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.709857  1749 raft_consensus.cc:385] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.718155  1749 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.719864  1751 tablet_bootstrap.cc:492] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:55.720307  1751 ts_tablet_manager.cc:1403] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.003s
I20260709 12:58:55.722970  1751 raft_consensus.cc:359] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.723606  1751 raft_consensus.cc:385] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.723855  1751 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.724509  1751 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.726471  1751 ts_tablet_manager.cc:1434] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:58:55.727365  1751 tablet_bootstrap.cc:492] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:55.732991  1751 tablet_bootstrap.cc:654] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.735008  1749 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.737721  1749 ts_tablet_manager.cc:1434] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 12:58:55.737790  1862 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.738761  1749 tablet_bootstrap.cc:492] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:55.738493  1862 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.741375  1862 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.742537  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.743183  1706 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:55.743616  1752 ts_tablet_manager.cc:1434] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:58:55.744962  1752 tablet_bootstrap.cc:492] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:55.741400  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:55.748565  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:58:55.749536  1600 leader_election.cc:343] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.755808  1862 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:55.759938  1862 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.764846  1862 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.774214  1966 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.774789  1966 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.777235  1966 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:55.778321  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:55.778695  1751 tablet_bootstrap.cc:492] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:55.779165  1751 ts_tablet_manager.cc:1403] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.007s
I20260709 12:58:55.779079  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:58:55.779738  1674 leader_election.cc:343] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.756549  1749 tablet_bootstrap.cc:654] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.757367  1752 tablet_bootstrap.cc:654] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.784994  1751 raft_consensus.cc:359] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.786113  1751 raft_consensus.cc:385] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.786535  1751 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
W20260709 12:58:55.787125  1673 leader_election.cc:343] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.787606  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:55.787640  1751 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.791792  1966 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:55.801302  1751 ts_tablet_manager.cc:1434] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:58:55.803011  1751 tablet_bootstrap.cc:492] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:55.805492  1862 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.809494  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:55.812101  1751 tablet_bootstrap.cc:654] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:55.818614  1600 leader_election.cc:343] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:55.824520  1749 tablet_bootstrap.cc:492] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:55.824990  1749 ts_tablet_manager.cc:1403] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.000s
I20260709 12:58:55.827529  1749 raft_consensus.cc:359] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.828190  1749 raft_consensus.cc:385] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.828449  1749 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.829255  1751 tablet_bootstrap.cc:492] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:55.829128  1749 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.831151  1749 ts_tablet_manager.cc:1434] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:58:55.832146  1751 ts_tablet_manager.cc:1403] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.027s	user 0.003s	sys 0.017s
I20260709 12:58:55.832165  1749 tablet_bootstrap.cc:492] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:55.837356  1751 raft_consensus.cc:359] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.837888  1751 raft_consensus.cc:385] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.838195  1751 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.838811  1751 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.839745  1752 tablet_bootstrap.cc:492] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:55.840103  1749 tablet_bootstrap.cc:654] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.840226  1752 ts_tablet_manager.cc:1403] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.037s
I20260709 12:58:55.840842  1751 ts_tablet_manager.cc:1434] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.002s
I20260709 12:58:55.841926  1751 tablet_bootstrap.cc:492] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:55.847594  1751 tablet_bootstrap.cc:654] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.850950  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:55.851745  1706 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.850282  1752 raft_consensus.cc:359] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.852758  1752 raft_consensus.cc:385] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.853140  1752 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.854540  1752 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.856932  1752 ts_tablet_manager.cc:1434] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.005s
I20260709 12:58:55.865373  1980 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.852929  1862 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.865918  1706 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:55.871068  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:55.872480  1923 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:55.876778  1923 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:55.876075  1752 tablet_bootstrap.cc:492] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:55.878062  1923 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.893246  1749 tablet_bootstrap.cc:492] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:55.893687  1749 ts_tablet_manager.cc:1403] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.012s
I20260709 12:58:55.898640  1749 raft_consensus.cc:359] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.899528  1749 raft_consensus.cc:385] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.899856  1749 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.904670  1749 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.905418  1751 tablet_bootstrap.cc:492] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:55.907696  1751 ts_tablet_manager.cc:1403] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.027s
I20260709 12:58:55.908828  1749 ts_tablet_manager.cc:1434] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:58:55.909838  1749 tablet_bootstrap.cc:492] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:55.917105  1751 raft_consensus.cc:359] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.917913  1751 raft_consensus.cc:385] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.918221  1751 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.918844  1751 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.923928  1752 tablet_bootstrap.cc:654] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.924853  2024 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:55.922988  1751 ts_tablet_manager.cc:1434] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:58:55.927014  1751 tablet_bootstrap.cc:492] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:55.931588  1751 tablet_bootstrap.cc:654] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.936390  1749 tablet_bootstrap.cc:654] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.947101  1749 tablet_bootstrap.cc:492] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:55.946420  1458 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.947576  1749 ts_tablet_manager.cc:1403] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.003s
I20260709 12:58:55.947641  1751 tablet_bootstrap.cc:492] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:55.948207  1751 ts_tablet_manager.cc:1403] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.005s
I20260709 12:58:55.950520  1751 raft_consensus.cc:359] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.950866  1749 raft_consensus.cc:359] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.951395  1751 raft_consensus.cc:385] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.951532  1749 raft_consensus.cc:385] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:55.951846  1751 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.951880  1749 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:55.952771  1751 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.952768  1749 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.953312  1784 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.953855  1784 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.955076  1749 ts_tablet_manager.cc:1434] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:58:55.955578  1751 ts_tablet_manager.cc:1434] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:58:55.955626  1784 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.955984  1749 tablet_bootstrap.cc:492] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:55.956955  1751 tablet_bootstrap.cc:492] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:55.957722  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.958415  1705 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:55.960237  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:55.961292  2024 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.961745  2024 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.962863  1784 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:55.963205  1784 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.963487  1784 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.964577  2024 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.965551  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:55.966252  1634 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:55.965570  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:55.967034  1751 tablet_bootstrap.cc:654] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.967097  1705 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:55.967489  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:55.968243  2024 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:55.968586  2024 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.968930  2024 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.968954  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:55.969756  1628 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:55.976301  2024 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.979091  1749 tablet_bootstrap.cc:654] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:55.982492  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:55.982604  1784 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.982750  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:55.983184  1705 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.983464  1628 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.988447  1966 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.988986  1966 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.989663  1980 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.990202  1980 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:55.991122  1966 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:55.991895  2024 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.993451  1980 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:55.993207  1705 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:55.994730  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:55.995168  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:55.995465  1634 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:55.995653  1526 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:55.996058  1556 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:55.996856  1980 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:55.996968  1524 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:55.997563  1980 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:55.997852  1884 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:55.998334  1884 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.998790  1884 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.999225  1674 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:56.000650  2031 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:56.001127  2031 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.002012  2031 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:55.998755  1980 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.013358  1884 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.016639  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:56.020893  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:56.020846  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:56.022956  1631 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.021202  1705 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:56.025488  1884 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.016881  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:56.026942  1634 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:56.038539  1884 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.039139  1884 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.041286  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:56.042479  1884 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.042742  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:56.043557  1709 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:56.045090  1526 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:56.046265  1884 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:56.042124  1705 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.046841  1884 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.047438  1884 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.051875  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:56.052604  1634 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.053066  2024 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.053793  2024 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.058888  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:56.059834  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:56.060741  1629 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
W20260709 12:58:56.061678  1526 leader_election.cc:343] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.062772  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:56.063526  1629 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:56.066903  2024 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.068037  1752 tablet_bootstrap.cc:492] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:56.068539  1752 ts_tablet_manager.cc:1403] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.193s	user 0.008s	sys 0.009s
I20260709 12:58:56.075011  1884 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.082324  2031 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.084739  1884 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.085081  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:56.085673  1709 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.075388  1628 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:56.077054  1784 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.077432  1524 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:56.090566  1884 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:56.080237  1634 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:56.091068  1884 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.093856  1884 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.094902  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:56.095141  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:56.095513  1559 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.096035  1980 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:56.096628  1980 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:56.097549  1980 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.102813  1559 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:56.105580  1556 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.111109  1752 raft_consensus.cc:359] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.112290  1752 raft_consensus.cc:385] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.112571  1752 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.116743  1884 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.118214  1674 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:56.119920  1841 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:56.119953  1749 tablet_bootstrap.cc:492] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:56.120517  1841 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:56.120867  1749 ts_tablet_manager.cc:1403] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.165s	user 0.042s	sys 0.039s
I20260709 12:58:56.121400  1841 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.124250  1749 raft_consensus.cc:359] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.124985  1749 raft_consensus.cc:385] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.125286  1749 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.126395  1752 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.052109  1631 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:56.127282  1749 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.134496  1749 ts_tablet_manager.cc:1434] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 12:58:56.137346  1752 ts_tablet_manager.cc:1434] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.001s
I20260709 12:58:56.137501  1524 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 12:58:56.138906  2052 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:58:56.139899  1784 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:56.141392  1752 tablet_bootstrap.cc:492] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:56.142167  1784 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:56.140090  1709 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:56.147925  1526 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:56.149515  2053 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:56.150081  2053 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:56.148320  1784 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.151002  2053 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.140856  1749 tablet_bootstrap.cc:492] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:56.152117  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:56.165848  1752 tablet_bootstrap.cc:654] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.158470  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:56.158191  1628 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.184577  1787 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.156761  1705 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:56.164083  2031 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:56.184367  1457 catalog_manager.cc:5697] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:56.185042  1787 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.181169  1631 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.189327  1456 catalog_manager.cc:5697] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:56.193485  1884 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.196324  1787 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.197009  1751 tablet_bootstrap.cc:492] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:56.197549  1751 ts_tablet_manager.cc:1403] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.241s	user 0.036s	sys 0.042s
I20260709 12:58:56.200750  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:56.202596  1600 leader_election.cc:343] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.204385  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:56.208586  1601 leader_election.cc:343] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.208967  1601 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:56.209506  1787 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:56.204870  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:56.210659  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:56.213094  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:56.214236  1634 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:56.216547  1526 leader_election.cc:343] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.221123  1749 tablet_bootstrap.cc:654] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.227660  1752 tablet_bootstrap.cc:492] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:56.228106  1752 ts_tablet_manager.cc:1403] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.003s
I20260709 12:58:56.230358  1634 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:56.231985  1751 raft_consensus.cc:359] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.233745  1751 raft_consensus.cc:385] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.234082  1751 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.235155  1751 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.237668  1751 ts_tablet_manager.cc:1434] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.001s
I20260709 12:58:56.238597  1751 tablet_bootstrap.cc:492] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:56.241670  1628 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:56.243954  1752 raft_consensus.cc:359] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.244493  1752 raft_consensus.cc:385] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.244724  1752 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.246412  1524 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:56.247463  1884 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:56.250501  1752 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.248343  1884 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:56.259152  1884 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.248636  1631 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:56.266647  1752 ts_tablet_manager.cc:1434] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 12:58:56.267361  1751 tablet_bootstrap.cc:654] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.267650  1752 tablet_bootstrap.cc:492] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:56.267525  1456 catalog_manager.cc:5697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:56.269356  1456 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:56.272514  1456 catalog_manager.cc:5697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:56.281592  1749 tablet_bootstrap.cc:492] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:56.282481  1749 ts_tablet_manager.cc:1403] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.142s	user 0.019s	sys 0.006s
I20260709 12:58:56.290154  1749 raft_consensus.cc:359] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.294409  1749 raft_consensus.cc:385] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.294740  1749 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.295369  1749 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.295776  1751 tablet_bootstrap.cc:492] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:56.296463  1751 ts_tablet_manager.cc:1403] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.001s
I20260709 12:58:56.297340  1749 ts_tablet_manager.cc:1434] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.000s
I20260709 12:58:56.299144  1752 tablet_bootstrap.cc:654] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.302773  1749 tablet_bootstrap.cc:492] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:56.303195  1751 raft_consensus.cc:359] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.303884  1751 raft_consensus.cc:385] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.304154  1751 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.304740  1751 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.306773  1751 ts_tablet_manager.cc:1434] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:58:56.314345  1751 tablet_bootstrap.cc:492] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:56.316395  1752 tablet_bootstrap.cc:492] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:56.316859  1752 ts_tablet_manager.cc:1403] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.001s
I20260709 12:58:56.319029  1751 tablet_bootstrap.cc:654] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.318548  1456 catalog_manager.cc:5697] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:56.319393  1752 raft_consensus.cc:359] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.320029  1752 raft_consensus.cc:385] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.320292  1752 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.320932  1752 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.322907  1752 ts_tablet_manager.cc:1434] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:58:56.324292  1749 tablet_bootstrap.cc:654] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.333207  1752 tablet_bootstrap.cc:492] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:56.347003  1749 tablet_bootstrap.cc:492] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:56.347579  1749 ts_tablet_manager.cc:1403] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.012s
I20260709 12:58:56.351056  1749 raft_consensus.cc:359] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.351864  1749 raft_consensus.cc:385] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.352180  1749 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.354542  1749 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.356341  1752 tablet_bootstrap.cc:654] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.356803  1749 ts_tablet_manager.cc:1434] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:56.358222  1749 tablet_bootstrap.cc:492] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:56.359112  1556 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.363083  1751 tablet_bootstrap.cc:492] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:56.363641  1751 ts_tablet_manager.cc:1403] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.025s
I20260709 12:58:56.366469  1751 raft_consensus.cc:359] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.367218  1751 raft_consensus.cc:385] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.367550  1751 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.369369  1751 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.372804  1751 ts_tablet_manager.cc:1434] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:56.373862  1751 tablet_bootstrap.cc:492] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:56.378345  1749 tablet_bootstrap.cc:654] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.371539  1752 tablet_bootstrap.cc:492] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:56.379608  1752 ts_tablet_manager.cc:1403] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.009s
I20260709 12:58:56.382308  1752 raft_consensus.cc:359] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.382992  1752 raft_consensus.cc:385] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.383255  1752 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.383503  1862 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:56.383917  1752 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.385488  1752 ts_tablet_manager.cc:1434] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:58:56.386446  1752 tablet_bootstrap.cc:492] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:56.395747  1751 tablet_bootstrap.cc:654] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.399199  1862 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:56.402661  1752 tablet_bootstrap.cc:654] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.449113  1980 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:56.451862  1980 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.452562  1980 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.456831  2053 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:56.459439  2053 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.460074  2053 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.463837  2053 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.467487  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:56.468175  1706 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:56.468791  1980 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.469229  1751 tablet_bootstrap.cc:492] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:56.469693  1751 ts_tablet_manager.cc:1403] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.023s
I20260709 12:58:56.470082  1526 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:56.472365  1751 raft_consensus.cc:359] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.472429  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:56.472848  2053 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:56.473107  1751 raft_consensus.cc:385] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.473233  2053 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.473397  1751 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.473589  2053 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:56.474210  1526 leader_election.cc:343] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.475036  1751 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.476401  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:56.502485  1751 ts_tablet_manager.cc:1434] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 12:58:56.504768  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:56.505434  1631 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:56.506243  1628 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:56.507490  1751 tablet_bootstrap.cc:492] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:56.513803  2053 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.515921  2053 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.516285  1751 tablet_bootstrap.cc:654] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.516918  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:56.517469  1706 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.521464  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:56.524663  2053 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:56.525053  2053 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.525406  2053 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.525733  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:56.526391  1628 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.531509  1706 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:56.532636  1526 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:56.533543  1784 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:56.533970  1784 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:56.534725  1784 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.535851  1628 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:56.551837  1841 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:56.555212  1910 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.555724  1910 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.558791  1910 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.535784  2053 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.535730  1751 tablet_bootstrap.cc:492] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:56.542881  2031 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.559695  2031 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.559976  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:56.560822  2053 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:56.561431  1600 leader_election.cc:343] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.561661  2031 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:56.562366  1751 ts_tablet_manager.cc:1403] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.000s
I20260709 12:58:56.563723  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:56.563851  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:56.564139  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:56.564424  1631 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.564873  1751 raft_consensus.cc:359] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:56.565364  1674 leader_election.cc:343] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.566665  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:56.567271  1630 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:56.571478  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:56.572860  1673 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:56.573621  2031 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:56.574052  2031 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.574416  2031 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:56.575222  1601 leader_election.cc:343] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.575623  1601 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:56.576222  1787 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:56.573848  1631 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
W20260709 12:58:56.565416  1526 leader_election.cc:343] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.579036  1841 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.565536  1751 raft_consensus.cc:385] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.579537  1751 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.579497  1841 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.582261  1841 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:56.583381  2031 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.583735  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:56.584364  1559 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:56.585951  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:56.586715  1846 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:56.587064  1846 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.587237  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:56.587394  1846 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.587904  1457 catalog_manager.cc:5697] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:56.590791  1751 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.592511  1784 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:56.592613  1559 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.596951  1846 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.599597  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:56.600169  1558 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.601382  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:56.601989  1631 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:56.607273  2031 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:56.609963  1558 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:56.611274  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:56.602061  1559 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:56.609767  1846 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:56.613251  1846 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:56.609656  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:56.608850  1749 tablet_bootstrap.cc:492] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:56.614166  1629 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.614423  1749 ts_tablet_manager.cc:1403] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.257s	user 0.027s	sys 0.051s
I20260709 12:58:56.613842  1846 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:56.618265  1749 raft_consensus.cc:359] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.618520  1846 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.621222  2031 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.621505  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:56.612804  1752 tablet_bootstrap.cc:492] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:56.622890  1841 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:56.619077  1749 raft_consensus.cc:385] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.623313  1752 ts_tablet_manager.cc:1403] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.237s	user 0.023s	sys 0.044s
I20260709 12:58:56.623587  1749 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.624151  1629 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:56.624589  1749 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.621798  2031 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.627310  1751 ts_tablet_manager.cc:1434] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:58:56.628400  2031 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:56.628230  1751 tablet_bootstrap.cc:492] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:56.630750  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:56.632927  1752 raft_consensus.cc:359] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.634707  1752 raft_consensus.cc:385] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.635174  1752 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.636210  1752 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.638509  1749 ts_tablet_manager.cc:1434] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:58:56.639539  1749 tablet_bootstrap.cc:492] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:56.639775  1751 tablet_bootstrap.cc:654] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.638512  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:56.642660  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:56.642810  2024 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:56.643342  2024 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:56.643813  2031 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.649156  2031 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.647303  1709 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.648168  1629 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 1: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:58:56.645239  2024 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.657483  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:56.657769  2031 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:56.657990  1749 tablet_bootstrap.cc:654] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.658761  1784 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:56.660331  1752 ts_tablet_manager.cc:1434] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.002s
I20260709 12:58:56.661552  1752 tablet_bootstrap.cc:492] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:56.666985  1841 raft_consensus.cc:697] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:56.650357  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:56.668437  1631 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.668082  1841 consensus_queue.cc:237] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.670605  1749 tablet_bootstrap.cc:492] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:56.671047  1749 ts_tablet_manager.cc:1403] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.002s
I20260709 12:58:56.672659  1751 tablet_bootstrap.cc:492] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:56.673523  1749 raft_consensus.cc:359] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.674257  1749 raft_consensus.cc:385] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.674415  1751 ts_tablet_manager.cc:1403] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.000s
I20260709 12:58:56.673525  1752 tablet_bootstrap.cc:654] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.680130  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:56.680603  2031 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:56.687404  1674 leader_election.cc:343] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.692939  1751 raft_consensus.cc:359] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.693908  1751 raft_consensus.cc:385] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.694235  1751 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.694976  1751 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.674544  1749 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.696928  2031 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:56.696835  1749 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.700251  1749 ts_tablet_manager.cc:1434] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:58:56.703254  1749 tablet_bootstrap.cc:492] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
W20260709 12:58:56.706166  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 48766.6us
I20260709 12:58:56.713289  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:56.713948  1629 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
W20260709 12:58:56.718921  1735 tablet.cc:2406] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:58:56.720379  1751 ts_tablet_manager.cc:1434] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 12:58:56.721748  1751 tablet_bootstrap.cc:492] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:56.726300  2054 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:56.713394  1749 tablet_bootstrap.cc:654] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.733352  1751 tablet_bootstrap.cc:654] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.739490  1749 tablet_bootstrap.cc:492] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:56.739943  1749 ts_tablet_manager.cc:1403] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.004s
I20260709 12:58:56.742635  1749 raft_consensus.cc:359] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.743289  1749 raft_consensus.cc:385] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.743556  1749 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.744635  1749 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.746790  1749 ts_tablet_manager.cc:1434] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:56.747826  1749 tablet_bootstrap.cc:492] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:56.756129  1749 tablet_bootstrap.cc:654] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.767833  1846 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:56.770306  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:56.787112  1784 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:56.796670  1787 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.830369  1787 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.832828  1787 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.834383  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:56.835186  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:56.835819  1601 leader_election.cc:343] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:56.836952  1600 leader_election.cc:343] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.837453  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:56.838907  1787 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:56.815675  1980 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:56.843098  2088 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:56.843654  2088 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.844131  2088 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:56.847298  1787 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.848019  1787 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.851567  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:56.852818  1862 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:56.853339  1601 leader_election.cc:343] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.853412  1862 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.858291  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:56.860543  1601 leader_election.cc:343] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.861307  1862 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.863480  1787 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:56.863996  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:56.864126  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:56.865974  1600 leader_election.cc:343] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.866636  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:58:56.867624  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 97458us
W20260709 12:58:56.867985  1600 leader_election.cc:343] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.869444  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:56.870921  1862 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:56.868374  1787 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:56.877589  1862 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.878296  1862 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.883286  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:56.885207  1601 leader_election.cc:343] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.887640  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:56.896395  1862 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:56.901249  1600 leader_election.cc:343] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:56.901988  1600 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:56.775398  1456 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:56.917194  1456 catalog_manager.cc:5697] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:56.713461  1631 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:56.938725  1752 tablet_bootstrap.cc:492] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:56.967609  1752 ts_tablet_manager.cc:1403] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.306s	user 0.029s	sys 0.043s
I20260709 12:58:56.944056  1910 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:56.971266  1752 raft_consensus.cc:359] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.971966  1752 raft_consensus.cc:385] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:56.972242  1752 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:56.972956  1752 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:56.975404  1752 ts_tablet_manager.cc:1434] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:56.976604  1752 tablet_bootstrap.cc:492] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
W20260709 12:58:56.948873  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47669.5us
I20260709 12:58:56.993417  1752 tablet_bootstrap.cc:654] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:56.996380  1457 catalog_manager.cc:5697] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:57.005152  1884 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.005658  2054 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:57.007045  2054 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:57.009684  2053 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:57.005698  1884 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.014700  1884 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:57.016601  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:57.018731  2088 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.020753  1706 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 1: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:58:57.047555  2088 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:57.060290  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:57.060956  1557 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:57.073766  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:57.074453  1628 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:57.075846  2053 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:57.076069  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:57.077137  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:57.081179  1628 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:57.084424  1752 tablet_bootstrap.cc:492] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:57.084918  1752 ts_tablet_manager.cc:1403] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.109s	user 0.006s	sys 0.010s
I20260709 12:58:57.091965  1751 tablet_bootstrap.cc:492] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:57.092595  1751 ts_tablet_manager.cc:1403] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.371s	user 0.060s	sys 0.139s
I20260709 12:58:57.099067  1628 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:57.100693  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:57.101953  2088 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:57.102476  2088 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:57.121832  2088 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.124804  1749 tablet_bootstrap.cc:492] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:57.120339  1752 raft_consensus.cc:359] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.125468  1749 ts_tablet_manager.cc:1403] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.378s	user 0.050s	sys 0.139s
I20260709 12:58:57.125478  1752 raft_consensus.cc:385] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:57.125974  1752 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:57.130828  1752 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.160496  1752 ts_tablet_manager.cc:1434] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.075s	user 0.011s	sys 0.003s
I20260709 12:58:57.184592  1784 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:57.191107  1752 tablet_bootstrap.cc:492] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:57.193136  1557 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:57.193771  2095 raft_consensus.cc:2764] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:58:57.211534  1784 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:57.221889  1751 raft_consensus.cc:359] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.224946  1751 raft_consensus.cc:385] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:57.225219  1751 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:57.225780  1751 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.243709  1751 ts_tablet_manager.cc:1434] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.151s	user 0.014s	sys 0.009s
W20260709 12:58:57.262506  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 54928.6us
I20260709 12:58:57.317313  1751 tablet_bootstrap.cc:492] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:57.319845  1749 raft_consensus.cc:359] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.321935  1749 raft_consensus.cc:385] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:57.322268  1749 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:57.327128  1749 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.340953  1749 ts_tablet_manager.cc:1434] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.215s	user 0.008s	sys 0.008s
I20260709 12:58:57.351008  1749 tablet_bootstrap.cc:492] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:57.368011  1457 catalog_manager.cc:5697] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.373589  2088 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:57.406589  1787 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.408461  1787 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:57.416450  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 53178.6us
I20260709 12:58:57.426410  1787 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:57.525933  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:57.532894  1703 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
W20260709 12:58:57.534605  1988 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:58:57.490301  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:57.579793  1526 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:57.658798  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 79175.9us
I20260709 12:58:57.695863  1752 tablet_bootstrap.cc:654] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:57.697041  1749 tablet_bootstrap.cc:654] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:57.698781  1751 tablet_bootstrap.cc:654] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:57.743809  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:57.757076  1752 tablet_bootstrap.cc:492] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:57.757798  1752 ts_tablet_manager.cc:1403] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.567s	user 0.024s	sys 0.018s
I20260709 12:58:57.761291  1752 raft_consensus.cc:359] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.761940  1752 raft_consensus.cc:385] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:57.762245  1752 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:57.762952  1752 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.765007  1752 ts_tablet_manager.cc:1434] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:58:57.764868  1841 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:57.765868  1752 tablet_bootstrap.cc:492] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:57.762174  1846 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.775379  1601 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:57.787511  2110 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:57.800686  1749 tablet_bootstrap.cc:492] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:57.801357  1749 ts_tablet_manager.cc:1403] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.456s	user 0.016s	sys 0.050s
I20260709 12:58:57.781361  1846 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.803781  2081 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:57.805540  1846 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:57.800769  2110 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.806846  2110 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:57.802162  2031 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:58:57.813812  2121 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.814333  2121 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.823863  1751 tablet_bootstrap.cc:492] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:57.826737  1751 ts_tablet_manager.cc:1403] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.516s	user 0.013s	sys 0.045s
I20260709 12:58:57.835703  1752 tablet_bootstrap.cc:654] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:57.847030  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:57.849212  1862 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.845860  2088 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:58:57.865350  1749 raft_consensus.cc:359] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.865942  1749 raft_consensus.cc:385] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:57.853585  1862 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.866885  1749 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
W20260709 12:58:57.868693  1674 leader_election.cc:343] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:57.870638  1749 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:57.873211  1862 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:57.863296  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:58:57.907676  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 67127.2us
W20260709 12:58:57.908457  1600 leader_election.cc:343] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:57.911011  1846 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:57.918483  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 64224.4us
W20260709 12:58:57.930737  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 76115.7us
I20260709 12:58:57.941162  1749 ts_tablet_manager.cc:1434] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.139s	user 0.014s	sys 0.017s
I20260709 12:58:57.944468  1751 raft_consensus.cc:359] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:57.944799  1673 leader_election.cc:343] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:57.945261  1751 raft_consensus.cc:385] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:57.945418  1673 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:57.945580  1751 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:57.948458  2121 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:57.952054  1749 tablet_bootstrap.cc:492] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
W20260709 12:58:57.963330  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45479.8us
I20260709 12:58:57.953661  1751 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:57.974669  2131 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:58:57.999430  1751 ts_tablet_manager.cc:1434] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.172s	user 0.005s	sys 0.005s
I20260709 12:58:57.987507  2114 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:58.003513  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:58.005250  1702 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:58.033052  1749 tablet_bootstrap.cc:654] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.039302  1751 tablet_bootstrap.cc:492] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:58.041834  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:58.059777  1601 leader_election.cc:343] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.072806  1752 tablet_bootstrap.cc:492] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:58.073494  1752 ts_tablet_manager.cc:1403] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.308s	user 0.012s	sys 0.006s
I20260709 12:58:58.117702  1749 tablet_bootstrap.cc:492] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:58.118227  1749 ts_tablet_manager.cc:1403] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.174s	user 0.010s	sys 0.018s
W20260709 12:58:58.123469  2144 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:58:58.109107  2110 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.125738  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:58.131124  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:58.137228  1628 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
W20260709 12:58:58.146867  1600 leader_election.cc:343] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.147321  1600 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:58.146960  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:58.157181  1752 raft_consensus.cc:359] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.159957  1752 raft_consensus.cc:385] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.160181  2140 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:58.160380  1752 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.160655  2140 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.161073  2140 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:58.164639  2132 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:58.163614  1749 raft_consensus.cc:359] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.167845  1749 raft_consensus.cc:385] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.168220  1749 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.171103  1787 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.171721  1787 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.174386  1752 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.178581  1752 ts_tablet_manager.cc:1434] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.105s	user 0.004s	sys 0.007s
I20260709 12:58:58.179862  1752 tablet_bootstrap.cc:492] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:58.183626  2110 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:58.169863  1749 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.194450  1787 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:58.195464  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:58.202387  1749 ts_tablet_manager.cc:1434] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.002s
I20260709 12:58:58.215306  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:58.226670  1702 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:58.248489  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:58.249168  1708 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:58.249262  1600 leader_election.cc:343] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:58.249924  1600 leader_election.cc:343] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.254253  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:58.255697  1601 leader_election.cc:343] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.256098  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:58.273090  1749 tablet_bootstrap.cc:492] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:58.288264  1708 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:58.274374  2105 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:58.300293  1601 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:58.303758  2120 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:58.304283  2120 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:58.304486  1751 tablet_bootstrap.cc:654] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.318572  2053 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.319188  2053 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.305106  2120 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.324112  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:58.310652  2140 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:58.325712  1526 leader_election.cc:343] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.326305  1752 tablet_bootstrap.cc:654] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.326464  2140 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:58.328436  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:58.329578  1701 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:58.333220  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:58.347507  1749 tablet_bootstrap.cc:654] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.349174  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:58.349996  1626 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:58.341315  2053 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:58.364554  1524 leader_election.cc:343] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.365020  1524 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:58.385957  2111 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:58.388967  2115 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:58:58.389464  2115 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.389993  1701 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:58.392585  1526 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:58.395584  2053 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:58.396121  2053 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:58.397020  2053 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.393528  2120 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.417701  2120 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.424396  1626 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:58.424867  2115 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:58.428438  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:58.433579  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:58.434834  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:58.437131  2120 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:58:58.438391  1600 leader_election.cc:343] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.440158  1751 tablet_bootstrap.cc:492] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:58.443605  1751 ts_tablet_manager.cc:1403] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.405s	user 0.032s	sys 0.035s
I20260709 12:58:58.443881  1674 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:58.438285  1456 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:58.438953  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:58.475430  2132 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.483640  2114 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:58:58.496029  1601 leader_election.cc:343] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.497737  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:58.502316  2139 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:58.522645  1752 tablet_bootstrap.cc:492] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:58.523176  1752 ts_tablet_manager.cc:1403] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.344s	user 0.015s	sys 0.010s
I20260709 12:58:58.487295  2132 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.527230  1749 tablet_bootstrap.cc:492] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:58.527696  1749 ts_tablet_manager.cc:1403] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.289s	user 0.031s	sys 0.029s
I20260709 12:58:58.529089  1751 raft_consensus.cc:359] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.529767  1751 raft_consensus.cc:385] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.530066  1751 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.530682  1751 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.533905  2132 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:58.536620  1457 catalog_manager.cc:5697] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:58.539579  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:58.546440  1752 raft_consensus.cc:359] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.547096  1752 raft_consensus.cc:385] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.538127  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:58.547389  1752 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.548123  1752 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:58.547283  1600 leader_election.cc:343] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.549232  1751 ts_tablet_manager.cc:1434] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.105s	user 0.008s	sys 0.000s
W20260709 12:58:58.549456  1601 leader_election.cc:343] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.550833  1751 tablet_bootstrap.cc:492] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:58.552004  1752 ts_tablet_manager.cc:1434] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:58:58.551806  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:58.552913  1752 tablet_bootstrap.cc:492] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:58.552893  1787 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:58.544062  1749 raft_consensus.cc:359] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.554427  1749 raft_consensus.cc:385] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.554682  1787 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.555240  1787 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.554728  1749 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.558501  1787 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:58.558677  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:58.559871  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:58.560371  1600 leader_election.cc:343] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.557654  1749 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:58.562232  1601 leader_election.cc:343] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.562776  1752 tablet_bootstrap.cc:654] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.562592  1601 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:58.563825  1787 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:58.565717  1749 ts_tablet_manager.cc:1434] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.002s
I20260709 12:58:58.567745  1751 tablet_bootstrap.cc:654] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.568764  1749 tablet_bootstrap.cc:492] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:58.577965  1749 tablet_bootstrap.cc:654] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.585176  1751 tablet_bootstrap.cc:492] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:58.585646  1751 ts_tablet_manager.cc:1403] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.002s
I20260709 12:58:58.586638  1752 tablet_bootstrap.cc:492] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:58.587147  1752 ts_tablet_manager.cc:1403] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 12:58:58.588539  1751 raft_consensus.cc:359] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.589447  1751 raft_consensus.cc:385] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.589795  1751 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.589710  1752 raft_consensus.cc:359] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.590860  1752 raft_consensus.cc:385] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.591140  1751 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.591183  1752 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.593746  1751 ts_tablet_manager.cc:1434] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 12:58:58.594203  1749 tablet_bootstrap.cc:492] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:58.593611  1752 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.594729  1751 tablet_bootstrap.cc:492] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:58.594731  1749 ts_tablet_manager.cc:1403] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.015s
I20260709 12:58:58.596341  1752 ts_tablet_manager.cc:1434] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:58.597276  1752 tablet_bootstrap.cc:492] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:58.598228  1749 raft_consensus.cc:359] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.599021  1749 raft_consensus.cc:385] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.599367  1749 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.600081  1749 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.602115  1751 tablet_bootstrap.cc:654] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.602249  1749 ts_tablet_manager.cc:1434] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:58.603283  1749 tablet_bootstrap.cc:492] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:58.628659  1749 tablet_bootstrap.cc:654] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.712177  2088 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.712731  2088 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.715983  2053 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.716459  2053 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.714854  2088 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:58.719365  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:58.720885  1626 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:58.721273  2132 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:58.722268  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:58.723269  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:58.723763  1752 tablet_bootstrap.cc:654] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.723877  1633 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:58.724342  2112 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:58.724710  2112 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.725035  2112 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:58.726665  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:58.727304  1705 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:58.728757  1787 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.729173  1787 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.730180  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:58.731029  1787 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:58.731134  2111 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:58.731479  2111 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.731781  2111 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:58.734732  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:58.736495  1601 leader_election.cc:343] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.736555  1749 tablet_bootstrap.cc:492] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:58.737210  1749 ts_tablet_manager.cc:1403] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.018s
I20260709 12:58:58.737123  2112 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.737329  2053 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:58.741055  1749 raft_consensus.cc:359] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.746742  1749 raft_consensus.cc:385] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.747046  1749 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.747813  2111 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.749857  2111 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:58.751336  2112 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:58.747686  1749 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.752347  1752 tablet_bootstrap.cc:492] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:58.752349  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:58.753000  1752 ts_tablet_manager.cc:1403] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.156s	user 0.012s	sys 0.001s
I20260709 12:58:58.753135  1626 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:58.754123  1749 ts_tablet_manager.cc:1434] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.006s
I20260709 12:58:58.755314  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:58.755652  1752 raft_consensus.cc:359] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.756606  1752 raft_consensus.cc:385] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.756858  1752 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.757390  1749 tablet_bootstrap.cc:492] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Bootstrap starting.
I20260709 12:58:58.757306  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:58.757519  1752 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.760010  1752 ts_tablet_manager.cc:1434] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:58.761093  1752 tablet_bootstrap.cc:492] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:58.760984  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:58.762255  1702 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:58.764428  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:58.767172  1752 tablet_bootstrap.cc:654] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.757905  1633 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:58.768805  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 12:58:58.771327  1600 leader_election.cc:343] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.771754  1600 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:58.772710  1787 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:58.774701  1674 leader_election.cc:343] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:58.776083  1674 leader_election.cc:343] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.793542  1633 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:58.798846  1749 tablet_bootstrap.cc:654] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.802241  1752 tablet_bootstrap.cc:492] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:58.830286  1752 ts_tablet_manager.cc:1403] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.002s
I20260709 12:58:58.830638  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:58.833124  1752 raft_consensus.cc:359] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.834158  2111 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:58:58.822057  1506 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:58.827623  1626 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:58.834743  2111 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:58.828809  1702 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:58.836750  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:58.837893  2113 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:58.838505  2113 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:58.839030  1751 tablet_bootstrap.cc:492] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:58.839661  1751 ts_tablet_manager.cc:1403] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.245s	user 0.050s	sys 0.082s
I20260709 12:58:58.839690  2113 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.843186  1751 raft_consensus.cc:359] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.844127  1751 raft_consensus.cc:385] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.844468  1751 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.845417  1751 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.847143  1551 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:58.848466  1751 ts_tablet_manager.cc:1434] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:58:58.858825  2111 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.860287  1787 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.860807  1787 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.862709  1787 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:58.871019  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:58:58.872673  1600 leader_election.cc:343] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.874261  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:58:58.875801  1601 leader_election.cc:343] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.876228  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:58.878059  2105 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:58.833870  1752 raft_consensus.cc:385] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.878860  1752 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.887672  1751 tablet_bootstrap.cc:492] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:58.890277  1752 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.893317  1752 ts_tablet_manager.cc:1434] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:58:58.899379  1752 tablet_bootstrap.cc:492] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:58.904085  1751 tablet_bootstrap.cc:654] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:58.942065  2105 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.942823  2105 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.946167  1787 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:58.948396  1749 tablet_bootstrap.cc:492] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: No bootstrap required, opened a new log
I20260709 12:58:58.948882  1749 ts_tablet_manager.cc:1403] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent bootstrapping tablet: real 0.192s	user 0.029s	sys 0.041s
I20260709 12:58:58.951838  1749 raft_consensus.cc:359] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.953106  1749 raft_consensus.cc:385] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:58.953606  1749 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Initialized, Role: FOLLOWER
I20260709 12:58:58.954483  1749 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.956617  1749 ts_tablet_manager.cc:1434] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:58.961573  2053 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:58:58.973016  2115 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.973524  2115 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:58.975497  2115 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:58.977803  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:58.979285  2105 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:58.980829  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:58.981467  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:58.982129  1701 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:58.983876  1601 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:58.986136  2132 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:58.986522  2132 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.986869  2132 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:58.988125  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:58.981498  1633 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
W20260709 12:58:58.987258  1674 leader_election.cc:343] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:58.988823  1558 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 0.
I20260709 12:58:58.995673  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:58.998342  2115 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:59.002696  2115 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.002243  1458 catalog_manager.cc:5697] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.006354  1752 tablet_bootstrap.cc:654] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.003937  2115 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.017912  2132 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.024551  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:59.025174  1558 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.029357  1456 catalog_manager.cc:5697] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:59.030648  2132 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:59.020275  2111 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:58:59.046794  1751 tablet_bootstrap.cc:492] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:59.046844  2115 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.048357  1751 ts_tablet_manager.cc:1403] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.161s	user 0.012s	sys 0.022s
I20260709 12:58:59.048710  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:58:59.050107  1702 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.055527  2115 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:59.056533  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:59.057278  1626 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.057351  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 12:58:59.058787  1674 leader_election.cc:343] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:59.060070  1558 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:59.061359  1600 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:59.062165  2120 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.062610  2139 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:59.063115  2139 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:58:59.062650  2120 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.063956  2139 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.064383  1626 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:59.065366  2120 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:59.067317  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:59.068949  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:59.068760  1751 raft_consensus.cc:359] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.069453  1751 raft_consensus.cc:385] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.069720  1751 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
W20260709 12:58:59.070919  1601 leader_election.cc:343] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:59.071256  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:59.071575  2112 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:59.073063  1751 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:58:59.074961  1600 leader_election.cc:343] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:59.075377  1600 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:59.076593  2120 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:59.072800  2112 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:59.078332  2112 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.083218  1752 tablet_bootstrap.cc:492] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:59.083684  1752 ts_tablet_manager.cc:1403] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.185s	user 0.012s	sys 0.014s
I20260709 12:58:59.084646  1751 ts_tablet_manager.cc:1434] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:58:59.090101  1752 raft_consensus.cc:359] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.090790  1752 raft_consensus.cc:385] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.091049  1752 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.091679  1752 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.094373  1752 ts_tablet_manager.cc:1434] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:58:59.094492  2113 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.095301  1752 tablet_bootstrap.cc:492] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:59.094944  2113 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.096791  2113 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:59.098470  1751 tablet_bootstrap.cc:492] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:59.101764  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:59.102319  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:59.102460  1633 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:59.102949  1558 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:59.104158  1702 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:58:59.104254  1674 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:59.105172  2113 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:59.105562  2113 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.105927  2113 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.116528  2113 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.125660  1752 tablet_bootstrap.cc:654] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.134402  1751 tablet_bootstrap.cc:654] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.147334  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:59.147981  1558 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.147429  2113 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:59.150230  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:59.150799  1626 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.149420  1456 catalog_manager.cc:5697] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:59.156963  1626 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:59.158114  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:59.158888  2115 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:59.161130  1558 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:59.163511  2115 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:59.164705  2115 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.182533  1752 tablet_bootstrap.cc:492] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:59.183039  1752 ts_tablet_manager.cc:1403] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.005s
I20260709 12:58:59.180907  1458 catalog_manager.cc:5697] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.186234  1751 tablet_bootstrap.cc:492] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:59.185724  1752 raft_consensus.cc:359] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.189872  1751 ts_tablet_manager.cc:1403] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.092s	user 0.018s	sys 0.010s
I20260709 12:58:59.190084  1752 raft_consensus.cc:385] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.190408  1752 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.191816  1752 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.192829  1751 raft_consensus.cc:359] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.193580  1751 raft_consensus.cc:385] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.193842  1752 ts_tablet_manager.cc:1434] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:58:59.194796  1752 tablet_bootstrap.cc:492] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:59.193852  1751 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.197062  1751 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.199101  1751 ts_tablet_manager.cc:1434] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:59.204378  1752 tablet_bootstrap.cc:654] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.206748  1751 tablet_bootstrap.cc:492] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:59.212652  2111 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.213264  2111 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.215436  2111 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:59.217013  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:59.217542  1751 tablet_bootstrap.cc:654] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:59.219172  1526 leader_election.cc:343] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:59.220077  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:59.220355  2115 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.220714  1626 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 0.
I20260709 12:58:59.220804  2115 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.221868  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:58:59.222982  2115 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:59.223780  2140 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:59.223887  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:59.224244  2140 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.224573  1633 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:59.225179  1752 tablet_bootstrap.cc:492] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:59.225632  1752 ts_tablet_manager.cc:1403] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.005s
I20260709 12:58:59.223799  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:59.225808  1673 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:59.226346  1558 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:59.224622  2140 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.231915  2113 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:59.232362  2113 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.232712  2113 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.235095  1751 tablet_bootstrap.cc:492] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:59.236497  1751 ts_tablet_manager.cc:1403] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.005s
I20260709 12:58:59.236148  1458 catalog_manager.cc:5697] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.242847  2140 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.239979  1751 raft_consensus.cc:359] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.243822  1751 raft_consensus.cc:385] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.244094  1751 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.244952  1751 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.245700  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:59.246343  1626 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.228199  1752 raft_consensus.cc:359] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.250927  1752 raft_consensus.cc:385] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.251214  1752 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.252187  1751 ts_tablet_manager.cc:1434] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:58:59.251837  1752 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.253199  1751 tablet_bootstrap.cc:492] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:59.253751  1752 ts_tablet_manager.cc:1434] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:58:59.254704  1752 tablet_bootstrap.cc:492] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:59.254705  2113 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.262058  1751 tablet_bootstrap.cc:654] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.262249  1626 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:58:59.263438  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:59.264209  2111 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:59.264701  2111 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:58:59.265548  2111 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.267937  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:59.268654  1558 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.278679  2140 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:59.277937  2115 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:59.280519  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:58:59.288307  1526 leader_election.cc:343] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:59.288816  1752 tablet_bootstrap.cc:654] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.299476  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:59.300129  1634 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.303632  1458 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:59.305892  1751 tablet_bootstrap.cc:492] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:59.306445  1751 ts_tablet_manager.cc:1403] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.016s
I20260709 12:58:59.306747  1634 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:59.307407  2113 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:59.308075  1673 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:59.308917  2113 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:59.309593  2113 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:59.310456  2113 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.311062  1751 raft_consensus.cc:359] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.311901  1751 raft_consensus.cc:385] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.312191  1751 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.312908  1751 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.308429  1558 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:59.318549  1751 ts_tablet_manager.cc:1434] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:58:59.319624  1751 tablet_bootstrap.cc:492] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
W20260709 12:58:59.328151  1674 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:59.337648  1456 catalog_manager.cc:5697] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.343825  1752 tablet_bootstrap.cc:492] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:59.344323  1752 ts_tablet_manager.cc:1403] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.001s
I20260709 12:58:59.347060  1752 raft_consensus.cc:359] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.347712  1752 raft_consensus.cc:385] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.347977  1752 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.349613  1751 tablet_bootstrap.cc:654] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.350626  1752 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.353155  1752 ts_tablet_manager.cc:1434] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:58:59.354166  1752 tablet_bootstrap.cc:492] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Bootstrap starting.
I20260709 12:58:59.362788  1752 tablet_bootstrap.cc:654] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.367544  2115 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.368273  2115 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.372715  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:59.373684  1634 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:59.375631  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:59.376816  2088 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.377480  2088 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.380133  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:59.381106  1558 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:59.381268  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:59.382078  1634 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 1: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:58:59.380208  2088 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:59.383831  2088 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:59.384192  2088 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.384954  2115 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:59.384550  2088 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.393155  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:59.406352  2088 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.410435  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:59.411036  1634 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.421663  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:58:59.434219  2112 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.443462  2112 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:59.448174  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:59.451004  1551 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.448702  1751 tablet_bootstrap.cc:492] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:59.453068  1751 ts_tablet_manager.cc:1403] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.134s	user 0.034s	sys 0.040s
I20260709 12:58:59.455789  1751 raft_consensus.cc:359] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.456444  1751 raft_consensus.cc:385] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.456694  1751 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.448860  2088 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:59.458082  1751 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.459492  1634 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:59.460410  1751 ts_tablet_manager.cc:1434] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:59.461447  1751 tablet_bootstrap.cc:492] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:59.465147  1752 tablet_bootstrap.cc:492] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: No bootstrap required, opened a new log
I20260709 12:58:59.465590  1752 ts_tablet_manager.cc:1403] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Time spent bootstrapping tablet: real 0.112s	user 0.023s	sys 0.040s
I20260709 12:58:59.468123  1752 raft_consensus.cc:359] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.468730  1752 raft_consensus.cc:385] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.468959  1752 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.469540  1752 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.470309  1751 tablet_bootstrap.cc:654] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.470259  2112 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.470810  2112 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.471513  1752 ts_tablet_manager.cc:1434] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:58:59.473102  2112 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:59.474202  2053 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:59.475720  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:59.476604  2140 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:59.480491  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:59.481099  1633 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:59.482868  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:59.483939  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:59.485421  2112 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:59.485878  2112 raft_consensus.cc:697] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:59.485756  1551 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:59.486898  2112 consensus_queue.cc:237] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.490653  2088 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:59.491060  2088 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.491183  1751 tablet_bootstrap.cc:492] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:59.491418  2088 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.492002  1751 ts_tablet_manager.cc:1403] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.000s
W20260709 12:58:59.495038  1674 leader_election.cc:343] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:59.495926  1751 raft_consensus.cc:359] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.496883  1751 raft_consensus.cc:385] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.497182  1751 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.498092  1751 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.502379  1751 ts_tablet_manager.cc:1434] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:58:59.503814  1751 tablet_bootstrap.cc:492] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Bootstrap starting.
I20260709 12:58:59.507457  2115 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:59.512337  1751 tablet_bootstrap.cc:654] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:59.517340  2053 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.517861  2053 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.519901  2053 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:59.522354  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:59.525148  2132 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:59.546823  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:59.547827  1751 tablet_bootstrap.cc:492] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: No bootstrap required, opened a new log
I20260709 12:58:59.548527  1751 ts_tablet_manager.cc:1403] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Time spent bootstrapping tablet: real 0.045s	user 0.032s	sys 0.008s
I20260709 12:58:59.552438  1526 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:59.552906  1751 raft_consensus.cc:359] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.553483  2140 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:59.553977  1751 raft_consensus.cc:385] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:59.554934  1751 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Initialized, Role: FOLLOWER
I20260709 12:58:59.555944  1751 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.549616  1456 catalog_manager.cc:5697] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.559523  1751 ts_tablet_manager.cc:1434] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:58:59.568542  2088 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.578713  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:59.579305  1634 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.587613  2132 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:59.590267  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:59.591063  1558 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.600873  1558 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:59.602316  1674 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:58:59.603098  2113 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:59.603559  2113 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:59.604362  2113 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.605331  1634 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:59.577844  2088 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:59.618312  1558 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.626715  2088 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.627365  2088 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.630203  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:58:59.630833  1557 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:59.631088  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:59.631736  1633 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 0.
I20260709 12:58:59.633041  2198 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:59.633490  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:59.634698  2112 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:59.634886  2088 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:59.635108  2112 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.635481  2112 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.640515  1456 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.644353  2112 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.658890  2112 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:58:59.659925  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:58:59.660516  1633 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.660916  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:58:59.661531  1557 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.668377  1633 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:59.669355  1557 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:58:59.669355  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:58:59.670315  2112 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:59.670780  2112 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:58:59.671540  2112 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.682365  1456 catalog_manager.cc:5697] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.722301  2112 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:59.739513  2088 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:59.741717  2054 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:59.763376  2140 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:59.767483  2112 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:59.786484  2115 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:59.868115  1557 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:59.876080  2053 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:58:59.876646  2053 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:58:59.880668  2053 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:58:59.881784  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:58:59.883335  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:58:59.884723  1524 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:58:59.885434  2053 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:59.895195  2112 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:59.915575  2115 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:00.077970  2113 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:00.099200  2198 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:00.112919  2112 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:00.129621  2088 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:01.445498   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:01.472954  2225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:01.473532  2224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:01.474695   431 server_base.cc:1061] running on GCE node
W20260709 12:59:01.474752  2227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:01.476392   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:01.476676   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:01.476822   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601941476811 us; error 0 us; skew 500 ppm
I20260709 12:59:01.477356   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:01.479943   431 webserver.cc:533] Webserver started at http://127.0.107.196:40363/ using document root <none> and password file <none>
I20260709 12:59:01.480387   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:01.480654   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:01.481050   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:01.482502   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-3-root/instance:
uuid: "6923294c847b48ebb577e0935d316aa3"
format_stamp: "Formatted at 2026-07-09 12:59:01 on dist-test-slave-nr1f"
I20260709 12:59:01.487353   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:59:01.491111  2232 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:01.491992   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:59:01.492339   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-3-root
uuid: "6923294c847b48ebb577e0935d316aa3"
format_stamp: "Formatted at 2026-07-09 12:59:01 on dist-test-slave-nr1f"
I20260709 12:59:01.492703   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:01.504899   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:01.506825   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:01.509378   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:01.512796   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:01.513034   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:01.513312   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:01.513520   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:01.587325   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:38311
I20260709 12:59:01.587450  2295 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:38311 every 8 connection(s)
I20260709 12:59:01.593220   431 auto_leader_rebalancer-test.cc:384] add a tserver: 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:01.605624  2296 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36797
I20260709 12:59:01.606076  2296 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:01.606770  2296 heartbeater.cc:507] Master 127.0.107.254:36797 requested a full tablet report, sending...
I20260709 12:59:01.608727  1457 ts_manager.cc:194] Registered new tserver with Master: 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:01.610133  1457 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48036
I20260709 12:59:02.028594  1634 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:02.034965  1702 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:02.035449  1558 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:02.036638  2219 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:02.037926  2220 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:02.048529  2303 raft_consensus.cc:2955] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:02.049978  1702 raft_consensus.cc:2955] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:02.049978  1558 raft_consensus.cc:2955] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
W20260709 12:59:02.054252  1599 consensus_peers.cc:597] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4afefd9972704c7ba44201033b7d2e6b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:02.068718  1457 catalog_manager.cc:5697] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:02.084995  1702 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:02.108124  1634 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:02.108650  1557 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:02.110651  2115 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:02.112545  2115 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:02.123116  1673 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b699c6ee183d45208fccb5d51557fe41. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:02.127555  2115 raft_consensus.cc:2955] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:02.129282  1634 raft_consensus.cc:2955] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:02.143934  1557 raft_consensus.cc:2955] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:02.149269  1456 catalog_manager.cc:5697] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:02.173764  1557 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:02.181057  1705 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:02.182561  2111 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:02.184460  1634 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:02.187136  2237 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:02.194700  2111 raft_consensus.cc:2955] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:02.200385  1701 raft_consensus.cc:2955] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
W20260709 12:59:02.204190  1524 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db8014a9a7494e619e862cbd380cb262. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:02.221442  1458 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:02.227319  1701 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:02.233672  1626 raft_consensus.cc:2955] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:02.237654  1634 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:02.239138  2113 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:02.240538  1557 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:02.244014  1673 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44f91d5f5a1f4564ab4ec7b1b5b0aa0b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:02.246726  2318 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:02.273792  2115 raft_consensus.cc:2955] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:02.275945  1557 raft_consensus.cc:2955] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:02.277021  1634 raft_consensus.cc:2955] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:02.292507  1458 catalog_manager.cc:5697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:02.561833  2328 ts_tablet_manager.cc:933] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:02.562614  2329 ts_tablet_manager.cc:933] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:02.564258  2328 tablet_copy_client.cc:323] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 12:59:02.565927  2329 tablet_copy_client.cc:323] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:02.593499  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 4afefd9972704c7ba44201033b7d2e6b from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 12:59:02.593499  1570 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet db8014a9a7494e619e862cbd380cb262 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:02.594388  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 4afefd9972704c7ba44201033b7d2e6b from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-4afefd9972704c7ba44201033b7d2e6b
I20260709 12:59:02.594420  1570 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet db8014a9a7494e619e862cbd380cb262 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-db8014a9a7494e619e862cbd380cb262
I20260709 12:59:02.602257  1570 tablet_copy_source_session.cc:215] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:02.602746  1645 tablet_copy_source_session.cc:215] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:02.607036  2329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db8014a9a7494e619e862cbd380cb262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:02.607858  2328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4afefd9972704c7ba44201033b7d2e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:02.612797  2296 heartbeater.cc:499] Master 127.0.107.254:36797 was elected leader, sending a full tablet report...
I20260709 12:59:02.644059  2328 tablet_copy_client.cc:806] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:02.644827  2328 tablet_copy_client.cc:670] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:02.645969  2335 ts_tablet_manager.cc:933] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:02.649290  2328 tablet_copy_client.cc:538] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:02.652431  2329 tablet_copy_client.cc:806] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:02.653146  2329 tablet_copy_client.cc:670] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:02.659319  2335 tablet_copy_client.cc:323] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:02.679836  2329 tablet_copy_client.cc:538] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:02.699910  2328 tablet_bootstrap.cc:492] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:02.701709  2329 tablet_bootstrap.cc:492] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:02.730170  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet b699c6ee183d45208fccb5d51557fe41 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:02.730808  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet b699c6ee183d45208fccb5d51557fe41 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-b699c6ee183d45208fccb5d51557fe41
I20260709 12:59:02.737617  1719 tablet_copy_source_session.cc:215] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:02.743382  2335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b699c6ee183d45208fccb5d51557fe41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:02.786972  2335 tablet_copy_client.cc:806] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:02.792119  2335 tablet_copy_client.cc:670] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:02.797888  2328 tablet_bootstrap.cc:492] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:02.799072  2328 tablet_bootstrap.cc:492] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:02.803568  2328 ts_tablet_manager.cc:1403] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.017s
I20260709 12:59:02.806141  2335 tablet_copy_client.cc:538] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:02.805833  2340 ts_tablet_manager.cc:933] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:02.811007  2328 raft_consensus.cc:359] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:02.812034  2328 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:02.812788  2328 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:02.815487  2329 tablet_bootstrap.cc:492] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:02.816484  2329 tablet_bootstrap.cc:492] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:02.817229  2329 ts_tablet_manager.cc:1403] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.116s	user 0.029s	sys 0.009s
I20260709 12:59:02.817370  2340 tablet_copy_client.cc:323] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:02.819226  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:02.819766  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-44f91d5f5a1f4564ab4ec7b1b5b0aa0b
I20260709 12:59:02.820252  2335 tablet_bootstrap.cc:492] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:02.824123  2329 raft_consensus.cc:359] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:02.826563  2329 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:02.827261  2329 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:02.830526  1719 tablet_copy_source_session.cc:215] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:02.834214  2328 ts_tablet_manager.cc:1434] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.002s
I20260709 12:59:02.835889  2340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:02.841015  2329 ts_tablet_manager.cc:1434] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.009s
I20260709 12:59:02.857678  2340 tablet_copy_client.cc:806] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:02.858422  2340 tablet_copy_client.cc:670] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:02.861613  1570 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-db8014a9a7494e619e862cbd380cb262 received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:02.862125  1570 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-db8014a9a7494e619e862cbd380cb262 on tablet db8014a9a7494e619e862cbd380cb262 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:02.862723  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-4afefd9972704c7ba44201033b7d2e6b received from {username='slave'} at 127.0.0.1:59260
I20260709 12:59:02.863262  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-4afefd9972704c7ba44201033b7d2e6b on tablet 4afefd9972704c7ba44201033b7d2e6b with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:02.867678  2335 tablet_bootstrap.cc:492] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:02.868533  2340 tablet_copy_client.cc:538] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:02.870642  2335 tablet_bootstrap.cc:492] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:02.871366  2335 ts_tablet_manager.cc:1403] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.051s	user 0.026s	sys 0.005s
I20260709 12:59:02.874447  2335 raft_consensus.cc:359] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:02.875783  2335 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:02.876459  2335 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:02.877398  2340 tablet_bootstrap.cc:492] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:02.883055  2335 ts_tablet_manager.cc:1434] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:59:02.888211  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-b699c6ee183d45208fccb5d51557fe41 received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:02.888809  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-b699c6ee183d45208fccb5d51557fe41 on tablet b699c6ee183d45208fccb5d51557fe41 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:02.906114  2340 tablet_bootstrap.cc:492] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:02.907337  2340 tablet_bootstrap.cc:492] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:02.908062  2340 ts_tablet_manager.cc:1403] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.012s
I20260709 12:59:02.911651  2340 raft_consensus.cc:359] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:02.912387  2340 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:02.912911  2340 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:02.915124  2340 ts_tablet_manager.cc:1434] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:59:02.916930  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-44f91d5f5a1f4564ab4ec7b1b5b0aa0b received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:02.917364  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-44f91d5f5a1f4564ab4ec7b1b5b0aa0b on tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:02.993366  2270 raft_consensus.cc:1217] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:03.106993  2270 raft_consensus.cc:1217] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:03.163146  2270 raft_consensus.cc:1217] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:03.379132  2270 raft_consensus.cc:1217] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:03.493757  2347 raft_consensus.cc:1064] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:03.496745  2347 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:03.506922  1633 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.508411  2270 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.508345  2349 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:03.509744  1705 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.515146  2349 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:03.516258  2347 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:03.527089  2349 raft_consensus.cc:2955] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:03.531795  1701 raft_consensus.cc:2955] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:03.536368  1633 raft_consensus.cc:2955] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:03.547744  1457 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:03.551172  2317 raft_consensus.cc:1064] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:03.553830  2317 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:03.568285  2270 raft_consensus.cc:2955] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:03.573925  2271 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.578259  2113 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:03.578516  1551 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.578765  1628 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.583688  2318 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:03.585551  2318 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:03.631481  2219 raft_consensus.cc:1064] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:03.705717  2219 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:03.751544  2269 raft_consensus.cc:2955] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:03.748703  2318 raft_consensus.cc:2955] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:03.781917  1626 raft_consensus.cc:2955] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:03.807083  1551 raft_consensus.cc:2955] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:03.808125  1557 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.809010  1701 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.809527  2270 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:03.840950  2219 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:03.827880  1455 catalog_manager.cc:5697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:03.846596  2337 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:59:03.850243  2337 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:03.914958  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 76056.1us
I20260709 12:59:03.964136  1553 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:03.975981  2113 raft_consensus.cc:1064] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:03.979993  2113 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:04.021418  2361 raft_consensus.cc:2955] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.030792  1701 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:04.032696  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 61042.3us
I20260709 12:59:04.026077  1557 raft_consensus.cc:2955] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.044512  1626 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:04.055999  2270 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:04.055999  2237 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:59:04.058913  2270 raft_consensus.cc:2955] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.110846  2347 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:04.113353  2269 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:59:04.126765  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 120982us
I20260709 12:59:04.125236  2372 raft_consensus.cc:2955] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.131827  1626 raft_consensus.cc:2955] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.129558  2366 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:59:04.163801  1702 raft_consensus.cc:2955] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 12:59:04.218451  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 77106.5us
I20260709 12:59:04.245203  1628 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:04.248909  2271 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:04.252895  1457 catalog_manager.cc:5697] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.272975  2373 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:04.275190  2373 raft_consensus.cc:2955] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.281266  2370 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:04.290086  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b699c6ee183d45208fccb5d51557fe41 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:04.290781  2269 raft_consensus.cc:2955] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.291762  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet db8014a9a7494e619e862cbd380cb262 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:04.292552  1456 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.319875  1692 tablet_service.cc:1558] Processing DeleteTablet for tablet db8014a9a7494e619e862cbd380cb262 with delete_type TABLET_DATA_TOMBSTONED (TS 4f1725fe36e349ac85405627f9c93d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:04.324021  1626 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:04.326810  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 180182us
W20260709 12:59:04.328140  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 179835us
I20260709 12:59:04.332755  2271 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:04.335389  2219 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:04.336045  1557 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:04.337299  1551 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:04.344151  2361 raft_consensus.cc:2955] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.348308  2384 tablet_replica.cc:333] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 12:59:04.349339  2384 raft_consensus.cc:2243] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:04.355311  2268 raft_consensus.cc:2955] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.360240  2384 raft_consensus.cc:2272] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:04.372900  2384 ts_tablet_manager.cc:1916] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:04.386976  2370 raft_consensus.cc:2955] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.403064  2270 raft_consensus.cc:2955] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.407114  1702 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:04.408004  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4afefd9972704c7ba44201033b7d2e6b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:04.407533  1456 catalog_manager.cc:5697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.416543  2219 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:04.422569  2376 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:04.422987  1458 catalog_manager.cc:5697] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.423853  1702 raft_consensus.cc:2955] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.426272  2376 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:04.433945  1625 tablet_service.cc:1558] Processing DeleteTablet for tablet b699c6ee183d45208fccb5d51557fe41 with delete_type TABLET_DATA_TOMBSTONED (TS 7e99891af85f4b10aa1cc2da6aa33082 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42238
W20260709 12:59:04.434787  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 50305.5us
I20260709 12:59:04.447824  1543 tablet_service.cc:1558] Processing DeleteTablet for tablet 4afefd9972704c7ba44201033b7d2e6b with delete_type TABLET_DATA_TOMBSTONED (TS 87144ea1a4a14ab8b942fb426159f031 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:59:04.464514  1628 raft_consensus.cc:2955] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.474326  2270 raft_consensus.cc:2955] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.483518  2384 ts_tablet_manager.cc:1929] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:04.484354  2384 log.cc:1199] T db8014a9a7494e619e862cbd380cb262 P 4f1725fe36e349ac85405627f9c93d95: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/wals/db8014a9a7494e619e862cbd380cb262
I20260709 12:59:04.512810  2385 tablet_replica.cc:333] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 12:59:04.516348  2386 tablet_replica.cc:333] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 12:59:04.523038  2385 raft_consensus.cc:2243] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:04.524127  2385 raft_consensus.cc:2272] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:04.528143  2386 raft_consensus.cc:2243] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:04.529114  2386 raft_consensus.cc:2272] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:04.529150  2385 ts_tablet_manager.cc:1916] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:04.532550  2386 ts_tablet_manager.cc:1916] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:04.569439  1445 catalog_manager.cc:5028] TS 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): tablet db8014a9a7494e619e862cbd380cb262 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:04.572605  1551 raft_consensus.cc:2955] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.572634  1553 raft_consensus.cc:2955] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 12:59:04.637077  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 116224us
I20260709 12:59:04.636803  1454 catalog_manager.cc:5697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.710974  2386 ts_tablet_manager.cc:1929] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:04.729656  2386 log.cc:1199] T 4afefd9972704c7ba44201033b7d2e6b P 87144ea1a4a14ab8b942fb426159f031: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/wals/4afefd9972704c7ba44201033b7d2e6b
I20260709 12:59:04.742771  1444 catalog_manager.cc:5028] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): tablet 4afefd9972704c7ba44201033b7d2e6b (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:04.755183  2385 ts_tablet_manager.cc:1929] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:04.755725  2385 log.cc:1199] T b699c6ee183d45208fccb5d51557fe41 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/wals/b699c6ee183d45208fccb5d51557fe41
I20260709 12:59:04.758556  1443 catalog_manager.cc:5028] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): tablet b699c6ee183d45208fccb5d51557fe41 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
W20260709 12:59:04.760039  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 49996.1us
W20260709 12:59:04.929534  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:04.930491  1705 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:04.942396  2270 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:04.942862  1553 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:04.945003  2378 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:04.946924  2376 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:04.958810  2364 raft_consensus.cc:2955] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.971482  2270 raft_consensus.cc:2955] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:04.981927  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:04.996065  1553 raft_consensus.cc:2955] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:05.002331  1456 catalog_manager.cc:5697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:05.020529  1625 tablet_service.cc:1558] Processing DeleteTablet for tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b with delete_type TABLET_DATA_TOMBSTONED (TS 7e99891af85f4b10aa1cc2da6aa33082 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42238
I20260709 12:59:05.022002  2385 tablet_replica.cc:333] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 12:59:05.023229  2385 raft_consensus.cc:2243] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:05.024256  2385 raft_consensus.cc:2272] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:05.047654  2385 ts_tablet_manager.cc:1916] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:05.077840  2385 ts_tablet_manager.cc:1929] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:05.078240  2385 log.cc:1199] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 7e99891af85f4b10aa1cc2da6aa33082: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/wals/44f91d5f5a1f4564ab4ec7b1b5b0aa0b
I20260709 12:59:05.079707  1443 catalog_manager.cc:5028] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): tablet 44f91d5f5a1f4564ab4ec7b1b5b0aa0b (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:06.082649  1633 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:06.090529  1705 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:06.090919  1599 consensus_peers.cc:597] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 323bbbd0be5249329755d7e00ed71324. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:06.092077  2393 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:06.093151  1553 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:06.094484  2393 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:06.100124  2219 raft_consensus.cc:2955] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.102108  1708 raft_consensus.cc:2955] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.110139  1553 raft_consensus.cc:2955] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.114518  1551 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:06.122382  1458 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:06.136289  1708 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:59:06.136783  1524 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d44a8411cf4642829994ec97173d358a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:06.137123  1633 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:06.138659  2372 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:06.140004  2388 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:06.174221  2372 raft_consensus.cc:2955] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.176390  1633 raft_consensus.cc:2955] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.180225  1708 raft_consensus.cc:2955] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.203043  1455 catalog_manager.cc:5697] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.205478  1551 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:06.215375  1633 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:06.216763  1708 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:06.217597  2388 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:06.219071  1524 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a45da2e3894b42dc93ed11eb2c31220c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:06.221134  2391 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:06.231799  2388 raft_consensus.cc:2955] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.233961  1705 raft_consensus.cc:2955] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.238040  1634 raft_consensus.cc:2955] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.248814  1551 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:06.259826  1455 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.267127  1633 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:06.268574  1705 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:06.270040  2388 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:06.270874  2391 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:06.274223  1524 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0ab32967f744404a0f736900b1d7b9a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:06.289218  2391 raft_consensus.cc:2955] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.309141  1455 catalog_manager.cc:5697] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:06.316861  1634 raft_consensus.cc:2955] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.315189  1705 raft_consensus.cc:2955] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:06.682228  2412 ts_tablet_manager.cc:933] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:06.684070  2412 tablet_copy_client.cc:323] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 12:59:06.686080  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 323bbbd0be5249329755d7e00ed71324 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 12:59:06.686632  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 323bbbd0be5249329755d7e00ed71324 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-323bbbd0be5249329755d7e00ed71324
I20260709 12:59:06.706363  1645 tablet_copy_source_session.cc:215] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:06.710085  2412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 323bbbd0be5249329755d7e00ed71324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:06.731106  2412 tablet_copy_client.cc:806] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:06.731804  2412 tablet_copy_client.cc:670] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:06.732857  2414 ts_tablet_manager.cc:933] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:06.735371  2414 tablet_copy_client.cc:323] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:06.738221  1570 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet d44a8411cf4642829994ec97173d358a from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:06.738736  1570 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet d44a8411cf4642829994ec97173d358a from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-d44a8411cf4642829994ec97173d358a
I20260709 12:59:06.745608  1570 tablet_copy_source_session.cc:215] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:06.747371  2412 tablet_copy_client.cc:538] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:06.750067  2414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44a8411cf4642829994ec97173d358a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:06.762867  2412 tablet_bootstrap.cc:492] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:06.777493  2414 tablet_copy_client.cc:806] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:06.778294  2414 tablet_copy_client.cc:670] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:06.780316  2416 ts_tablet_manager.cc:933] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:06.788571  2414 tablet_copy_client.cc:538] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:06.793702  2412 tablet_bootstrap.cc:492] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:06.794804  2412 tablet_bootstrap.cc:492] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:06.796007  2412 ts_tablet_manager.cc:1403] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.022s
I20260709 12:59:06.799273  2412 raft_consensus.cc:359] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:06.800231  2412 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:06.800953  2412 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:06.803826  2418 ts_tablet_manager.cc:933] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:06.838114  2414 tablet_bootstrap.cc:492] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:06.844000  2412 ts_tablet_manager.cc:1434] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.034s
I20260709 12:59:06.851897  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-323bbbd0be5249329755d7e00ed71324 received from {username='slave'} at 127.0.0.1:59260
I20260709 12:59:06.852488  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-323bbbd0be5249329755d7e00ed71324 on tablet 323bbbd0be5249329755d7e00ed71324 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:06.847129  2416 tablet_copy_client.cc:323] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:06.848428  2418 tablet_copy_client.cc:323] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:06.860263  1570 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet a45da2e3894b42dc93ed11eb2c31220c from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:06.860908  1570 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet a45da2e3894b42dc93ed11eb2c31220c from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-a45da2e3894b42dc93ed11eb2c31220c
I20260709 12:59:06.865886  1569 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet d0ab32967f744404a0f736900b1d7b9a from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:06.866592  1569 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet d0ab32967f744404a0f736900b1d7b9a from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-d0ab32967f744404a0f736900b1d7b9a
I20260709 12:59:06.874156  1570 tablet_copy_source_session.cc:215] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:06.876508  1569 tablet_copy_source_session.cc:215] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:06.877700  2416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a45da2e3894b42dc93ed11eb2c31220c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:06.880089  2418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ab32967f744404a0f736900b1d7b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:06.898481  2418 tablet_copy_client.cc:806] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:06.899225  2418 tablet_copy_client.cc:670] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:06.903718  2418 tablet_copy_client.cc:538] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:06.912973  2416 tablet_copy_client.cc:806] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:06.914330  2418 tablet_bootstrap.cc:492] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:06.916066  2416 tablet_copy_client.cc:670] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:06.920118  2416 tablet_copy_client.cc:538] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:06.926167  2414 tablet_bootstrap.cc:492] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:06.927311  2414 tablet_bootstrap.cc:492] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:06.928120  2414 ts_tablet_manager.cc:1403] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.090s	user 0.034s	sys 0.016s
I20260709 12:59:06.931998  2414 raft_consensus.cc:359] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:06.933023  2414 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:06.930334  2416 tablet_bootstrap.cc:492] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:06.933827  2414 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:06.936879  2414 ts_tablet_manager.cc:1434] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:06.939051  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-d44a8411cf4642829994ec97173d358a received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:06.939536  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-d44a8411cf4642829994ec97173d358a on tablet d44a8411cf4642829994ec97173d358a with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:06.963681  2418 tablet_bootstrap.cc:492] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:06.964820  2418 tablet_bootstrap.cc:492] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:06.965642  2418 ts_tablet_manager.cc:1403] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.005s
I20260709 12:59:06.969056  2418 raft_consensus.cc:359] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:06.970129  2418 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:06.970886  2418 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:06.976956  2418 ts_tablet_manager.cc:1434] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:59:06.979031  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-d0ab32967f744404a0f736900b1d7b9a received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:06.979514  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-d0ab32967f744404a0f736900b1d7b9a on tablet d0ab32967f744404a0f736900b1d7b9a with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:06.990273  2416 tablet_bootstrap.cc:492] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:06.991744  2416 tablet_bootstrap.cc:492] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:06.992798  2416 ts_tablet_manager.cc:1403] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.063s	user 0.027s	sys 0.007s
I20260709 12:59:06.995359  2416 raft_consensus.cc:359] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:06.995962  2416 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:06.996493  2416 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:06.998572  2416 ts_tablet_manager.cc:1434] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:59:07.004383  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-a45da2e3894b42dc93ed11eb2c31220c received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:07.004806  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-a45da2e3894b42dc93ed11eb2c31220c on tablet a45da2e3894b42dc93ed11eb2c31220c with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:07.166699  2268 raft_consensus.cc:1217] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:59:07.181851  2268 raft_consensus.cc:1217] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:07.213691  2268 raft_consensus.cc:1217] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:59:07.364172  2268 raft_consensus.cc:1217] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:07.624109  2219 raft_consensus.cc:1064] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:07.626420  2219 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:07.633126  1708 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:07.633452  2270 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:07.635380  2219 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:07.636740  1551 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:07.637792  2410 raft_consensus.cc:1064] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:07.640458  2361 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:07.641495  2422 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:59:07.650272  2410 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:07.689770  1701 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:07.702975  2410 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:59:07.713716  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 65390.5us
I20260709 12:59:07.715590  2428 raft_consensus.cc:2955] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.718827  2270 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:07.721233  2268 raft_consensus.cc:2955] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.722822  2436 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:07.730379  2410 raft_consensus.cc:1064] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:07.731673  1634 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:07.733835  2410 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:07.744374  2426 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:07.749280  1454 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.750540  1554 raft_consensus.cc:2955] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.761274  1708 raft_consensus.cc:2955] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.764812  2426 raft_consensus.cc:2955] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.765623  1705 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:07.784526  2430 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:07.788275  2268 raft_consensus.cc:2955] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.798892  2270 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:07.798938  1634 raft_consensus.cc:2955] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.814838  1633 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:07.814760  2391 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:07.823606  1708 raft_consensus.cc:2955] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.836776  2434 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:07.861603  2434 raft_consensus.cc:2955] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.869441  2268 raft_consensus.cc:2955] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.885924  1708 raft_consensus.cc:2955] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.886004  1628 raft_consensus.cc:2955] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.906431  1456 catalog_manager.cc:5697] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.908136  1456 catalog_manager.cc:5697] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.914458  1628 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:07.925871  2268 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:07.925870  1708 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:07.927186  2428 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:07.929314  2219 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:07.937683  2431 raft_consensus.cc:2955] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.940754  1702 raft_consensus.cc:2955] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.949712  1553 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:07.950974  1554 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:07.946367  2268 raft_consensus.cc:2955] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.956840  2270 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:07.959064  2270 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:07.960923  2426 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:07.965741  2410 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:07.974298  1628 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:07.975407  2434 raft_consensus.cc:2955] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.976466  2437 raft_consensus.cc:2955] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:07.990302  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 323bbbd0be5249329755d7e00ed71324 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:07.991942  2436 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:07.996968  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d0ab32967f744404a0f736900b1d7b9a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:07.997987  2269 raft_consensus.cc:2955] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.003360  1634 raft_consensus.cc:2955] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.004395  2270 raft_consensus.cc:2955] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.008289  1633 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:08.010690  2391 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:08.012843  2391 raft_consensus.cc:1064] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:08.009116  1455 catalog_manager.cc:5697] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:08.010721  1458 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.015739  1633 raft_consensus.cc:2955] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.042418  1692 tablet_service.cc:1558] Processing DeleteTablet for tablet d0ab32967f744404a0f736900b1d7b9a with delete_type TABLET_DATA_TOMBSTONED (TS 4f1725fe36e349ac85405627f9c93d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:08.045572  1543 tablet_service.cc:1558] Processing DeleteTablet for tablet 323bbbd0be5249329755d7e00ed71324 with delete_type TABLET_DATA_TOMBSTONED (TS 87144ea1a4a14ab8b942fb426159f031 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:59:08.052814  1454 catalog_manager.cc:5697] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New cstate: current_term: 2 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.046514  2451 tablet_replica.cc:333] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 12:59:08.056098  2451 raft_consensus.cc:2243] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:08.062455  2451 raft_consensus.cc:2272] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:08.052687  2391 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:08.070384  2451 ts_tablet_manager.cc:1916] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:08.081337  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d44a8411cf4642829994ec97173d358a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:08.090317  1692 tablet_service.cc:1558] Processing DeleteTablet for tablet d44a8411cf4642829994ec97173d358a with delete_type TABLET_DATA_TOMBSTONED (TS 4f1725fe36e349ac85405627f9c93d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:08.118719  2452 tablet_replica.cc:333] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 12:59:08.121837  2452 raft_consensus.cc:2243] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:08.122701  2452 raft_consensus.cc:2272] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:08.134087  1702 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:08.137554  2451 ts_tablet_manager.cc:1929] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:59:08.138136  2451 log.cc:1199] T d0ab32967f744404a0f736900b1d7b9a P 4f1725fe36e349ac85405627f9c93d95: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/wals/d0ab32967f744404a0f736900b1d7b9a
I20260709 12:59:08.139783  1445 catalog_manager.cc:5028] TS 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): tablet d0ab32967f744404a0f736900b1d7b9a (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:08.140532  2270 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:08.141218  2451 tablet_replica.cc:333] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 12:59:08.142330  2451 raft_consensus.cc:2243] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:08.142189  2436 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:08.143392  2430 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:08.143815  2451 raft_consensus.cc:2272] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:08.146100  2452 ts_tablet_manager.cc:1916] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:08.147224  2451 ts_tablet_manager.cc:1916] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:08.163349  1633 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:08.167632  2426 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:08.170491  2451 ts_tablet_manager.cc:1929] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:59:08.171038  2451 log.cc:1199] T d44a8411cf4642829994ec97173d358a P 4f1725fe36e349ac85405627f9c93d95: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/wals/d44a8411cf4642829994ec97173d358a
I20260709 12:59:08.172637  1445 catalog_manager.cc:5028] TS 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): tablet d44a8411cf4642829994ec97173d358a (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:08.165520  2436 raft_consensus.cc:2955] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.175105  2452 ts_tablet_manager.cc:1929] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:08.175575  2452 log.cc:1199] T 323bbbd0be5249329755d7e00ed71324 P 87144ea1a4a14ab8b942fb426159f031: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/wals/323bbbd0be5249329755d7e00ed71324
I20260709 12:59:08.178365  1444 catalog_manager.cc:5028] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): tablet 323bbbd0be5249329755d7e00ed71324 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:08.179813  1633 raft_consensus.cc:2955] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.183485  2270 raft_consensus.cc:2955] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.186535  1702 raft_consensus.cc:2955] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.204515  1454 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:08.225379  1554 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:08.235128  1702 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:08.236611  2270 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:08.237682  2437 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:08.242753  2391 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:08.244722  2437 raft_consensus.cc:2955] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.250835  1708 raft_consensus.cc:2955] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.264650  2269 raft_consensus.cc:2955] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:08.266554  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a45da2e3894b42dc93ed11eb2c31220c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:08.274796  1455 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:08.298395  1625 tablet_service.cc:1558] Processing DeleteTablet for tablet a45da2e3894b42dc93ed11eb2c31220c with delete_type TABLET_DATA_TOMBSTONED (TS 7e99891af85f4b10aa1cc2da6aa33082 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42238
I20260709 12:59:08.300156  2457 tablet_replica.cc:333] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 12:59:08.301221  2457 raft_consensus.cc:2243] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:08.301929  2457 raft_consensus.cc:2272] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:08.305181  2457 ts_tablet_manager.cc:1916] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:08.318931  2457 ts_tablet_manager.cc:1929] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:08.319252  2457 log.cc:1199] T a45da2e3894b42dc93ed11eb2c31220c P 7e99891af85f4b10aa1cc2da6aa33082: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/wals/a45da2e3894b42dc93ed11eb2c31220c
I20260709 12:59:08.320590  1443 catalog_manager.cc:5028] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): tablet a45da2e3894b42dc93ed11eb2c31220c (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:09.384521  1628 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 12:59:09.390776  1599 consensus_peers.cc:597] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 793edbca26c648ccab7933d6e1c299e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:09.390970  1705 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:09.391428  1554 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:09.392488  2428 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:09.393601  2460 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:09.403527  2460 raft_consensus.cc:2955] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.405279  1554 raft_consensus.cc:2955] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.405939  1705 raft_consensus.cc:2955] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.417480  1554 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:09.420614  1454 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.425678  1705 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:09.427016  1524 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af202c0dfac940fb86d9d9d0a9124f44. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:09.430745  1628 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:09.431728  2437 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:09.442514  2458 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:09.469857  2458 raft_consensus.cc:2955] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.475492  1708 raft_consensus.cc:2955] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.475625  1628 raft_consensus.cc:2955] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.492091  1708 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:09.501009  1628 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:09.502768  1673 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44a80c9a41a3498da7aa33d70b18ace6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:09.503862  1554 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:09.505213  2390 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:09.507200  2390 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:59:09.515606  1455 catalog_manager.cc:5697] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.522078  2370 raft_consensus.cc:2955] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.530268  1628 raft_consensus.cc:2955] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.535844  1551 raft_consensus.cc:2955] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.547111  1708 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 12:59:09.567629  1673 consensus_peers.cc:597] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fcdd2749ff424225974f40bab0aaff25. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:09.569418  1628 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:09.568481  1454 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.569865  1551 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:09.573028  2390 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:09.576167  2390 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:09.586197  2370 raft_consensus.cc:2955] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.604453  1551 raft_consensus.cc:2955] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.608796  1455 catalog_manager.cc:5697] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:09.615681  1634 raft_consensus.cc:2955] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:09.899145  2478 ts_tablet_manager.cc:933] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:09.906870  2478 tablet_copy_client.cc:323] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:09.910148  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet 44a80c9a41a3498da7aa33d70b18ace6 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:09.910714  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet 44a80c9a41a3498da7aa33d70b18ace6 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-44a80c9a41a3498da7aa33d70b18ace6
I20260709 12:59:09.918825  1719 tablet_copy_source_session.cc:215] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:09.922286  2478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a80c9a41a3498da7aa33d70b18ace6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:09.938439  2478 tablet_copy_client.cc:806] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:09.939044  2478 tablet_copy_client.cc:670] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:09.944886  2478 tablet_copy_client.cc:538] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:09.955348  2478 tablet_bootstrap.cc:492] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:09.961490  2480 ts_tablet_manager.cc:933] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:09.965660  2480 tablet_copy_client.cc:323] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 12:59:09.967607  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 793edbca26c648ccab7933d6e1c299e5 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 12:59:09.968199  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 793edbca26c648ccab7933d6e1c299e5 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-793edbca26c648ccab7933d6e1c299e5
I20260709 12:59:09.977135  2478 tablet_bootstrap.cc:492] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:09.978210  2478 tablet_bootstrap.cc:492] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:09.978156  1645 tablet_copy_source_session.cc:215] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:09.979149  2478 ts_tablet_manager.cc:1403] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.004s
I20260709 12:59:09.981881  2480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793edbca26c648ccab7933d6e1c299e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:09.982297  2478 raft_consensus.cc:359] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:09.983222  2478 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:09.983768  2478 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:09.993214  2478 ts_tablet_manager.cc:1434] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 12:59:09.998730  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-44a80c9a41a3498da7aa33d70b18ace6 received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:09.999297  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-44a80c9a41a3498da7aa33d70b18ace6 on tablet 44a80c9a41a3498da7aa33d70b18ace6 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:10.005209  2480 tablet_copy_client.cc:806] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:10.009757  2480 tablet_copy_client.cc:670] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:10.033821  2480 tablet_copy_client.cc:538] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:10.041292  2478 ts_tablet_manager.cc:933] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:10.043737  2480 tablet_bootstrap.cc:492] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:10.054538  2478 tablet_copy_client.cc:323] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:10.056187  1569 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet af202c0dfac940fb86d9d9d0a9124f44 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:10.056771  1569 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet af202c0dfac940fb86d9d9d0a9124f44 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-af202c0dfac940fb86d9d9d0a9124f44
I20260709 12:59:10.064412  1569 tablet_copy_source_session.cc:215] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:10.067997  2478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af202c0dfac940fb86d9d9d0a9124f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.091919  2478 tablet_copy_client.cc:806] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:10.092624  2478 tablet_copy_client.cc:670] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:10.096246  2480 tablet_bootstrap.cc:492] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:10.097163  2480 tablet_bootstrap.cc:492] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:10.097891  2480 ts_tablet_manager.cc:1403] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.006s
I20260709 12:59:10.098181  2478 tablet_copy_client.cc:538] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:10.103904  2480 raft_consensus.cc:359] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:10.104959  2480 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:10.105752  2480 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:10.108289  2478 tablet_bootstrap.cc:492] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:10.108647  2480 ts_tablet_manager.cc:1434] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:59:10.110678  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-793edbca26c648ccab7933d6e1c299e5 received from {username='slave'} at 127.0.0.1:59260
I20260709 12:59:10.111083  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-793edbca26c648ccab7933d6e1c299e5 on tablet 793edbca26c648ccab7933d6e1c299e5 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:10.133939  2480 ts_tablet_manager.cc:933] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:10.147531  2480 tablet_copy_client.cc:323] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:10.149320  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet fcdd2749ff424225974f40bab0aaff25 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:10.149852  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet fcdd2749ff424225974f40bab0aaff25 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-fcdd2749ff424225974f40bab0aaff25
I20260709 12:59:10.153266  2478 tablet_bootstrap.cc:492] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:10.154191  2478 tablet_bootstrap.cc:492] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:10.154846  2478 ts_tablet_manager.cc:1403] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.021s
I20260709 12:59:10.157721  2478 raft_consensus.cc:359] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:10.158571  2478 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:10.159494  2478 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:10.165045  1719 tablet_copy_source_session.cc:215] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:10.167320  2478 ts_tablet_manager.cc:1434] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:59:10.168246  2480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcdd2749ff424225974f40bab0aaff25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:10.169121  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-af202c0dfac940fb86d9d9d0a9124f44 received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:10.169529  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-af202c0dfac940fb86d9d9d0a9124f44 on tablet af202c0dfac940fb86d9d9d0a9124f44 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:10.185990  2480 tablet_copy_client.cc:806] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:10.186674  2480 tablet_copy_client.cc:670] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:10.193958  2480 tablet_copy_client.cc:538] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:10.203608  2480 tablet_bootstrap.cc:492] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:10.227156  2480 tablet_bootstrap.cc:492] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:10.228052  2480 tablet_bootstrap.cc:492] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:10.228713  2480 ts_tablet_manager.cc:1403] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 12:59:10.232089  2480 raft_consensus.cc:359] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:10.232925  2480 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:10.233556  2480 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:10.236207  2480 ts_tablet_manager.cc:1434] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:10.237766  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-fcdd2749ff424225974f40bab0aaff25 received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:10.238209  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-fcdd2749ff424225974f40bab0aaff25 on tablet fcdd2749ff424225974f40bab0aaff25 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:10.351082  2270 raft_consensus.cc:1217] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:10.374756  2270 raft_consensus.cc:1217] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:10.526736  2270 raft_consensus.cc:1217] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:10.573534  2270 raft_consensus.cc:1217] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:10.800637  2460 raft_consensus.cc:1064] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:10.802910  2460 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:10.809288  1705 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:10.810892  2490 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:10.814531  2270 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:10.815824  2492 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:10.818126  1554 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:10.819532  2461 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:10.840342  2492 raft_consensus.cc:2955] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:10.842151  1708 raft_consensus.cc:2955] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:10.862248  2269 raft_consensus.cc:2955] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:10.864308  1455 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:10.904670  1554 raft_consensus.cc:2955] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:10.936012  1633 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:10.943538  2269 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:10.944969  1708 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:10.947983  2472 raft_consensus.cc:1064] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:10.950555  2472 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:10.953020  2490 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:10.955408  2461 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:10.963994  2460 raft_consensus.cc:2955] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:10.966913  1708 raft_consensus.cc:2955] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:10.968473  2269 raft_consensus.cc:2955] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:10.981901  2458 raft_consensus.cc:1064] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:10.984735  2458 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:10.994304  1454 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.004084  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 793edbca26c648ccab7933d6e1c299e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:11.035596  2269 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.036345  1628 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.038717  1554 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.038110  2370 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:11.040915  2370 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:11.042143  2502 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:11.061131  1543 tablet_service.cc:1558] Processing DeleteTablet for tablet 793edbca26c648ccab7933d6e1c299e5 with delete_type TABLET_DATA_TOMBSTONED (TS 87144ea1a4a14ab8b942fb426159f031 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:59:11.075186  2507 tablet_replica.cc:333] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 12:59:11.085175  1708 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.085412  2270 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.084735  2370 raft_consensus.cc:2955] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.087311  2436 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:11.088375  2508 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:11.095278  1633 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.101732  2436 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:11.119331  1554 raft_consensus.cc:2955] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.114961  2269 raft_consensus.cc:2955] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.132702  2390 raft_consensus.cc:1064] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:11.151470  2390 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:11.144748  2507 raft_consensus.cc:2243] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:11.152992  2509 raft_consensus.cc:2955] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.154548  2507 raft_consensus.cc:2272] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:11.159230  2507 ts_tablet_manager.cc:1916] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:11.160934  1626 raft_consensus.cc:2955] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.165879  1702 raft_consensus.cc:2955] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.144304  1454 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:11.135569  1628 raft_consensus.cc:2955] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.186621  2269 raft_consensus.cc:2955] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.191638  2507 ts_tablet_manager.cc:1929] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:11.192129  2507 log.cc:1199] T 793edbca26c648ccab7933d6e1c299e5 P 87144ea1a4a14ab8b942fb426159f031: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/wals/793edbca26c648ccab7933d6e1c299e5
I20260709 12:59:11.193694  1458 catalog_manager.cc:5697] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.196482  1444 catalog_manager.cc:5028] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): tablet 793edbca26c648ccab7933d6e1c299e5 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:11.201534  2270 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.203680  2502 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:11.207516  1628 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.211241  1554 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:11.213744  2472 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:11.217514  2370 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:11.222834  1702 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:11.252507  2270 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:11.256203  2502 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:11.243297  1551 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:11.275367  2268 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:11.276274  1626 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:11.277427  2437 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:11.284214  2437 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:11.291586  2370 raft_consensus.cc:2955] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.293998  2437 raft_consensus.cc:2955] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.300843  1633 raft_consensus.cc:2955] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.310642  2268 raft_consensus.cc:2955] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.330953  2270 raft_consensus.cc:2955] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.339440  1628 raft_consensus.cc:2955] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 12:59:11.353404  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 97386.1us
I20260709 12:59:11.288787  2502 raft_consensus.cc:2955] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.357638  1554 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:11.364656  2518 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:11.382822  1456 catalog_manager.cc:5697] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.384016  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet af202c0dfac940fb86d9d9d0a9124f44 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:11.394119  1454 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.396603  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 44a80c9a41a3498da7aa33d70b18ace6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:11.400270  1692 tablet_service.cc:1558] Processing DeleteTablet for tablet af202c0dfac940fb86d9d9d0a9124f44 with delete_type TABLET_DATA_TOMBSTONED (TS 4f1725fe36e349ac85405627f9c93d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:11.402457  2521 tablet_replica.cc:333] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 12:59:11.403595  2521 raft_consensus.cc:2243] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:11.404420  2521 raft_consensus.cc:2272] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:11.408187  2521 ts_tablet_manager.cc:1916] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:59:11.415516  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50380us
I20260709 12:59:11.415398  1455 catalog_manager.cc:5697] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.419394  1625 tablet_service.cc:1558] Processing DeleteTablet for tablet 44a80c9a41a3498da7aa33d70b18ace6 with delete_type TABLET_DATA_TOMBSTONED (TS 7e99891af85f4b10aa1cc2da6aa33082 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42238
I20260709 12:59:11.427851  1552 raft_consensus.cc:2955] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.435773  2521 ts_tablet_manager.cc:1929] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:11.435145  1558 raft_consensus.cc:2955] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.437283  2522 tablet_replica.cc:333] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 12:59:11.445335  2522 raft_consensus.cc:2243] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:11.446141  2522 raft_consensus.cc:2272] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:11.448371  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 62585.7us
I20260709 12:59:11.458416  2522 ts_tablet_manager.cc:1916] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:11.467732  2521 log.cc:1199] T af202c0dfac940fb86d9d9d0a9124f44 P 4f1725fe36e349ac85405627f9c93d95: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/wals/af202c0dfac940fb86d9d9d0a9124f44
I20260709 12:59:11.469430  1445 catalog_manager.cc:5028] TS 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): tablet af202c0dfac940fb86d9d9d0a9124f44 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:11.482592  2522 ts_tablet_manager.cc:1929] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:11.483171  2522 log.cc:1199] T 44a80c9a41a3498da7aa33d70b18ace6 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/wals/44a80c9a41a3498da7aa33d70b18ace6
I20260709 12:59:11.484889  1443 catalog_manager.cc:5028] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): tablet 44a80c9a41a3498da7aa33d70b18ace6 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:11.511448  2268 raft_consensus.cc:2955] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.529781  1702 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:11.536522  2268 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:11.537175  1628 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:11.538430  2370 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:11.539151  2519 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:11.546082  2502 raft_consensus.cc:2955] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.552812  1626 raft_consensus.cc:2955] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.552067  2268 raft_consensus.cc:2955] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:11.557823  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fcdd2749ff424225974f40bab0aaff25 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:11.567312  1455 catalog_manager.cc:5697] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:11.586995  1543 tablet_service.cc:1558] Processing DeleteTablet for tablet fcdd2749ff424225974f40bab0aaff25 with delete_type TABLET_DATA_TOMBSTONED (TS 87144ea1a4a14ab8b942fb426159f031 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:59:11.587966  2507 tablet_replica.cc:333] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 12:59:11.588878  2507 raft_consensus.cc:2243] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:11.589588  2507 raft_consensus.cc:2272] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:11.592665  2507 ts_tablet_manager.cc:1916] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:11.605955  2507 ts_tablet_manager.cc:1929] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:11.606287  2507 log.cc:1199] T fcdd2749ff424225974f40bab0aaff25 P 87144ea1a4a14ab8b942fb426159f031: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/wals/fcdd2749ff424225974f40bab0aaff25
I20260709 12:59:11.607558  1444 catalog_manager.cc:5028] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): tablet fcdd2749ff424225974f40bab0aaff25 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:12.645140  1558 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 12:59:12.652392  1524 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6e602f7f3e34ef89e4eee8ddf3a9eb5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:12.652940  1702 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:12.653403  1628 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:12.654464  2524 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.655267  2526 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.666208  2524 raft_consensus.cc:2955] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.667984  1628 raft_consensus.cc:2955] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.668910  1704 raft_consensus.cc:2955] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.681248  1558 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:12.687826  1454 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.691962  1628 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:12.692497  1524 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e325950f4164ab99442980dc2c53386. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:12.693733  2524 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:12.696537  1702 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:12.699071  2509 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.705636  2509 raft_consensus.cc:2955] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.711532  1628 raft_consensus.cc:2955] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.714115  1704 raft_consensus.cc:2955] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.738844  1628 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:12.756351  1455 catalog_manager.cc:5697] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.763151  1708 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:12.764787  1558 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:12.764676  2460 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.766290  2490 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:12.769016  1599 consensus_peers.cc:597] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 845a9ac484f44da5a4a18f3ffa7030e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:12.779798  2523 raft_consensus.cc:2955] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.781798  1704 raft_consensus.cc:2955] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.787053  1552 raft_consensus.cc:2955] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.802089  1456 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.813287  1704 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:12.822976  1558 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:12.824208  1673 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ffc7074d09d4b0a8caf498542f3e843. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:12.825405  2502 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.826025  1628 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:12.827589  2541 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:12.835482  2502 raft_consensus.cc:2955] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.837335  1558 raft_consensus.cc:2955] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.841890  1628 raft_consensus.cc:2955] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:12.853971  1456 catalog_manager.cc:5697] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:13.101562  2544 ts_tablet_manager.cc:933] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:13.103482  2544 tablet_copy_client.cc:323] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:13.105196  1569 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet 8e325950f4164ab99442980dc2c53386 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:13.105809  1569 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet 8e325950f4164ab99442980dc2c53386 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-8e325950f4164ab99442980dc2c53386
I20260709 12:59:13.111919  1569 tablet_copy_source_session.cc:215] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:13.114985  2544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e325950f4164ab99442980dc2c53386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:13.143270  2544 tablet_copy_client.cc:806] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:13.143914  2544 tablet_copy_client.cc:670] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:13.153497  2544 tablet_copy_client.cc:538] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:13.160974  2544 tablet_bootstrap.cc:492] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:13.181622  2544 tablet_bootstrap.cc:492] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:13.182535  2544 tablet_bootstrap.cc:492] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:13.183211  2544 ts_tablet_manager.cc:1403] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.004s
I20260709 12:59:13.186416  2544 raft_consensus.cc:359] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:13.187089  2544 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:13.187676  2544 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:13.191079  2544 ts_tablet_manager.cc:1434] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:59:13.192930  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-8e325950f4164ab99442980dc2c53386 received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:13.193367  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-8e325950f4164ab99442980dc2c53386 on tablet 8e325950f4164ab99442980dc2c53386 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:13.253454  2544 ts_tablet_manager.cc:933] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:13.255151  2544 tablet_copy_client.cc:323] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:13.256659  1569 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:13.257177  1569 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-e6e602f7f3e34ef89e4eee8ddf3a9eb5
I20260709 12:59:13.264433  1569 tablet_copy_source_session.cc:215] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:13.273105  2544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:13.292021  2549 ts_tablet_manager.cc:933] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:13.294312  2549 tablet_copy_client.cc:323] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 12:59:13.296181  2544 tablet_copy_client.cc:806] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:13.296195  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 845a9ac484f44da5a4a18f3ffa7030e5 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 12:59:13.296816  2544 tablet_copy_client.cc:670] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:13.296931  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 845a9ac484f44da5a4a18f3ffa7030e5 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-845a9ac484f44da5a4a18f3ffa7030e5
I20260709 12:59:13.311784  1645 tablet_copy_source_session.cc:215] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:13.318125  2549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845a9ac484f44da5a4a18f3ffa7030e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:13.323977  2544 tablet_copy_client.cc:538] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:13.330365  2551 ts_tablet_manager.cc:933] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:13.336153  2544 tablet_bootstrap.cc:492] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:13.351464  2551 tablet_copy_client.cc:323] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:13.355122  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet 9ffc7074d09d4b0a8caf498542f3e843 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:13.355710  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet 9ffc7074d09d4b0a8caf498542f3e843 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-9ffc7074d09d4b0a8caf498542f3e843
I20260709 12:59:13.367187  2544 tablet_bootstrap.cc:492] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:13.368145  2544 tablet_bootstrap.cc:492] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:13.368785  2544 ts_tablet_manager.cc:1403] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.007s
I20260709 12:59:13.371769  2544 raft_consensus.cc:359] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:13.372627  2544 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:13.373281  2544 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:13.377673  1719 tablet_copy_source_session.cc:215] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:13.378823  2544 ts_tablet_manager.cc:1434] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 12:59:13.381049  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-e6e602f7f3e34ef89e4eee8ddf3a9eb5 received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:13.381457  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-e6e602f7f3e34ef89e4eee8ddf3a9eb5 on tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:13.382346  2551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffc7074d09d4b0a8caf498542f3e843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:13.383849  2549 tablet_copy_client.cc:806] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:13.384380  2549 tablet_copy_client.cc:670] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:13.391059  2549 tablet_copy_client.cc:538] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:13.399500  2551 tablet_copy_client.cc:806] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:13.400127  2551 tablet_copy_client.cc:670] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:13.405316  2549 tablet_bootstrap.cc:492] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:13.407230  2551 tablet_copy_client.cc:538] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:13.416695  2551 tablet_bootstrap.cc:492] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:13.438472  2551 tablet_bootstrap.cc:492] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:13.439229  2551 tablet_bootstrap.cc:492] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:13.439906  2551 ts_tablet_manager.cc:1403] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 12:59:13.443380  2551 raft_consensus.cc:359] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:13.443859  2549 tablet_bootstrap.cc:492] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:13.444033  2551 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:13.444923  2549 tablet_bootstrap.cc:492] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:13.444866  2551 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:13.445628  2549 ts_tablet_manager.cc:1403] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.009s
I20260709 12:59:13.447757  2551 ts_tablet_manager.cc:1434] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:59:13.448928  2549 raft_consensus.cc:359] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:13.450074  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-9ffc7074d09d4b0a8caf498542f3e843 received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:13.450492  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-9ffc7074d09d4b0a8caf498542f3e843 on tablet 9ffc7074d09d4b0a8caf498542f3e843 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:13.449767  2549 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:13.451407  2549 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:13.454145  2549 ts_tablet_manager.cc:1434] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 12:59:13.457269  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-845a9ac484f44da5a4a18f3ffa7030e5 received from {username='slave'} at 127.0.0.1:59260
I20260709 12:59:13.458185  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-845a9ac484f44da5a4a18f3ffa7030e5 on tablet 845a9ac484f44da5a4a18f3ffa7030e5 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:13.482906  2268 raft_consensus.cc:1217] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:13.689922  2268 raft_consensus.cc:1217] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:13.728420  2268 raft_consensus.cc:1217] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:13.868532  2268 raft_consensus.cc:1217] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:14.103453  2552 raft_consensus.cc:1064] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:14.105559  2552 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:14.113523  1702 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.114773  2268 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.115782  2552 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.116729  2524 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.117451  1628 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.119366  2552 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.132328  2509 raft_consensus.cc:2955] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.149837  2268 raft_consensus.cc:2955] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.157860  1454 catalog_manager.cc:5697] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:14.147673  1628 raft_consensus.cc:2955] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.169737  1704 raft_consensus.cc:2955] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.190129  1558 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:14.204460  2268 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.204476  1628 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.205946  2552 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:14.209846  2509 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.214165  2552 raft_consensus.cc:2955] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.216377  2268 raft_consensus.cc:2955] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.220396  1628 raft_consensus.cc:2955] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.232046  1454 catalog_manager.cc:5697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.233170  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e325950f4164ab99442980dc2c53386 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:14.249830  1692 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e325950f4164ab99442980dc2c53386 with delete_type TABLET_DATA_TOMBSTONED (TS 4f1725fe36e349ac85405627f9c93d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:14.264161  2566 tablet_replica.cc:333] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 12:59:14.265012  2566 raft_consensus.cc:2243] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:14.265774  2566 raft_consensus.cc:2272] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:14.268826  2566 ts_tablet_manager.cc:1916] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:14.286286  2539 raft_consensus.cc:1064] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:14.286563  2566 ts_tablet_manager.cc:1929] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:14.286999  2566 log.cc:1199] T 8e325950f4164ab99442980dc2c53386 P 4f1725fe36e349ac85405627f9c93d95: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/wals/8e325950f4164ab99442980dc2c53386
I20260709 12:59:14.289031  1445 catalog_manager.cc:5028] TS 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): tablet 8e325950f4164ab99442980dc2c53386 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:14.288753  2539 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:14.296300  1704 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.298122  2268 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.299324  1558 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.300768  2523 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.301613  2490 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:59:14.325640  2524 raft_consensus.cc:1064] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:14.329138  2524 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:14.348546  2523 raft_consensus.cc:2955] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.350657  2539 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:14.351516  2268 raft_consensus.cc:2955] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.364271  1704 raft_consensus.cc:2955] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.381902  2270 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.385895  1708 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.388957  1455 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:14.386469  2570 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:59:14.399840  2552 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.410957  1633 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.418941  1553 raft_consensus.cc:2955] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.422197  2524 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.431567  1633 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:14.439888  1704 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.441417  2539 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.445040  2268 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.447714  2523 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.451265  2502 raft_consensus.cc:1064] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:14.454264  2502 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:14.454581  2490 raft_consensus.cc:2955] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.459941  2268 raft_consensus.cc:2955] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.460352  1704 raft_consensus.cc:2955] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.461576  2570 raft_consensus.cc:2955] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.471735  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 845a9ac484f44da5a4a18f3ffa7030e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:14.474613  1628 raft_consensus.cc:2955] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.484169  1454 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 12:59:14.488513  1443 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 845a9ac484f44da5a4a18f3ffa7030e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 12:59:14.496421  2269 raft_consensus.cc:2955] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.504413  1543 tablet_service.cc:1558] Processing DeleteTablet for tablet 845a9ac484f44da5a4a18f3ffa7030e5 with delete_type TABLET_DATA_TOMBSTONED (TS 87144ea1a4a14ab8b942fb426159f031 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:59:14.508949  1704 raft_consensus.cc:2955] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.530079  1633 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.530609  2270 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.532641  2541 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.534622  2541 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:14.556720  1455 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.566229  1558 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:14.568657  2572 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:14.581910  2557 raft_consensus.cc:2955] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.601820  1633 raft_consensus.cc:2955] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.606709  2581 tablet_replica.cc:333] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 12:59:14.617416  2581 raft_consensus.cc:2243] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:14.622426  2581 raft_consensus.cc:2272] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:14.630474  2581 ts_tablet_manager.cc:1916] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:14.630065  1553 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:14.634915  1552 raft_consensus.cc:2955] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.644870  1455 catalog_manager.cc:5697] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.653213  2269 raft_consensus.cc:2955] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.658921  2581 ts_tablet_manager.cc:1929] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:14.659404  2581 log.cc:1199] T 845a9ac484f44da5a4a18f3ffa7030e5 P 87144ea1a4a14ab8b942fb426159f031: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/wals/845a9ac484f44da5a4a18f3ffa7030e5
I20260709 12:59:14.662608  1444 catalog_manager.cc:5028] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): tablet 845a9ac484f44da5a4a18f3ffa7030e5 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:14.669344  1708 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.670835  2580 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.685151  2570 raft_consensus.cc:2955] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.690243  2269 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.695242  2509 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:14.700451  2270 raft_consensus.cc:2955] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.703251  1708 raft_consensus.cc:2955] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.747895  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:14.774530  1708 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:14.806137  1455 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:14.810581  2270 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.824604  2541 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:59:14.836997  1625 tablet_service.cc:1558] Processing DeleteTablet for tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5 with delete_type TABLET_DATA_TOMBSTONED (TS 7e99891af85f4b10aa1cc2da6aa33082 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42238
I20260709 12:59:14.840891  1552 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:14.856361  2572 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:14.892309  1552 raft_consensus.cc:2955] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.881148  2541 raft_consensus.cc:2955] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.893744  2587 tablet_replica.cc:333] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 12:59:14.900259  2587 raft_consensus.cc:2243] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:14.904145  2587 raft_consensus.cc:2272] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:14.932512  2270 raft_consensus.cc:2955] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.935658  1455 catalog_manager.cc:5697] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:14.947842  2587 ts_tablet_manager.cc:1916] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:14.956166  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ffc7074d09d4b0a8caf498542f3e843 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:14.959748  1625 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ffc7074d09d4b0a8caf498542f3e843 with delete_type TABLET_DATA_TOMBSTONED (TS 7e99891af85f4b10aa1cc2da6aa33082 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42238
I20260709 12:59:14.973600  2587 ts_tablet_manager.cc:1929] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:14.974218  2587 log.cc:1199] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/wals/e6e602f7f3e34ef89e4eee8ddf3a9eb5
I20260709 12:59:14.976334  2587 tablet_replica.cc:333] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 12:59:14.976210  1443 catalog_manager.cc:5028] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): tablet e6e602f7f3e34ef89e4eee8ddf3a9eb5 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:14.977412  2587 raft_consensus.cc:2243] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:14.978134  2587 raft_consensus.cc:2272] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:14.981228  2587 ts_tablet_manager.cc:1916] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:14.996383  2587 ts_tablet_manager.cc:1929] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:14.996733  2587 log.cc:1199] T 9ffc7074d09d4b0a8caf498542f3e843 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/wals/9ffc7074d09d4b0a8caf498542f3e843
I20260709 12:59:14.998607  1443 catalog_manager.cc:5028] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): tablet 9ffc7074d09d4b0a8caf498542f3e843 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:16.036185  1702 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 12:59:16.043046  1673 consensus_peers.cc:597] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05f358a33737477ba11488ec75b16050. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:16.043123  1631 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:16.043176  1552 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:16.044735  2591 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:16.045714  2585 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:16.057806  2588 raft_consensus.cc:2955] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.059810  1631 raft_consensus.cc:2955] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.065161  1552 raft_consensus.cc:2955] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.071826  1558 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:16.075492  1455 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:16.088189  1524 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12ca9a7e99a249b3820b6df8c497bfde. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:16.089681  1702 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:16.089891  1631 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:16.092007  2509 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:16.093191  2524 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:16.116565  2509 raft_consensus.cc:2955] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.119306  1631 raft_consensus.cc:2955] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.126405  1702 raft_consensus.cc:2955] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.139384  1708 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 12:59:16.149675  1673 consensus_peers.cc:597] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8129c29801c142749490f0df95b71485. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:16.149233  1454 catalog_manager.cc:5697] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.154872  1552 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:16.158865  2585 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:16.159909  1631 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:16.161752  2591 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:16.170562  2585 raft_consensus.cc:2955] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.175184  1633 raft_consensus.cc:2955] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.179392  1552 raft_consensus.cc:2955] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.187981  1558 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:16.198892  1458 catalog_manager.cc:5697] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.217826  1708 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:16.218979  1524 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c546ee055ea8417b8c1054e545eee77c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:16.219537  2524 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:16.221485  1633 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:16.222891  2524 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:16.234547  2509 raft_consensus.cc:2955] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.237191  1633 raft_consensus.cc:2955] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.238191  1708 raft_consensus.cc:2955] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:16.256554  1455 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.483789  2610 ts_tablet_manager.cc:933] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:16.486125  2610 tablet_copy_client.cc:323] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:16.488271  1569 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet 12ca9a7e99a249b3820b6df8c497bfde from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:16.488830  1569 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet 12ca9a7e99a249b3820b6df8c497bfde from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-12ca9a7e99a249b3820b6df8c497bfde
I20260709 12:59:16.492046  2612 ts_tablet_manager.cc:933] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:16.494223  2612 tablet_copy_client.cc:323] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:16.496423  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet 05f358a33737477ba11488ec75b16050 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:16.496958  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet 05f358a33737477ba11488ec75b16050 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-05f358a33737477ba11488ec75b16050
I20260709 12:59:16.497946  1569 tablet_copy_source_session.cc:215] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:16.501681  2610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ca9a7e99a249b3820b6df8c497bfde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:16.506572  1719 tablet_copy_source_session.cc:215] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:16.510097  2612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f358a33737477ba11488ec75b16050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:16.518221  2610 tablet_copy_client.cc:806] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:16.518935  2610 tablet_copy_client.cc:670] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:16.528839  2610 tablet_copy_client.cc:538] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:16.535058  2612 tablet_copy_client.cc:806] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:16.535768  2612 tablet_copy_client.cc:670] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:16.539541  2610 tablet_bootstrap.cc:492] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:16.543001  2612 tablet_copy_client.cc:538] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:16.553817  2612 tablet_bootstrap.cc:492] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:16.570674  2610 tablet_bootstrap.cc:492] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:16.572567  2610 tablet_bootstrap.cc:492] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:16.573357  2610 ts_tablet_manager.cc:1403] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.007s
I20260709 12:59:16.579843  2610 raft_consensus.cc:359] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:16.581101  2610 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:16.581866  2610 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:16.603170  2610 ts_tablet_manager.cc:1434] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.005s
I20260709 12:59:16.605005  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-12ca9a7e99a249b3820b6df8c497bfde received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:16.605506  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-12ca9a7e99a249b3820b6df8c497bfde on tablet 12ca9a7e99a249b3820b6df8c497bfde with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:16.608042  2612 tablet_bootstrap.cc:492] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:16.610517  2612 tablet_bootstrap.cc:492] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:16.611356  2612 ts_tablet_manager.cc:1403] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.021s
I20260709 12:59:16.614904  2612 raft_consensus.cc:359] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:16.615841  2612 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:16.616496  2612 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:16.619025  2612 ts_tablet_manager.cc:1434] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:59:16.620774  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-05f358a33737477ba11488ec75b16050 received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:16.621222  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-05f358a33737477ba11488ec75b16050 on tablet 05f358a33737477ba11488ec75b16050 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:16.700423  2612 ts_tablet_manager.cc:933] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:16.702162  2612 tablet_copy_client.cc:323] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:16.703788  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet 8129c29801c142749490f0df95b71485 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:16.704316  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet 8129c29801c142749490f0df95b71485 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-8129c29801c142749490f0df95b71485
I20260709 12:59:16.712002  1719 tablet_copy_source_session.cc:215] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:16.715289  2612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8129c29801c142749490f0df95b71485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:16.735858  2612 tablet_copy_client.cc:806] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:16.736500  2612 tablet_copy_client.cc:670] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:16.739987  2612 tablet_copy_client.cc:538] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:16.750211  2610 ts_tablet_manager.cc:933] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:16.752948  2610 tablet_copy_client.cc:323] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:16.752969  2612 tablet_bootstrap.cc:492] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:16.754956  1569 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet c546ee055ea8417b8c1054e545eee77c from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:16.755524  1569 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet c546ee055ea8417b8c1054e545eee77c from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-c546ee055ea8417b8c1054e545eee77c
I20260709 12:59:16.762759  1569 tablet_copy_source_session.cc:215] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:16.766081  2610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c546ee055ea8417b8c1054e545eee77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:16.780507  2612 tablet_bootstrap.cc:492] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:16.781633  2612 tablet_bootstrap.cc:492] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:16.782390  2612 ts_tablet_manager.cc:1403] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.007s
I20260709 12:59:16.785867  2612 raft_consensus.cc:359] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:16.786746  2612 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:16.787392  2612 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:16.790169  2612 ts_tablet_manager.cc:1434] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:59:16.792806  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-8129c29801c142749490f0df95b71485 received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:16.793223  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-8129c29801c142749490f0df95b71485 on tablet 8129c29801c142749490f0df95b71485 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:16.797169  2610 tablet_copy_client.cc:806] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:16.797753  2610 tablet_copy_client.cc:670] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:16.807284  2610 tablet_copy_client.cc:538] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:16.816581  2610 tablet_bootstrap.cc:492] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:16.831959  2610 tablet_bootstrap.cc:492] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:16.833279  2610 tablet_bootstrap.cc:492] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:16.833930  2610 ts_tablet_manager.cc:1403] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:59:16.836882  2610 raft_consensus.cc:359] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:16.837544  2610 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:16.838203  2610 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:16.840335  2610 ts_tablet_manager.cc:1434] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:59:16.842152  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-c546ee055ea8417b8c1054e545eee77c received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:16.842592  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-c546ee055ea8417b8c1054e545eee77c on tablet c546ee055ea8417b8c1054e545eee77c with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:16.899436  2269 raft_consensus.cc:1217] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:17.097445  2270 raft_consensus.cc:1217] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:17.108491  2270 raft_consensus.cc:1217] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:17.181648  2270 raft_consensus.cc:1217] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:17.360527  2591 raft_consensus.cc:1064] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:17.362919  2591 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:17.369024  1631 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.369376  2270 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.371217  1552 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.371423  2591 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.372321  2588 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.374576  2588 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.385883  2591 raft_consensus.cc:2955] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.387832  1558 raft_consensus.cc:2955] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.391654  1633 raft_consensus.cc:2955] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.402410  2270 raft_consensus.cc:2955] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.412511  1458 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.447137  1708 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:17.459015  2270 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:17.462108  2588 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.462752  1631 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:17.464911  2585 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.471356  2591 raft_consensus.cc:2955] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.472817  2269 raft_consensus.cc:2955] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.473449  1631 raft_consensus.cc:2955] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.483987  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05f358a33737477ba11488ec75b16050 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:17.487927  1455 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.501425  1543 tablet_service.cc:1558] Processing DeleteTablet for tablet 05f358a33737477ba11488ec75b16050 with delete_type TABLET_DATA_TOMBSTONED (TS 87144ea1a4a14ab8b942fb426159f031 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:59:17.515453  2629 tablet_replica.cc:333] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 12:59:17.516955  2629 raft_consensus.cc:2243] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:17.517868  2629 raft_consensus.cc:2272] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:17.535176  2524 raft_consensus.cc:1064] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:17.537338  2524 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:17.544788  2270 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.545157  2629 ts_tablet_manager.cc:1916] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:17.593873  1633 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.595345  2589 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:17.597399  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50677.4us
I20260709 12:59:17.599493  1708 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.614925  2589 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.616262  2524 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.628352  2629 ts_tablet_manager.cc:1929] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:17.629230  2629 log.cc:1199] T 05f358a33737477ba11488ec75b16050 P 87144ea1a4a14ab8b942fb426159f031: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/wals/05f358a33737477ba11488ec75b16050
I20260709 12:59:17.632589  1444 catalog_manager.cc:5028] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): tablet 05f358a33737477ba11488ec75b16050 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:17.648046  2509 raft_consensus.cc:2955] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.657122  2270 raft_consensus.cc:2955] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.665105  1633 raft_consensus.cc:2955] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.671135  1708 raft_consensus.cc:2955] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.679486  1454 catalog_manager.cc:5697] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.703104  1558 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:17.708652  2270 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:17.708730  1633 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:17.710163  2635 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:17.712460  2635 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.717407  2589 raft_consensus.cc:2955] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.720901  1633 raft_consensus.cc:2955] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.725971  2632 raft_consensus.cc:1064] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:17.730935  2269 raft_consensus.cc:2955] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.733448  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 12ca9a7e99a249b3820b6df8c497bfde with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:17.728550  2632 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:17.741370  1454 catalog_manager.cc:5697] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.757053  2269 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.758522  1558 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.758607  2591 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:17.760591  2588 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.764715  1633 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.766289  2585 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.774873  1692 tablet_service.cc:1558] Processing DeleteTablet for tablet 12ca9a7e99a249b3820b6df8c497bfde with delete_type TABLET_DATA_TOMBSTONED (TS 4f1725fe36e349ac85405627f9c93d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:17.786566  2640 tablet_replica.cc:333] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 12:59:17.787689  2640 raft_consensus.cc:2243] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:17.787976  2635 raft_consensus.cc:1064] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:17.788407  2640 raft_consensus.cc:2272] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:17.794528  2635 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:17.797307  2640 ts_tablet_manager.cc:1916] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:17.804911  1633 raft_consensus.cc:2955] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.818096  2270 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.819717  2524 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.823436  1634 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.825575  2640 ts_tablet_manager.cc:1929] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:17.826292  2640 log.cc:1199] T 12ca9a7e99a249b3820b6df8c497bfde P 4f1725fe36e349ac85405627f9c93d95: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/wals/12ca9a7e99a249b3820b6df8c497bfde
I20260709 12:59:17.826167  2524 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.825654  1708 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:17.829779  2524 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:17.803471  2591 raft_consensus.cc:2955] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.835530  1445 catalog_manager.cc:5028] TS 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): tablet 12ca9a7e99a249b3820b6df8c497bfde (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:17.846879  2268 raft_consensus.cc:2955] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.860139  1454 catalog_manager.cc:5697] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.874572  2524 raft_consensus.cc:2955] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.876783  1634 raft_consensus.cc:2955] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.881230  1552 raft_consensus.cc:2955] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.896979  1708 raft_consensus.cc:2955] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.918128  2268 raft_consensus.cc:2955] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.916838  1455 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.938453  1702 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:17.948989  2268 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:17.951375  1634 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:17.951473  2585 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.955116  2591 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.957549  1552 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:17.961512  2591 raft_consensus.cc:2955] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.965067  2269 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:17.966682  2646 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:17.968360  2269 raft_consensus.cc:2955] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.971017  1634 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:17.972427  2635 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:17.973675  2589 raft_consensus.cc:2955] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.975996  2268 raft_consensus.cc:2955] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.982157  1633 raft_consensus.cc:2955] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:17.986904  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c546ee055ea8417b8c1054e545eee77c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:17.989672  1634 raft_consensus.cc:2955] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:18.003060  1455 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.004635  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8129c29801c142749490f0df95b71485 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:18.009867  1454 catalog_manager.cc:5697] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:18.015762  1692 tablet_service.cc:1558] Processing DeleteTablet for tablet c546ee055ea8417b8c1054e545eee77c with delete_type TABLET_DATA_TOMBSTONED (TS 4f1725fe36e349ac85405627f9c93d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:18.016711  2640 tablet_replica.cc:333] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 12:59:18.017737  2640 raft_consensus.cc:2243] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.018519  2640 raft_consensus.cc:2272] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.023128  2640 ts_tablet_manager.cc:1916] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:18.026599  1543 tablet_service.cc:1558] Processing DeleteTablet for tablet 8129c29801c142749490f0df95b71485 with delete_type TABLET_DATA_TOMBSTONED (TS 87144ea1a4a14ab8b942fb426159f031 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:59:18.027640  2629 tablet_replica.cc:333] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 12:59:18.028703  2629 raft_consensus.cc:2243] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:18.029999  2629 raft_consensus.cc:2272] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:18.049731  2640 ts_tablet_manager.cc:1929] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:18.050278  2640 log.cc:1199] T c546ee055ea8417b8c1054e545eee77c P 4f1725fe36e349ac85405627f9c93d95: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/wals/c546ee055ea8417b8c1054e545eee77c
I20260709 12:59:18.052071  1445 catalog_manager.cc:5028] TS 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): tablet c546ee055ea8417b8c1054e545eee77c (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:18.053750  2629 ts_tablet_manager.cc:1916] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:18.074265  2629 ts_tablet_manager.cc:1929] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:18.074610  2629 log.cc:1199] T 8129c29801c142749490f0df95b71485 P 87144ea1a4a14ab8b942fb426159f031: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/wals/8129c29801c142749490f0df95b71485
I20260709 12:59:18.075951  1444 catalog_manager.cc:5028] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): tablet 8129c29801c142749490f0df95b71485 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:19.112360  1708 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:19.117871  1633 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:19.117865  1673 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88018a232de842fc8fcd30e124b7c4d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:19.118420  1552 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:19.119616  2648 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.120443  2585 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.134800  2585 raft_consensus.cc:2955] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.136611  1634 raft_consensus.cc:2955] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.138896  1552 raft_consensus.cc:2955] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.148334  1708 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:19.151815  1457 catalog_manager.cc:5697] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:19.160851  1673 consensus_peers.cc:597] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dbfb4dc01d084c658bb8ff2ae985e80a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:19.161837  1634 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:19.163203  2648 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.164407  1552 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:19.165848  2585 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.172592  2585 raft_consensus.cc:2955] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.174607  1552 raft_consensus.cc:2955] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.184837  1633 raft_consensus.cc:2955] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.190511  1634 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:19.205514  1708 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:19.206748  1552 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:19.206959  2609 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.207551  1456 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.209110  2609 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:19.220026  1599 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ee92ce4d1fe4cbdbec21419ac95fa2f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:19.231742  2609 raft_consensus.cc:2955] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.233667  1552 raft_consensus.cc:2955] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.247305  1708 raft_consensus.cc:2955] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.255704  1552 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:19.258307  1453 catalog_manager.cc:5697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
W20260709 12:59:19.278422  1524 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 447b9d1298e947858fa3d05e918d4a08. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:19.279688  1634 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:19.280486  1708 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:19.281049  2646 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.282533  2650 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.290482  2509 raft_consensus.cc:2955] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.292371  1708 raft_consensus.cc:2955] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.292742  1634 raft_consensus.cc:2955] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.309563  1453 catalog_manager.cc:5697] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:19.662503  2668 ts_tablet_manager.cc:933] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:19.665670  2668 tablet_copy_client.cc:323] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:19.668860  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet 88018a232de842fc8fcd30e124b7c4d7 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:19.669250  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet 88018a232de842fc8fcd30e124b7c4d7 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-88018a232de842fc8fcd30e124b7c4d7
I20260709 12:59:19.676744  1719 tablet_copy_source_session.cc:215] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:19.679756  2668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88018a232de842fc8fcd30e124b7c4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:19.688542  2670 ts_tablet_manager.cc:933] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:19.690682  2670 tablet_copy_client.cc:323] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:19.692421  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet dbfb4dc01d084c658bb8ff2ae985e80a from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:19.693004  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet dbfb4dc01d084c658bb8ff2ae985e80a from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-dbfb4dc01d084c658bb8ff2ae985e80a
I20260709 12:59:19.697503  2668 tablet_copy_client.cc:806] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:19.698129  2668 tablet_copy_client.cc:670] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:19.709437  1719 tablet_copy_source_session.cc:215] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:19.713717  2668 tablet_copy_client.cc:538] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:19.716573  2670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbfb4dc01d084c658bb8ff2ae985e80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:19.727460  2672 ts_tablet_manager.cc:933] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:19.729712  2668 tablet_bootstrap.cc:492] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:19.735311  2672 tablet_copy_client.cc:323] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 12:59:19.737337  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 12:59:19.737907  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-2ee92ce4d1fe4cbdbec21419ac95fa2f
I20260709 12:59:19.746665  1645 tablet_copy_source_session.cc:215] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:19.756558  2672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:19.764299  2670 tablet_copy_client.cc:806] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:19.764945  2670 tablet_copy_client.cc:670] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:19.774284  2670 tablet_copy_client.cc:538] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:19.776409  2668 tablet_bootstrap.cc:492] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:19.776643  2672 tablet_copy_client.cc:806] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:19.777323  2668 tablet_bootstrap.cc:492] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:19.777401  2672 tablet_copy_client.cc:670] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:19.778179  2668 ts_tablet_manager.cc:1403] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.012s
I20260709 12:59:19.780121  2676 ts_tablet_manager.cc:933] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:19.781222  2668 raft_consensus.cc:359] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:19.782123  2668 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:19.782853  2672 tablet_copy_client.cc:538] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:19.782779  2668 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:19.793754  2670 tablet_bootstrap.cc:492] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:19.802378  2668 ts_tablet_manager.cc:1434] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.024s	user 0.014s	sys 0.002s
I20260709 12:59:19.804000  2672 tablet_bootstrap.cc:492] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:19.807159  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-88018a232de842fc8fcd30e124b7c4d7 received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:19.812031  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-88018a232de842fc8fcd30e124b7c4d7 on tablet 88018a232de842fc8fcd30e124b7c4d7 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:19.841405  2676 tablet_copy_client.cc:323] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:19.843168  1569 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet 447b9d1298e947858fa3d05e918d4a08 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:19.843722  1569 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet 447b9d1298e947858fa3d05e918d4a08 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-447b9d1298e947858fa3d05e918d4a08
I20260709 12:59:19.854914  1569 tablet_copy_source_session.cc:215] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:19.858294  2676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 447b9d1298e947858fa3d05e918d4a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:19.861121  2670 tablet_bootstrap.cc:492] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:19.862200  2670 tablet_bootstrap.cc:492] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:19.862860  2670 ts_tablet_manager.cc:1403] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.069s	user 0.024s	sys 0.006s
I20260709 12:59:19.865861  2670 raft_consensus.cc:359] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:19.866719  2670 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:19.867394  2670 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:19.872627  2670 ts_tablet_manager.cc:1434] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:59:19.875815  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-dbfb4dc01d084c658bb8ff2ae985e80a received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:19.876219  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-dbfb4dc01d084c658bb8ff2ae985e80a on tablet dbfb4dc01d084c658bb8ff2ae985e80a with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:19.916175  2672 tablet_bootstrap.cc:492] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:19.917158  2672 tablet_bootstrap.cc:492] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:19.917843  2672 ts_tablet_manager.cc:1403] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.114s	user 0.024s	sys 0.025s
I20260709 12:59:19.920663  2676 tablet_copy_client.cc:806] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:19.921247  2676 tablet_copy_client.cc:670] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:19.921430  2672 raft_consensus.cc:359] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:19.922439  2672 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:19.925019  2672 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:19.930711  2672 ts_tablet_manager.cc:1434] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:59:19.932443  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-2ee92ce4d1fe4cbdbec21419ac95fa2f received from {username='slave'} at 127.0.0.1:59260
I20260709 12:59:19.932869  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-2ee92ce4d1fe4cbdbec21419ac95fa2f on tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:19.933425  2676 tablet_copy_client.cc:538] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:19.948637  2676 tablet_bootstrap.cc:492] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:19.972702  2676 tablet_bootstrap.cc:492] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:19.973603  2676 tablet_bootstrap.cc:492] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:19.974361  2676 ts_tablet_manager.cc:1403] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.011s
I20260709 12:59:19.977391  2676 raft_consensus.cc:359] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:19.978220  2676 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:19.978873  2676 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:19.985023  2676 ts_tablet_manager.cc:1434] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:59:19.987154  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-447b9d1298e947858fa3d05e918d4a08 received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:19.987601  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-447b9d1298e947858fa3d05e918d4a08 on tablet 447b9d1298e947858fa3d05e918d4a08 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:20.110816  2268 raft_consensus.cc:1217] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:20.183050  2268 raft_consensus.cc:1217] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:20.274876  2268 raft_consensus.cc:1217] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:20.301364  2268 raft_consensus.cc:1217] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:20.556186  2585 raft_consensus.cc:1064] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:20.558432  2585 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:20.564163  2269 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:20.565670  2675 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.566639  1634 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:20.569674  1558 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:20.571604  2585 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.572389  2675 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.585438  2591 raft_consensus.cc:2955] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.588531  1558 raft_consensus.cc:2955] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.589131  2269 raft_consensus.cc:2955] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.605122  1453 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.606277  1634 raft_consensus.cc:2955] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.667374  1704 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:20.674183  2686 raft_consensus.cc:1064] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:20.674490  1634 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:20.675916  2269 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:20.675933  2675 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:20.676744  2686 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:20.680634  2675 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:20.683647  2591 raft_consensus.cc:2955] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.684923  1704 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:20.686437  2685 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.687474  2269 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:20.687577  1558 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:20.688999  2686 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.689791  2683 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.692414  1634 raft_consensus.cc:2955] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.702565  2650 raft_consensus.cc:1064] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:20.706184  2650 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:20.722987  2269 raft_consensus.cc:2955] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.726697  2683 raft_consensus.cc:2955] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.729496  2268 raft_consensus.cc:2955] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.731707  1702 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:20.733738  2270 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:20.734012  1631 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:20.744210  2681 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.747987  2681 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.753433  2509 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:20.770675  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dbfb4dc01d084c658bb8ff2ae985e80a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:20.788266  2681 raft_consensus.cc:2955] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.802664  1457 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:20.804607  2270 raft_consensus.cc:2955] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.812968  1631 raft_consensus.cc:2955] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.815835  1702 raft_consensus.cc:2955] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.850917  1455 catalog_manager.cc:5697] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:20.888031  2591 raft_consensus.cc:1064] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:20.890900  2591 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:20.913506  1704 raft_consensus.cc:2955] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.921888  1552 raft_consensus.cc:2955] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.926973  1455 catalog_manager.cc:5697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:20.952211  1631 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:20.954516  1543 tablet_service.cc:1558] Processing DeleteTablet for tablet dbfb4dc01d084c658bb8ff2ae985e80a with delete_type TABLET_DATA_TOMBSTONED (TS 87144ea1a4a14ab8b942fb426159f031 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:59:20.962229  2270 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:20.968441  2683 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:20.971379  2712 tablet_replica.cc:333] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 12:59:20.971747  1552 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:20.973097  2712 raft_consensus.cc:2243] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:20.973974  2712 raft_consensus.cc:2272] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:20.977015  1558 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:20.982092  2683 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:20.988251  2686 raft_consensus.cc:2955] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:20.991674  2268 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:20.997350  1634 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:20.997516  1558 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:21.000499  1702 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:21.002666  2675 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:59:21.003708  2706 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:21.007995  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:21.012567  2270 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:21.015662  2704 raft_consensus.cc:2955] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.020048  1704 raft_consensus.cc:2955] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.024690  2712 ts_tablet_manager.cc:1916] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:21.025377  2705 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:21.032423  2270 raft_consensus.cc:2955] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.006662  2591 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:21.006595  2268 raft_consensus.cc:2955] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.053449  2585 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:21.057255  1456 catalog_manager.cc:5697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:21.053113  1552 raft_consensus.cc:2955] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.080570  1455 catalog_manager.cc:5697] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.093735  1625 tablet_service.cc:1558] Processing DeleteTablet for tablet 447b9d1298e947858fa3d05e918d4a08 with delete_type TABLET_DATA_TOMBSTONED (TS 7e99891af85f4b10aa1cc2da6aa33082 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42238
I20260709 12:59:21.097015  1692 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f with delete_type TABLET_DATA_TOMBSTONED (TS 4f1725fe36e349ac85405627f9c93d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:21.112526  2712 ts_tablet_manager.cc:1929] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:21.117511  2712 log.cc:1199] T dbfb4dc01d084c658bb8ff2ae985e80a P 87144ea1a4a14ab8b942fb426159f031: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/wals/dbfb4dc01d084c658bb8ff2ae985e80a
I20260709 12:59:21.130241  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 447b9d1298e947858fa3d05e918d4a08 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:21.136075  1444 catalog_manager.cc:5028] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): tablet dbfb4dc01d084c658bb8ff2ae985e80a (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:21.139182  2716 tablet_replica.cc:333] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 12:59:21.147130  2716 raft_consensus.cc:2243] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:21.140708  2715 tablet_replica.cc:333] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 12:59:21.150879  2716 raft_consensus.cc:2272] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:21.154436  2715 raft_consensus.cc:2243] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:21.155441  2715 raft_consensus.cc:2272] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:21.162937  2675 raft_consensus.cc:2955] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.161782  2715 ts_tablet_manager.cc:1916] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:21.175302  2716 ts_tablet_manager.cc:1916] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:21.171305  2270 raft_consensus.cc:2955] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.187569  1558 raft_consensus.cc:2955] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.194197  2715 ts_tablet_manager.cc:1929] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:21.194783  2715 log.cc:1199] T 447b9d1298e947858fa3d05e918d4a08 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/wals/447b9d1298e947858fa3d05e918d4a08
I20260709 12:59:21.196520  1443 catalog_manager.cc:5028] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): tablet 447b9d1298e947858fa3d05e918d4a08 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:21.197263  2716 ts_tablet_manager.cc:1929] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:21.197726  2716 log.cc:1199] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 4f1725fe36e349ac85405627f9c93d95: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/wals/2ee92ce4d1fe4cbdbec21419ac95fa2f
I20260709 12:59:21.199298  1445 catalog_manager.cc:5028] TS 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): tablet 2ee92ce4d1fe4cbdbec21419ac95fa2f (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:21.205206  1631 raft_consensus.cc:2955] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.214205  1454 catalog_manager.cc:5697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.234331  1704 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:21.243456  2270 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:21.244830  2708 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:21.246675  1551 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:21.250792  2708 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:21.254017  2585 raft_consensus.cc:2955] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.265609  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88018a232de842fc8fcd30e124b7c4d7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:21.264846  2270 raft_consensus.cc:2955] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.266160  1551 raft_consensus.cc:2955] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:21.274237  1455 catalog_manager.cc:5697] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:21.287048  1625 tablet_service.cc:1558] Processing DeleteTablet for tablet 88018a232de842fc8fcd30e124b7c4d7 with delete_type TABLET_DATA_TOMBSTONED (TS 7e99891af85f4b10aa1cc2da6aa33082 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42238
I20260709 12:59:21.288009  2715 tablet_replica.cc:333] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 12:59:21.288988  2715 raft_consensus.cc:2243] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:21.289758  2715 raft_consensus.cc:2272] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:21.293258  2715 ts_tablet_manager.cc:1916] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:21.307382  2715 ts_tablet_manager.cc:1929] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:21.307739  2715 log.cc:1199] T 88018a232de842fc8fcd30e124b7c4d7 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/wals/88018a232de842fc8fcd30e124b7c4d7
I20260709 12:59:21.309089  1443 catalog_manager.cc:5028] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): tablet 88018a232de842fc8fcd30e124b7c4d7 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:21.595034   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:21.665400  1702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05f358a33737477ba11488ec75b16050"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:21.666219  1702 raft_consensus.cc:606] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:21.668690  1702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:21.669209  1702 raft_consensus.cc:606] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:21.671403  1702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:21.671877  1702 raft_consensus.cc:606] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:21.683696  1631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 12:59:21.684322  1631 raft_consensus.cc:606] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:21.688030  1702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:21.688508  1702 raft_consensus.cc:606] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:21.690857  1702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:21.691390  1702 raft_consensus.cc:606] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:21.702656  1551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d44a8411cf4642829994ec97173d358a"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:38648
I20260709 12:59:21.703155  1551 raft_consensus.cc:606] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:21.704306   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:59:21.705897   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:21.900045  2509 raft_consensus.cc:993] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:21.900656  2509 raft_consensus.cc:1081] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:21.902108  2270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d44a8411cf4642829994ec97173d358a"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58718
I20260709 12:59:21.902684  2270 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:21.903141  2270 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.909801  2270 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:21.912458  2270 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:21.912824  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:21.913277  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:21.913638  1551 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:21.914305  1551 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:21.914325  1631 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.915320  1551 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:21.916407  1551 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.919552  1631 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:21.920837  2234 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:21.921324  1551 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:21.923046  2723 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:21.924095  2723 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:21.925000  2723 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:21.934092  1453 catalog_manager.cc:5697] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 3, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:21.987774  2729 raft_consensus.cc:993] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:21.988269  2585 raft_consensus.cc:1081] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:21.989710  1631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:42252
I20260709 12:59:21.990180  1631 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:21.990541  1631 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:21.996518  1631 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:21.998766  1631 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:21.999356  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:21.999902  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:22.000037  1558 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.000435  1704 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.000713  1704 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:22.001339  1704 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:22.002429  1704 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.006042  1558 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:22.007458  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:22.006628  1704 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:22.008627  2686 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.009122  2686 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:22.010085  2686 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:22.013137  2729 raft_consensus.cc:993] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:22.013616  2585 raft_consensus.cc:1081] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:22.015618  1631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:42252
I20260709 12:59:22.016152  1631 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.016485  1631 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.022469  1453 catalog_manager.cc:5697] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.025465  1631 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:22.027657  1631 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:22.027848  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:22.028628  1558 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.029093  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:22.029650  1702 raft_consensus.cc:3055] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.029876  1702 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:22.030602  1702 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:22.031821  1702 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.035537  1558 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:22.036543  1600 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:22.037376  2686 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.037792  2686 raft_consensus.cc:697] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:22.038606  2686 consensus_queue.cc:237] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:22.040102  1702 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:22.048146  1453 catalog_manager.cc:5697] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.071007  2585 raft_consensus.cc:993] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:22.071570  2729 raft_consensus.cc:1081] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:22.073113  1634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:42252
I20260709 12:59:22.073541  1634 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.073815  1634 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.078890  1634 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:22.080560  1634 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:22.081451  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:22.081691  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:22.082154  1558 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.082290  1702 raft_consensus.cc:3055] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.082688  1702 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:22.083416  1702 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:22.084546  1702 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.087692  1558 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:22.088644  1600 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:22.089318  2686 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.089609  1702 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:22.090822  2686 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:22.092041  2686 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:22.102510  2684 raft_consensus.cc:993] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:22.103006  2684 raft_consensus.cc:1081] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:22.102903  1453 catalog_manager.cc:5697] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.104981  1702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48138
I20260709 12:59:22.105571  1702 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.105962  1702 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.111732  2585 raft_consensus.cc:993] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:22.112278  2729 raft_consensus.cc:1081] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:22.114313  2270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58716
I20260709 12:59:22.114814  2270 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.113766  1702 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:22.115131  2270 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.117655  1702 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:22.119410  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:22.120303  1558 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.122453  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:22.123000  1634 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.123270  1634 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:22.124097  1634 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:22.125161  1634 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.125622  1558 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:22.126791  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:22.127529  2729 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.121815  2270 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:22.128005  2729 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:22.129212  2729 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:22.130602  2270 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:22.131168  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:22.131733  1558 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.139287  1634 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:22.140242  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:22.140970  1702 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.141332  1702 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:22.142177  1702 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:22.143471  1702 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.149291  1453 catalog_manager.cc:5697] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 2, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.149989  1702 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:22.150108  1558 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:22.156160  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:22.156952  2723 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.157446  2723 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:22.158427  2723 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:22.160320  2585 raft_consensus.cc:993] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:22.160816  2729 raft_consensus.cc:1081] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:22.162343  2270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05f358a33737477ba11488ec75b16050"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58716
I20260709 12:59:22.162834  2270 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.163169  2270 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.170536  1456 catalog_manager.cc:5697] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.172452  2270 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:22.175971  2270 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:22.177454  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:22.178212  1702 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:22.178580  1702 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:22.180472  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:22.179345  1702 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:22.181051  1634 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.181720  1702 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:22.187707  1634 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:22.188596  1702 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:22.188644  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:22.189536  2723 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.190012  2723 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:22.190773  2723 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:22.199446  1456 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.345841  1634 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:22.353042  1702 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:22.354808  2684 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.355796  1558 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:22.355912  1599 consensus_peers.cc:597] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 207df21ae856459f9637b16a0feb2796. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:22.357180  2684 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.365417  2739 raft_consensus.cc:2955] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.368191  1702 raft_consensus.cc:2955] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.372423  1558 raft_consensus.cc:2955] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.383657  1456 catalog_manager.cc:5697] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.388643  1551 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:22.411827  1704 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:22.412485  1631 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:22.413376  2718 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.416778  2718 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.417400  1702 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.419442  2686 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:22.421092  1524 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 461e1b446c454dbfa1bd2a8ae75ae2c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:22.434757  2718 raft_consensus.cc:2955] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.468173  1704 raft_consensus.cc:2955] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.476073  1558 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.477492  1453 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.481901  2686 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:22.481328  1631 raft_consensus.cc:2955] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.486485  1634 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:22.488065  2723 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:22.483639  1551 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:22.533674  1704 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.554987  1552 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.556915  2686 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:22.557459  1553 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:22.559530  2723 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:22.567325  2585 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:22.578796  1704 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:22.586838  2749 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:59:22.593782  1551 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.600052  2509 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:22.601516  1524 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d45e74819157464ca3f225e90c8b6a9e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:22.604915  1631 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:22.612639  2509 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:22.619818  1702 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.604080  2740 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:59:22.633343  1702 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.635241  2739 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:22.638998  2723 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:22.682083  1558 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:22.686592  2686 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:22.702992  2718 raft_consensus.cc:2955] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.706820   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:22.713521  1558 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.721983  1707 raft_consensus.cc:2955] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
W20260709 12:59:22.738130  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44561.1us
I20260709 12:59:22.749219  1553 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:22.756592  2723 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:22.761693  1631 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:59:22.772745  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 55492.6us
I20260709 12:59:22.806516  1634 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.808007  2724 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:22.821352  1707 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:22.823385  2754 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:22.845688  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 75902.9us
I20260709 12:59:22.856218  2779 ts_tablet_manager.cc:933] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:22.865334  1456 catalog_manager.cc:5697] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.866761  2729 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:22.871218  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 71118.9us
I20260709 12:59:22.876173  2763 raft_consensus.cc:2955] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.882138  1707 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:22.882138  1631 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:22.887506  2724 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:22.892696  1707 raft_consensus.cc:2955] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.901975  2754 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:22.910471  1524 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff5a03f3312f4e6bac9383280b5b9131. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:22.919500  1631 raft_consensus.cc:2955] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.934899   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:22.933832  1634 raft_consensus.cc:2955] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.948695  2779 tablet_copy_client.cc:323] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 12:59:22.955677  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 207df21ae856459f9637b16a0feb2796 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 12:59:22.956199  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 207df21ae856459f9637b16a0feb2796 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-207df21ae856459f9637b16a0feb2796
I20260709 12:59:22.964596  1645 tablet_copy_source_session.cc:215] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:22.964222  1455 catalog_manager.cc:5697] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:22.969147  2779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207df21ae856459f9637b16a0feb2796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.011477  2779 tablet_copy_client.cc:806] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:23.012041  2779 tablet_copy_client.cc:670] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:23.016390  2779 tablet_copy_client.cc:538] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:23.016652  2784 ts_tablet_manager.cc:933] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:23.016429  1626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 12:59:23.017119  1626 raft_consensus.cc:606] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:23.021626  1631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 12:59:23.022199  1631 raft_consensus.cc:606] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:23.023447  2784 tablet_copy_client.cc:323] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:23.025054  1558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56d2e4b816a44719af0c86481062c407"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:38648
I20260709 12:59:23.025209  1569 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet 461e1b446c454dbfa1bd2a8ae75ae2c4 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:23.025599  1558 raft_consensus.cc:606] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:23.025712  1569 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet 461e1b446c454dbfa1bd2a8ae75ae2c4 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-461e1b446c454dbfa1bd2a8ae75ae2c4
I20260709 12:59:23.030455  2779 tablet_bootstrap.cc:492] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:23.036168  1569 tablet_copy_source_session.cc:215] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:23.039314  1631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:57634
I20260709 12:59:23.039866  1631 raft_consensus.cc:606] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:23.043149  1701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:23.043670  1701 raft_consensus.cc:606] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:23.044809   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:23.042717  2784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 461e1b446c454dbfa1bd2a8ae75ae2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.046286   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:23.075752  2784 tablet_copy_client.cc:806] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:23.076054  2779 tablet_bootstrap.cc:492] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:23.077488  2779 tablet_bootstrap.cc:492] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:23.078222  2779 ts_tablet_manager.cc:1403] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.007s
I20260709 12:59:23.076423  2784 tablet_copy_client.cc:670] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:23.081019  2779 raft_consensus.cc:359] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:23.082084  2779 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:23.082861  2779 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:23.088338  2779 ts_tablet_manager.cc:1434] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:59:23.091488  2784 tablet_copy_client.cc:538] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:23.092247  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-207df21ae856459f9637b16a0feb2796 received from {username='slave'} at 127.0.0.1:59260
I20260709 12:59:23.092682  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-207df21ae856459f9637b16a0feb2796 on tablet 207df21ae856459f9637b16a0feb2796 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:23.095551  2684 raft_consensus.cc:993] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:23.096009  2684 raft_consensus.cc:1081] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:23.099992  1701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48138
I20260709 12:59:23.100463  1701 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.100761  1701 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.107350  1701 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:23.110417  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:23.110644  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:23.111001  1631 raft_consensus.cc:3055] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:23.111313  1558 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.111382  1631 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:23.111581  2784 tablet_bootstrap.cc:492] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:23.112229  1631 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:23.113247  1631 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.118717  1558 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:23.121387  1631 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:23.121914  2754 raft_consensus.cc:993] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:23.122485  2754 raft_consensus.cc:1081] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:23.122551  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:23.123473  2585 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:23.123934  2585 raft_consensus.cc:697] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:23.124642  2585 consensus_queue.cc:237] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:23.126250  1701 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:23.126399  1634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56d2e4b816a44719af0c86481062c407"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:42256
I20260709 12:59:23.126950  1634 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.127360  1634 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.136979  1455 catalog_manager.cc:5697] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 3, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.148339  1634 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:23.152274  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:23.152834  1552 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.153126  1552 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:23.153815  1552 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:23.154923  1552 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.156805  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:23.157414  1701 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.161547  1552 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:23.162891  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:23.163753  2686 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:23.164229  2686 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:23.165041  2686 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:23.173545  1701 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:23.174556  1634 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:23.187490  1455 catalog_manager.cc:5697] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.191455  2784 tablet_bootstrap.cc:492] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:23.192489  2784 tablet_bootstrap.cc:492] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:23.193229  2784 ts_tablet_manager.cc:1403] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.010s
I20260709 12:59:23.194804  2779 ts_tablet_manager.cc:933] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:23.197435  2784 raft_consensus.cc:359] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:23.198427  2784 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:23.199137  2784 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:23.202358  2784 ts_tablet_manager.cc:1434] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:59:23.205678  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-461e1b446c454dbfa1bd2a8ae75ae2c4 received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:23.206218  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-461e1b446c454dbfa1bd2a8ae75ae2c4 on tablet 461e1b446c454dbfa1bd2a8ae75ae2c4 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:23.231191  2779 tablet_copy_client.cc:323] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:23.233004  1569 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet d45e74819157464ca3f225e90c8b6a9e from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:23.233598  1569 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet d45e74819157464ca3f225e90c8b6a9e from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-d45e74819157464ca3f225e90c8b6a9e
I20260709 12:59:23.242470  1569 tablet_copy_source_session.cc:215] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:23.245707  2779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45e74819157464ca3f225e90c8b6a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.252178  2739 raft_consensus.cc:993] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:23.252735  2739 raft_consensus.cc:1081] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:23.254781  2270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58714
I20260709 12:59:23.255331  2270 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.255718  2270 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.262082  2779 tablet_copy_client.cc:806] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:23.264340  2270 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:23.267551  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:23.268155  1631 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.268451  1631 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:23.268530  2779 tablet_copy_client.cc:670] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:23.269644  1631 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:23.271618  1631 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.274784  2779 tablet_copy_client.cc:538] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:23.274924  2270 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:23.276036  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:23.276605  1701 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.279943  1631 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:23.281224  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:23.282209  2765 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:23.282727  2765 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:23.284273  2765 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:23.292109  1701 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:23.295976  2779 tablet_bootstrap.cc:492] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:23.298568  1456 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.313369  2686 raft_consensus.cc:993] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:23.313884  2740 raft_consensus.cc:1081] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:23.315744  1704 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48138
I20260709 12:59:23.316295  1704 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.316617  1704 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.320466  2784 ts_tablet_manager.cc:933] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:23.324599  1704 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:23.327803  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:23.328435  1631 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:23.328740  1631 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:23.329723  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:23.330627  1558 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.341953  2784 tablet_copy_client.cc:323] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:23.330976  1631 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:23.333345  1704 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:23.343890  1631 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.336898  2779 tablet_bootstrap.cc:492] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:23.344807  1569 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet ff5a03f3312f4e6bac9383280b5b9131 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:23.345460  1569 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet ff5a03f3312f4e6bac9383280b5b9131 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-ff5a03f3312f4e6bac9383280b5b9131
I20260709 12:59:23.352264  1631 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:23.353300  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:23.353758  2779 tablet_bootstrap.cc:492] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:23.353608  1558 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:23.356292  1569 tablet_copy_source_session.cc:215] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:23.354113  2585 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:23.357421  2585 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:23.358247  2585 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:23.364688  2779 ts_tablet_manager.cc:1403] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.008s
I20260709 12:59:23.368085  2779 raft_consensus.cc:359] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:23.369041  2779 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:23.369309  2784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5a03f3312f4e6bac9383280b5b9131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:23.369832  2779 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:23.374281  2779 ts_tablet_manager.cc:1434] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:59:23.375254  1455 catalog_manager.cc:5697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 3, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.390331  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-d45e74819157464ca3f225e90c8b6a9e received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:23.390880  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-d45e74819157464ca3f225e90c8b6a9e on tablet d45e74819157464ca3f225e90c8b6a9e with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:23.392194  2775 raft_consensus.cc:993] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:23.392736  2775 raft_consensus.cc:1081] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:23.394451  2268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58716
I20260709 12:59:23.394982  2268 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.395323  2268 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.399513  2784 tablet_copy_client.cc:806] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:23.400118  2784 tablet_copy_client.cc:670] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:23.403743  2784 tablet_copy_client.cc:538] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:23.405109  2268 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:23.407327  2268 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:23.417743  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:23.420686  1701 raft_consensus.cc:3055] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.420998  1701 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:23.421725  1701 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:23.413475  2784 tablet_bootstrap.cc:492] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:23.413743  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:23.424420  1631 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.416033  2270 raft_consensus.cc:1217] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:23.447479  1631 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:23.450268  2234 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:23.451109  2724 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:23.451582  2724 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:23.452210  1701 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.452374  2724 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:23.464121  1701 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:23.482725  2784 tablet_bootstrap.cc:492] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:23.482883  1455 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.483875  2784 tablet_bootstrap.cc:492] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:23.484664  2784 ts_tablet_manager.cc:1403] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.071s	user 0.037s	sys 0.012s
I20260709 12:59:23.487835  2784 raft_consensus.cc:359] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:23.488780  2784 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:23.489476  2784 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:23.491873  2784 ts_tablet_manager.cc:1434] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:59:23.493563  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-ff5a03f3312f4e6bac9383280b5b9131 received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:23.493956  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-ff5a03f3312f4e6bac9383280b5b9131 on tablet ff5a03f3312f4e6bac9383280b5b9131 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:23.607735  1701 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:23.610059  2740 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:23.611944  2270 raft_consensus.cc:1217] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:23.628713  1558 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:23.631283  2686 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:23.679353  2270 raft_consensus.cc:1217] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:23.706265  1558 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:23.707381  2585 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.715443  1626 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:23.719331  2773 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.776654  1701 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:23.778630  2765 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:23.802482  1626 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:23.803793  2724 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:23.805547  2686 raft_consensus.cc:1064] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:23.807909  2686 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:23.824652  1707 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.827672  2739 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.837054  2268 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.840356  2739 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.846565  1626 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:23.848105  2771 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:23.852948  1552 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:23.854847  2798 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.856282  1631 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:23.861090  2806 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:23.878849  2798 raft_consensus.cc:2955] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:23.890525  1707 raft_consensus.cc:2955] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:23.894294  2268 raft_consensus.cc:2955] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:23.901964  1558 raft_consensus.cc:2955] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:23.922981  1455 catalog_manager.cc:5697] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:23.925218  1552 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:23.928738  2773 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:59:23.926601  1707 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:23.935168  2765 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:23.971935  2268 raft_consensus.cc:1217] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:23.986975  1631 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:23.993484  2268 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:24.004616  1707 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:24.004671  2739 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:24.006666  2739 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.019105  2718 raft_consensus.cc:1064] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:24.021029  2798 raft_consensus.cc:2955] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.021489  2718 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.026206  1704 raft_consensus.cc:2955] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.047259   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:24.053601  2268 raft_consensus.cc:2955] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.054566  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 207df21ae856459f9637b16a0feb2796 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:24.061852  2753 raft_consensus.cc:1064] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:24.064312  2753 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.089093  1453 catalog_manager.cc:5697] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:24.105002  1704 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:24.106187  1631 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:24.106463  2718 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:24.111985  2754 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.116245  2268 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:24.117830  2754 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.121965  1543 tablet_service.cc:1558] Processing DeleteTablet for tablet 207df21ae856459f9637b16a0feb2796 with delete_type TABLET_DATA_TOMBSTONED (TS 87144ea1a4a14ab8b942fb426159f031 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:59:24.129287  1701 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:24.129328  2269 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:24.131698  1626 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:24.131906  2718 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.133348  2763 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.137205  2718 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.178194  2819 tablet_replica.cc:333] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 12:59:24.185062  2819 raft_consensus.cc:2243] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:24.186131  2819 raft_consensus.cc:2272] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:24.185144  2754 raft_consensus.cc:2955] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.185578  2763 raft_consensus.cc:2955] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.190145  2819 ts_tablet_manager.cc:1916] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:24.191170  2268 raft_consensus.cc:2955] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.191604  1631 raft_consensus.cc:2955] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.185211   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:24.197026  1634 raft_consensus.cc:2955] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.205370  2819 ts_tablet_manager.cc:1929] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:24.205915  2819 log.cc:1199] T 207df21ae856459f9637b16a0feb2796 P 87144ea1a4a14ab8b942fb426159f031: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/wals/207df21ae856459f9637b16a0feb2796
I20260709 12:59:24.207527  1444 catalog_manager.cc:5028] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): tablet 207df21ae856459f9637b16a0feb2796 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:24.214637  1453 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.215669  2268 raft_consensus.cc:2955] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.234303  1456 catalog_manager.cc:5697] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:24.245630  1704 raft_consensus.cc:2955] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.277163  1707 raft_consensus.cc:2955] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.290127  1552 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.298259  1704 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:24.302613  2269 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:24.303267  2763 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.309978  2718 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.314391  1558 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.335570  1701 raft_consensus.cc:2955] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.343842  2268 raft_consensus.cc:2955] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.347280  1707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:24.347919  1707 raft_consensus.cc:606] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:24.348628  2753 raft_consensus.cc:2955] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.368506  2269 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:24.373152  1626 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:24.374361  1554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:38648
I20260709 12:59:24.374541  2754 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.375016  1554 raft_consensus.cc:606] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:24.376138  2754 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.377482  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d45e74819157464ca3f225e90c8b6a9e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:24.381131  1456 catalog_manager.cc:5697] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:24.388288  1628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:57634
I20260709 12:59:24.388923  1628 raft_consensus.cc:606] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:24.398268  2748 raft_consensus.cc:993] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:24.395681  1704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8129c29801c142749490f0df95b71485"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:24.399171  2748 raft_consensus.cc:1081] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:24.399513  1704 raft_consensus.cc:606] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:24.401018  2718 raft_consensus.cc:2955] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.405241  1554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:38648
I20260709 12:59:24.406100  2268 raft_consensus.cc:2955] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.408113  1554 raft_consensus.cc:606] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:24.411979   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:24.413616   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:24.415412  1625 tablet_service.cc:1558] Processing DeleteTablet for tablet d45e74819157464ca3f225e90c8b6a9e with delete_type TABLET_DATA_TOMBSTONED (TS 7e99891af85f4b10aa1cc2da6aa33082 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42238
I20260709 12:59:24.428906  2763 raft_consensus.cc:1064] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:24.433645  2269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58718
I20260709 12:59:24.433949  1631 raft_consensus.cc:2955] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.445523  2269 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:24.445997  2269 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.509163  2825 tablet_replica.cc:333] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 12:59:24.509052  2269 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.519754  1453 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 3 to 4, term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to <none>, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New cstate: current_term: 2 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.523495  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 461e1b446c454dbfa1bd2a8ae75ae2c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:24.525249  2825 raft_consensus.cc:2243] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:24.526141  2825 raft_consensus.cc:2272] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:24.516945  2763 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.531942  2825 ts_tablet_manager.cc:1916] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:24.540802  1692 tablet_service.cc:1558] Processing DeleteTablet for tablet 461e1b446c454dbfa1bd2a8ae75ae2c4 with delete_type TABLET_DATA_TOMBSTONED (TS 4f1725fe36e349ac85405627f9c93d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:24.543787  2269 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:24.544026  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:24.540455  1456 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 2 to 1, leader changed from <none> to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.544683  1626 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.546932  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:24.547603  1558 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:24.547945  1558 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:24.548799  1558 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.549986  1558 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.558135  2825 ts_tablet_manager.cc:1929] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:24.558732  2825 log.cc:1199] T d45e74819157464ca3f225e90c8b6a9e P 7e99891af85f4b10aa1cc2da6aa33082: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/wals/d45e74819157464ca3f225e90c8b6a9e
I20260709 12:59:24.562570  1701 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:24.565245  2748 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.570521  1443 catalog_manager.cc:5028] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): tablet d45e74819157464ca3f225e90c8b6a9e (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:24.578783  1626 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:24.580657  2748 raft_consensus.cc:993] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:24.583655  2748 raft_consensus.cc:1081] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:24.585340  1701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48150
I20260709 12:59:24.585913  1701 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:24.586297  1701 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.586700  1631 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:24.587561  2270 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:24.580811  1558 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:24.591252  2235 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:24.592479  2771 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.592990  2771 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:24.593856  2771 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.596954  1701 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.599292  1701 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:24.600811  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:24.601502  2268 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.607293  1456 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:24.606798  2748 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:24.608875  2268 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:24.610878  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:24.611832  2775 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.612389  2775 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:24.613353  2775 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.616427  2828 tablet_replica.cc:333] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 12:59:24.617568  2828 raft_consensus.cc:2243] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:24.618825  2806 raft_consensus.cc:993] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:24.619311  2806 raft_consensus.cc:1081] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:24.619589  2828 raft_consensus.cc:2272] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:24.623687  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:24.624328  1558 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:24.624643  1558 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:24.625459  1558 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.626153  2823 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:24.626811  1558 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.628008  1626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:42252
I20260709 12:59:24.628578  1626 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:24.628957  1626 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.636058  1626 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:24.644903  1456 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.646829  1558 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:24.660094  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:24.662784  1704 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:24.663098  1704 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:24.663897  1704 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:24.664974  1704 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.659770  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:24.666379  1552 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.690053  2763 raft_consensus.cc:2955] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.699657  1552 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:24.651616  2828 ts_tablet_manager.cc:1916] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:24.700992  1600 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:24.702919  2739 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.702988  2270 raft_consensus.cc:2955] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.712428  1626 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:24.720840  1704 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:24.736840  2739 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:24.737892  2739 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:24.740046  2828 ts_tablet_manager.cc:1929] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:24.740562  2828 log.cc:1199] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 4f1725fe36e349ac85405627f9c93d95: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/wals/461e1b446c454dbfa1bd2a8ae75ae2c4
I20260709 12:59:24.742480  1445 catalog_manager.cc:5028] TS 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): tablet 461e1b446c454dbfa1bd2a8ae75ae2c4 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:24.745258  1701 raft_consensus.cc:2955] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.761132  1456 catalog_manager.cc:5697] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.783305  1552 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.786288  2775 raft_consensus.cc:993] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:24.786793  2775 raft_consensus.cc:1081] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:24.790352  2269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8129c29801c142749490f0df95b71485"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58716
I20260709 12:59:24.790930  2269 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:24.790274  1626 raft_consensus.cc:2955] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.791251  2269 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.796911  1704 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:24.798887  2763 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.800915  2269 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.805256  1455 catalog_manager.cc:5697] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.807391  2269 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:24.808213  2823 raft_consensus.cc:2955] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.809373  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:24.810047  1631 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.814384  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:24.815055  1704 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:24.815382  1704 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:24.816174  1704 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.817880  2269 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:24.819947  1701 raft_consensus.cc:2955] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.826821  1704 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.837420  2748 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:24.838233  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff5a03f3312f4e6bac9383280b5b9131 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:24.841639  2269 raft_consensus.cc:2955] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.848922  1704 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:24.850065  2236 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:24.850917  2771 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:24.851382  2771 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:24.852248  2771 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.857399  1631 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:24.863080  2833 raft_consensus.cc:993] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:24.863579  2833 raft_consensus.cc:1081] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:24.865033  2269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58714
I20260709 12:59:24.865473  2269 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:24.865808  2269 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.871570  2269 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:24.873328  2269 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:24.897825  1444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 59358.4us
I20260709 12:59:24.919072  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:24.921327  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:24.930766  1707 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:24.948639  1453 catalog_manager.cc:5697] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:24.970662  1626 raft_consensus.cc:3055] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:24.971184  1626 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:25.019457  1631 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:25.019220  1455 catalog_manager.cc:5697] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:25.026444  2771 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:25.038021  1552 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:25.050793  1625 tablet_service.cc:1558] Processing DeleteTablet for tablet ff5a03f3312f4e6bac9383280b5b9131 with delete_type TABLET_DATA_TOMBSTONED (TS 7e99891af85f4b10aa1cc2da6aa33082 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42238
I20260709 12:59:25.053196  2825 tablet_replica.cc:333] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 12:59:25.060779  1707 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:25.062959  1701 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:25.064231  1556 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:25.061954  2771 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:59:25.077555  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:25.078647  2739 consensus_queue.cc:1059] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:25.075947  2773 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:59:25.081068  2771 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:25.081358  1626 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:25.086134  1626 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.094122  2771 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:25.102887  1626 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:25.105522  2771 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:25.147276  1558 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:25.150068  2834 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:25.163620  2270 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:25.165540  2773 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:25.193023  1456 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:25.231751  1707 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:25.241173  2825 raft_consensus.cc:2243] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:25.242396  2825 raft_consensus.cc:2272] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:25.237008  2834 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:59:25.255345  2825 ts_tablet_manager.cc:1916] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:25.281845  1704 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:25.283833  2841 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:25.289218  2825 ts_tablet_manager.cc:1929] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:25.289960  2825 log.cc:1199] T ff5a03f3312f4e6bac9383280b5b9131 P 7e99891af85f4b10aa1cc2da6aa33082: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/wals/ff5a03f3312f4e6bac9383280b5b9131
I20260709 12:59:25.292232  1443 catalog_manager.cc:5028] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): tablet ff5a03f3312f4e6bac9383280b5b9131 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:25.295647  1626 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:25.297111  2771 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:25.414752   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:25.458014   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:25.493955  1556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:38648
I20260709 12:59:25.494657  1556 raft_consensus.cc:606] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:25.497511  1556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:38648
I20260709 12:59:25.498184  1556 raft_consensus.cc:606] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:25.507993  1707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:25.508565  1707 raft_consensus.cc:606] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:25.511765  1634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 12:59:25.512353  1634 raft_consensus.cc:606] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:25.515141  1556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:38648
I20260709 12:59:25.515592  1556 raft_consensus.cc:606] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:25.516798   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:25.518051   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:25.533926  2823 raft_consensus.cc:993] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:25.534504  2823 raft_consensus.cc:1081] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:25.536072  1707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48150
I20260709 12:59:25.536613  1707 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:25.536993  1707 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.542424  1707 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:25.545135  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:25.545543  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:25.545812  1556 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:25.546156  2268 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.546208  1556 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:25.547427  1556 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:25.548216  1556 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.552187  2268 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:25.553586  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:25.553759  1556 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:25.555166  1707 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:25.555274  2775 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:25.555859  2775 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:25.557297  2775 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:25.567394  1456 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.577507  1707 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:25.578684  2771 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:25.592087  1634 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:25.594969  2724 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:25.670706  2748 raft_consensus.cc:993] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:25.671187  2823 raft_consensus.cc:1081] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:25.672657  1634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:42256
I20260709 12:59:25.673123  1634 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:25.673389  1634 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.679425  1634 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:25.681337  1634 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:25.681813  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:25.681962  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:25.682540  1707 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.682610  1552 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:25.683784  1552 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:25.684556  1552 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:25.685763  1552 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.691874  1552 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:25.693105  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:25.694072  2833 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:25.694545  2833 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:25.694941  1707 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:25.695375  2833 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:25.705193  1456 catalog_manager.cc:5697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.883116  2823 raft_consensus.cc:993] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:25.883646  2748 raft_consensus.cc:1081] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:25.884891  1634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:42256
I20260709 12:59:25.885334  1634 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:25.885629  1634 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.891330  1634 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:25.892938  1634 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:25.893560  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:25.893783  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:25.894140  1552 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:25.894433  1707 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.894491  1552 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:25.895221  1552 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:25.896194  1552 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.898952  1707 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:25.900357  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:25.900832  1552 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:25.901193  2833 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:25.901741  2833 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:25.903108  2833 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:25.912474  1456 catalog_manager.cc:5697] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.913643  2686 raft_consensus.cc:993] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:25.914098  2833 raft_consensus.cc:1081] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:25.915640  1707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48138
I20260709 12:59:25.916121  1707 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:25.916417  1707 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.925802  1707 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:25.927567  1707 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:25.928351  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:25.928642  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:25.928951  1552 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.929222  1634 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:25.929533  1634 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:25.930197  1634 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:25.931089  1634 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.934521  1552 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:25.935634  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:25.936005  1634 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:25.936594  2775 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:25.937106  2775 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:25.938272  2775 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:25.947849  1456 catalog_manager.cc:5697] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 2, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:26.078613  2806 raft_consensus.cc:993] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:26.079129  2775 raft_consensus.cc:1081] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:26.080889  2271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58716
I20260709 12:59:26.081389  2271 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.081741  2271 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.086997  2271 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:26.088650  2271 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:26.089648  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:26.089776  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:26.090554  1707 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:26.090920  1707 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:26.090945  1552 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.091893  1707 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:26.093778  1707 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.097616  1552 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:26.098927  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:26.099751  2724 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:26.100242  2724 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:26.101255  1707 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:26.101177  2724 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:26.116139  2271 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:26.117913  2806 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:26.120242  1456 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:26.141597  1556 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:26.151412  2775 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:26.179776  1552 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.181209  2686 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.203646  1707 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.205366  2834 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:26.224279  1634 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:26.251493  1707 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:26.253356  1556 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:26.255155  2833 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.257503  2834 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:26.260630  1599 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b113b168afa40cfaab164f8317e42c1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:26.271679  2740 raft_consensus.cc:2955] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.272742  1556 raft_consensus.cc:2955] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.282076  1707 raft_consensus.cc:2955] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.297410  1456 catalog_manager.cc:5697] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.304355  1707 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.306198  2834 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.319499  1626 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:26.332366  1556 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.334211  2740 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.345690  1701 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:26.347487  2834 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.353320  1552 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:26.354719  2740 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:26.355756  1599 consensus_peers.cc:597] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44fa411feaaf4e2d91d23edd17e19ae0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:26.366354  2834 raft_consensus.cc:2955] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.368108  1552 raft_consensus.cc:2955] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.372445  1701 raft_consensus.cc:2955] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.383764  1626 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:26.388065  1455 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.390801  1552 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:26.391274  1599 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d6b0ca7e03c249ebad5c6f720df4efca. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:26.391243  1701 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:26.392143  2834 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.392947  2740 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.401489  2834 raft_consensus.cc:2955] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.414438  1552 raft_consensus.cc:2955] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.416168  1707 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:26.419090  1701 raft_consensus.cc:2955] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.421329  1456 catalog_manager.cc:5697] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.422186  1626 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.433295  2775 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.445233  1634 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:26.449349  1673 consensus_peers.cc:597] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5f195a66bf8449c96e58c306dec48a5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:26.450201  1552 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:26.451709  2775 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.454185  2775 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.465437  1558 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:26.470628  2806 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.470219  2860 raft_consensus.cc:2955] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.475384  1558 raft_consensus.cc:2955] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.480515  1634 raft_consensus.cc:2955] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.505944  1453 catalog_manager.cc:5697] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:26.519040   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:26.602408   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:26.658565  1556 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:26.665992  2771 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:26.666374  1626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "207df21ae856459f9637b16a0feb2796"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:57634
I20260709 12:59:26.667052  1626 raft_consensus.cc:606] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:26.672246  1626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 12:59:26.672845  1626 raft_consensus.cc:606] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:26.743314  1701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:26.744119  1701 raft_consensus.cc:606] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:26.756224  1701 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:26.772634  2771 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:26.781553  1558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:38648
I20260709 12:59:26.782212  1558 raft_consensus.cc:606] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:26.784152   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:26.785681   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:26.821873  2823 raft_consensus.cc:993] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:26.822499  2823 raft_consensus.cc:1081] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:26.828392  1701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48150
I20260709 12:59:26.830520  1701 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.831003  1701 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.853375  2893 ts_tablet_manager.cc:933] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:26.861142  2893 tablet_copy_client.cc:323] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 12:59:26.861896  1701 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:26.863230  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet d6b0ca7e03c249ebad5c6f720df4efca from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 12:59:26.863777  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet d6b0ca7e03c249ebad5c6f720df4efca from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-d6b0ca7e03c249ebad5c6f720df4efca
I20260709 12:59:26.864671  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:26.865298  1556 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:26.865593  1556 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:26.866401  1556 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:26.868856  1556 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.870910  1701 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:26.872268  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:26.873063  2270 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.883705  1645 tablet_copy_source_session.cc:215] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:26.884790  2270 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:26.886613  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:26.886875  2895 ts_tablet_manager.cc:933] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:26.887588  2860 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:26.888080  2860 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:26.888921  2860 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:26.899358  2893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6b0ca7e03c249ebad5c6f720df4efca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:26.900446  1556 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:26.902927  2896 ts_tablet_manager.cc:933] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:26.906764  2895 tablet_copy_client.cc:323] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:26.909607  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet a5f195a66bf8449c96e58c306dec48a5 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:26.910393  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet a5f195a66bf8449c96e58c306dec48a5 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-a5f195a66bf8449c96e58c306dec48a5
I20260709 12:59:26.923520  1453 catalog_manager.cc:5697] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.924408  1719 tablet_copy_source_session.cc:215] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:26.930537  2893 tablet_copy_client.cc:806] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:26.932556  2895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f195a66bf8449c96e58c306dec48a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:26.939044  2890 raft_consensus.cc:993] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:26.939604  2890 raft_consensus.cc:1081] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:26.941599  2268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "207df21ae856459f9637b16a0feb2796"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58714
I20260709 12:59:26.942272  2268 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.942624  2268 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.950158  2893 tablet_copy_client.cc:670] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:26.950426  2268 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:26.951980  2895 tablet_copy_client.cc:806] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:26.952649  2895 tablet_copy_client.cc:670] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:26.955910  2896 tablet_copy_client.cc:323] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 12:59:26.957610  2268 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:26.958943  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:26.959558  1631 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:26.959856  1631 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:26.960242  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:26.960827  1705 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.960637  1631 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:26.961414  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 2b113b168afa40cfaab164f8317e42c1 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 12:59:26.961980  1631 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:26.962001  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 2b113b168afa40cfaab164f8317e42c1 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-2b113b168afa40cfaab164f8317e42c1
I20260709 12:59:26.969976  2900 ts_tablet_manager.cc:933] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:26.970736  1631 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:26.970083  2895 tablet_copy_client.cc:538] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:26.972118  2893 tablet_copy_client.cc:538] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:26.972507  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:26.973996  2771 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:26.974740  2771 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:26.975881  2771 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:26.983719  1645 tablet_copy_source_session.cc:215] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:26.987538  2900 tablet_copy_client.cc:323] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 12:59:26.989377  2893 tablet_bootstrap.cc:492] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:26.990723  2895 tablet_bootstrap.cc:492] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:26.994302  2896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b113b168afa40cfaab164f8317e42c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:27.001091  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 44fa411feaaf4e2d91d23edd17e19ae0 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 12:59:27.001734  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 44fa411feaaf4e2d91d23edd17e19ae0 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-44fa411feaaf4e2d91d23edd17e19ae0
I20260709 12:59:26.970710  1705 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:27.054076  2896 tablet_copy_client.cc:806] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:27.054736  2896 tablet_copy_client.cc:670] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:27.059863  2806 raft_consensus.cc:993] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 12:59:27.068881  2806 raft_consensus.cc:1081] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Signalling peer 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 12:59:27.080613  1645 tablet_copy_source_session.cc:215] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:27.081960  1558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:42098
I20260709 12:59:27.082705  1558 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:27.083104  1558 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.089217  2900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44fa411feaaf4e2d91d23edd17e19ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:27.090272  1453 catalog_manager.cc:5697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:27.100752  2895 tablet_bootstrap.cc:492] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:27.101853  2895 tablet_bootstrap.cc:492] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:27.102146  1558 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:27.102706  2895 ts_tablet_manager.cc:1403] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.112s	user 0.035s	sys 0.013s
I20260709 12:59:27.104451  1558 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:27.106468  2895 raft_consensus.cc:359] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:27.108619  2895 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:27.109424  2895 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:27.112413  2895 ts_tablet_manager.cc:1434] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:59:27.118942  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-a5f195a66bf8449c96e58c306dec48a5 received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:27.119462  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-a5f195a66bf8449c96e58c306dec48a5 on tablet a5f195a66bf8449c96e58c306dec48a5 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:27.119817  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:27.120426  1701 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:27.120713  1701 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:27.121395  1701 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:27.126569  1701 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.132867  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:27.133584  2268 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.142124  2686 raft_consensus.cc:993] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:27.142724  2740 raft_consensus.cc:1081] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:27.142889  2268 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:27.151203  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:27.152731  2748 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:27.153257  2748 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:27.154166  2748 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:27.156632  1705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48138
I20260709 12:59:27.157226  1705 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:27.157577  1705 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:27.161758  1701 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:27.168176  2896 tablet_copy_client.cc:538] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:27.177753  2896 tablet_bootstrap.cc:492] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:27.179026  2900 tablet_copy_client.cc:806] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:27.179872  2900 tablet_copy_client.cc:670] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:27.192257  2893 tablet_bootstrap.cc:492] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:27.193166  2893 tablet_bootstrap.cc:492] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:27.193383  2900 tablet_copy_client.cc:538] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:27.193828  2893 ts_tablet_manager.cc:1403] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.205s	user 0.033s	sys 0.032s
I20260709 12:59:27.196358  1455 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 2 to 3, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.196046  1705 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:27.204365  1705 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:27.205358  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:27.206578  1631 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:27.206875  1631 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:27.207574  1631 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:27.208086  2893 raft_consensus.cc:359] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:27.209272  2893 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:27.209990  2893 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:27.211776  2900 tablet_bootstrap.cc:492] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:27.208572  1631 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:27.225445  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:27.225996  1556 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:27.227353  2893 ts_tablet_manager.cc:1434] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:59:27.234314  1556 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:27.235646  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:27.236837  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-d6b0ca7e03c249ebad5c6f720df4efca received from {username='slave'} at 127.0.0.1:59260
I20260709 12:59:27.237287  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-d6b0ca7e03c249ebad5c6f720df4efca on tablet d6b0ca7e03c249ebad5c6f720df4efca with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:27.238900  2775 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:27.239352  2775 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:27.241658  2775 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:27.256521  2896 tablet_bootstrap.cc:492] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:27.259735  1631 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:27.262265  2896 tablet_bootstrap.cc:492] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:27.262946  2896 ts_tablet_manager.cc:1403] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.013s
I20260709 12:59:27.273586  2900 tablet_bootstrap.cc:492] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:27.274961  2900 tablet_bootstrap.cc:492] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:27.275652  2900 ts_tablet_manager.cc:1403] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.064s	user 0.035s	sys 0.021s
I20260709 12:59:27.278589  2900 raft_consensus.cc:359] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:27.279879  2900 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:27.280855  2900 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:27.283654  2900 ts_tablet_manager.cc:1434] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:59:27.283483  1455 catalog_manager.cc:5697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 2, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:27.285851  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-44fa411feaaf4e2d91d23edd17e19ae0 received from {username='slave'} at 127.0.0.1:59260
I20260709 12:59:27.286288  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-44fa411feaaf4e2d91d23edd17e19ae0 on tablet 44fa411feaaf4e2d91d23edd17e19ae0 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:27.286660  2271 raft_consensus.cc:1217] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:27.290576  2896 raft_consensus.cc:359] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:27.291412  2896 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:27.293476  2896 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:27.296077  2896 ts_tablet_manager.cc:1434] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.002s
I20260709 12:59:27.300112  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-2b113b168afa40cfaab164f8317e42c1 received from {username='slave'} at 127.0.0.1:59260
I20260709 12:59:27.300534  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-2b113b168afa40cfaab164f8317e42c1 on tablet 2b113b168afa40cfaab164f8317e42c1 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:27.306156  2271 raft_consensus.cc:1217] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:27.344314  2271 raft_consensus.cc:1217] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:27.349378  1558 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:27.350836  2860 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.377604  1631 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:27.379853  2904 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.392930  2271 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:27.400413  2806 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.427274  1705 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:27.429576  2771 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.646818  1634 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:27.648058  2806 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:27.650573  1556 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:27.654929  2271 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:27.656260  2860 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:27.658408  1701 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:27.660204  2748 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:27.668469  2748 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:27.776811  2860 raft_consensus.cc:1064] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:27.780815  2860 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:27.786748   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:27.804747  1556 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:27.806434  2806 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.818919  2268 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:27.819497  1634 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:27.831408  2775 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.837143  2775 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.849735  2271 raft_consensus.cc:1217] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:27.871650  2775 raft_consensus.cc:2955] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:27.878422  2890 raft_consensus.cc:1064] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:27.888435  2890 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:27.888082  1556 raft_consensus.cc:2955] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:27.889613  1634 raft_consensus.cc:2955] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:27.919286  1455 catalog_manager.cc:5697] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.939600  2268 raft_consensus.cc:2955] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:27.954896  2833 raft_consensus.cc:1064] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:27.967190  2833 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:27.969905  1556 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:27.971556  1701 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:27.972546  2890 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.970825  2271 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:27.973474  2930 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:27.975490  2887 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:28.010792  2268 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:28.011160  1558 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:28.013669  2890 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:28.015024  2887 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:28.021763  1701 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:28.020985  2930 raft_consensus.cc:2955] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.027281   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:28.036670  2740 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:28.055622  1552 raft_consensus.cc:2955] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.067760  2270 raft_consensus.cc:2955] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.069245  2740 raft_consensus.cc:2955] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.090979  2271 raft_consensus.cc:2955] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.097641  1705 raft_consensus.cc:2955] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.104063  1704 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:28.109692  1634 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:28.111330  2268 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:28.111909  2806 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:28.113224  1704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:28.113775  1704 raft_consensus.cc:606] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:28.114112  2922 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:28.120226  1704 raft_consensus.cc:630] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Rejecting request to transfer leadership because tablet server 87144ea1a4a14ab8b942fb426159f031 is not a voter in the active config
I20260709 12:59:28.121819  2775 raft_consensus.cc:2955] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.123651  1626 raft_consensus.cc:2955] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.130559  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a5f195a66bf8449c96e58c306dec48a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:28.132790  2268 raft_consensus.cc:2955] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.142445  1453 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:28.141295  1704 raft_consensus.cc:2955] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.149037  1554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:38648
I20260709 12:59:28.149605  1554 raft_consensus.cc:606] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:28.151968  1701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:28.152412  1701 raft_consensus.cc:606] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:28.154155   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:28.155797   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:28.167601  1626 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:28.168394  1454 catalog_manager.cc:5697] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.181042  2775 raft_consensus.cc:993] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:28.181540  2775 raft_consensus.cc:1081] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:28.183949  1634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:42252
I20260709 12:59:28.184468  1634 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:28.184810  1634 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.190304  2271 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:28.174937  1453 catalog_manager.cc:5697] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:28.191377  1704 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:28.192349  2740 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:28.193137  1634 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:28.195758  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:28.196271  1556 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.196467  1634 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:28.199005  2930 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:28.199148  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:28.199780  1701 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:28.200083  1701 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:28.200783  1701 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:28.201877  1701 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.202386  2890 raft_consensus.cc:2955] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.209450  1556 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:28.210368  2271 raft_consensus.cc:2955] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.217341  1543 tablet_service.cc:1558] Processing DeleteTablet for tablet a5f195a66bf8449c96e58c306dec48a5 with delete_type TABLET_DATA_TOMBSTONED (TS 87144ea1a4a14ab8b942fb426159f031 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:59:28.222119  2941 tablet_replica.cc:333] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 12:59:28.223268  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 44fa411feaaf4e2d91d23edd17e19ae0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:28.224445  2941 raft_consensus.cc:2243] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.225245  2941 raft_consensus.cc:2272] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.212173  1701 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:28.212324  1705 raft_consensus.cc:2955] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.230160  1626 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:28.231403  1454 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:28.214970  1600 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:28.236135  2268 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:28.239353  2833 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:28.240514  2930 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:28.241014  2930 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:28.242075  2930 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:28.245263  2941 ts_tablet_manager.cc:1916] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:28.250229  2833 raft_consensus.cc:2955] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.261296  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d6b0ca7e03c249ebad5c6f720df4efca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:28.262094  2271 raft_consensus.cc:2955] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.265102  1556 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:28.267946  2887 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:28.272339  1556 raft_consensus.cc:2955] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.277778  2941 ts_tablet_manager.cc:1929] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:28.278272  2941 log.cc:1199] T a5f195a66bf8449c96e58c306dec48a5 P 87144ea1a4a14ab8b942fb426159f031: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/wals/a5f195a66bf8449c96e58c306dec48a5
I20260709 12:59:28.279491  2887 raft_consensus.cc:1064] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:28.281888  1444 catalog_manager.cc:5028] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): tablet a5f195a66bf8449c96e58c306dec48a5 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:28.285758  2887 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:28.293495  1543 tablet_service.cc:1558] Processing DeleteTablet for tablet 44fa411feaaf4e2d91d23edd17e19ae0 with delete_type TABLET_DATA_TOMBSTONED (TS 87144ea1a4a14ab8b942fb426159f031 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:59:28.299219  2941 tablet_replica.cc:333] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 12:59:28.300685  2941 raft_consensus.cc:2243] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.301295  2941 pending_rounds.cc:70] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031: Trying to abort 1 pending ops.
I20260709 12:59:28.301628  2941 pending_rounds.cc:77] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305633660786450432 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } } }
I20260709 12:59:28.302939  2941 raft_consensus.cc:2917] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:59:28.303336  2941 raft_consensus.cc:2889] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:59:28.303689  2941 raft_consensus.cc:2272] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.308398  2941 ts_tablet_manager.cc:1916] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:28.308470  1456 catalog_manager.cc:5697] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.319963  2268 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:28.322485  1705 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:28.323706  1556 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:28.324347  2930 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:28.325454  2890 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:28.329679  2740 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:28.336889  2941 ts_tablet_manager.cc:1929] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:28.337453  2941 log.cc:1199] T 44fa411feaaf4e2d91d23edd17e19ae0 P 87144ea1a4a14ab8b942fb426159f031: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/wals/44fa411feaaf4e2d91d23edd17e19ae0
I20260709 12:59:28.339082  1444 catalog_manager.cc:5028] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): tablet 44fa411feaaf4e2d91d23edd17e19ae0 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:28.348294  2890 raft_consensus.cc:2955] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.349984  1705 raft_consensus.cc:2955] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.359638  2268 raft_consensus.cc:2955] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.361400  1692 tablet_service.cc:1558] Processing DeleteTablet for tablet d6b0ca7e03c249ebad5c6f720df4efca with delete_type TABLET_DATA_TOMBSTONED (TS 4f1725fe36e349ac85405627f9c93d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:28.368844  2948 tablet_replica.cc:333] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 12:59:28.392467  1456 catalog_manager.cc:5697] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.402935  2948 raft_consensus.cc:2243] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.403911  2948 raft_consensus.cc:2272] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.408742  1556 raft_consensus.cc:2955] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.410271  2948 ts_tablet_manager.cc:1916] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:28.420439  1453 catalog_manager.cc:5697] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 2 to 3, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:28.427485  2948 ts_tablet_manager.cc:1929] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:28.428218  2948 log.cc:1199] T d6b0ca7e03c249ebad5c6f720df4efca P 4f1725fe36e349ac85405627f9c93d95: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/wals/d6b0ca7e03c249ebad5c6f720df4efca
I20260709 12:59:28.430258  1445 catalog_manager.cc:5028] TS 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): tablet d6b0ca7e03c249ebad5c6f720df4efca (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:28.448436  1634 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:28.452384  2268 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:28.453346  1554 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:28.453606  2833 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:28.455705  2740 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:28.462317  2887 raft_consensus.cc:2955] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.464715  1554 raft_consensus.cc:2955] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.468524  2271 raft_consensus.cc:2955] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:28.475493  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b113b168afa40cfaab164f8317e42c1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:28.488906  1456 catalog_manager.cc:5697] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 3 to 4, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:28.502830  1692 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b113b168afa40cfaab164f8317e42c1 with delete_type TABLET_DATA_TOMBSTONED (TS 4f1725fe36e349ac85405627f9c93d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:28.503818  2948 tablet_replica.cc:333] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 12:59:28.504859  2948 raft_consensus.cc:2243] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.505663  2948 raft_consensus.cc:2272] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.509423  2948 ts_tablet_manager.cc:1916] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:28.521306  2948 ts_tablet_manager.cc:1929] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:28.521611  2948 log.cc:1199] T 2b113b168afa40cfaab164f8317e42c1 P 4f1725fe36e349ac85405627f9c93d95: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/wals/2b113b168afa40cfaab164f8317e42c1
I20260709 12:59:28.523092  1445 catalog_manager.cc:5028] TS 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): tablet 2b113b168afa40cfaab164f8317e42c1 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:28.639066  2925 raft_consensus.cc:993] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:28.639561  2748 raft_consensus.cc:1081] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:28.640801  1634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:42256
I20260709 12:59:28.641338  1634 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:28.641746  1634 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:28.646243  1634 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:28.647951  1634 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:28.648504  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:28.649183  1556 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:28.649425  1556 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:28.649487  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:28.650134  2271 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:28.650157  1556 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:28.651161  1556 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:28.656327  1556 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:28.656165  2271 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:28.657626  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:28.658381  2833 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:28.658824  2833 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:28.659554  2833 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:28.681566  1453 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:28.811403  1705 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:28.812718  2833 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:28.829107  1554 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:28.830454  2740 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:29.152617  2271 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:29.153708  2740 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:29.156826   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:29.166718  1554 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:29.168068  2833 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:29.256094   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:29.303011  1626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 12:59:29.303548  1626 raft_consensus.cc:606] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:29.305917  1701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:29.306519  1701 raft_consensus.cc:606] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:29.309185  1701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:29.309615  1701 raft_consensus.cc:606] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:29.310519   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:29.311556   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:29.406350  2860 raft_consensus.cc:993] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:29.406809  2806 raft_consensus.cc:1081] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:29.408201  2271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58716
I20260709 12:59:29.408658  2271 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.408964  2271 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:29.413539  2271 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:29.414978  2271 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:29.415581  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:29.416123  1626 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:29.416051  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:29.417788  1701 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:29.418111  1701 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:29.418792  1701 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:29.419631  1701 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:29.420957  1626 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:29.421929  2234 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:29.422595  2771 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:29.423517  2771 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:29.424294  2771 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:29.425014  1701 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:29.433667  1453 catalog_manager.cc:5697] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.569911  1554 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:29.576562  1701 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:29.577998  1524 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eda09757c25a4279a4c93c29eeff416a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.579667  2925 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:29.589964  1626 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:29.591238  2965 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:29.590701  2966 raft_consensus.cc:2955] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.592284  1701 raft_consensus.cc:2955] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.607161  1626 raft_consensus.cc:2955] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.608310  1634 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:29.610767  1456 catalog_manager.cc:5697] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.614830  1701 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:29.615242  1599 consensus_peers.cc:597] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f6a8ad007074cfe96f8430d622f5f80. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.616066  1554 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:29.617525  2887 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:29.619508  2740 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:29.629865  2887 raft_consensus.cc:2955] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.632784  1554 raft_consensus.cc:2955] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.658849  1626 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 12:59:29.665814  1599 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86aa6466101d44fc98160eb3586dc176. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.667173  1705 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:29.667307  1554 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:29.668651  2740 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:29.669483  1453 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.670352  2887 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:29.668226  1701 raft_consensus.cc:2955] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.685477  2833 raft_consensus.cc:2955] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.686259  1554 raft_consensus.cc:2955] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.695305  2806 raft_consensus.cc:993] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 12:59:29.703135  1704 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:29.718102  2806 raft_consensus.cc:1081] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Signalling peer 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 12:59:29.717279  1453 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.732484  1556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:42098
I20260709 12:59:29.733042  1556 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.733381  1556 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:29.749367  2833 raft_consensus.cc:993] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:29.749903  2833 raft_consensus.cc:1081] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:29.752043  1556 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:29.752867  1707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48138
I20260709 12:59:29.753430  1707 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.753785  1707 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:29.754969  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:29.755512  1628 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:29.757117  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:29.757661  1705 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:29.757921  1705 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:29.758615  1705 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:29.759570  1705 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:29.761924  1628 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
W20260709 12:59:29.762678  1673 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 423fad3d086c4c18b5d84ecfeeb2957a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:29.763625  1524 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:29.764040  1628 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:29.764936  1552 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:29.765729  2966 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:29.767459  2975 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:29.769057  2806 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:29.774056  2966 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:29.775174  2966 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:29.780797  2860 raft_consensus.cc:2955] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.782728  1554 raft_consensus.cc:2955] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.784296  1634 raft_consensus.cc:2955] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.767781  1556 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:29.792950  1707 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:29.794726  1705 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:29.797845  1453 catalog_manager.cc:5697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.799535  1707 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:29.800199  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:29.800808  1628 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:29.801095  1628 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:29.801796  1628 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:29.802923  1628 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:29.803179  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:29.803784  1552 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:29.808315  1628 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
W20260709 12:59:29.809715  2976 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:59:29.810297  1673 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:29.811249  2975 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:29.811774  2975 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:29.813099  1454 catalog_manager.cc:5697] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 2 to 3, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.818576  2975 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:29.821003  1552 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:29.830464  1701 raft_consensus.cc:2955] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:29.846396  1454 catalog_manager.cc:5697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 3, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.935784  1634 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:29.937608  2771 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:29.952575  1701 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:29.955037  2771 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:29.984735  2989 ts_tablet_manager.cc:933] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:29.988521  2989 tablet_copy_client.cc:323] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:29.990562  1569 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet eda09757c25a4279a4c93c29eeff416a from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:29.991142  1569 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet eda09757c25a4279a4c93c29eeff416a from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-eda09757c25a4279a4c93c29eeff416a
I20260709 12:59:29.999800  1569 tablet_copy_source_session.cc:215] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:30.004894  2989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eda09757c25a4279a4c93c29eeff416a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:30.016366  2991 ts_tablet_manager.cc:933] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:30.020749  2991 tablet_copy_client.cc:323] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 12:59:30.021078  2989 tablet_copy_client.cc:806] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:30.021765  2989 tablet_copy_client.cc:670] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:30.022718  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 2f6a8ad007074cfe96f8430d622f5f80 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 12:59:30.024029  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 2f6a8ad007074cfe96f8430d622f5f80 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-2f6a8ad007074cfe96f8430d622f5f80
I20260709 12:59:30.027871  2989 tablet_copy_client.cc:538] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:30.039129  2989 tablet_bootstrap.cc:492] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:30.042790  1645 tablet_copy_source_session.cc:215] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:30.046581  2991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f6a8ad007074cfe96f8430d622f5f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:30.064903  2989 tablet_bootstrap.cc:492] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:30.065945  2989 tablet_bootstrap.cc:492] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:30.066803  2989 ts_tablet_manager.cc:1403] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.028s	user 0.024s	sys 0.000s
I20260709 12:59:30.068257  2991 tablet_copy_client.cc:806] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:30.068948  2991 tablet_copy_client.cc:670] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:30.070892  2989 raft_consensus.cc:359] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:30.072018  2989 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:30.072734  2989 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:30.075193  2989 ts_tablet_manager.cc:1434] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:59:30.077106  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-eda09757c25a4279a4c93c29eeff416a received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:30.077507  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-eda09757c25a4279a4c93c29eeff416a on tablet eda09757c25a4279a4c93c29eeff416a with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:30.085650  2991 tablet_copy_client.cc:538] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:30.095947  2991 tablet_bootstrap.cc:492] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:30.124372  2991 tablet_bootstrap.cc:492] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:30.125452  2991 tablet_bootstrap.cc:492] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:30.126279  2991 ts_tablet_manager.cc:1403] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.016s
I20260709 12:59:30.129436  2991 raft_consensus.cc:359] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:30.130478  2991 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:30.131232  2991 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:30.134342  2991 ts_tablet_manager.cc:1434] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:59:30.136128  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-2f6a8ad007074cfe96f8430d622f5f80 received from {username='slave'} at 127.0.0.1:59260
I20260709 12:59:30.136520  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-2f6a8ad007074cfe96f8430d622f5f80 on tablet 2f6a8ad007074cfe96f8430d622f5f80 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:30.212061  2991 ts_tablet_manager.cc:933] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:30.213680  2991 tablet_copy_client.cc:323] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 12:59:30.215157  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 86aa6466101d44fc98160eb3586dc176 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 12:59:30.215595  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 86aa6466101d44fc98160eb3586dc176 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-86aa6466101d44fc98160eb3586dc176
I20260709 12:59:30.223666  1645 tablet_copy_source_session.cc:215] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:30.226703  2991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86aa6466101d44fc98160eb3586dc176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:30.248334  2991 tablet_copy_client.cc:806] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:30.249078  2991 tablet_copy_client.cc:670] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:30.257037  2991 tablet_copy_client.cc:538] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:30.266835  2991 tablet_bootstrap.cc:492] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:30.374347   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:30.428296  2991 tablet_bootstrap.cc:492] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:30.429652  1552 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:30.430882  1701 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:59:30.442440  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 63297.2us
I20260709 12:59:30.452415  2991 tablet_bootstrap.cc:492] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:30.453298  2991 ts_tablet_manager.cc:1403] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.187s	user 0.026s	sys 0.011s
I20260709 12:59:30.456115  2989 ts_tablet_manager.cc:933] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:30.447845  1626 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:30.459954  1628 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:30.463883  3000 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:30.458591  2991 raft_consensus.cc:359] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:30.474584  2991 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:30.475243  3002 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:30.475340  2991 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:30.479250  2991 ts_tablet_manager.cc:1434] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:59:30.480873  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-86aa6466101d44fc98160eb3586dc176 received from {username='slave'} at 127.0.0.1:59260
I20260709 12:59:30.481293  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-86aa6466101d44fc98160eb3586dc176 on tablet 86aa6466101d44fc98160eb3586dc176 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:30.485497  2270 raft_consensus.cc:1217] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:30.504849  2965 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:30.536094  2979 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:59:30.554306  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44249.7us
I20260709 12:59:30.562538  2989 tablet_copy_client.cc:323] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:30.566784  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet 423fad3d086c4c18b5d84ecfeeb2957a from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:30.567344  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet 423fad3d086c4c18b5d84ecfeeb2957a from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-423fad3d086c4c18b5d84ecfeeb2957a
I20260709 12:59:30.582231  2270 raft_consensus.cc:1217] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:30.591146  1719 tablet_copy_source_session.cc:215] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:30.595692   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:30.649085  2270 raft_consensus.cc:1217] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:30.675020  2989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423fad3d086c4c18b5d84ecfeeb2957a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:30.709486  2989 tablet_copy_client.cc:806] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:30.710266  2989 tablet_copy_client.cc:670] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:30.718619  1701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:30.719234  1701 raft_consensus.cc:606] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:30.724763  1626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 12:59:30.725463  1626 raft_consensus.cc:606] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:30.728690  1554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:38648
I20260709 12:59:30.729259  1554 raft_consensus.cc:606] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:30.729275  2989 tablet_copy_client.cc:538] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:30.737448   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:30.738826   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:30.740761  2989 tablet_bootstrap.cc:492] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:30.768131  2989 tablet_bootstrap.cc:492] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:30.769138  2989 tablet_bootstrap.cc:492] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:30.769886  2989 ts_tablet_manager.cc:1403] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.029s	user 0.024s	sys 0.005s
I20260709 12:59:30.772948  2989 raft_consensus.cc:359] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:30.773838  2989 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:30.774596  2989 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:30.777525  2989 ts_tablet_manager.cc:1434] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:30.779819  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-423fad3d086c4c18b5d84ecfeeb2957a received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:30.780189  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-423fad3d086c4c18b5d84ecfeeb2957a on tablet 423fad3d086c4c18b5d84ecfeeb2957a with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:30.889982  2998 raft_consensus.cc:993] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:30.890583  3001 raft_consensus.cc:1081] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:30.890734  2973 raft_consensus.cc:1064] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:30.893375  1626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:42252
I20260709 12:59:30.893302  2973 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:30.893988  1626 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:30.894419  1626 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.900558  1701 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:30.901901  2833 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:30.903822  1626 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:30.906478  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:30.907032  1554 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.912329  2270 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:30.913879  2833 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:30.914502  1554 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:30.916092  1600 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:30.917011  2887 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:30.922190  2965 raft_consensus.cc:993] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:30.922760  2965 raft_consensus.cc:1081] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:30.924698  1701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48150
I20260709 12:59:30.925246  1701 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:30.925607  1701 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.935333  1552 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:30.937363  2833 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:30.945093  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:30.945729  1707 raft_consensus.cc:3055] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:30.946056  1707 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:30.946820  1707 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:30.947813  1707 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.955376  1707 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:30.954196  2973 raft_consensus.cc:993] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:30.957857  2973 raft_consensus.cc:1081] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:30.961535  2271 raft_consensus.cc:1217] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:30.963944  1704 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48138
I20260709 12:59:30.964787  1704 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:30.965204  1704 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.975389  2973 raft_consensus.cc:2955] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:30.965708  1701 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:30.991901  2271 raft_consensus.cc:2955] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:30.993803  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:30.994424  1554 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:30.994714  1554 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:30.995801  1554 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:30.996865  1554 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.004532  1704 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:31.016839  2965 raft_consensus.cc:1064] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:31.019141  2965 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:30.956786  1626 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:31.032608  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:31.033631  1558 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.042526  2887 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:31.043864  2887 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:31.045306  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:31.043056  1704 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:31.047883  1631 raft_consensus.cc:3055] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:31.048280  1631 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:31.049597  1558 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:31.049038  1631 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:31.073541  1631 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:31.078011  1674 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:31.070451  1701 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:31.072088  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64568.3us
I20260709 12:59:31.087675  1554 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:31.089747  1631 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:31.090420  1705 raft_consensus.cc:2955] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.101858  2998 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:31.102711  2998 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:31.106163  2270 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:31.113489  3003 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:31.103668  2998 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 12:59:31.124914  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46996.7us
I20260709 12:59:31.126286  1626 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:31.135918  1553 raft_consensus.cc:2955] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.141671  3003 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:31.192165  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 129481us
I20260709 12:59:31.197540  1454 catalog_manager.cc:5697] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:31.199921  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 134792us
I20260709 12:59:31.202916  1455 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.209272  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:31.210084  2270 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.215867  2966 raft_consensus.cc:2955] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.227157  1628 raft_consensus.cc:2955] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.234261  1705 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:31.244509  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:31.245347  2998 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:31.245874  2998 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:31.246706  2998 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:31.253244  2271 raft_consensus.cc:2955] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.262852  2965 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:31.263530  2270 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:31.269750  1454 catalog_manager.cc:5697] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.287289  1456 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 2, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:31.297113  1626 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:31.302402  1704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:31.303071  1704 raft_consensus.cc:606] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:59:31.306258  1705 raft_consensus.cc:2955] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.308122  1701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:31.308743  1701 raft_consensus.cc:606] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Received request to transfer leadership
W20260709 12:59:31.310227  1445 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 86aa6466101d44fc98160eb3586dc176 already in progress [suppressed 1 similar messages]
I20260709 12:59:31.313093  1704 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:31.314216  2271 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:31.315075  2887 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:31.316032  3025 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:31.318437  1456 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 3 to 4, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:31.330122  3023 raft_consensus.cc:2955] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.332489  2271 raft_consensus.cc:2955] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.337503  1705 raft_consensus.cc:2955] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.348806  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f6a8ad007074cfe96f8430d622f5f80 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:31.353575  1704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48128
I20260709 12:59:31.354264  1704 raft_consensus.cc:606] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:59:31.359442  1456 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 3 to 4, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:31.365304  1506 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:59:31.365805  1506 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 86aa6466101d44fc98160eb3586dc176 already in progress
W20260709 12:59:31.366138  1506 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 86aa6466101d44fc98160eb3586dc176 already in progress
I20260709 12:59:31.372104  1543 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f6a8ad007074cfe96f8430d622f5f80 with delete_type TABLET_DATA_TOMBSTONED (TS 87144ea1a4a14ab8b942fb426159f031 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42084
I20260709 12:59:31.375211  3043 tablet_replica.cc:333] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 12:59:31.376375  3043 raft_consensus.cc:2243] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:31.377427  3043 raft_consensus.cc:2272] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:31.382812  3043 ts_tablet_manager.cc:1916] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:31.403414  3043 ts_tablet_manager.cc:1929] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:31.403798  3043 log.cc:1199] T 2f6a8ad007074cfe96f8430d622f5f80 P 87144ea1a4a14ab8b942fb426159f031: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-0-root/wals/2f6a8ad007074cfe96f8430d622f5f80
I20260709 12:59:31.405370  1444 catalog_manager.cc:5028] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): tablet 2f6a8ad007074cfe96f8430d622f5f80 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:31.567200  3034 raft_consensus.cc:1064] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
W20260709 12:59:31.569144  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.570992  3034 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:31.572656  2271 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Advancing to term 2
I20260709 12:59:31.583650  2271 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:31.585109  2998 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:31.593158  2270 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:31.595422  1554 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:31.596333  1628 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:31.597944  3034 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:31.599032  3029 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:31.603005  3029 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:31.617729  1626 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:31.632318  1553 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:31.638628  2975 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:31.640309  2975 raft_consensus.cc:1064] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
W20260709 12:59:31.640758  2975 raft_consensus.cc:1068] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Unable to promote non-voter 6923294c847b48ebb577e0935d316aa3: Service unavailable: leader transfer in progress
I20260709 12:59:31.643887  3034 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:31.645162  1554 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.648053  3020 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:31.674484  2265 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:31.675403  3001 raft_consensus.cc:993] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:31.675938  3001 raft_consensus.cc:1081] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:31.680233  1634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:42252
I20260709 12:59:31.680769  1634 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:31.681118  1634 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.682444  3001 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:31.688879  1634 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:31.690007  1631 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.690089  3026 raft_consensus.cc:2955] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.698284  3001 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:31.699746  1634 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:31.702634  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:31.708644  1634 raft_consensus.cc:2955] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.711166  1705 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.713449  3020 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:31.728650  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:31.729314  1556 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:31.729720  3034 raft_consensus.cc:3055] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:31.730355  3034 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:31.731457  1455 catalog_manager.cc:5697] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.739918   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:31.731453  3034 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:31.768738  3034 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:31.767782  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50260us
I20260709 12:59:31.789795  1556 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:31.828608  1704 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:31.835136  1601 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:31.839496  2887 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:31.840008  2887 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:31.840814  2887 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:31.846570  1554 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:31.876513  2270 raft_consensus.cc:2955] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.838181  1556 raft_consensus.cc:2955] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.888005  1552 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:31.921561  1453 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 2 to 3, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:31.926453  1705 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:31.928483  2271 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:31.930215  2965 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:31.943686   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:31.904564  1704 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:31.956974  3002 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:31.966419  2265 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:31.969897  3029 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:31.970284  1556 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:31.972147  3029 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:31.974697  3003 raft_consensus.cc:2955] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.977954  2975 raft_consensus.cc:2955] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.982928  2265 raft_consensus.cc:2955] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:31.991340  2266 raft_consensus.cc:2955] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:32.002461  1445 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 423fad3d086c4c18b5d84ecfeeb2957a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:32.007170  1704 raft_consensus.cc:2955] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:32.011863  1444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eda09757c25a4279a4c93c29eeff416a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:32.018219  1456 catalog_manager.cc:5697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.025177  1558 raft_consensus.cc:2955] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:32.036731  1625 tablet_service.cc:1558] Processing DeleteTablet for tablet 423fad3d086c4c18b5d84ecfeeb2957a with delete_type TABLET_DATA_TOMBSTONED (TS 7e99891af85f4b10aa1cc2da6aa33082 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42238
I20260709 12:59:32.037870  1455 catalog_manager.cc:5697] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 3 to 4, VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.044700  1634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 12:59:32.045374  1634 raft_consensus.cc:606] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:32.044781  3059 tablet_replica.cc:333] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 12:59:32.048014  3059 raft_consensus.cc:2243] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.048722  3059 raft_consensus.cc:2272] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.052412  1634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 12:59:32.053016  1634 raft_consensus.cc:606] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:32.054431  1625 tablet_service.cc:1558] Processing DeleteTablet for tablet eda09757c25a4279a4c93c29eeff416a with delete_type TABLET_DATA_TOMBSTONED (TS 7e99891af85f4b10aa1cc2da6aa33082 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42238
I20260709 12:59:32.055794  1704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:32.056026  3059 ts_tablet_manager.cc:1916] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:32.056423  1704 raft_consensus.cc:606] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:32.061147   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:32.064033   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:32.074365  3059 ts_tablet_manager.cc:1929] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:32.075717  3059 log.cc:1199] T 423fad3d086c4c18b5d84ecfeeb2957a P 7e99891af85f4b10aa1cc2da6aa33082: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/wals/423fad3d086c4c18b5d84ecfeeb2957a
I20260709 12:59:32.077252  1443 catalog_manager.cc:5028] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): tablet 423fad3d086c4c18b5d84ecfeeb2957a (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:32.077399  3059 tablet_replica.cc:333] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 12:59:32.078480  3059 raft_consensus.cc:2243] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:32.079066  3059 raft_consensus.cc:2272] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:32.082121  3059 ts_tablet_manager.cc:1916] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:32.095151  3059 ts_tablet_manager.cc:1929] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:32.095544  3059 log.cc:1199] T eda09757c25a4279a4c93c29eeff416a P 7e99891af85f4b10aa1cc2da6aa33082: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-1-root/wals/eda09757c25a4279a4c93c29eeff416a
I20260709 12:59:32.096902  1443 catalog_manager.cc:5028] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): tablet eda09757c25a4279a4c93c29eeff416a (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 12:59:32.173974  2887 raft_consensus.cc:993] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 12:59:32.174506  3020 raft_consensus.cc:1081] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Signalling peer 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 12:59:32.175769  1556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:42086
I20260709 12:59:32.176149  1556 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:32.176362  1556 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.180836  1556 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:32.182235  1556 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:32.182893  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:32.183410  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:32.183451  1634 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:32.183981  1634 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:32.184026  2265 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.186851  1634 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:32.188138  1634 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.195104  1634 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:32.194129  2265 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:32.196545  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:32.197358  2966 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:32.197875  2966 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:32.198721  2966 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:32.208451  1455 catalog_manager.cc:5697] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 1 to 2, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.240993  1704 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:32.242100  3020 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:32.246376  2887 raft_consensus.cc:993] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:32.246831  3023 raft_consensus.cc:1081] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:32.250065  2265 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Advancing to term 3
I20260709 12:59:32.254735  1704 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48138
I20260709 12:59:32.255353  1704 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:32.255716  1704 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.258628  1556 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:32.261219  3023 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:32.262492  1704 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:32.263543  1705 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:32.264406  1704 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:32.265642  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:32.266184  1634 raft_consensus.cc:3055] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:32.266633  1634 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:32.267491  1634 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:32.268311  3017 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:32.269431  1634 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.272011  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:32.272611  1556 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.275687  1634 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:32.276741  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:32.277576  3034 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:32.278067  3034 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:32.278867  3034 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:32.279850  1556 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:32.280577  1553 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: [2.3-3.4]
I20260709 12:59:32.282130  2265 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 3 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:32.291397  1455 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 3 to 4, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:32.355340  3034 raft_consensus.cc:993] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:32.355906  3029 raft_consensus.cc:1081] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:32.357998  2265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58716
I20260709 12:59:32.358613  2265 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:32.358938  2265 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.363672  2265 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:32.365391  2265 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:32.366060  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:32.366312  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:32.366674  1634 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.367024  1705 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:32.367378  1705 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:32.368180  1705 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:32.369359  1705 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:32.372902  1634 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:32.373908  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:32.374082  1705 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:32.374624  2999 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:32.375172  2999 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:32.375948  2999 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:32.385335  1455 catalog_manager.cc:5697] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.714741  2265 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 3 LEARNER]: Advancing to term 4
I20260709 12:59:32.720496  2265 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:32.721596  3034 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:32.726986  3034 raft_consensus.cc:1064] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
W20260709 12:59:32.727357  3034 raft_consensus.cc:1068] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Unable to promote non-voter 6923294c847b48ebb577e0935d316aa3: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:32.776435  1705 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:32.777609  3027 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:32.785022  1628 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:32.788058  2966 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:32.790434  1628 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:32.791132  1634 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:32.792686  3027 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:32.793125  3034 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:32.795621  2265 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:32.802614  2966 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:59:32.851415  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 47045.4us
I20260709 12:59:32.915771  1556 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:32.937446  3029 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:32.950465  3076 raft_consensus.cc:1064] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:32.956339  3076 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:32.970801  2266 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:32.973006  1628 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:32.973567  3075 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:32.975380  3029 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:32.978852  1556 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:32.983626  3029 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:32.986428  3074 raft_consensus.cc:2955] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:32.988260  2266 raft_consensus.cc:2955] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:32.993391  1553 raft_consensus.cc:2955] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:33.006419  1634 raft_consensus.cc:2955] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:33.008538  1453 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 2 to 6, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.064899   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:33.131644  1553 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:33.137393  1634 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:33.137429  1705 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:33.137532  1524 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8fae2aaea9349b488e73c3574050a18. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.138737  3002 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:33.139551  3072 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:33.147714  3002 raft_consensus.cc:2955] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.149295  1634 raft_consensus.cc:2955] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.151512  1705 raft_consensus.cc:2955] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.163192  1704 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:33.165583  1456 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
W20260709 12:59:33.175915  1673 consensus_peers.cc:597] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3fe250573e1c4fdd9d93dbaaa494b367. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.176831  1553 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:33.177906  1628 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:33.178184  3075 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:33.179524  3076 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:33.188198  3075 raft_consensus.cc:2955] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.191617  1553 raft_consensus.cc:2955] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.193064  1628 raft_consensus.cc:2955] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.209486  1454 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.211452  1631 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:33.223115  1704 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:59:33.224574  1599 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ab2c76ce9ba4519b8beb7decd86314d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.224777  3023 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:33.227795  1553 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:59:33.230002  3023 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:33.243034  2887 raft_consensus.cc:2955] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.246912  1704 raft_consensus.cc:2955] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.246956  1556 raft_consensus.cc:2955] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.257688  1705 consensus_queue.cc:237] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:33.262840  1456 catalog_manager.cc:5697] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index -1 to 3, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.281083  1631 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:33.281342  1673 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7270b72e069f42daa3f82eaa77d9e299. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.281635  1556 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:33.282732  3074 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:33.284327  3076 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:33.296891  3074 raft_consensus.cc:2955] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.297634  1556 raft_consensus.cc:2955] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.301956  1631 raft_consensus.cc:2955] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.316352  1456 catalog_manager.cc:5697] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index -1 to 2, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:33.374707   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:33.432884  1553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:38648
I20260709 12:59:33.433548  1553 raft_consensus.cc:606] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:33.439605  1701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:33.440249  1701 raft_consensus.cc:606] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Received request to transfer leadership to TS 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:33.444303   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:33.445693   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:33.558943  3096 ts_tablet_manager.cc:933] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:33.560983  3096 tablet_copy_client.cc:323] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:39635
I20260709 12:59:33.562829  1569 tablet_copy_service.cc:140] P 87144ea1a4a14ab8b942fb426159f031: Received BeginTabletCopySession request for tablet b8fae2aaea9349b488e73c3574050a18 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:44176)
I20260709 12:59:33.563400  1569 tablet_copy_service.cc:161] P 87144ea1a4a14ab8b942fb426159f031: Beginning new tablet copy session on tablet b8fae2aaea9349b488e73c3574050a18 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:44176: session id = 6923294c847b48ebb577e0935d316aa3-b8fae2aaea9349b488e73c3574050a18
I20260709 12:59:33.569556  1569 tablet_copy_source_session.cc:215] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:33.572607  3096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fae2aaea9349b488e73c3574050a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:33.589519  3096 tablet_copy_client.cc:806] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:33.590389  3096 tablet_copy_client.cc:670] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:33.593771  3096 tablet_copy_client.cc:538] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:33.602883  3096 tablet_bootstrap.cc:492] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:33.628968  3098 ts_tablet_manager.cc:933] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:33.629971  3096 tablet_bootstrap.cc:492] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:33.630949  3096 tablet_bootstrap.cc:492] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:33.631600  3096 ts_tablet_manager.cc:1403] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.029s	user 0.026s	sys 0.000s
I20260709 12:59:33.634454  3096 raft_consensus.cc:359] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:33.635324  3096 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:33.635959  3096 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:33.638688  3096 ts_tablet_manager.cc:1434] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:33.642467  3098 tablet_copy_client.cc:323] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:33.644017  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet 3fe250573e1c4fdd9d93dbaaa494b367 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:33.644521  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet 3fe250573e1c4fdd9d93dbaaa494b367 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-3fe250573e1c4fdd9d93dbaaa494b367
I20260709 12:59:33.648355  1569 tablet_copy_service.cc:342] P 87144ea1a4a14ab8b942fb426159f031: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-b8fae2aaea9349b488e73c3574050a18 received from {username='slave'} at 127.0.0.1:44176
I20260709 12:59:33.648838  1569 tablet_copy_service.cc:434] P 87144ea1a4a14ab8b942fb426159f031: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-b8fae2aaea9349b488e73c3574050a18 on tablet b8fae2aaea9349b488e73c3574050a18 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:33.652266  1719 tablet_copy_source_session.cc:215] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:33.655730  3098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fe250573e1c4fdd9d93dbaaa494b367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:33.688074  3098 tablet_copy_client.cc:806] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:33.688730  3098 tablet_copy_client.cc:670] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:33.693557  3098 tablet_copy_client.cc:538] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:33.703044  3098 tablet_bootstrap.cc:492] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:33.724141  3098 tablet_bootstrap.cc:492] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:33.725102  3098 tablet_bootstrap.cc:492] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:33.725816  3098 ts_tablet_manager.cc:1403] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 12:59:33.728924  3098 raft_consensus.cc:359] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:33.729839  3098 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:33.730600  3098 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:33.733377  3098 ts_tablet_manager.cc:1434] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:59:33.735690  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-3fe250573e1c4fdd9d93dbaaa494b367 received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:33.736171  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-3fe250573e1c4fdd9d93dbaaa494b367 on tablet 3fe250573e1c4fdd9d93dbaaa494b367 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:33.837854  3098 ts_tablet_manager.cc:933] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:33.839596  3098 tablet_copy_client.cc:323] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 12:59:33.841104  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 0ab2c76ce9ba4519b8beb7decd86314d from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 12:59:33.841657  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 0ab2c76ce9ba4519b8beb7decd86314d from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-0ab2c76ce9ba4519b8beb7decd86314d
I20260709 12:59:33.851078  1645 tablet_copy_source_session.cc:215] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:33.855858  3098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab2c76ce9ba4519b8beb7decd86314d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:33.874786  3098 tablet_copy_client.cc:806] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:33.875402  3098 tablet_copy_client.cc:670] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:33.879742  3098 tablet_copy_client.cc:538] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:33.884210  3096 ts_tablet_manager.cc:933] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:33.896095  3098 tablet_bootstrap.cc:492] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:33.924587  3096 tablet_copy_client.cc:323] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 12:59:33.928896  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet 7270b72e069f42daa3f82eaa77d9e299 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 12:59:33.929504  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet 7270b72e069f42daa3f82eaa77d9e299 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-7270b72e069f42daa3f82eaa77d9e299
I20260709 12:59:33.930968  3098 tablet_bootstrap.cc:492] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:33.932001  3098 tablet_bootstrap.cc:492] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:33.932749  3098 ts_tablet_manager.cc:1403] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.005s
I20260709 12:59:33.937292  3098 raft_consensus.cc:359] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:33.938254  3098 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:33.938961  3098 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:33.942785  3098 ts_tablet_manager.cc:1434] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:59:33.947014  2966 raft_consensus.cc:993] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:33.947506  2966 raft_consensus.cc:1081] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 12:59:33.950945  1631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:42256
I20260709 12:59:33.951471  1631 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.951793  1631 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.965270  1719 tablet_copy_source_session.cc:215] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:33.965620  1631 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:33.968245  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:33.971575  1558 raft_consensus.cc:3055] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:33.971920  1558 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:33.972878  1558 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:33.968585  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-0ab2c76ce9ba4519b8beb7decd86314d received from {username='slave'} at 127.0.0.1:59260
I20260709 12:59:33.974645  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-0ab2c76ce9ba4519b8beb7decd86314d on tablet 0ab2c76ce9ba4519b8beb7decd86314d with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:33.968659  1631 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:33.980402  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:33.981112  2271 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:33.986168  1558 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:34.003643  2271 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:34.008636  1599 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:34.048022  3076 raft_consensus.cc:993] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: : Instructing follower 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:34.064509  3076 raft_consensus.cc:1081] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Signalling peer 6923294c847b48ebb577e0935d316aa3 to start an election
I20260709 12:59:34.449823   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:34.482926  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 474395us
W20260709 12:59:34.490430  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.893126  3111 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:34.893992  3111 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:34.897495  3111 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:34.951818  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.959383  3111 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:34.960311  3111 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:34.963889  3111 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.068840  3111 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.069717  3111 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:35.245395  3115 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.246104  3115 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:35.248762  3115 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.249382  3115 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.288443  3114 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:35.289373  3114 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.291977  3114 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.304448  3111 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.342742  3112 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 12:59:35.343502  3002 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.072s	user 0.007s	sys 0.009s
W20260709 12:59:35.377944  3002 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.007s	sys 0.009s
I20260709 12:59:35.346083  3117 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.380000  3117 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.382382  3117 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.351910  3116 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.249960  3115 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:35.386133  3116 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:35.387889  3115 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.377202  3112 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.448330  3112 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.483433  3116 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.574910  3002 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.576402  3117 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.575297  3111 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.577560  3117 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.578801  3111 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:35.583209  3115 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.584159  3115 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:35.586625  3112 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.587443  3112 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.588812  3115 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.589782  3114 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.578756  3116 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.590929  3114 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:35.592695  3112 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.591472  3116 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.576712  3002 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:35.580331  3120 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.598510  3119 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.595642  3117 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.596230  3116 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.597224  3111 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.600489  3121 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 12:59:35.597754  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.593817  3114 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.619494  3112 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.617627  3121 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:35.624127  3112 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.625329  3121 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.627264  3112 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.629642  3002 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.597582  3118 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 12:59:35.631960  1558 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.645s	user 0.024s	sys 0.005s
I20260709 12:59:35.632791  1558 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
W20260709 12:59:35.633736  1558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1252) took 1665 ms (client timeout 1705 ms). Trace:
W20260709 12:59:35.634344  1558 rpcz_store.cc:269] 0709 12:59:33.967871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.967999 (+   128us) service_pool.cc:224] Handling call
0709 12:59:35.633571 (+1665572us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.626122  3120 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.642225  3121 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.644701  3121 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:35.630697  3118 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.648785  3114 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.650305  3114 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:35.662897  3114 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.688233  3125 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:35.688652  3118 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.680298  3112 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.662708  3111 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.689251  3125 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.690331  3121 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.642072  3119 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.702266  3114 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.710307  3114 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.690122  3112 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.716758  3112 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.709182  3125 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.718230  3128 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:35.720412  3127 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.721761  3128 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.727388  3128 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:35.728260  3120 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:35.672143  3117 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.729297  3127 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.713725  3114 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.671790  3115 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.698791  3118 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.740671  1454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 226) took 1505 ms. Trace:
I20260709 12:59:35.741300  1454 rpcz_store.cc:276] 0709 12:59:34.234845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.248065 (+ 13220us) service_pool.cc:224] Handling call
0709 12:59:35.740350 (+1492285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317,"reported_tablets":1}
I20260709 12:59:35.742561  3115 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:35.744309  3117 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.684141  3122 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.672254  3116 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.735378  3111 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:35.752344  3130 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:35.754447  3127 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.771214  3131 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.731225  3123 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:35.746263  3128 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.751113  3118 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.774153  3115 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.758752  3114 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.773183  3120 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.776412  3123 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.772125  3131 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:35.790298  3116 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:35.796279  3127 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.751114  3122 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.831300  3114 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.914096  3114 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.880558  3118 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:35.882393  3108 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:35.833614  3128 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.842351  3117 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:35.933013  3105 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:35.936272  3075 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:35.937124  3075 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:35.852710  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 81126.4us
I20260709 12:59:35.929941  3119 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.899901  3120 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.984293  3127 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.987042  3127 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:35.826013  3130 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.959007  3108 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:35.987329  3120 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.092900  3120 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.071475  3136 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.093727  3120 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.094108  3136 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.063395  3111 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.020560  3122 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.067780  3128 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.059999  3132 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:35.980034  3116 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.097313  3132 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.002324  3123 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:35.987918  2887 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.055040  3118 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:35.983443  3119 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.098995  2887 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.099309  3118 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.100006  3119 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.101527  2887 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.062354  3133 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.071957  3126 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.096239  3128 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.108476  3132 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.109241  3152 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.111472  3148 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.113755  3146 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.094189  3108 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.097734  3130 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.101698  3118 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.118046  3143 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.118779  3075 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.143976  3142 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.144905  3142 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.140551  3132 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.166451  3143 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.184178  3143 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.160116  3126 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.142302  3128 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.166826  3130 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.207808  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.208647  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.209825  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.210235  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.210398  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.209757  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.211127  1555 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 1.
I20260709 12:59:36.211318  1556 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:36.211572  1559 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 1.
I20260709 12:59:36.176730  3108 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.168323  3152 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.215628  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.197422  3119 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.219892  2268 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:36.223542  3130 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.227438  3128 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.228034  3134 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.228317  3096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7270b72e069f42daa3f82eaa77d9e299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:36.179823  3105 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:36.232613  3126 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.141635  3148 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.197677  3132 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.245287  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.246017  2268 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:59:36.247527  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.248615  3151 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.247619  3155 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.233538  3108 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.161703  3133 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.178018  3146 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.245352  3104 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.256978  3130 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.249339  3151 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.277791  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.279174  3108 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.279786  3108 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.228854  3134 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:36.277045  3142 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.287189  3153 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.294567  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.289345  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.279211  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.280304  3108 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.296680  1554 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 1.
I20260709 12:59:36.296029  2268 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:59:36.298595  2266 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:36.302896  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.303646  1551 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:59:36.290172  3120 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:36.313576  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.294368  3135 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.289376  3158 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.287130  3155 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.322594  3131 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.317507  3145 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.322404  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.304656  3104 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.335275  3150 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.336598  2265 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:36.327903  3137 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.330958  3148 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.336913  3145 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.330184  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.333130  3159 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.330579  3138 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.332980  3144 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.333174  3139 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.345537  3152 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.365505  3120 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.337616  3149 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.359392  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.362399  3155 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.358793  3133 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.334398  3153 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.366423  3132 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.357628  3140 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.363440  3148 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.333772  3105 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.370704  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.387099  3168 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.367765  2264 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:59:36.371555  3120 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.407230  3165 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.414731  3164 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.397797  2266 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:36.358347  3158 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.401261  3155 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.378005  3160 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.422154  3155 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.411767  3151 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.364214  3135 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.428607  3135 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.429320  3135 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.430016  3135 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.432711  3135 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.433254  3135 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.401077  3140 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.435949  3140 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.436535  3163 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 12:59:36.423502  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49695.1us
I20260709 12:59:36.396727  3144 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.441488  3144 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.443859  3140 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.444615  3075 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.444598  3140 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.445361  3075 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.446923  3140 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.447408  3075 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.447533  3140 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.448122  3140 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.382534  3159 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.433949  3135 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.453167  3159 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.408202  3165 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.453377  3135 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.383250  3150 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.416736  3148 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.422910  3160 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.437237  3163 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.466492  3159 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.466224  3108 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.454166  3134 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.471333  3175 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.409586  3138 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.415280  3139 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.414649  3168 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.405612  3149 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.481233  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.482849  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.483089  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.483201  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.396446  3137 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:36.483791  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.483862  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.486002  3174 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.486135  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.486476  3167 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.464423  3144 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.483660  3169 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.473444  3146 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.465690  3162 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.492743  3131 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.454526  3164 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.509372  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.509553  3156 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.511236  1626 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:36.494784  2264 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:59:36.503113  2266 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:59:36.513154  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.493587  3159 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.513325  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.493978  2263 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:36.523917  3149 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.521757  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:36.503415  3175 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.510049  3171 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.542335  1633 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 1.
I20260709 12:59:36.523919  3165 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:36.520593  3174 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.525379  3144 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.550879  3140 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.516146  3162 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.513497  3169 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.555186  3155 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.589843  3122 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:36.513188  3167 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.519454  3156 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.603731  3165 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.550413  3131 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.620509  1524 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:36.606750  3150 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.612880  2264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
 from {username='slave'} at 127.0.0.1:58716
I20260709 12:59:36.610112  3076 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.610365  3134 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.623169  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:36.612082  3108 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.623590  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.619184  3122 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.645910  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:36.643569  3170 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:36.647058  3170 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.618461  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.643642  3178 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.649837  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.563546  3171 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:36.623346  3116 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:36.660578  1629 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:36.666074  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.650954  3111 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:36.666695  1708 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:36.623140  3176 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.670047  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.670382  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.649289  3122 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:36.650120  3178 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.674873  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.651218  3138 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.664283  3163 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.669930  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.676177  2267 raft_consensus.cc:1217] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:36.676693  2265 raft_consensus.cc:1217] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:36.661295  3116 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.679486  3116 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:36.660879  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.680262  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.662647  3148 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.651818  2264 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:36.662936  3170 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.676872  3162 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.671221  3165 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:36.665400  3134 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.671548  3111 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.695662  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.697242  2264 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:36.670923  3175 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.702514  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.677256  3139 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.705210  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:36.703157  3144 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.695662  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.678524  3108 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.702795  3111 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:36.711735  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.675376  3076 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.705040  3166 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.727257  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.728190  1708 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:36.716822  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.730846  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.736931  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.737162  3131 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.740609  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.740914  3171 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.741219  3108 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.741940  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.743078  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.729669  3164 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.744165  1629 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 1.
I20260709 12:59:36.748853  3136 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.751008  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.751674  1708 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:36.751789  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.752540  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.752843  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.752940  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.753588  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.754233  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.754402  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.756089  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.756732  1708 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:36.757522  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.758302  3174 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.757679  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.755478  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.762444  1703 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:59:36.762871  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.763466  1633 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:36.764643  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.765178  3156 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.742614  1560 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 1.
W20260709 12:59:36.736943  2292 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5060 after lost signal to thread 434
I20260709 12:59:36.767030  3178 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:36.767482  2292 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5740 after lost signal to thread 1492
I20260709 12:59:36.772604  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.774996  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.775354  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.775960  1626 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:36.770337  3139 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.776837  3139 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.777626  3165 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.778007  3137 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.778388  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.778970  3139 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.778530  3134 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.782313  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.706418  3176 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.770958  3171 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.768118  3160 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.783731  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.784123  3137 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.790913  3137 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:36.791920  3171 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:36.793099  3104 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.793309  3137 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.783905  3166 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.759361  1635 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 1.
I20260709 12:59:36.739532  3180 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:36.798010  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.798650  1556 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 1.
I20260709 12:59:36.744447  3167 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:36.799404  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 94274.4us
I20260709 12:59:36.797531  3181 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:36.801800  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.801998  3181 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.802459  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.802757  3181 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:36.803576  3180 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.807593  3180 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:36.808111  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.808671  3153 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.809551  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:36.810326  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.811614  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.814112  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.815440  3168 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.815641  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.819298  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.819877  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.820693  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.821275  2266 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:59:36.834203  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:36.800647  2292 debug-util.cc:398] Leaking SignalData structure 0x7b0800348300 after lost signal to thread 1584
I20260709 12:59:36.839838  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.840193  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.840998  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.841197  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.841495  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.842259  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.842278  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.844103  3185 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:36.844626  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.844961  3185 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:36.845974  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.846793  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.845382  3185 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:36.849390  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.850157  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.852347  3176 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.850307  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.839574  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:36.855049  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:36.858279  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.850384  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.854266  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.860793  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.859223  2234 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:36.861876  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:36.862977  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 56049.8us
I20260709 12:59:36.866992  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.867857  3131 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:36.868299  3131 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.868772  3131 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:36.869042  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.835767  3171 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.868115  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.871626  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:36.873896  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.874011  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:36.846925  3166 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.876418  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.854301  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.882843  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.883440  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.878446  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.885236  3126 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:36.870545  3136 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:36.888546  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.889071  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.890456  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.867857  1635 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:59:36.897464  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.881898  3184 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:36.904343  3158 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:36.882547  1629 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:59:36.928336  3184 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:36.928855  3184 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:36.900791  3096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58716 (request call id 434) took 3017 ms. Trace:
I20260709 12:59:36.884423  3116 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.902086  3169 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.901995  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.903285  3145 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.882326  3133 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:59:36.929350  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 74387.4us
I20260709 12:59:36.894304  3136 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 12:59:36.894572  2292 debug-util.cc:398] Leaking SignalData structure 0x7b080030c380 after lost signal to thread 1659
I20260709 12:59:36.872376  3111 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:36.889168  3126 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.959795  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:36.969820  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.929875  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.961362  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.963375  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.963809  3116 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:36.964095  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.964203  1706 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:36.936025  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.966127  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:36.904572  3076 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:36.982807  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.970633  1560 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:36.970980  1556 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:59:36.984717  1552 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:36.978143  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.978734  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.979173  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.979288  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.979593  1551 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:36.980271  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:36.979983  1526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.972s (SENT)
I20260709 12:59:36.982573  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.959463  3133 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:36.967567  3136 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:36.989645  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.990393  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:36.971686  3126 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:36.996953  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.973407  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:36.984074  3182 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.009817  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:37.010251  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.010499  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.011041  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:37.011224  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.011698  2268 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:59:37.011790  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.011986  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.012956  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.003329  3133 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.013352  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:37.013609  3110 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:37.008356  3182 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:37.013017  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.017943  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.019691  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.019822  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:37.020613  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.020865  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.021075  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:37.021209  1560 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:59:37.013259  3122 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:37.011068  2292 debug-util.cc:398] Leaking SignalData structure 0x7b080033b6e0 after lost signal to thread 1733
I20260709 12:59:37.007124  1706 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:37.017138  3182 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.023175  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.022979  3157 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:37.042605  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.042557  1600 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:37.024147  3111 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:37.033010  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:36.943166  3096 rpcz_store.cc:276] 0709 12:59:33.883493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.883630 (+   137us) service_pool.cc:224] Handling call
0709 12:59:33.884540 (+   910us) ts_tablet_manager.cc:934] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
0709 12:59:36.226377 (+2341837us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:36.623551 (+397174us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:36.623675 (+   124us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:36.873147 (+249472us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:36.900168 (+ 27021us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:36.900594 (+   426us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:36.900685 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":228,"tablet-copy.queue_time_us":130,"thread_start_us":39255,"threads_started":1}
I20260709 12:59:37.050127  2269 raft_consensus.cc:1217] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:37.051743  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.046986  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.053359  3145 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.056691  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.056936  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:37.053987  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 45832.9us
I20260709 12:59:37.063678  1600 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:37.068225  1560 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:59:37.071395  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 12:59:37.072105  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 47980us
I20260709 12:59:37.072348  3135 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.072577  3122 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:37.072809  3135 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:37.073166  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:37.014245  3110 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.076515  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.054390  3120 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:37.076782  3180 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.077567  1707 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:37.084018  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.054303  3157 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:37.059098  3145 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 12:59:37.074676  2292 debug-util.cc:398] Leaking SignalData structure 0x7b080034bc60 after lost signal to thread 2295
I20260709 12:59:37.078871  3179 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.095824  3179 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:37.096010  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.096252  3179 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.087493  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.090425  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.091164  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.084385  1559 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:37.091290  3133 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.091815  3157 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.094298  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.094509  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.081279  3169 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.073191  3135 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.105587  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.081434  3159 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:37.088755  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:37.102648  1554 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:37.099975  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.082749  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.106205  1558 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 2: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:37.095284  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.099575  3145 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.113262  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.114089  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:37.130443  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.131487  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:37.130533  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.135126  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.134557  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.114387  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:37.142313  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.158587  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.108521  3169 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:37.174753  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.174674  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.178543  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.111321  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.180299  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.182209  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:37.133903  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.187464  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:37.188583  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:37.179131  1702 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 1.
I20260709 12:59:37.184955  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.114401  3159 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.176563  3169 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.171964  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.200400  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.203089  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:37.188709   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:37.194298  3186 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:37.214942  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.215080  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.215348  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:37.194403  3116 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:37.220814  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.193825  3159 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:37.179492  2264 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.226372  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.232754  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.217224  3070 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:59:37.233276  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.227136  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.229912  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.234721  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.236480  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.221203  3153 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.240142  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:37.240749  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:37.221866  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.223006  3186 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:37.263677  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.224480  3116 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:37.224517  3159 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.238252  3153 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:37.266645  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.263089  1526 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:37.214344  3185 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.209812  3126 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.272045  1526 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:37.264825  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:37.234196  3176 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.275703  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.240721  3190 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:37.275930  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.262130  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.278545  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.278923  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.269279  3186 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.287048  1557 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:37.287844  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.282624  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.282711  3111 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.269924  3116 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.281215  3096 tablet_copy_client.cc:806] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:37.285414  2263 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:37.277195  3122 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:37.273080  2262 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:37.273852  3153 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:37.293002  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 320496us
I20260709 12:59:37.293094  2270 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:37.292557  2236 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.290381  3111 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:37.306663  3176 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.307231  1601 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.308765  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.309476  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.315387  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:37.293937  3168 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.268465  3184 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.281492  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:37.288897  3180 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:37.317665  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 134682us
I20260709 12:59:37.276796  3190 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:37.313277  2235 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:37.319773  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.279568  3075 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:59:37.315369  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.315579  3111 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.318202  3076 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.320693  3120 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:37.310457  3122 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:37.328434  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:37.329562  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 130397us
I20260709 12:59:37.326465  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:59:37.335116  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 58982.8us
I20260709 12:59:37.336560  1552 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:37.344121  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.318150  3110 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:37.334928  3122 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.353281  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.345346  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.328568  3096 tablet_copy_client.cc:670] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:37.327962  3190 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.330811  3167 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:37.362751  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.359236  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.369051  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.361765  3076 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.363677  3187 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.373849  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.372072  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.394991  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.369814  3075 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:37.393785  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 67395.8us
W20260709 12:59:37.399322  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 86120us
I20260709 12:59:37.384410  3153 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:37.393184  2236 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.400327  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.400133  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:37.386453  3132 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:37.385560  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:37.416401  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80534.2us
W20260709 12:59:37.417519  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 72512.4us
I20260709 12:59:37.394323  3187 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:37.396888  3166 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.428076  3186 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:37.406858  3151 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.407570  3109 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.409649  3075 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:37.439002  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.439559  1601 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.414409  3132 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:37.430924  3187 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.421604  3120 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:37.444343  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44271.9us
W20260709 12:59:37.444276  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44067.6us
I20260709 12:59:37.454006  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 12:59:37.455011  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 60074us
I20260709 12:59:37.455792  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.456655  3151 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.435566  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.438099  3075 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.435882  2264 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:37.408447  3135 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:37.443197  3185 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:37.457000  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.452819  3132 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.458920  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.463804  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.468852  1601 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.469998  3184 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:37.470147  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.472107  3168 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.472342  3179 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.466276  3200 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.475647  3186 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:37.442551  3197 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.482293  3196 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.482741  3196 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:37.483114  3196 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.477517  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.484524  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.492789  1673 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.495736  1631 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:37.497189  1601 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.498914  1601 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.500869  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.461297  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.503400  1673 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:37.507194  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 53366.8us
I20260709 12:59:37.484433  3171 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:37.507397  1601 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.479264  3166 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:37.507669  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 71417.6us
I20260709 12:59:37.520273  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:37.521437  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.523201  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:37.524427  1601 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.493861  3076 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.513589  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:37.525537  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 71629.5us
I20260709 12:59:37.493508  3203 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.502661  3105 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.506239  3158 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.502497  3200 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:37.528419  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:37.528899  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.505385  3168 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.508463  3176 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.535727  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.525698  3070 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.525599  3148 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.531810  3179 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:37.545274  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:37.538395  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.507959  3199 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.531525  3166 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.528797  3167 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:37.527856  3076 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:37.563467  3076 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.512307  3202 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.550660  1526 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:37.531546  3171 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.531998  3203 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:37.529038  3195 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:37.554217  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.559975  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.561873  3153 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:37.562376  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.558455  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.564556  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.530050  3205 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.537776  3176 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 12:59:37.566951  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 124115us
W20260709 12:59:37.546586  3193 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:59:37.570075  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.570762  3203 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.572726  3197 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:37.572726  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:37.580077  3133 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:37.534775  3190 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:37.558533  3167 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:37.573256  3195 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:37.601202  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.602497  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:37.568536  3185 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:37.606921  3197 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:37.617172  3185 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:37.599396  3176 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.617627  3185 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.565768  3202 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 12:59:37.574797  3181 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.771s	user 0.000s	sys 0.016s
I20260709 12:59:37.610419  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:59:37.610805  3136 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 12:59:37.611383  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:37.614012  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:37.617295  3197 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.602982  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.597751  3196 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.619304  3116 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.621384  3202 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.618564  3167 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:37.615662  3131 consensus_meta.cc:287] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.746s	user 0.003s	sys 0.022s
I20260709 12:59:37.624359  3181 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.626266  3111 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:37.618788  3195 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:37.717589  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 193266us
I20260709 12:59:37.718601  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.721276  3200 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.636147  3134 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:37.601150  3166 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 12:59:37.712163  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 109249us
I20260709 12:59:37.626657  3136 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.729405  3166 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:37.729965  3166 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:37.730157  3136 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:37.730505  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:37.731444  2265 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:37.723523  1601 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:37.709802  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 188479us
I20260709 12:59:37.733640  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.734781  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.737542  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:37.740736  1557 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:37.715224  3133 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.745283  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.746730  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.748055  1552 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:37.748107  1673 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.749642  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.747792  3148 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.751911  2268 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:37.752646  3168 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.754632  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:37.728109  3134 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:37.761416  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:37.764137  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:37.764433  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:37.748548  3110 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.766287  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:37.756006  3211 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:37.774273  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 72487.6us
I20260709 12:59:37.713382  3122 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:37.719611  3159 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:37.774444  3213 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:37.779218  3213 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:37.759589  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:37.780154  3159 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:37.759106  3116 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:37.779232  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:37.742342  3212 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.783056  3075 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:37.784475  1709 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:37.718372  3131 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.753566  3179 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:37.755210  3169 consensus_meta.cc:287] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
I20260709 12:59:37.779664  3213 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.791182  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.731282  3166 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.794461  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:37.787282  3145 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.003s
I20260709 12:59:37.795368  2262 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 2: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:37.802179  3110 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.802199  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:37.802302  3109 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.813751  3096 tablet_copy_client.cc:538] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:37.793754  3153 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:59:37.820052  3153 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:37.820446  3153 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 12:59:37.821692  3157 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.006s
I20260709 12:59:37.822324  3157 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:37.823531  3096 tablet_bootstrap.cc:492] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 12:59:37.821314  3153 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.824643  3153 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.825033  3157 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:37.827155  3122 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:37.828384  1524 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.829105  1551 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:37.829360  3122 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:37.812727  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:37.830394  3110 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:37.830545  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.831573  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.831909  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.796977  3111 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:37.794330  3212 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:37.837219  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:37.841027  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:37.831255  3122 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:37.802292  3126 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:37.830878  3109 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:59:37.836849  3182 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.786s	user 0.009s	sys 0.003s
I20260709 12:59:37.850548  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:37.810976  3190 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:37.855295  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:37.855881  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:37.857239  1551 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:37.858738  1558 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:37.811384  3145 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:37.863564  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:37.863844  1560 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:37.864701  3145 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:37.857239  1559 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:37.838449  3110 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.840423  3192 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.880461  3185 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.881443  3145 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:37.865433  3187 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.882558  3145 raft_consensus.cc:3055] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:37.882849  3185 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:37.882905  3145 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:37.804250  3169 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.879408  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:59:37.886700  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.850669  3166 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:37.896695  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:37.860357  3111 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:37.899813  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:37.902063  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:37.867205  3182 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.905478  1553 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:37.884143  3187 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:37.909592  3105 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:37.913215  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:37.884214  3171 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:37.909876  3075 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:37.918879  3182 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:37.914354  3203 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.928035  3169 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:37.900763  2262 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:37.930202  3131 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:37.898250  3135 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:37.939234  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:37.944603  2270 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:37.945302  1455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 227) took 1184 ms. Trace:
I20260709 12:59:37.950353  1455 rpcz_store.cc:276] 0709 12:59:36.750349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.754093 (+  3744us) service_pool.cc:224] Handling call
0709 12:59:37.934651 (+1180558us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152630,"reported_tablets":2}
I20260709 12:59:37.914973  3196 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:37.884434  3145 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.861449  3134 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.964488  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:37.900422  3158 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:59:37.969537  3202 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:37.976963  3202 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:37.977015  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:37.977468  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:37.978413  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:37.979102  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:37.990682  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:37.905212  3200 consensus_queue.cc:1059] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:59:37.952287  3181 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:38.005213  3158 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:37.956422  1551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:38648
I20260709 12:59:37.936582  3176 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:38.010398  1551 raft_consensus.cc:606] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
W20260709 12:59:38.006624  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 382589us
W20260709 12:59:38.015988  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 43547.7us
I20260709 12:59:38.004204  3200 raft_consensus.cc:3055] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:38.041728  1705 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.040735  1524 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.011206  3145 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.054836  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:38.009948  3158 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:38.043422  1599 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.059273  3167 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.060032  3076 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:38.045717  3212 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.072849  3212 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:38.073733  3212 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.075285  3212 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.063035  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.039865  3200 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:38.067984  3197 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.071885  3076 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:38.072438  1704 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.098932  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.080513  3213 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:38.081372  3132 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 12:59:38.082661  3176 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:38.083398  3158 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:38.090651  3157 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.115070  3158 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.089913  3211 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:59:38.093681  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1276) took 1126 ms. Trace:
I20260709 12:59:38.094367  3203 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:38.102775  3200 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:38.111316  3134 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.111793  3195 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.113278  3132 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.076340  3159 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.100270  3197 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:38.120011  1553 rpcz_store.cc:276] 0709 12:59:36.967202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.967328 (+   126us) service_pool.cc:224] Handling call
0709 12:59:36.975902 (+  8574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:37.910226 (+934324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.093437 (+183211us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b5400182254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:38.093601 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2137542400}
W20260709 12:59:38.121132  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 80481.4us
I20260709 12:59:38.137538  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.139286  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.121623  3205 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.145629  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.148813  2271 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:38.144693  3182 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.136602  3200 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.149935  3157 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.141932  3159 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.161110  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.143976  3131 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.155293  3181 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:59:38.184105  2235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.015s	sys 0.048s
W20260709 12:59:38.194306  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.195456  2235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.015s	sys 0.048s
W20260709 12:59:38.196244  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 667895us
I20260709 12:59:38.196535  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.197652  2235 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.159814  3157 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 12:59:38.202149  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.013s	sys 0.024s
I20260709 12:59:38.201514  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.204749  2235 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.202227  3120 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.202454  3110 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.159121  3182 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:59:38.214169  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.014s	sys 0.024s
W20260709 12:59:38.208768  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 109939us
I20260709 12:59:38.182215  3208 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.206236  2235 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:38.210532  3214 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.217269  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.220396  2235 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.222092  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:38.222596  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.208958  3126 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.175299  3205 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:59:38.220808  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.227476  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.229904  3215 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:38.201081  3159 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:59:38.237171  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.247294  2235 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.224107  3120 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:38.226704  3136 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.255913  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.253696  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.255940  2235 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.254148  3120 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:38.262848  3120 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.263159  1556 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.262763  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.261655  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.242786  3203 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:38.267051  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.266731  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.269397  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.274298  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.253237  3167 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:38.279197  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.226414  3184 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:59:38.254878  3110 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.274168  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.233811  3181 consensus_queue.cc:1059] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:38.264094  3187 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:38.319506  3187 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.319952  3187 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.283483  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 12:59:38.306505  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 62922.8us
W20260709 12:59:38.318153  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.266678  3216 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:59:38.326870  3184 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.327837  3184 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:38.295135  1555 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.328351  3184 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:38.270946  3203 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:38.281040  3126 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.323906  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 12:59:38.331033  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 75220.6us
I20260709 12:59:38.258831  3122 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:59:38.287106  3132 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:38.285426  3213 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:38.338079  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.338229  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.340875  3179 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.260147  3157 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:38.345052  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.345453  3157 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.284240  3166 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:59:38.309087  3195 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:38.340865  3226 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.348778  1599 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.338564  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.349814  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.350946  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.351532  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.354179  1599 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.354501  1560 raft_consensus.cc:2393] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 2: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:38.346194  3206 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 12:59:38.355953  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.356328  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.356971  1556 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:38.357125  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.357662  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.358314  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.358881  3167 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.359409  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.361020  1558 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 2: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:38.358330  1556 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:38.329365  3184 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.338266  3203 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.388727  1557 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:38.389124  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.355300  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.367272  3227 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.391705  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:38.392939  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.394831  3192 raft_consensus.cc:1064] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:38.396013  1629 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.397348  1629 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:38.398255  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.370965  1709 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.372936  3166 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.373766  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.374835  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.375283  3153 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:38.341192  3210 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.376471  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.376932  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.360158  3133 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.420729  1634 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:38.377776  3076 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:38.352562  3213 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.378491  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:38.342885  3171 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:38.379331  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:38.380028  1704 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.439189  1630 raft_consensus.cc:2393] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 2: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:38.439424  1626 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 2: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:38.379943  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.381028  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.440384  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:38.439153  1631 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:38.440933  1626 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:38.384567  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.441493  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.384999  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.440527  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.447048  3160 raft_consensus.cc:1064] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:38.440485  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:38.449991  1628 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 2: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:38.386804  1526 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.387424  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:59:38.451380  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64652.6us
I20260709 12:59:38.387494  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.387754  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.363655  3105 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.376407  3151 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.401284  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.401690  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.414907  1703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:60964
I20260709 12:59:38.417695  3203 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.420046  3116 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.389922  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.425021  3120 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.377940  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.402122  3166 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:38.429772  3131 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.430287  1708 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 12:59:38.430562  3135 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:38.430825  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:38.431947  3227 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:38.432579  3180 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:38.433099  1601 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.382611  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.445303  3134 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:38.455009  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:38.457999  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:38.459997  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 58798.9us
I20260709 12:59:38.461182  1633 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
W20260709 12:59:38.461287  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 86133.2us
W20260709 12:59:38.461568  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.464335  3116 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:38.462984  3076 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.483220  1703 raft_consensus.cc:606] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.465497  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:38.511520  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:38.512364  1627 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 2: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:38.464854  1707 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.513432  3227 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.484297  2268 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.513870  3227 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:38.487412  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.488047  3191 raft_consensus.cc:993] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:38.486634  3135 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:38.491482  3198 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.515604  3198 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:38.515262  3187 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.515913  3135 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:38.516433  3198 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.517657  3135 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.508605  3180 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:38.519385  1635 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:38.519516  3180 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:38.521550  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 88547.5us
I20260709 12:59:38.515108  3191 raft_consensus.cc:1081] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 12:59:38.499405  3203 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:38.508790  2235 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.510879  3116 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:38.464823  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:38.459408  3122 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.483623  3136 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.522367  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.525286  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.485847  3131 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:38.527666  3231 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.517794  3198 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.538831  3199 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:59:38.534669  3132 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.546679  3199 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.547062  3199 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:38.547989  3199 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.549245  3199 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.524068  2235 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.489359  3120 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:38.491532  1632 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 4: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:38.536674  3187 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:38.538467  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.564024  2268 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:38.564270  3135 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.564291  2270 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:38.564954  1601 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.566010  3135 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.552860  3076 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.553699  3218 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:38.565019  2264 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.567557  3218 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 12:59:38.568560  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44575.4us
I20260709 12:59:38.553574  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.553464  3192 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.555284  3166 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.515043  3227 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.560045  1673 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.533545  3203 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.560725  3110 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:38.569669  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.573945  1599 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.575634  3224 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.568408  3218 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:38.579335  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.580533  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.571050  3135 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.583115  3132 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.583438  3213 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:38.581733  3211 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.581952  3152 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.587607  2270 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.588238  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.587471  3230 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.591796  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.590520  3211 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:59:38.592834  3230 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.593187  3211 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.593374  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:38.593596  3211 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:38.593969  1631 raft_consensus.cc:2376] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3. Re-sending same reply.
I20260709 12:59:38.573019  3133 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.590543  3110 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.597675  3212 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:38.599745  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.595261  3213 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:59:38.601876  3166 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.610566   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:38.610675  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:38.606510  1707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48150
I20260709 12:59:38.611379  1707 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:38.611635  1707 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.569259  3151 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:59:38.615679  3135 raft_consensus.cc:3055] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:38.616110  3135 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:38.616163  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.616951  3135 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.618842  3135 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.621191  1701 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:38.606873  2235 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.577379  3076 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.622160  3218 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.621743  1707 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.582249  3120 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.624257  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.622539  3126 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.612347   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:38.628333  3191 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.628158  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.570972  3131 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.628197  1558 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:38.627401  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.629671  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.630687  1557 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 2: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:38.629361  3159 raft_consensus.cc:3055] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.633718  3159 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:38.634728  1707 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:38.634852  3126 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:38.594455  3211 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.636896  3211 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.594859  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:59:38.632961  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.633119  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:38.630630  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.640305  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.635963  3126 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:38.630673  1553 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 2: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:38.641400  1524 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.642097  3191 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.652254  3070 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:38.652603  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:38.653215  1557 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.654230  3070 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:38.654320  2264 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.649274  3126 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:38.653092  3186 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:38.653529  1557 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:38.623322  3215 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.654395  3133 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:38.629671  3208 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.629603  3131 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.662889  3122 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.655402  3070 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.658566  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:38.662299  3186 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:38.664536  2270 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.661546  1557 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.668493  3186 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.634689  3159 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.670243  3159 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.671530  1557 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.674602  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.661150  3105 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.667321  3133 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:38.676924  3215 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.677935  1631 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.678320  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.679390  3105 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 12:59:38.682112  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.682197  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.684898  2270 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:38.685909  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:38.687947  1553 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:38.681707  3191 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.689280  3153 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:38.689853  3153 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:38.690130  3070 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.694578  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.695963  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.690752  3153 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.696709  3219 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:59:38.699558  3219 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:38.699687  3190 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.700104  3219 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:38.697244  1633 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:38.700850  3182 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.681522  3105 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.713387  3122 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:38.715674  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.716661  3232 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:38.701824  1524 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:38.719745  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:38.719991  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.718822  1557 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:38.721760  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:38.677433  3133 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.676008  3126 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.725097  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:38.721989  3116 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.744621  3227 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.727717  3185 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.723656  3191 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:38.725015  3216 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.728993  3134 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:59:38.729439  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.729435  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.739434  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 247) took 1006 ms. Trace:
I20260709 12:59:38.740370  3180 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.754957  1627 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.750496  3185 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:38.756680  3185 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.753494  1708 rpcz_store.cc:276] 0709 12:59:37.730071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.730231 (+   160us) service_pool.cc:224] Handling call
0709 12:59:38.736018 (+1005787us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54000a78d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:38.736121 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1581800192}
I20260709 12:59:38.741349  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.758008  3185 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.736084  3122 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:38.760118  3122 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:38.717307  3232 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:38.762231  3232 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.745028  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.746834  1631 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.761282  3122 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:38.764616  3116 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.764958  3203 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.752177  3191 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:38.769382  3191 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:38.772310  3105 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:38.753926  3131 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:38.763185  3134 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:38.775827  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:38.773084  3212 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:59:38.781626  3225 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:59:38.792421  3116 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.778575  3201 consensus_queue.cc:1059] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:59:38.794823  3201 raft_consensus.cc:3055] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.795194  3201 raft_consensus.cc:740] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:38.798648  3201 consensus_queue.cc:260] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:38.803030  3201 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:38.808631  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.772948  3219 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.833052  1557 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:38.811189  3096 tablet_bootstrap.cc:492] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:38.812012  3134 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.813628  3223 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:38.779592  3131 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:38.822305  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:38.823104  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:38.824384  3184 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.826121  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:38.827396  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:38.835732  1557 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:38.836849  1558 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:38.846236  1631 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:38.846702  1626 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:38.848166  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.848045  1630 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:38.851346  1524 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.852099  3185 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.853430  3187 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:38.853371  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:38.854176  3208 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.854486  3131 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:38.800871  3215 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.860477  3187 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:38.861032  3134 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:38.861838  3187 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.873934  1629 raft_consensus.cc:2410] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:38.874631  3212 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:59:38.869104  3223 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:38.880632  3182 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:38.817723  3160 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.908550  3219 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.886757  3206 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.890591  3151 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:59:38.890347  3166 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:59:38.917505  3206 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:38.935360  3206 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.922585  3096 tablet_bootstrap.cc:492] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 12:59:38.968279  3207 consensus_queue.cc:1059] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:59:38.947000  3152 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:59:38.942467  3232 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:38.972177  3096 ts_tablet_manager.cc:1403] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 1.149s	user 0.030s	sys 0.016s
I20260709 12:59:38.991518  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:38.986008  1454 catalog_manager.cc:5697] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:38.987744  3222 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:38.988391  3176 raft_consensus.cc:3055] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.990175  3126 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.971364  3210 raft_consensus.cc:3055] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:38.994817  3135 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:38.996382  3176 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:39.007993  1560 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:39.015048  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:39.046635  3169 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:38.995180  3222 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:39.033257  3210 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:39.072856  3169 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:39.197957  3169 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.199769  2264 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:39.200954  3096 raft_consensus.cc:359] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:39.201725  3151 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:39.202229  3096 raft_consensus.cc:740] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 12:59:39.194347  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:39.202932  3096 consensus_queue.cc:260] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:39.107779  3223 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:39.084360  1456 catalog_manager.cc:5697] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:39.035903  3136 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:39.190842  3206 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:39.192866  1708 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:39.196477  1554 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
W20260709 12:59:39.204263  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 128102us
I20260709 12:59:39.207171  3136 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:39.209775  3222 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.210759  3136 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.213129  3096 ts_tablet_manager.cc:1434] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.216s	user 0.009s	sys 0.001s
I20260709 12:59:39.212837  3210 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.213652  3136 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.214366  3210 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.215225  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-7270b72e069f42daa3f82eaa77d9e299 received from {username='slave'} at 127.0.0.1:36040
I20260709 12:59:39.215729  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-7270b72e069f42daa3f82eaa77d9e299 on tablet 7270b72e069f42daa3f82eaa77d9e299 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:39.073107  2234 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:39.222266  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 149244us
W20260709 12:59:39.209266  3234 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.133s	user 0.000s	sys 0.004s
I20260709 12:59:39.225746  3214 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:39.226118  1627 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:39.207604  3111 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:39.231768  3222 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.234198  1708 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:39.244534  2264 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:39.248476  1628 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:39.236335  3075 consensus_queue.cc:1175] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6923294c847b48ebb577e0935d316aa3" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 12:59:39.234656  3176 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:39.243512  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:39.254567  3111 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:59:39.266710  2270 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:39.268672  3075 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:39.269074  2264 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:39.270799  1558 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:59:39.272778  3132 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:39.276238  3169 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:39.266081  3176 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:39.283640  3238 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.002s
I20260709 12:59:39.287698  3122 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:39.293148  1560 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:39.296239  3230 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:39.311077  1560 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:39.314430  3076 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:39.320173  3223 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.324733  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:39.329345  3236 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.338552  3232 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:39.339365  3152 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:39.340122  3152 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:39.348214  1629 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:39.348917  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:39.350666  1628 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:39.337461  3236 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.357066  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:39.341041  3152 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.355528  3236 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:39.362072  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:39.365759  1708 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:39.375608  1628 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:39.370677  1558 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:39.370690  3232 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:59:39.377758  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:39.378492  3216 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:39.328645  3126 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:39.390662  3126 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:39.391566  3126 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.385787  3075 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:39.386066  1708 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.370672  3122 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:39.367847  3215 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:39.389494  3230 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:39.390187  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:39.396377  1558 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:39.421614  1708 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:39.424644  3206 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:39.395821  3075 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.422880  3230 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:59:39.393965  3180 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:59:39.427956  3126 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.431398  3075 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.444352  1708 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:59:39.408272  3122 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.422510  2262 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
W20260709 12:59:39.505460  3245 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:59:39.498370  3202 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:59:39.511549  3122 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:39.492803  3246 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:39.517815  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:39.518893  2268 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 3: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:39.554456  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:39.593375  1627 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:39.622749  3222 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.645562  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:39.648181  3122 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:39.648583  3122 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:39.649197  2264 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 2 LEARNER]: Advancing to term 3
I20260709 12:59:39.648974  3122 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.639317  3222 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.679186  1702 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.679610  3075 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.681224  3222 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:39.681608  3075 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:39.689355  1633 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:39.691747  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:39.692528  2270 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.695412  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:39.684983  3254 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:59:39.696302  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:39.699890  1558 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.703231  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:39.703866  2268 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:39.704322  3185 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.704794  3185 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.706142  3206 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:39.701924  1702 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:39.713661  1560 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:39.716827  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:39.718115  3186 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:39.721328  3184 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.724021  2270 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:39.723968  3184 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.667619  2264 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 3 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:39.733196  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:39.743564   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:39.744062  1454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35556 (request call id 316) took 1159 ms. Trace:
I20260709 12:59:39.765080  1455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 228) took 1367 ms. Trace:
I20260709 12:59:39.769320  1558 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:39.765740  1455 rpcz_store.cc:276] 0709 12:59:38.397757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.397933 (+   176us) service_pool.cc:224] Handling call
0709 12:59:38.739864 (+341931us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5400002490. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeab0b2 00007f06e3e24a89 00007f06e3dbcda6 00007f06e3d8e088 00007f06e3e8c37e 00007f06e234d2a4 00007f06e234d232 00007f06e234d161 00007f06e234d0dc
0709 12:59:39.765003 (+1025139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":840,"reported_tablets":1,"spinlock_wait_cycles":4563840}
I20260709 12:59:39.768013  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:39.784216  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:39.784948  1706 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:39.783177  3135 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.787911  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:39.788033  3135 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.789283  3232 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:39.789649  3232 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.789963  3232 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.792776  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:39.762818  3075 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:39.793398  1709 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:59:39.757550  3223 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:39.794224  3223 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.794579  3223 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.795056  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:39.793464  3075 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:39.791807  3122 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.738132  3180 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 12:59:39.796557  3244 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:39.783315  3176 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 12:59:39.807382  3252 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:59:39.819185  1453 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35568 (request call id 318) took 1209 ms. Trace:
I20260709 12:59:39.808848  3135 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:39.809937  3182 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.821647  1453 rpcz_store.cc:276] 0709 12:59:38.591251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.593741 (+  2490us) service_pool.cc:224] Handling call
0709 12:59:39.800765 (+1207024us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112126,"reported_tablets":2}
I20260709 12:59:39.840574  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:39.841281  2264 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:39.819483  3185 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:39.817919  3231 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:39.848616  3231 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.849045  3231 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.820434  3176 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.852180  3176 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:39.853180  3182 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.855189  3182 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:39.809985  3075 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.862867  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:39.863677  1558 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:39.871335  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:39.872048  2264 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:39.873157  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:39.882449  1558 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:39.885953  3202 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:39.888782  3184 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:39.873955  3160 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:39.876830  3176 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:39.895442  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:39.897492  2270 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:39.892918  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:39.902540  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:39.903072  2268 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:39.901510  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:39.905205  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:39.908558  3185 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:39.911737  3185 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.910215  3187 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.912109  3185 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.912302  3187 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.899685  3160 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:39.908800  3180 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:39.918293  3180 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.918601  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:39.902263  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:39.923668  2264 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:39.918651  3180 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.898738  3176 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:39.940279  3184 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:39.943696  3184 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.945574  3122 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:39.947371  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:39.945952  3184 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:39.948518  1703 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:39.951354  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:39.952770  3122 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:39.953626  3122 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:39.947530  1627 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.958729  3227 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:39.959328  3227 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:39.961438  3236 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:39.908429  1453 catalog_manager.cc:5697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.962056  3236 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:39.964787  3236 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:39.954146  3122 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:39.966373  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:39.967175  2264 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:39.965605  1453 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 4 to 5, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.969878  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:39.971035  1554 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:39.973068  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:39.977970  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:39.964784  3187 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:39.981909  1673 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:39.982987  3212 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:39.981434  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:39.983407  3212 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:39.983918  3212 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:39.983506  1453 catalog_manager.cc:5697] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 3, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.986591  1554 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:39.744594  1454 rpcz_store.cc:276] 0709 12:59:38.584776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.584905 (+   129us) service_pool.cc:224] Handling call
0709 12:59:38.637999 (+ 53094us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b540009b354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf39090 00007f06ddfd7f3a 00007f06e3d8e1cc 00007f06e3e8c37e 00007f06e234d2a4 00007f06e234d232 00007f06e234d161 00007f06e234d0dc 00007f06e234c392 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:39.743979 (+1105980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:39.218767 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:39.225603 (+  6836us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:39.225658 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:59:39.225707 (+    49us) tablet.cc:662] Decoding operations
0709 12:59:39.226182 (+   475us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:39.226265 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:39.226296 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:39.226583 (+   287us) tablet.cc:701] Row locks acquired
0709 12:59:39.226618 (+    35us) write_op.cc:260] PREPARE: finished
0709 12:59:39.226766 (+   148us) write_op.cc:270] Start()
0709 12:59:39.229378 (+  2612us) write_op.cc:276] Timestamp: P: 1783601979226712 usec, L: 0
0709 12:59:39.229422 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:59:39.230146 (+   724us) log.cc:844] Serialized 536 byte log entry
0709 12:59:39.430810 (+200664us) op_driver.cc:464] REPLICATION: finished
0709 12:59:39.669522 (+238712us) write_op.cc:301] APPLY: starting
0709 12:59:39.673935 (+  4413us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:39.684341 (+ 10406us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:39.684511 (+   170us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:39.684817 (+   306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:39.685066 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:39.685121 (+    55us) write_op.cc:312] APPLY: finished
0709 12:59:39.689542 (+  4421us) log.cc:844] Serialized 23 byte log entry
0709 12:59:39.725150 (+ 35608us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:39.725229 (+    79us) write_op.cc:454] Released schema lock
0709 12:59:39.725280 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:39.725635 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:39.725671 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":3806080,"child_traces":[["op",{"apply.queue_time_us":208309,"apply.run_cpu_time_us":2492,"apply.run_wall_time_us":83902,"num_ops":1,"prepare.queue_time_us":180957,"prepare.run_cpu_time_us":6873,"prepare.run_wall_time_us":62077,"raft.queue_time_us":345206,"raft.run_cpu_time_us":57264,"raft.run_wall_time_us":345243,"replication_time_us":179971,"thread_start_us":218851,"threads_started":4,"wal-append.queue_time_us":49841}]]}
I20260709 12:59:39.989728  1628 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:39.994318  3210 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:39.996690  3210 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:39.997092  3210 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.942209  3176 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.002009  3122 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.009910  3122 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.010097  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:40.017153  1627 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:40.018648  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.019367  1630 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:40.020684  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:40.022250  3212 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.022531  3202 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:40.023414  1703 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:40.024997  1702 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:40.028426  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:40.029270  3212 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.030009  3212 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.038256  3212 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:40.003389  1453 catalog_manager.cc:5697] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 12:59:40.039855  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.040668  1557 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:40.042104  3212 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.036443  3176 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.044989  3176 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.033413  3210 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.046073  2264 raft_consensus.cc:2368] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4.
I20260709 12:59:40.046394  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:40.048110  1673 leader_election.cc:400] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4.
I20260709 12:59:40.048465  1673 leader_election.cc:403] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:59:40.050419  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:40.051250  1557 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:40.052079  3196 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.052624  3196 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.056360  3210 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.056998  3210 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:40.057477  3210 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.058307  3196 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:40.060153  3176 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.067206  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.067364  3110 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.067963  1560 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:40.068100  3110 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.069128  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.070053  3122 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:40.070572  3122 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:40.070750  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:40.071370  1558 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.071801  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.071557  3122 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.072592  1633 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:40.073839  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:40.074874  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.074935  3076 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.075603  3076 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.075924  3210 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.076107  3076 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.076607  3210 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.077028  3210 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.077387  3210 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.014159  3160 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:40.090505  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:40.106453  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.107153  2268 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 2: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:40.084600  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.012473  3232 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.114619  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.115314  3110 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.094815  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:40.095938  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 300956us
I20260709 12:59:40.118698  1628 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:40.116942  3116 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.126716  1558 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:40.127836  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.104878  2270 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:40.107153  1557 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:40.129294  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:40.120165  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:40.122695  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.136387  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:40.139389  3132 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:40.134618  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:40.139834  3132 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:40.138156  3274 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:40.140257  3132 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.140549  3274 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.143384  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.144439  1709 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 2: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:40.145188  3275 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:40.145766  3275 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.146314  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:40.118444  3182 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:40.152803  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.155843  2268 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 2: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:40.162853  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.115306  1627 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:40.167102  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.167728  1558 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:40.169204  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.144104  3110 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:40.142694  3202 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.110129  3223 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.157497  3160 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.182571  3160 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.184616  3160 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:40.138651  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:40.185449  2264 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 3: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:40.150002  3196 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:40.157030  3275 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.187667  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:40.188309  2270 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.170223  3153 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.189836  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.189699  3153 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.192371  3153 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:40.192448  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:40.193051  1558 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.175818  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.173230  3274 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.179800  3223 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.194360  2268 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 2: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:40.194326  3274 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:40.180328  3227 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.195812  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.129878  3116 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.196434  1560 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:40.197023  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.200600  1553 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:40.201891  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:40.199002  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.204320  1628 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:40.205227  2270 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:40.214433  3227 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:40.214584  1558 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:40.215022  3227 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.215410  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:40.216116  1708 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 12:59:40.216501  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47375.1us
I20260709 12:59:40.217209  3227 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.217800  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.194916  3274 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:40.222543  3274 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.210599  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:59:40.226415  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 83887.8us
I20260709 12:59:40.225630  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.228829  1554 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:40.170503  3182 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:40.195823  3135 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:40.196307  3110 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:40.241307  3284 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.247747  3284 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:40.250263  3135 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:40.252920  3135 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.242755  3236 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:40.253650  3236 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.196794  3202 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.223728  3075 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.224530  3223 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:40.258211  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.259449  3116 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.264545  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.275655  2268 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:40.257500  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.260874  3231 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.272686  2265 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 2: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:40.262809  3182 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.259739  3222 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:40.264921  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:40.279094  3222 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.279708  3135 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:40.280136  3135 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:40.280506  3135 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.280714  3231 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.272697  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.187556  3180 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.260391  3110 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.278541  1553 raft_consensus.cc:2410] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:59:40.231585  3160 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.281256  3222 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.241115  3153 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:40.291841  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.254016  3236 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.301633  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.298398  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.312218  2270 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 3: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:40.311297  1560 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:40.314245  1600 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.256383  3202 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.316133  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.316839  1628 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:40.298472  3231 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.325184  1558 raft_consensus.cc:2368] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4.
I20260709 12:59:40.284395  3223 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.261979  3281 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:40.331843  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.332515  2268 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:40.293025  3275 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.299506  3160 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.256347  3076 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.263121  3075 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.323968  3131 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.358392  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:40.359385  1600 leader_election.cc:400] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4.
I20260709 12:59:40.359809  1600 leader_election.cc:403] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:40.325066  3153 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:40.341468  3160 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.323688  3185 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.355980  3131 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.331396  3231 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.347486  3284 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.370332  3184 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.411989  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:40.418475  3122 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.368898  3286 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:40.432601  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 214471us
I20260709 12:59:40.427495  2268 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.373446  3232 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.434415  3184 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:40.435585  3122 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.436749  3231 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.437120  3169 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.438627  3223 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.376886  3196 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:40.439954  2270 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:40.440124  1557 raft_consensus.cc:2368] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:40.454440  3291 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.455542  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.357079  3281 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.341144  3275 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:40.376369  3131 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.462064  3191 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.462585  3116 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.471256  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.472376  3293 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.472534  3180 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.456775  3286 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.497356  3286 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.478679  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:40.499446  2270 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.476114  2271 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
W20260709 12:59:40.466665  3277 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.271s	user 0.000s	sys 0.004s
I20260709 12:59:40.489863  1628 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:40.469035  3169 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:40.458937  3212 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.517596  3293 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4.
I20260709 12:59:40.515414  3122 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.488415  3132 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.521027  3076 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.520925  3210 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.525115  3236 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.553411  3236 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:40.474080  3288 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:40.495874  3116 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.554301  3288 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.555780  3116 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.556442  3288 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.531142  3184 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.531674  3196 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.532541  3212 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:40.489048  3191 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.564982  3191 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.533646  3185 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.476163  3153 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.489408  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.482602  3284 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:40.518517  3283 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:59:40.570535  3284 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.498839  3176 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4.
I20260709 12:59:40.572727  3284 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.570545  2266 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:40.588090  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.589187  2266 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:59:40.504778  3169 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:40.606626  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 247434us
I20260709 12:59:40.607542  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:40.607829  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.609273  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.609926  1631 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:40.610162  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.609400  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.610730  1634 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:59:40.610980  1553 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:40.615011  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.616247  1626 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:40.619807  2270 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:40.617226  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.621311  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:40.622004  1635 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.622856  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.623499  1632 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:40.627859  3206 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.628314  3206 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.628716  3206 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.613474  1703 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:40.631287  3122 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.631724  3122 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.632098  3122 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.632531  3132 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.634855  3275 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.635258  3160 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.636103  3274 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.637318  3160 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:40.640671  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.641302  1553 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:40.644302  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:40.483878  3291 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.651141  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.648792  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.646099  1633 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:40.651050  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:40.620915  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.655839  3232 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:40.656322  3232 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:40.657097  3232 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.659089  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:40.660089  2263 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.662838  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.654381  1553 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:40.666642  1558 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:40.618984  3184 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.629781  1635 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:40.672544  3184 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.618690  3075 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:40.619359  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.666554  2268 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:40.691016  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:40.668623  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 211626us
I20260709 12:59:40.669720  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.657750  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:40.692974  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.693588  2268 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:40.695147  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:40.685614  1634 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:40.695760  1633 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.696375  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:40.696983  2262 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.698957  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:40.702693  1633 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:40.707373  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.668116  3274 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.708246  1628 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:40.710088  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.707204  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:40.675554  3184 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.712942  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.714287  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:40.668826  3160 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.669965  3215 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:40.677606  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.720515  3284 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.723187  3116 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:40.723397  3284 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.723750  3116 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.724363  3116 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.725782  3291 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.727212  3135 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.729832  1629 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:40.710240  3296 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.713625  2264 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.711716  3282 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:40.771394  3210 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:40.771574  3282 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.772526  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:40.773097  1558 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.773973  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:40.774910  1635 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.723887  3284 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.719695  3176 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:59:40.715749  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.715685  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 12:59:40.776746  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 61136.5us
I20260709 12:59:40.777274  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.777809  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:40.765437  2263 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:40.730954  3160 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:40.778853  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:40.779789  3212 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:40.780138  3212 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:40.780467  3212 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.781286  3160 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:40.745761  1634 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:40.760074  1627 raft_consensus.cc:2368] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3.
I20260709 12:59:40.783257  3222 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:40.783635  3222 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.783957  3222 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.773849  3282 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.731738  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:40.784721  1632 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.719157  3187 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:40.785981  3187 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 12:59:40.786397  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 70752.2us
I20260709 12:59:40.786856  3187 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.788025  1600 leader_election.cc:400] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:40.788167  2234 leader_election.cc:400] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3.
I20260709 12:59:40.788712  3293 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:40.788970  2234 leader_election.cc:403] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:40.717413  3274 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:40.789589  3274 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:40.757759  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:40.790427  3294 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.790917  2268 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 2: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:40.790948  3294 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.790450  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.774958  2262 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:40.711900  2267 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:40.802830  1558 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:40.788357  1600 leader_election.cc:403] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:40.789199  3293 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:40.789999  3274 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:40.765357  3291 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.777978  1553 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:40.795516  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:40.799880  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.825176  2268 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:59:40.719182  3215 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.826186  3215 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:40.801227  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:40.804313  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.832577  3216 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.824971  3206 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.835901  1635 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:40.837144  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:40.736708  3296 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.781672  3116 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.837955  1634 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:59:40.838250  3296 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.839684  3116 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.781932  3160 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:40.740477  3135 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.822652  3286 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:40.844189  3286 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.844964  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:40.845575  2268 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:40.845481  3293 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.844213  3122 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:40.802489  3132 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3.
I20260709 12:59:40.848654  1560 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:40.837761  3294 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.818233  3275 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:40.851979  1627 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:40.856920  3281 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.833238  3216 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.866276  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:59:40.866585  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 62384.3us
I20260709 12:59:40.864315  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:40.867813  1560 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:40.873155  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 72042.4us
W20260709 12:59:40.874696  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 401131us
I20260709 12:59:40.910905  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:40.880777  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:40.886957  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:40.899780  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:40.881541  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:40.837136  3206 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.918860  1709 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:59:40.864781  3160 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:40.874933  3275 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:40.871997  3122 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:40.925916  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:40.875015  3202 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:40.924361  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 233441us
I20260709 12:59:40.866083  3291 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.911875  3298 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:40.915799  1708 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:40.928841  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:40.957935  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:40.958287  1704 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.909547  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:40.908970  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:40.911243  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:40.921095  3231 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.962149  3231 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.962949  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:40.963527  1555 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.964313  3231 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:40.925334  3295 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:40.965029  3295 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.965173  3222 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:40.966358  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:40.966952  1552 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.967698  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.955786  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:40.956235  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.968466  1705 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:40.958938  1557 raft_consensus.cc:2368] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4.
I20260709 12:59:40.969527  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:40.970209  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.915125  1707 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:40.960176  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:40.961228  1706 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.915333  1701 raft_consensus.cc:2368] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:41.039369  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:41.040066  1701 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:40.968286  1556 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:40.930399  3275 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:40.947260  3153 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.978572  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:41.050230  1631 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.023070  1557 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:41.023599  1702 raft_consensus.cc:2368] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5.
I20260709 12:59:40.913221  3169 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.021768  1524 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:41.023725  2268 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:41.026292  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:41.029198  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:40.954128  3299 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:41.035573  1601 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:40.967236  3295 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.038278  1708 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:40.956118  3152 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.045609  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:41.046504  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:41.083774  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:41.044732  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:41.084337  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 48856.1us
I20260709 12:59:41.085268  1553 raft_consensus.cc:2393] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:40.978128  1633 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:41.019752  3185 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.022801  3298 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:41.061903  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:40.971760  3202 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:41.062284  3216 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.065091  1524 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:40.967304  3131 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:40.961887  3160 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.083460  3305 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.094899  1707 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:41.096124  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:41.099787  1601 leader_election.cc:400] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:41.103034  1701 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:41.103633  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:41.111260  1601 leader_election.cc:400] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5.
I20260709 12:59:41.111258  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:41.067533  3299 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.049757  3275 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.083175  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:41.092423  3286 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:41.104012  1631 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:41.125972  1552 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:41.100392  2262 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:41.097179  1559 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:41.116452  1632 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 12:59:41.102586  1627 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.135529  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:41.136683  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:41.137168  1709 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.140748  3131 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.118288  1554 raft_consensus.cc:2368] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:41.141603  3298 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:41.143291  3169 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.144474  3286 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.144883  3286 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.145110  3222 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:41.101490  3281 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:41.146184  3281 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.146606  3281 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:41.147225  3301 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.186s	user 0.000s	sys 0.003s
I20260709 12:59:41.149147  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:41.054458  3153 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.121858  3202 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.122430  3182 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:41.102702  3185 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:41.124717  3215 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.129498  1560 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:41.129873  3299 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.158407  3305 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:41.159842  3305 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.112815  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:59:41.161247  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 48518.1us
I20260709 12:59:41.161839  3293 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:41.162245  3293 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.162581  3293 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.163370  3153 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.163879  1555 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 12:59:41.165613  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:41.165877  3215 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.166502  1705 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 2: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:41.166216  3296 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.168314  3296 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.107374  3308 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:41.169122  3308 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.168954  3185 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.172325  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:41.172928  1559 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.095661  3307 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:41.174466  3307 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.175385  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:41.176033  1630 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:41.176791  3307 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.155072  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:41.120390  2264 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:41.156219  3180 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:59:41.177484  1552 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:41.177728  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:41.167860  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:41.169477  3308 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.101050  3152 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.190732  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:41.154608  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:41.183467  2271 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:41.183851  1704 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:59:41.180424  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:41.193693  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:41.211370  1709 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:41.130086  3212 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:41.245296  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 63327.7us
I20260709 12:59:41.243090  1705 raft_consensus.cc:2376] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3. Re-sending same reply.
I20260709 12:59:41.246344  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:41.247627  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:41.173517  3299 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:41.186964  1627 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:41.185590  1706 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:41.217787  3153 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:41.219360  3152 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:41.180054  3274 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:41.246953  3289 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:41.243824  2263 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:41.221724  1559 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 12:59:41.216969  3284 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:41.266268  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:41.268903  1628 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.257206  1700 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:41.270191  1703 raft_consensus.cc:2368] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:41.257088  3291 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.260799  3307 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:41.221678  3281 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.266271  3289 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:41.282573  1709 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:41.278113  3296 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.279841  3307 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.261605  3153 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:41.288887  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:41.290287  1628 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:41.291050  3285 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.291534  3285 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.294050  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:41.294409  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:41.295101  2262 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:41.289283  3307 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.296872  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:41.293535  3285 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:41.289075  3296 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:41.300354  1704 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:41.303719  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:41.298424  3160 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.307648  3281 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:41.312016  3305 raft_consensus.cc:1064] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 12:59:41.312142  3212 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.300511  3222 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:41.312964  3160 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:41.313611  3289 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:41.313961  3160 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.319198  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:41.320518  3296 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.327557  1560 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:41.328620  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:41.313206  3222 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.331590  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:41.332027  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:41.332763  1555 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:41.335855  2267 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:41.338722  1601 leader_election.cc:400] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:41.339046  3153 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:41.339071  1601 leader_election.cc:403] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:41.338768  3187 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:41.341974  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:59:41.331974  3303 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 12:59:41.342595  1704 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.342545  2235 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:41.347034  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:41.343098  3295 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:41.363267  3299 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:41.363732  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:41.364590  3185 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.365044  3185 raft_consensus.cc:697] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:41.329699  3293 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.365856  3185 consensus_queue.cc:237] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:41.367170  3293 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.368600  2262 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:41.370563  1632 raft_consensus.cc:2368] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4.
I20260709 12:59:41.371776  3308 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.349313  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:59:41.351140  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 217633us
I20260709 12:59:41.373474  1634 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:41.346674  3285 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:41.374672  3285 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.375114  3285 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.354897  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:41.357159  3286 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:41.360594  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:41.341544  3222 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.362504  3284 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:41.375867  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:41.392925  1632 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.376551  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:41.376628  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:41.377319  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:41.377954  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:41.394804  1701 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.395032  2271 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.379498  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:41.386528  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:41.392004  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:41.395972  1628 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:41.396386  1554 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:41.394366  1634 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.397634  1673 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:41.398636  1673 leader_election.cc:400] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4.
I20260709 12:59:41.407764  1701 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:41.409328  1601 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:41.410004  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:41.413924  2271 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:41.415340  1599 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:41.415953  1632 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:41.416549  1634 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:41.420118  1626 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:41.424782  1704 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:41.426057  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:41.389396  2265 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Advancing to term 3
I20260709 12:59:41.410100  3299 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.428149  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:41.429388  2271 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.345992  3275 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.432771  3136 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.432857  3299 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:41.417315  3169 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.419878  3284 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.425868  3294 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:41.403275  3274 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:41.390583  3184 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:59:41.418867  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:41.419965  3122 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:59:41.439746  3169 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:41.441087  3299 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:41.437652  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 60413.3us
I20260709 12:59:41.420790  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:41.455789  2271 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:41.457255  1631 raft_consensus.cc:2368] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4.
I20260709 12:59:41.458532  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:41.405063  3281 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:59:41.463452  3294 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:41.437691  3323 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:41.494684  3323 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:41.494611  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:41.495888  3323 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:41.496480  1703 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:41.472373  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:41.502966  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:41.477164  3314 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:59:41.477315  3307 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.505527  3122 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:41.506016  3122 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:41.506223  3307 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.478287  3169 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:41.508450  1701 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:41.467783  2264 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:41.481247  3286 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:41.482852  3275 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.487470  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:41.510905  3324 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.510757  3184 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:41.511077  2266 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.487639  3308 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.511637  3216 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:41.512140  3216 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:41.511417  3324 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.490836  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:41.518715  1552 raft_consensus.cc:2368] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:41.491501  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:41.519731  1557 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.492151  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:41.493837  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:41.506561  3215 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.490130  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:41.506376  1704 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:41.534399  1553 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.524147  3294 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:41.526445  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 67590.3us
I20260709 12:59:41.540769  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:41.544618  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:41.545979  1634 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:41.548434  1557 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:41.545058  3284 raft_consensus.cc:697] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:41.540037  3215 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:41.550204  3184 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:41.547178  3136 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 12:59:41.570155  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.578631  3122 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.550827  2264 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.553994  3281 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:59:41.604301  1634 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:41.580518  3184 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:41.625660  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.559266  3216 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.610432  3184 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.652956  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:41.653687  2268 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.649820  2267 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:41.674182  1674 leader_election.cc:400] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4.
I20260709 12:59:41.631340  3169 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:41.679672  3281 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:41.684131  2268 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:41.612463  3284 consensus_queue.cc:237] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:41.728645  3216 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.752144  1557 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:41.703387  3286 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:41.755198  3286 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.758473  3325 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:41.759052  3325 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:41.761365  3325 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:41.763619  3286 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.767769  1600 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:41.769119  1600 leader_election.cc:400] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:41.769387  1600 leader_election.cc:403] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:59:41.769461  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:41.770159  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 162775us
W20260709 12:59:41.711067  3337 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:59:41.771931  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.631387  3215 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.775125  1673 leader_election.cc:400] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4.
I20260709 12:59:41.776141  1674 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:41.792301  1600 leader_election.cc:400] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:41.792673  1600 leader_election.cc:403] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:59:41.793340  1600 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:41.794442  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:41.764994  1630 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:41.658051  3136 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:41.796499  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 185689us
I20260709 12:59:41.704337  3169 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.812384  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:41.816478  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:41.796402  3286 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.798457  3293 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
W20260709 12:59:41.824746  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 48699.1us
I20260709 12:59:41.807977  3274 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:41.833389  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:41.795881  3222 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.819962  3284 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.826486  3153 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:41.818632  3324 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:41.846088  1558 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:41.844614  1553 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:41.842232  2266 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:41.831051  3286 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:41.823654  3122 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:41.832710  2265 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 3 LEARNER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:41.848256  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:41.867594  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:41.860635  3335 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:59:41.862308  3153 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:59:41.943143  3323 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:41.861442  3285 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:41.953958  3222 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:41.983934  3341 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:59:42.028126  2264 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:41.980085  3160 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:42.072441  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.086980  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:42.088972  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:42.087301  3344 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:59:42.032800  3323 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 12:59:42.046176  3333 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 12:59:42.088878  3286 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:42.120003  3285 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:42.101212  3160 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:42.152393  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 303) took 1200 ms. Trace:
I20260709 12:59:42.152940  1708 rpcz_store.cc:276] 0709 12:59:40.951509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.959854 (+  8345us) service_pool.cc:224] Handling call
0709 12:59:42.152086 (+1192232us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b54001def54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:42.152253 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10621824}
I20260709 12:59:41.978245  3305 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.154678  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 386) took 1174 ms. Trace:
I20260709 12:59:42.155210  2263 rpcz_store.cc:276] 0709 12:59:40.980651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.020800 (+ 40149us) service_pool.cc:224] Handling call
0709 12:59:42.154441 (+1133641us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b5400730354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:42.154578 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193097472}
I20260709 12:59:42.163555  3323 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.178643  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1814) took 1179 ms. Trace:
W20260709 12:59:42.189013  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.181527  3135 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:42.190217  3135 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.191469  3296 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.192096  3296 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.195693  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:42.196420  1631 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:42.146210  3347 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.199951  3347 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.208693  1524 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:42.179214  1633 rpcz_store.cc:276] 0709 12:59:40.988894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.110074 (+121180us) service_pool.cc:224] Handling call
0709 12:59:42.161931 (+1051857us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 12:59:42.167812 (+  5881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.168033 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.168071 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.168126 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:42.168168 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.168240 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.168375 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23119104}
I20260709 12:59:42.193797  3135 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:42.212311  3322 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:42.214645  3322 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:42.215890  3322 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.143309  3169 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:42.222731  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:42.224125  1628 raft_consensus.cc:2410] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:42.231333  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:42.232157  2262 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:42.249779  3160 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:42.270596  3347 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:42.279351  3184 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.003s
I20260709 12:59:42.279932  3184 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.282382  3296 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:42.268278  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1812) took 1289 ms. Trace:
I20260709 12:59:42.294327  1626 rpcz_store.cc:276] 0709 12:59:40.978427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.022435 (+ 44008us) service_pool.cc:224] Handling call
0709 12:59:41.148989 (+126554us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 12:59:42.267993 (+1119004us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400165dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:42.268171 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622513152}
I20260709 12:59:42.303395  2267 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:42.304680  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:42.305341  2265 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:59:42.311028  3345 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.328s	user 0.003s	sys 0.000s
I20260709 12:59:42.312232  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:42.315845  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 151200us
I20260709 12:59:42.318246  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:42.321655  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:42.316489  2265 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:42.340212  3135 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:42.340870  3135 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.349879  3302 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:42.350493  3302 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:42.350616  3184 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:42.352845  2267 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:59:42.352859  3302 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:42.356513  2270 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:42.357947  1633 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:42.360616  1633 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:42.354068  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1623) took 1393 ms. Trace:
I20260709 12:59:42.376200  1705 rpcz_store.cc:276] 0709 12:59:40.972376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.259878 (+287502us) service_pool.cc:224] Handling call
0709 12:59:41.260117 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.302163 (+ 42046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.302192 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.302235 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:41.302263 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.317641 (+1015378us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b54000b7f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:42.353845 (+ 36204us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.353957 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96235392}
W20260709 12:59:42.377954  1634 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.040s	sys 0.084s
W20260709 12:59:42.378358  1634 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.040s	sys 0.084s
I20260709 12:59:42.353540  3135 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:42.354367  2234 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:42.355137  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:42.383025  1599 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:42.386577  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:42.391749  2270 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:42.395243  2270 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:42.384486  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:42.399845  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:42.403290  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.403580  1628 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:42.407665  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:42.411758  1631 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
W20260709 12:59:42.415069  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.039s	sys 0.118s
W20260709 12:59:42.415417  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.039s	sys 0.118s
W20260709 12:59:42.415968  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 622722us
I20260709 12:59:42.384897  3282 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:42.389477  3295 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:42.416494  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 51752.4us
I20260709 12:59:42.420128  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:42.420709  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:42.409832  3135 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:42.421316  2270 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:42.422204  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:42.424290  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 215728us
I20260709 12:59:42.423175  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 12:59:42.438757  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 448149us
I20260709 12:59:42.439018  2271 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:42.444104  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:42.445474  2269 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:42.448724  1633 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:42.450519  1600 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:42.425282  3296 raft_consensus.cc:2764] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:59:42.457509  3135 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:42.474684  3135 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.479274  2269 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:59:42.480556  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.481642  1629 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:42.482795  2265 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Advancing to term 3
I20260709 12:59:42.482688  3358 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:59:42.428391  3153 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:42.484988  2262 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:42.485536  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 387) took 1108 ms. Trace:
I20260709 12:59:42.486655  3363 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:42.463845  3300 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:59:42.487391  3363 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.453943  3319 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:42.492347  3232 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:42.492756  3319 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:42.493228  3319 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:42.492897  3232 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:42.495064  3232 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:42.495491  2265 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 3 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:42.427718  3110 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 12:59:42.520936  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 70496.9us
I20260709 12:59:42.522696  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:42.546343  3363 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:42.570114  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 87887.8us
I20260709 12:59:42.570261  3324 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:42.571038  3324 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:42.572009  3295 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:42.572592  3295 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:42.573312  3324 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:42.574348  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 75611.4us
W20260709 12:59:42.576488  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 53892.1us
I20260709 12:59:42.579685  3353 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:42.582196  1551 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:42.582711  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:42.583990  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:42.589288  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:42.590591  1705 raft_consensus.cc:3055] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:42.591198  1705 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:42.595057  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:42.596334  1558 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:42.597124  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:42.599349  1704 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:42.591997  1705 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.600911  1705 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:42.601415  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:42.603518  1600 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:42.485865  2262 rpcz_store.cc:276] 0709 12:59:41.377331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.389876 (+ 12545us) service_pool.cc:224] Handling call
0709 12:59:42.231135 (+841259us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 12:59:42.485473 (+254338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31985408}
I20260709 12:59:42.580190  3353 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 12:59:42.656174  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52735.7us
I20260709 12:59:42.577481  3274 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:42.628501  1601 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:42.634382  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:42.692926  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64587.9us
W20260709 12:59:42.640131  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 120819us
I20260709 12:59:42.593850  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:42.641670  1453 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 229) took 2761 ms. Trace:
I20260709 12:59:42.697214  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:41.164222   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:42.699082  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 105326us
I20260709 12:59:42.645279  1454 catalog_manager.cc:5697] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 2, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 12:59:42.691010  1705 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 12:59:42.698721  1674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.014s	sys 0.026s
I20260709 12:59:42.681136  3296 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:42.704083  1674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.015s	sys 0.026s
I20260709 12:59:42.636459  2265 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:42.704150  1705 pending_rounds.cc:85] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 5
I20260709 12:59:42.640633  3358 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:42.723518  1701 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:42.710167  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 875464us
I20260709 12:59:42.709764  1454 catalog_manager.cc:5697] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 3, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 12:59:42.724638  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:42.592386  3153 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:42.640403  3357 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:42.641032  3295 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:42.639767  3300 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:42.708447  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:42.709565  3136 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:42.730953  1674 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:42.642129  3169 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:59:42.728936  1454 catalog_manager.cc:5697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 3, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 12:59:42.709092  3349 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:42.698495  3286 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:42.582005  3284 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.130s
I20260709 12:59:42.727790  1705 pending_rounds.cc:107] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:59:42.749207  1705 raft_consensus.cc:2889] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:42.729097  3358 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:42.641191  3327 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 12:59:42.742558  1454 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:42.722625  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:42.698812  3110 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:59:42.741745  3300 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:42.727615  3294 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.759073  3294 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.732874  3357 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:42.696528  3135 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:59:42.709396  3298 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:59:42.736522  3076 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:42.754668  2271 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 1 LEARNER]: Advancing to term 3
I20260709 12:59:42.736091  3275 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:42.695669  1453 rpcz_store.cc:276] 0709 12:59:39.879975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.880178 (+   203us) service_pool.cc:224] Handling call
0709 12:59:42.641560 (+2761382us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:40.147934 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:40.148511 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:40.148550 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:59:40.148569 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:40.186325 (+ 37756us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:40.186379 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:40.186405 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:59:40.186782 (+   377us) tablet.cc:701] Row locks acquired
0709 12:59:40.186796 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:59:40.186950 (+   154us) write_op.cc:270] Start()
0709 12:59:40.187064 (+   114us) write_op.cc:276] Timestamp: P: 1783601980186898 usec, L: 0
0709 12:59:40.187087 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:59:40.246086 (+ 58999us) log.cc:844] Serialized 1686 byte log entry
0709 12:59:40.762588 (+516502us) op_driver.cc:464] REPLICATION: finished
0709 12:59:41.128911 (+366323us) write_op.cc:301] APPLY: starting
0709 12:59:41.128988 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:41.129117 (+   129us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:41.129221 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:41.129826 (+   605us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:41.130048 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:59:41.130092 (+    44us) write_op.cc:312] APPLY: finished
0709 12:59:41.131933 (+  1841us) log.cc:844] Serialized 41 byte log entry
0709 12:59:41.132091 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:41.132189 (+    98us) write_op.cc:454] Released schema lock
0709 12:59:41.132229 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:41.132632 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:41.132659 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"spinlock_wait_cycles":3328,"child_traces":[["op",{"apply.queue_time_us":366073,"apply.run_cpu_time_us":2321,"apply.run_wall_time_us":3691,"num_ops":4,"prepare.queue_time_us":106049,"prepare.run_cpu_time_us":3874,"prepare.run_wall_time_us":116990,"replication_time_us":575302,"thread_start_us":336374,"threads_started":2}]]}
I20260709 12:59:42.768989  1601 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:42.767462  3356 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 12:59:42.778451  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 333299us
I20260709 12:59:42.754806  3136 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:42.760804  3176 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 12:59:42.803920  2236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.922s (SENT) [suppressed 14 similar messages]
I20260709 12:59:42.808135  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:42.810341  1558 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:42.813114  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:42.775039  3110 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:42.813819  1560 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:42.780993  3300 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:42.780609  3327 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.844640  1558 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:42.810842  3358 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.829454  3324 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:59:42.782933  3296 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:42.816957  2271 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 3 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:42.760418  3330 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:59:42.744978  3353 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.879454  1557 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:59:42.805560  3308 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:42.775446  3349 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:42.783815  3295 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:59:42.881243  3232 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:42.803135  3323 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:59:42.815320  3176 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:42.925873  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 144326us
I20260709 12:59:42.781117  3153 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.875826  3216 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:59:42.937306  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:43.039914  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 102724us
I20260709 12:59:42.773469  3319 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.874498  3110 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.948933  1557 pending_rounds.cc:85] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 4
I20260709 12:59:42.894506  3300 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:42.937822  3363 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:42.974521  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.016155  3160 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:42.894877  3357 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.935000  3291 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 12:59:43.016346  3369 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.258s	user 0.003s	sys 0.000s
I20260709 12:59:43.016803  3232 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.963044  3136 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.882046  3327 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:42.975066  3308 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:42.965637  3186 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:59:43.018877  3176 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:43.018996  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 266756us
I20260709 12:59:42.950903  3302 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:43.019529  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:43.055723  3374 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:59:43.074296  3302 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:43.074697  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 55253us
I20260709 12:59:43.075197  3325 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:43.075964  3325 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:43.076335  3302 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:42.937680  3358 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:43.051930  3300 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.080049  3300 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.045167  1557 pending_rounds.cc:107] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 2.5
W20260709 12:59:43.049247  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 245367us
W20260709 12:59:43.002840  3376 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
W20260709 12:59:43.004520  3360 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 12:59:43.005652  3365 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
W20260709 12:59:43.002225  3364 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 12:59:43.001474  3366 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 12:59:43.055302  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 324491us
I20260709 12:59:43.045322  3294 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.046306  3152 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:43.109714  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.072636  3357 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:43.073102  1631 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:43.061692  3291 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.066864  3382 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.082847  1557 raft_consensus.cc:2889] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:43.082949  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.084681  1705 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 12:59:43.124974  1705 pending_rounds.cc:85] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 2
I20260709 12:59:43.073637  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:43.085577  1704 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:43.086130  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.128746  1709 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:59:43.086822  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.092803  3319 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.091579  2271 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:43.091815  1702 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:43.132063  1601 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:43.096695  1552 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:43.051014  3160 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.102910  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:43.104650  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.140533  1554 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:43.105432  3346 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.111723  3306 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:43.144925  3346 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.145098  3306 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:43.147190  3306 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:43.147295  3346 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:43.105504  3327 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.051185  3363 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.108053  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:43.107219  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:43.113416  3370 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 12:59:43.115093  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:43.117079  3110 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.119568  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:43.120234  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:43.121819  3307 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:43.125219  1705 pending_rounds.cc:107] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:59:43.172294  1705 raft_consensus.cc:2917] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:59:43.131505  3294 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:59:43.119616  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1819) took 1742 ms. Trace:
I20260709 12:59:43.142403  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:43.143601  3232 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.124853  3322 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.165184  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.166249  3319 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.170063  3342 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:43.139858  3075 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:43.169550  3307 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:43.123775  3152 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.140044  3329 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.131328  3308 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:43.172837  1705 raft_consensus.cc:2889] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:43.149137  3291 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.178880  1551 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:43.132447  3382 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:43.169502  3289 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.159089  3231 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:43.161368  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.186350  3379 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:43.173072  3176 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:43.186982  3322 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.188105  3363 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.149485  3169 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:59:43.198940  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.158874  3227 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:43.182446  3380 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.188453  3319 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.184927  3281 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.171331  3202 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:59:43.170763  3274 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:59:43.189602  3160 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.185421  3298 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:59:43.198648  3110 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:43.241356  3275 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:59:43.229032  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.248075  2266 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:43.249037  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.229427  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.230094  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.193485  3342 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.228657  3176 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.232949  3152 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:43.219482  3231 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:43.233796  3227 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:43.234897  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.215518  3076 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:43.228027  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.263677  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.235718  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.268117  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.239475  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:43.222100  3289 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.251870  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.252028  3350 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:59:43.215186  3329 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.248169  3110 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.236891  3169 consensus_queue.cc:1243] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:59:43.257575  3298 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:43.280516  3298 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:43.236357  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:43.273734  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:43.265549  3227 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.243768  3281 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.270921  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.178416  1627 rpcz_store.cc:276] 0709 12:59:41.377473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.385590 (+  8117us) service_pool.cc:224] Handling call
0709 12:59:42.251929 (+866339us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 12:59:42.252196 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.252663 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.252705 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.253282 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.724459 (+471177us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:42.729165 (+  4706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.736434 (+  7269us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.117836 (+381402us) raft_consensus.cc:1685] finished
0709 12:59:43.117860 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.119551 (+  1691us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3894,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":2924,"spinlock_wait_cycles":10938752,"thread_start_us":447285,"threads_started":1,"wal-append.queue_time_us":512364}
I20260709 12:59:43.272292  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.273734  1702 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 1.
I20260709 12:59:43.278400  3329 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:43.262828  3275 consensus_queue.cc:1243] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:59:43.240159  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 85494.8us
I20260709 12:59:43.246171  3380 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:43.287271  3384 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 12:59:43.293601  3377 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.252s	user 0.001s	sys 0.003s
I20260709 12:59:43.293813  3358 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:43.238559  3379 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:43.298794  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 423364us
I20260709 12:59:43.269578  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:43.305106  1701 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:43.307253  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:43.252025  3355 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 12:59:43.270736  3076 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.294574  3286 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:43.551327  3286 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:43.527729  3176 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.527850  3298 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:43.553520  3286 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:43.446326  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 119874us
I20260709 12:59:43.523589  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.547655  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.519945  1556 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:43.555364  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:43.555560  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.556197  1702 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:43.345572  3275 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.521772  1558 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:43.558182  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:43.298604  3326 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.010s	sys 0.009s
W20260709 12:59:43.558728  3326 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.015s	sys 0.024s
I20260709 12:59:43.500397  3291 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.559499  3291 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:43.560184  1558 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:43.519043  1560 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:43.579667  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.580224  2266 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:43.580605  3322 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.580960  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.582796  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.585409  2267 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:43.586074  3307 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:43.435151  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.562821  3291 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:43.364890  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.295693  3152 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:43.325035  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.312654  3319 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.587311  3307 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:43.561484  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 254433us
I20260709 12:59:43.589648  3380 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:43.306401  3349 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.567381  3275 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.594748  3349 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.432468  3382 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:43.570797  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.573906  1705 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:43.574296  1704 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:43.434545  3384 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:43.588050  3289 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.598157  3384 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:43.598631  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.575249  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.599496  1554 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:43.576359  3110 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.578538  1708 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:43.601240  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:43.435949  3202 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:43.602676  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:43.603713  3202 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.597265  3275 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.608351  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:43.609305  3335 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:43.609705  3335 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:43.610143  3335 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.611301  3152 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:43.381145  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.584136  1709 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:59:43.613903  2262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.014s	sys 0.024s
W20260709 12:59:43.614382  2262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.014s	sys 0.024s
W20260709 12:59:43.614729  3353 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.013s	sys 0.016s
I20260709 12:59:43.328380  3358 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:43.615070  3353 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.013s	sys 0.016s
I20260709 12:59:43.615466  1704 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 1.
I20260709 12:59:43.564301  3076 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.621479  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.560678  3326 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:43.623493  3326 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:43.625197  3391 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.625051  3384 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.625825  3391 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:43.631058  3153 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.022s	sys 0.017s
I20260709 12:59:43.631655  1554 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 12:59:43.632229  3153 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.023s	sys 0.017s
I20260709 12:59:43.634536  3326 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.635910  3326 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:43.597700  3349 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:43.637550  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.638203  3355 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.645860  3355 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.581353  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.587330  2267 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 3 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:59:43.691745  3349 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.693571  3349 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 12:59:43.714578  1553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.030s	sys 0.013s
W20260709 12:59:43.715103  1553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.030s	sys 0.013s
W20260709 12:59:43.733125  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 97619.1us
I20260709 12:59:43.734143  3349 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:43.733366  3358 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 12:59:43.734089  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.735880  3391 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:43.735999  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:43.737764  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:43.742367  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 134131us
I20260709 12:59:43.744107  3153 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:43.744971  3153 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:43.746206  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:43.747017  3153 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:43.747948  3308 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:43.748940  3136 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:43.749378  3136 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.749774  3136 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:43.749682  3308 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:43.751415  3349 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:43.754565  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:43.754791  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 199508us
I20260709 12:59:43.755486  1599 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:43.757062  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:43.758442  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:43.760603  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:43.774578  2269 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:43.777244  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.777993  1557 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:43.531199  3342 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:43.780669  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 188533us
I20260709 12:59:43.509943  3379 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:43.462466  3281 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:43.756403  3292 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:43.798661  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.799639  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.766880  3308 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:43.765329  3325 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:43.817099  3379 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:43.818260  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.818776  3379 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:43.819335  3379 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:43.820475  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:43.821213  3379 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:43.821692  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:43.775003  3322 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:43.820535  3327 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.463107  3388 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.352s
I20260709 12:59:43.766767  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.781642  3306 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:43.828975  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:43.780403  3384 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:43.830955  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.766848  3294 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:59:43.799989  3330 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:43.823939  3357 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.705s	user 0.007s	sys 0.003s
I20260709 12:59:43.822104  3136 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:43.838812  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.536226  3231 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:43.825260  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.785393  3184 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:59:43.876492  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.872627  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:43.843487  3342 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:43.828222  3275 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:43.875326  3294 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:59:43.875520  3227 consensus_meta.cc:287] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.573s	user 0.006s	sys 0.003s
I20260709 12:59:43.878301  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.969825  2270 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:43.879268  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:43.879575  2265 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:43.967343  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 88780.2us
W20260709 12:59:43.970845  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 91652.1us
I20260709 12:59:43.971735  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:43.974583  3342 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:43.975337  3342 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:43.978405  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.980732  3410 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.098s	user 0.000s	sys 0.009s
I20260709 12:59:43.997344  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:43.876014  3231 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:43.871639  3355 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:43.831195  3327 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:44.021806  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:43.882397  3186 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:44.023543  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:44.038757  1556 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:44.040174  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:43.989075  1635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.033s	sys 0.071s
I20260709 12:59:43.882273  3358 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:44.060864  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:44.063755  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:44.089267  1704 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:44.067260  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:44.069118  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:43.991142  3153 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.086702  1709 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:59:44.088465  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 333064us
I20260709 12:59:43.984223  3294 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:44.001776  3286 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:44.002980  1703 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:59:44.111065  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:43.998450  3379 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:44.117856  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 48835.8us
I20260709 12:59:43.967948  3308 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 12:59:44.032733  3202 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:44.128656  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 314802us
I20260709 12:59:43.988847  3227 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:43.876492  3330 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:44.057323  3355 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.058288  3275 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.023669  3216 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 12:59:44.146687  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.161405  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 12:59:44.111370  3399 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:59:44.127079  3383 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:44.193763  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:44.092299  1635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.033s	sys 0.071s
I20260709 12:59:44.057911  3324 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 12:59:44.113032  3294 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.137002  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.126720  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.000772  3363 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 12:59:44.083701  3381 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 12:59:44.177337  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 355716us
W20260709 12:59:44.217607  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 397198us
I20260709 12:59:44.223762  1631 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:44.187213  1632 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:59:44.134241  1703 pending_rounds.cc:85] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 5
I20260709 12:59:44.144510  3380 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:44.206758  1674 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:44.253049  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.257845  3380 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:44.259487  3227 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:44.260190  3380 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 12:59:44.261327  3407 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:59:44.176578  3353 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.257606  3308 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.274151  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.274969  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:44.275549  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 401299us
I20260709 12:59:44.286382  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.204998  3300 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:44.194276  3152 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.287369  1634 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:44.263973  1703 pending_rounds.cc:107] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:59:44.304500  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.257696  3292 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:44.277828  3349 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:44.190263  3355 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:44.199524  3275 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:44.224596  3110 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:44.332420  3408 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:59:44.336537  3397 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
W20260709 12:59:44.352524  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 381578us
W20260709 12:59:44.332896  3394 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
W20260709 12:59:44.335645  3396 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:59:44.344235  3136 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:44.295439  3300 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.303917  1703 raft_consensus.cc:2889] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:44.304188  1627 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:44.265947  3381 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:44.291554  3353 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:44.366446  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.333671  3423 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:59:44.352902  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.348392  3349 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.387895  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.391381  1628 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:44.347546  3292 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.295574  3308 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:44.311072  3152 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:44.405354  1628 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:59:44.408926  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1502) took 1158 ms. Trace:
I20260709 12:59:44.413517  1708 rpcz_store.cc:276] 0709 12:59:43.250370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.602463 (+352093us) service_pool.cc:224] Handling call
0709 12:59:43.602807 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.603166 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.603195 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:43.603669 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.834097 (+230428us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:43.834143 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.834233 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.408675 (+574442us) raft_consensus.cc:1685] finished
0709 12:59:44.408703 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.408857 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":230042,"threads_started":1,"wal-append.queue_time_us":669400}
I20260709 12:59:44.381582  3300 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.393913  3349 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.435105  2234 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:44.403136  3153 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:44.427915  3307 consensus_meta.cc:287] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.838s	user 0.005s	sys 0.005s
I20260709 12:59:44.407259  3327 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:44.404938  1630 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:44.472524  1702 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:59:44.473048  1702 pending_rounds.cc:85] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 2
I20260709 12:59:44.473313  1702 pending_rounds.cc:107] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:59:44.473739  1702 raft_consensus.cc:2889] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:44.429636  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1496) took 1341 ms. Trace:
W20260709 12:59:44.481223  3412 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:59:44.483258  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.485050  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 522) took 1774 ms. Trace:
W20260709 12:59:44.486689  3401 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:59:44.487854  3300 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:44.491469  3152 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:44.497401  3417 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:59:44.499257  3353 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:44.507249  3275 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:44.466255  3330 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:44.533627  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 414882us
I20260709 12:59:44.466684  3153 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:44.537585  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:44.524508  3300 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:44.525905  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.575721  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:59:44.575497  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 401550us
I20260709 12:59:44.598959  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:44.611003  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:44.613164  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:44.614084  1701 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:44.519676  2262 rpcz_store.cc:276] 0709 12:59:42.710239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.712052 (+  1813us) service_pool.cc:224] Handling call
0709 12:59:42.743893 (+ 31841us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.776608 (+ 32715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.779266 (+  2658us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.935555 (+156289us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.614836 (+679281us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:43.614884 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.615080 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.467239 (+852159us) raft_consensus.cc:1685] finished
0709 12:59:44.469663 (+  2424us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.478844 (+  9181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6999,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5079,"thread_start_us":576469,"threads_started":1,"wal-append.queue_time_us":860011}
W20260709 12:59:44.574079  3410 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.009s	sys 0.010s
I20260709 12:59:44.621740  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:44.643956  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46041.4us
I20260709 12:59:44.575963  3423 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:44.650828  2268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.011s	sys 0.018s
W20260709 12:59:44.651161  2268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.011s	sys 0.018s
W20260709 12:59:44.652057  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 368299us
I20260709 12:59:44.652184  1601 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:44.649776  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:44.611088  3342 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.635s	user 0.013s	sys 0.000s
I20260709 12:59:44.576244  3110 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.573661  3322 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:44.647850  3380 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:44.643952  3300 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:44.667531  1560 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.026s	sys 0.107s
I20260709 12:59:44.648083  3424 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.609438  3294 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:44.650882  3286 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:44.616815  3427 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:59:44.664878  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1488) took 1559 ms. Trace:
I20260709 12:59:44.670986  3307 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:44.663884  3274 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:44.667090  3327 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:44.685274  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:44.650228  3186 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 12:59:44.677863  1560 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.027s	sys 0.108s
I20260709 12:59:44.673375  3380 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 12:59:44.691069  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 256071us
W20260709 12:59:44.699127  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.000s	sys 0.019s
W20260709 12:59:44.700086  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.000s	sys 0.019s
I20260709 12:59:44.697422  1631 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 2: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:44.677857  3298 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:44.676052  3308 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:44.658735  3342 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:44.703305  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:44.705547  1632 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:44.709311  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:44.713066  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.665747  3322 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:44.690003  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:44.707509  3409 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 12:59:44.690510  3307 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:44.695281  3327 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.722754  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.718734  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:44.768491  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 49844.8us
I20260709 12:59:44.680353  3300 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:44.703611  3442 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:44.705355  3380 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:44.699411  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:44.700640  3184 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 12:59:44.808197  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49904.2us
I20260709 12:59:44.703756  3325 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:44.707360  3353 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:44.685163  3424 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:44.807411  3327 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.841297  3432 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:44.718287  3421 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:44.687265  3286 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:44.744371  3383 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:44.899551  3326 consensus_meta.cc:287] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.263s	user 0.010s	sys 0.014s
W20260709 12:59:44.901485  3231 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.859s	user 0.008s	sys 0.002s
I20260709 12:59:44.902300  1626 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:59:44.863371  3419 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:44.902706  1626 pending_rounds.cc:85] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 3
I20260709 12:59:44.903018  1626 pending_rounds.cc:107] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:59:44.903306  1626 raft_consensus.cc:2889] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:44.866484  3325 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:44.910846  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:44.912771  1554 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:44.915457  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:44.808848  3426 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.332s	user 0.003s	sys 0.001s
I20260709 12:59:44.703828  3274 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:44.807147  3307 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:44.767699  3423 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:44.869369  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 99598.3us
I20260709 12:59:44.895920  3434 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:44.947733  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:44.814296  3152 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
W20260709 12:59:44.902740  3436 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:59:44.892402  1629 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:44.945046  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.857712  3184 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:44.509323  1706 rpcz_store.cc:276] 0709 12:59:43.088568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.092513 (+  3945us) service_pool.cc:224] Handling call
0709 12:59:43.092829 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.105547 (+ 12718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.105579 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:43.106055 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.765358 (+659303us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:43.767367 (+  2009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.782679 (+ 15312us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.407060 (+624381us) raft_consensus.cc:1685] finished
0709 12:59:44.415900 (+  8840us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.426750 (+ 10850us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6527,"raft.queue_time_us":15851,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":11285,"thread_start_us":342067,"threads_started":1,"wal-append.queue_time_us":932484}
I20260709 12:59:44.905261  3275 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.953702  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:44.954921  1701 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:44.917124  3335 consensus_meta.cc:287] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.306s	user 0.013s	sys 0.000s
I20260709 12:59:44.983003  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:44.929304  2264 raft_consensus.cc:2410] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:44.819638  3442 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:44.905488  3421 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:44.914245  3418 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:44.974500  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.868517  3353 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:44.904791  3349 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:44.975929  3420 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:44.980029  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:44.956183  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:44.988013  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:44.903026  3419 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:44.941854  3423 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:44.964614  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:45.088619  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1493) took 1819 ms. Trace:
W20260709 12:59:45.168403  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 257024us
I20260709 12:59:45.271055  1626 rpcz_store.cc:276] 0709 12:59:43.271138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.271446 (+   308us) service_pool.cc:224] Handling call
0709 12:59:43.271710 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.903837 (+1632127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.088363 (+184526us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400355f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:45.088556 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3749384064}
I20260709 12:59:45.274042  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 652) took 1488 ms. Trace:
I20260709 12:59:44.686635  1635 rpcz_store.cc:276] 0709 12:59:43.099684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.101259 (+  1575us) service_pool.cc:224] Handling call
0709 12:59:43.113554 (+ 12295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.131914 (+ 18360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.138439 (+  6525us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:43.166601 (+ 28162us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.228079 (+1061478us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:44.253520 (+ 25441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.274160 (+ 20640us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.648135 (+373975us) raft_consensus.cc:1685] finished
0709 12:59:44.648165 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.659225 (+ 11060us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6607,"raft.queue_time_us":13836,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":1033009,"threads_started":1,"wal-append.queue_time_us":1223029}
I20260709 12:59:45.048295  1557 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:45.274631  2269 rpcz_store.cc:276] 0709 12:59:43.786180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.786302 (+   122us) service_pool.cc:224] Handling call
0709 12:59:43.847679 (+ 61377us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 12:59:43.847895 (+   216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.872794 (+ 24899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.872833 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:43.986143 (+113310us) log.cc:844] Serialized 564 byte log entry
0709 12:59:44.165098 (+178955us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:44.165133 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.165218 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.266797 (+1101579us) raft_consensus.cc:1685] finished
0709 12:59:45.266934 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.273962 (+  7028us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57571584,"thread_start_us":178593,"threads_started":1,"wal-append.queue_time_us":441187}
W20260709 12:59:45.283013  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 335353us
I20260709 12:59:45.167083  3286 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:45.147367  3447 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:59:45.292413  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:45.154587  3384 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.310s	user 0.012s	sys 0.001s
I20260709 12:59:45.161142  3442 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:45.156255  3292 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.002s
I20260709 12:59:45.274562  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:45.152088  3110 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.281834  1629 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:45.310904  3449 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:45.008914  3418 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:45.092862  3381 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:45.158000  3424 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:45.313625  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1678) took 1294 ms. Trace:
I20260709 12:59:45.347033  1551 rpcz_store.cc:276] 0709 12:59:44.019697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.019809 (+   112us) service_pool.cc:224] Handling call
0709 12:59:44.020087 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.193315 (+173228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.193346 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.194143 (+   797us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.618964 (+424821us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:44.619033 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.619123 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.313339 (+694216us) raft_consensus.cc:1685] finished
0709 12:59:45.313364 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.313550 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142668,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":516665,"threads_started":2,"wal-append.queue_time_us":1082994}
I20260709 12:59:45.087664  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 400) took 1879 ms. Trace:
I20260709 12:59:45.348742  2263 rpcz_store.cc:276] 0709 12:59:43.208213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.210442 (+  2229us) service_pool.cc:224] Handling call
0709 12:59:43.235510 (+ 25068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.320741 (+ 85231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.328136 (+  7395us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:43.522782 (+194646us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.838521 (+315739us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:43.838595 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.087104 (+1248509us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b540063f954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:45.087178 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.087243 (+    65us) raft_consensus.cc:1685] finished
0709 12:59:45.087260 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.087586 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1576,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":33176,"spinlock_wait_cycles":112940288,"thread_start_us":275341,"threads_started":1,"wal-append.queue_time_us":572856,"wal-append.run_cpu_time_us":2531,"wal-append.run_wall_time_us":1191053}
I20260709 12:59:45.271176  3423 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.148319  3325 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:45.329015  3300 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:45.152784  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:45.285048  3430 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.163125  3421 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:45.275686  3342 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:45.318418  1552 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:45.110201  3294 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:45.325670  3437 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:45.326077  3274 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:45.249183  3429 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:45.290422  3446 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:45.004810  3275 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:45.301119  3295 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:44.995304  3335 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.309310  3286 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:45.326941  3384 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.981210  3434 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.358121  3349 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:45.328876  3292 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:45.360541  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 61626.5us
I20260709 12:59:45.364270  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1500) took 2129 ms. Trace:
I20260709 12:59:45.344262  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 654) took 1530 ms. Trace:
I20260709 12:59:45.338855  3184 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:45.408903  2271 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:45.369791  3430 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.372478  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:45.303273  3420 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.369851  3443 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:45.358902  3353 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:45.379325  3424 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.424335  3424 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.369712  2264 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:45.367645  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:45.164215  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:45.393563  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:45.419376  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:45.423146  3443 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.361259  3449 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.437428  2269 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:59:45.443418  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49982.6us
W20260709 12:59:45.426477  3327 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.003s
I20260709 12:59:45.445237  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:45.509203  1628 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 1.
I20260709 12:59:45.509572  3454 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:45.409149  3446 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.425684  1629 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:45.387684  3295 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:45.427544  3281 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:45.392231  3286 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:45.510195  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:45.523801  1628 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:45.524884  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:45.393095  3384 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.439364  3419 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:45.510174  3454 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 12:59:45.535164  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.040s	sys 0.074s
I20260709 12:59:45.450814  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:45.549288  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.040s	sys 0.074s
I20260709 12:59:45.514510  3421 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:45.556811  1628 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:45.566174  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:45.566740  1704 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:45.566771  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:45.567504  1708 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:45.567790  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:45.570384  1634 raft_consensus.cc:2410] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:45.542711  3454 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.565498  1673 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:59:45.574972  3450 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 12:59:45.576740  3461 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:59:45.577510  3384 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:45.578181  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:45.579804  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:45.581161  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1677) took 1561 ms. Trace:
I20260709 12:59:45.581635  1599 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:45.581579  1553 rpcz_store.cc:276] 0709 12:59:44.019378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.019507 (+   129us) service_pool.cc:224] Handling call
0709 12:59:44.019799 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.193225 (+173426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.193256 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.207863 (+ 14607us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.703106 (+495243us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:44.703151 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.703230 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.580932 (+877702us) raft_consensus.cc:1685] finished
0709 12:59:45.580957 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.581099 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142765,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":581927,"threads_started":2,"wal-append.queue_time_us":1086281}
W20260709 12:59:45.554545  3307 consensus_meta.cc:287] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.600s	user 0.014s	sys 0.009s
I20260709 12:59:45.552117  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:45.577838  3380 consensus_meta.cc:287] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.000s
I20260709 12:59:45.570256  3421 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.586862  3420 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:45.587150  3443 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:45.594753  3446 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:45.520052  3327 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:45.539276  3281 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.420845  3429 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:45.559465  3381 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:59:45.393651  3437 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.593511  3292 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:45.580549  2263 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:45.593138  3358 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:45.611601  1626 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:45.601435  1601 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:45.614308  3335 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:45.614554  1704 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
W20260709 12:59:45.608775  3465 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:59:45.615785  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:45.617098  3437 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:45.409832  2267 rpcz_store.cc:276] 0709 12:59:43.813447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.146547 (+333100us) service_pool.cc:224] Handling call
0709 12:59:44.201467 (+ 54920us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.288378 (+ 86911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:44.293897 (+  5519us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.379135 (+ 85238us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.703916 (+324781us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:44.709788 (+  5872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.719780 (+  9992us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.327280 (+607500us) raft_consensus.cc:1685] finished
0709 12:59:45.330774 (+  3494us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.342325 (+ 11551us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56819,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":117,"thread_start_us":263071,"threads_started":1,"wal-append.queue_time_us":491339}
I20260709 12:59:45.590164  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:45.621742  1632 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:45.630841  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:45.622874  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:45.624662  3286 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:45.636576  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:45.609220  3358 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:45.608969  3420 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:59:45.632850  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:45.631596  1632 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:45.649945  3457 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:45.612751  3307 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:45.592805  3380 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:45.634083  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44065us
I20260709 12:59:45.662292  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:45.637532  3294 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:45.667356  2234 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:45.644356  3433 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:45.647078  3358 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:45.668908  1704 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:59:45.625226  3429 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:45.410079  1700 rpcz_store.cc:276] 0709 12:59:43.235072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.591681 (+356609us) service_pool.cc:224] Handling call
0709 12:59:43.592005 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.738712 (+146707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.738765 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:43.741628 (+  2863us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.199635 (+458007us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:44.205324 (+  5689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.326642 (+1121318us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b54001df954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:45.326694 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.326741 (+    47us) raft_consensus.cc:1685] finished
0709 12:59:45.329266 (+  2525us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.364177 (+ 34911us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"spinlock_wait_cycles":126537088,"thread_start_us":428935,"threads_started":1,"wal-append.queue_time_us":618674,"wal-append.run_cpu_time_us":1724,"wal-append.run_wall_time_us":1056550}
I20260709 12:59:45.674778  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:45.680557  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:45.685844  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:45.688236  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:45.663053  3286 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:45.727293  3331 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:45.727403  3346 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:45.667542  3434 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:45.717875  3459 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:45.709722  3295 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:45.746315  3459 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:45.727484  3307 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:45.746793  3459 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:45.671241  3437 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:45.669505  3294 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:45.729430  3346 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.686291  3281 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:45.722447  3449 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:45.711618  3418 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:45.671578  3433 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.686206  3421 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:45.721947  3355 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:45.729362  3331 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.674341  3388 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:45.674362  3420 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:45.750427  3437 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:45.737072  3430 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:45.738021  3380 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:45.792382  3420 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.750591  3294 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.795354  3420 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:45.797323  3437 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:45.778833  3433 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:45.720806  3423 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.791527  3388 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.822327  3388 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.838726  3423 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:45.841668  3459 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.843398  3454 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:45.907476  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 228) took 2108 ms. Trace:
I20260709 12:59:45.908639  1558 rpcz_store.cc:276] 0709 12:59:43.798566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.799305 (+   739us) service_pool.cc:224] Handling call
0709 12:59:43.799714 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.800129 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.800169 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:43.800693 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.046293 (+245600us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:44.046353 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.046452 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.496770 (+450318us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 12:59:45.649567 (+1152797us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b2400195bd8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dad689c4 00007f06dad66acb 00007f06daf21dc9 00007f06daf21a55 00007f06daf20fb0 00007f06ddb97488 00007f06ddb97be8 00007f06ddb6f398 00007f06ddb6a76a 00007f06ddb69bb6
0709 12:59:45.906515 (+256948us) raft_consensus.cc:1685] finished
0709 12:59:45.906603 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.907102 (+   499us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":13612,"spinlock_wait_cycles":13965056,"thread_start_us":245208,"threads_started":1,"wal-append.queue_time_us":563420}
I20260709 12:59:46.041102  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.042685  1553 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.046674  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.047899  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.055867  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.056070  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.061929  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.063138  1700 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:46.064455  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.066103  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:46.067966  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.069952  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.071316  1700 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 1.
I20260709 12:59:46.075227  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 646) took 2311 ms. Trace:
I20260709 12:59:46.078159  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:46.075294  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:46.081029  1700 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:46.081503  2263 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:46.070077  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:45.670815  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:46.087395  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:46.088219  1707 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.075975  2266 rpcz_store.cc:276] 0709 12:59:43.763538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.765280 (+  1742us) service_pool.cc:224] Handling call
0709 12:59:44.957058 (+1191778us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaaf8c 00007f06daeaaef6 0000000000375939 00007f06e2f1e1e0 00007f06e2fe70c4 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 12:59:44.967313 (+ 10255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.004764 (+ 37451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.008801 (+  4037us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.266688 (+257887us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.509376 (+242688us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:45.509422 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.509490 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.722054 (+212564us) raft_consensus.cc:1685] finished
0709 12:59:45.722088 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.074772 (+352684us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13122,"raft.queue_time_us":25013,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":10388,"spinlock_wait_cycles":36727680,"thread_start_us":220152,"threads_started":1,"wal-append.queue_time_us":353955}
I20260709 12:59:46.091327  2266 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:45.747869  3286 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:46.128360  3295 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:46.129136  3349 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:46.129649  3295 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.130419  3349 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.130926  3286 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:46.134483  3300 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:46.134634  3331 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.135085  3319 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:46.135200  3349 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:45.822434  3346 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.212550  3454 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 12:59:46.214202  2270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 538) took 2416 ms (client timeout 1535 ms). Trace:
W20260709 12:59:46.214833  2270 rpcz_store.cc:269] 0709 12:59:43.797341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.876253 (+ 78912us) service_pool.cc:224] Handling call
0709 12:59:46.213627 (+2337374us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b5400030cd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:46.213912 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13545216}
I20260709 12:59:46.215369  3420 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:46.217490  2265 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:46.220465  3421 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:46.220997  3421 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:46.221411  3421 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.224128  3422 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:46.224685  3422 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:46.227101  3427 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:46.228075  3427 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:45.853078  3437 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.128443  3281 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:46.216624  3420 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:46.135402  3300 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:46.239260  1553 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:46.208456  3184 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:46.180578  3326 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:46.273813  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.265281  1707 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:46.272215  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.371187  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.204932  3295 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.291293  2267 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:46.208571  3335 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 12:59:46.357610  3480 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:59:46.273703  2236 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:45.854218  3459 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:46.397938  3308 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.273790  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 12:59:46.365595  3433 consensus_meta.cc:287] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.003s
I20260709 12:59:46.366938  3355 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:46.291369  3342 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 12:59:46.291314  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 626206us
I20260709 12:59:46.372323  3135 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:46.270422  3319 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.274297  3419 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:46.419181  3427 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:46.424835  3472 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.443s	user 0.001s	sys 0.000s
I20260709 12:59:46.437851  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.411213  3281 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.449738  1705 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 2: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:46.451192  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.452227  1701 raft_consensus.cc:2410] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:46.451447  3422 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:46.450616  1560 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 12:59:46.458652  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.441660  3286 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:46.445660  3275 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.423027  3308 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:46.451562  3110 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.422845  3433 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:46.473119  1701 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:46.473378  3281 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.474797  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1837) took 1512 ms. Trace:
I20260709 12:59:46.475668  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.479043  1635 rpcz_store.cc:276] 0709 12:59:44.962053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.574251 (+612198us) service_pool.cc:224] Handling call
0709 12:59:45.574707 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.575106 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.575143 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.575673 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.669046 (+ 93373us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:45.670675 (+  1629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.011447 (+340772us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.233283 (+221836us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 12:59:46.474179 (+240896us) raft_consensus.cc:1685] finished
0709 12:59:46.474207 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.474536 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8329,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":13563,"spinlock_wait_cycles":1009628544,"thread_start_us":71234,"threads_started":1,"wal-append.queue_time_us":177052}
I20260709 12:59:46.484828  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:46.486416  3346 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:46.490514  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:46.491470  1705 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.469748  3355 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.493717  3437 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:46.494921  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 653) took 2697 ms. Trace:
I20260709 12:59:46.426954  3184 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.455137  3307 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:46.496069  3355 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:46.447479  3420 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.460522  3335 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.504761  3184 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.507196  3295 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:46.507381  3275 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:46.507764  3420 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.508021  3295 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:46.508445  3275 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:46.495386  2265 rpcz_store.cc:276] 0709 12:59:43.797097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.126308 (+329211us) service_pool.cc:224] Handling call
0709 12:59:46.216794 (+2090486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.218124 (+  1330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.494682 (+276558us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b5400030cd0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:46.494850 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4806934272}
I20260709 12:59:46.509784  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.510246  3295 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.510692  1706 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:46.511909  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.512742  1706 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:46.513236  3335 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.514570  3300 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:46.517115  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.518476  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:46.519016  3294 consensus_meta.cc:287] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.725s	user 0.001s	sys 0.017s
I20260709 12:59:46.519943  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.519735  3294 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:46.518476  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.520744  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.528515  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.529613  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 232) took 2157 ms. Trace:
I20260709 12:59:46.513864  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.442092  3326 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.535593  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.533800  3110 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.551972  1704 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:46.553917  1601 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:46.546744  3307 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.540759  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.556442  1601 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:46.557628  3420 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:46.559248  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 407) took 1175 ms. Trace:
I20260709 12:59:46.559871  3420 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:46.559697  2267 rpcz_store.cc:276] 0709 12:59:45.384185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.648757 (+264572us) service_pool.cc:224] Handling call
0709 12:59:46.559019 (+910262us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54005d6e54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:46.559169 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338280704}
I20260709 12:59:46.560395  3420 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:46.530002  1555 rpcz_store.cc:276] 0709 12:59:44.372514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.528036 (+2155522us) service_pool.cc:224] Handling call
0709 12:59:46.529551 (+  1515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:46.447661  3135 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.564440  3135 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.566195  3420 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.444481  3342 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:46.568436  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 88563.4us
I20260709 12:59:46.567629  1707 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:46.575065  3322 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.550113  1700 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:46.577561  1555 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:46.577586  3286 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.580528  3424 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 12:59:46.582297  3358 consensus_meta.cc:287] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.896s	user 0.008s	sys 0.007s
I20260709 12:59:46.582844  3358 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:46.583930  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.584772  1552 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:46.585258  3358 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:46.586134  3307 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:46.586164  3388 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.706s	user 0.006s	sys 0.009s
I20260709 12:59:46.587405  3388 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.595853  3457 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.596395  3469 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:46.596647  3457 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.597054  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:46.597420  3326 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.597143  3469 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.598991  3457 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.599160  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 405) took 1216 ms. Trace:
I20260709 12:59:46.575964  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:46.599561  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1512) took 1665 ms. Trace:
I20260709 12:59:46.603300  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:46.548796  3319 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.604365  1633 rpcz_store.cc:276] 0709 12:59:44.934168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.993526 (+ 59358us) service_pool.cc:224] Handling call
0709 12:59:44.993867 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.293037 (+299170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.293088 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:45.293152 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:45.293202 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.599163 (+1305961us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54001662d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:46.599222 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.599376 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687371008}
I20260709 12:59:46.615000  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.570837  1635 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:46.617906  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.599737  3342 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.620021  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:59:46.621280  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 45517.5us
I20260709 12:59:46.622453  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.623723  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.623946   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:59:46.624354  3286 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.625229  3110 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.625885  3319 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:46.627511  3469 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.628286  1706 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:46.630369  1705 raft_consensus.cc:2410] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:46.631994  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.638249  1601 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:46.629153  3388 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.641050  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 362) took 1655 ms. Trace:
I20260709 12:59:46.681915  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.643486  3274 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:46.647563  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.648339  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:46.655867  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 56384.1us
I20260709 12:59:46.666507  3308 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.670549  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.685375  1633 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:46.633649  3294 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.671648  3275 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.672436  1558 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:46.673211  3327 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.678866  3433 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:46.678584  3358 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:46.679503  3300 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:46.679430  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.612313  3421 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.682250  1632 rpcz_store.cc:276] 0709 12:59:44.985118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.660786 (+675668us) service_pool.cc:224] Handling call
0709 12:59:45.661128 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.668224 (+  7096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.668258 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.990074 (+321816us) log.cc:844] Serialized 26 byte log entry
0709 12:59:46.403676 (+413602us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:46.406015 (+  2339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.413547 (+  7532us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.564820 (+151273us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 12:59:46.631074 (+ 66254us) raft_consensus.cc:1685] finished
0709 12:59:46.631095 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.640827 (+  9732us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4050,"raft.queue_time_us":6225,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":36209,"spinlock_wait_cycles":56772992,"thread_start_us":292690,"threads_started":1,"wal-append.queue_time_us":447944}
I20260709 12:59:46.690618  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:46.694151  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:46.698228  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 368) took 1022 ms. Trace:
I20260709 12:59:46.699497  3298 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 12:59:46.700317  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 83194.6us
I20260709 12:59:46.698334  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.709726  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.712970  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.715813  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:46.723218  3153 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.723387  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.723651  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.724114  1552 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:46.724817  1555 raft_consensus.cc:2410] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:46.725065  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.725674  1552 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:46.725963  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:46.715207  3298 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.714985  1629 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.727208  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 406) took 1343 ms. Trace:
I20260709 12:59:46.736877  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.726394  3446 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:46.727030  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.726382  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.725802  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.739514  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.741114  3294 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:46.741290  1557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1683) took 1797 ms (client timeout 1559 ms). Trace:
I20260709 12:59:46.603736  2262 rpcz_store.cc:276] 0709 12:59:45.382875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.385580 (+  2705us) service_pool.cc:224] Handling call
0709 12:59:45.428013 (+ 42433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.529151 (+101138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.540614 (+ 11463us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:46.394849 (+854235us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b1800449200. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a
0709 12:59:46.395614 (+   765us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b2c00096928. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2
0709 12:59:46.396438 (+   824us) log.cc:844] Serialized 26 byte log entry
0709 12:59:46.453609 (+ 57171us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:46.458761 (+  5152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.476435 (+ 17674us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.598817 (+122382us) raft_consensus.cc:1685] finished
0709 12:59:46.598834 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.598969 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5698,"raft.queue_time_us":8551,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":23923,"spinlock_wait_cycles":16092160,"thread_start_us":30039,"threads_started":1,"wal-append.queue_time_us":186592}
I20260709 12:59:46.751935  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.737370  2269 rpcz_store.cc:276] 0709 12:59:45.383357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.383464 (+   107us) service_pool.cc:224] Handling call
0709 12:59:45.430074 (+ 46610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.453366 (+ 23292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.726850 (+1273484us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b5400583250. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:46.727055 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106408704}
I20260709 12:59:46.743989  3381 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:46.750886  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:59:46.751250  1524 connection.cc:256] RPC call timeout handler was delayed by -1.8222121800000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
I20260709 12:59:46.728432  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 357) took 1808 ms. Trace:
I20260709 12:59:46.752321  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1369) took 1839 ms. Trace:
I20260709 12:59:46.776080  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.752382  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.753124  3388 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:46.753285  1601 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:46.756224  3325 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 12:59:46.749899  1557 rpcz_store.cc:269] 0709 12:59:44.943901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.982729 (+ 38828us) service_pool.cc:224] Handling call
0709 12:59:46.740952 (+1758223us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b54003133d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:46.741120 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148322688}
I20260709 12:59:46.762112  3433 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:46.764117  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:46.765991  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1848) took 1398 ms. Trace:
I20260709 12:59:46.766095  3300 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:46.766650  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1508) took 2582 ms (client timeout 1594 ms). Trace:
I20260709 12:59:46.728504  3421 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.713122  3420 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.767073  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1497) took 3678 ms. Trace:
I20260709 12:59:46.760315  2234 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:46.783878  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:46.781054  1631 rpcz_store.cc:269] 0709 12:59:44.184507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.274694 (+ 90187us) service_pool.cc:224] Handling call
0709 12:59:46.766266 (+2491572us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54003377d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:46.766460 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":954033920}
I20260709 12:59:46.776463  1559 rpcz_store.cc:276] 0709 12:59:44.910800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.916194 (+  5394us) service_pool.cc:224] Handling call
0709 12:59:46.745039 (+1828845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:46.745354 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.745385 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:46.745435 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:46.745470 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.745525 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.746155 (+   630us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54003133d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:46.750076 (+  3921us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4028941056}
I20260709 12:59:46.780483  3464 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:59:46.780894  1634 rpcz_store.cc:276] 0709 12:59:45.366988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.372236 (+  5248us) service_pool.cc:224] Handling call
0709 12:59:46.765464 (+1393228us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540007a654. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:46.765751 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346704256}
I20260709 12:59:46.791054  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:46.717036  1635 rpcz_store.cc:276] 0709 12:59:45.914244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.484123 (+569879us) service_pool.cc:224] Handling call
0709 12:59:46.697634 (+213511us) spinlock_profiling.cc:243] Waited 82.4 ms on lock 0x7b540035be54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:46.697769 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189405568}
I20260709 12:59:46.791921  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.792709  1560 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:46.774367  3381 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:46.798046  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.779070  3388 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:46.782191  3294 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 12:59:46.802315  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 76552us
I20260709 12:59:46.800529  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:46.802958  1632 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.804857  1631 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:46.806195  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:46.808490  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 48369.1us
I20260709 12:59:46.795689  3322 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:46.805084  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:46.811887  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.818501  1628 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:46.817430  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:46.800872  3388 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.826346  1633 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:46.828899  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.829766  1705 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:46.832050  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:46.832949  1631 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:46.834160  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:46.835830  1631 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.800526  3433 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.829217  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:46.839006  1558 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:46.841100  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.813560  3322 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:46.786188  3446 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.827292  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:46.849913  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:46.848943  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:46.788740  1703 rpcz_store.cc:276] 0709 12:59:43.088834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.090447 (+  1613us) service_pool.cc:224] Handling call
0709 12:59:43.093404 (+  2957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.393489 (+1300085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.766578 (+2373089us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54000b7554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:46.766908 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1787900160}
I20260709 12:59:46.858289  1704 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.860255  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:46.861670  3427 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 12:59:46.861969  1524 connection.cc:256] RPC call timeout handler was delayed by -1.6071121800000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260709 12:59:46.862326  3427 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:46.862679  1524 connection.cc:256] RPC call timeout handler was delayed by -1.5135121799999638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 12:59:46.863188  1524 connection.cc:256] RPC call timeout handler was delayed by -1.3515121799999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
W20260709 12:59:46.863507  1524 connection.cc:256] RPC call timeout handler was delayed by -1.3344121799999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
W20260709 12:59:46.863795  1524 connection.cc:256] RPC call timeout handler was delayed by -1.0922446280000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 12:59:46.847930  3322 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.868377  1707 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 3: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 12:59:46.871701  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 115436us
I20260709 12:59:46.874191  3231 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:59:46.874938  3132 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:46.875001  3298 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:46.875784  3132 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.877632  3298 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:46.869812  3275 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:46.878420  3275 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.878774  3275 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.879492  3432 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:46.847237  3421 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:46.855795  3331 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:46.776305  1630 rpcz_store.cc:276] 0709 12:59:44.919806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.924421 (+  4615us) service_pool.cc:224] Handling call
0709 12:59:44.986248 (+ 61827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.513760 (+527512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.519447 (+  5687us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:45.527072 (+  7625us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:45.529468 (+  2396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.728050 (+1198582us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b540035d254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:46.728116 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.728276 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034911488}
I20260709 12:59:46.853609  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.881119  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:46.881086   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:46.864609  3427 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.871987  3384 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:46.882396  3432 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.901085  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:59:46.904453  3485 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:59:46.905066  3452 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:46.904685  3294 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:46.905660  3452 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.906476  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:46.883589  3132 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.907984  3452 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:46.908070  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:46.909258  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:46.910687  3325 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:46.912118  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:46.912786  3446 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:46.913427  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 83424.1us
I20260709 12:59:46.914961  3300 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:46.883250  3381 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:46.915967  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:46.916649  3381 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.916731  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:46.917662  1709 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 3: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:46.917532  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:46.918294  2264 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:46.918476  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1654) took 3692 ms. Trace:
I20260709 12:59:46.919180  3433 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.884881  3331 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:46.919831  3331 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:46.921823  1633 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:46.927044  1629 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 12:59:46.927240  3432 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.927651  3186 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:46.928267  3186 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:46.930564  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:46.931903  1705 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:46.932379  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:46.899343  3384 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:46.935917  3384 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:46.943068  3421 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:46.913791  3420 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:46.950744  3380 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:46.951359  3380 raft_consensus.cc:697] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:46.951586  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:46.952239  3380 consensus_queue.cc:237] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:46.952867  1629 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:46.957589  3308 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:46.958154  3216 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:59:46.918920  1702 rpcz_store.cc:276] 0709 12:59:43.200483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.556937 (+356454us) service_pool.cc:224] Handling call
0709 12:59:43.557179 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.479029 (+921850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.855478 (+2376449us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54001c3ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:46.892747 (+ 37269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104294784}
I20260709 12:59:46.961184  3422 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:46.933785  1630 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 2: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:46.956504  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:46.971206  1631 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:46.978782  1632 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 12:59:46.979709  1704 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:46.981716  1634 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:46.981748  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 81722.6us
W20260709 12:59:46.986429  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 93194.9us
I20260709 12:59:46.989552  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:46.978006  3298 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:46.998219  3298 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:46.998716  3298 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:46.975643  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:46.999728  1629 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:47.000752  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.002964  3186 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:47.004681  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:47.006353  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:47.006880  3186 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:47.007645  3186 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:47.008383  3421 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:47.010895  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.011063  3388 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.011600  1631 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:47.011947  3186 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:47.012354  3186 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:47.012557  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.012735  3186 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.013263  3388 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:47.016111  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 742709us
I20260709 12:59:47.016888  2236 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:47.013217  1631 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:47.023080  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.026892  1630 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 12:59:47.025139  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:47.034198  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:47.018038  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.035617  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.038414  1704 raft_consensus.cc:2393] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 12:59:47.039105  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.039873  1524 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:47.039357  3132 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:47.039860  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:47.045028  3132 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:47.046530  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:47.047242  1631 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.047205  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:47.047008  3421 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:47.046783  3428 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.013s	sys 0.033s
I20260709 12:59:47.048106  3132 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:47.045434  3427 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:47.053776  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 123351us
I20260709 12:59:47.058544  2234 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:47.060030  3326 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:47.060097  2234 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:47.060483  3326 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.060853  3326 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:47.051716  3428 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.013s	sys 0.033s
I20260709 12:59:47.062377  3431 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:47.070295  3423 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:47.070686  3431 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:47.071137  3431 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.072352  3322 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.074963  3497 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:47.075453  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.076364  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:47.076785  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:47.078460  3489 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:47.082042  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:47.082294  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 655) took 2381 ms. Trace:
I20260709 12:59:47.082675  2271 rpcz_store.cc:276] 0709 12:59:44.700889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.701289 (+   400us) service_pool.cc:224] Handling call
0709 12:59:44.701670 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.409437 (+707767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.081869 (+1672432us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b5400710f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:47.082132 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1626169216}
I20260709 12:59:47.085160  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:47.085796  3497 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:47.087163  3308 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:47.077828  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.102579  1634 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 12:59:47.050979  1629 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:47.087555  3308 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:47.106496  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:47.108553  1628 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 12:59:47.105549  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 332) took 1042 ms. Trace:
I20260709 12:59:47.107975  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:47.095338  3423 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:47.113453  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.114281  1628 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 4: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:47.114236  3423 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.115195  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.115811  1628 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:47.116627  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.117873  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.111584  1701 rpcz_store.cc:276] 0709 12:59:46.053724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.497054 (+443330us) service_pool.cc:224] Handling call
0709 12:59:46.538785 (+ 41731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:46.613680 (+ 74895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.613719 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:46.613769 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:46.613811 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.095855 (+482044us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b54000a82d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:47.095896 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.096013 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140353920}
I20260709 12:59:47.140033  1631 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:47.142499  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:47.142814  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:47.146052  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 92321.2us
I20260709 12:59:47.149259  1601 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:47.152582  1634 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.156833  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.143873  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:47.157876  1633 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 4: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:47.149083  3322 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:47.162377  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:47.163787  1628 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:47.172268  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:47.174571  1551 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:47.176755  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:47.177088  1632 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:47.177901  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:47.175956  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:47.186445  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 363) took 2024 ms. Trace:
I20260709 12:59:47.187026  1632 rpcz_store.cc:276] 0709 12:59:45.153887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.162222 (+2008335us) service_pool.cc:224] Handling call
0709 12:59:47.176861 (+ 14639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.177600 (+   739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.177785 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.188964  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:47.170499  3388 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:47.194949  1631 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:47.174772  3294 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:47.208341  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1838) took 2207 ms. Trace:
I20260709 12:59:47.208853  1631 rpcz_store.cc:276] 0709 12:59:44.992632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.144545 (+2151913us) service_pool.cc:224] Handling call
0709 12:59:47.194743 (+ 50198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.200051 (+  5308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.200309 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.210887  3202 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:47.211464  3202 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.212282  3428 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:47.213056  3428 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:47.214697  3350 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
W20260709 12:59:47.215502  3476 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.398s	user 0.005s	sys 0.000s
W20260709 12:59:47.172497  3473 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.382s	user 0.005s	sys 0.000s
I20260709 12:59:47.189225  3433 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:47.194926  3346 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:47.189591  3319 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:47.246531  1632 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:47.249249  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1843) took 1982 ms. Trace:
I20260709 12:59:47.249562  1632 rpcz_store.cc:276] 0709 12:59:45.267787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.201016 (+1933229us) service_pool.cc:224] Handling call
0709 12:59:47.245870 (+ 44854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.248983 (+  3113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.249198 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.250985  1632 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:47.251525  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1846) took 1891 ms. Trace:
I20260709 12:59:47.251794  1632 rpcz_store.cc:276] 0709 12:59:45.361739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.250543 (+1888804us) service_pool.cc:224] Handling call
0709 12:59:47.250833 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.251291 (+   458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.251454 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.252875  1632 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:47.253348  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1847) took 1888 ms. Trace:
W20260709 12:59:47.247565  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 76138.6us
I20260709 12:59:47.253612  1632 rpcz_store.cc:276] 0709 12:59:45.365645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.252442 (+1886797us) service_pool.cc:224] Handling call
0709 12:59:47.252733 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.253161 (+   428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.253295 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.178140  3132 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:47.259030  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 70162.4us
W20260709 12:59:47.259588  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 88203.9us
I20260709 12:59:47.270013  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:47.275063  1631 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:47.218619  3452 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:47.244890  3454 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:47.278676  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 83584.2us
W20260709 12:59:47.280697  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 102894us
I20260709 12:59:47.282346  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:47.222859  3388 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:47.285612  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1844) took 1948 ms. Trace:
I20260709 12:59:47.290275  1631 rpcz_store.cc:276] 0709 12:59:45.326982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.209772 (+1882790us) service_pool.cc:224] Handling call
0709 12:59:47.274891 (+ 65119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.275508 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.275689 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.248116  3346 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 12:59:47.289762  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 118098us
I20260709 12:59:47.255187  3421 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:47.267087  3424 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:47.223740  3298 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.283408  3433 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:47.320792  1600 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:47.298604  3346 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.297583  3452 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:47.264489  3294 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.330312  1634 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:47.309623  1630 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:47.332317  3330 raft_consensus.cc:3055] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:47.332571  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 212859us
I20260709 12:59:47.334244  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:47.309217  3424 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:47.348953  3424 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.350494  3433 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:47.350980  3452 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.308439  3202 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:47.354038  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1834) took 2250 ms. Trace:
I20260709 12:59:47.347586  3298 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:47.354477  1626 rpcz_store.cc:276] 0709 12:59:44.940447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.341243 (+400796us) service_pool.cc:224] Handling call
0709 12:59:45.341557 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.612023 (+270466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.160753 (+1548730us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b540018e7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:47.190235 (+ 29482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620643584}
I20260709 12:59:47.292192  3384 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.362381  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1516) took 1932 ms. Trace:
I20260709 12:59:47.362794  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 12:59:47.342303  3498 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 12:59:47.374505  1631 rpcz_store.cc:276] 0709 12:59:45.429722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.309572 (+1879850us) service_pool.cc:224] Handling call
0709 12:59:47.333989 (+ 24417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.361940 (+ 27951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.361968 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:47.362129 (+   161us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:47.362162 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.362217 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.362331 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.286827  3308 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:47.400388  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 67307.5us
I20260709 12:59:47.402132  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:47.451898  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:47.345849  3330 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 12:59:47.458359  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 95632us
I20260709 12:59:47.459295  1701 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:47.453472  1702 pending_rounds.cc:85] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 5
I20260709 12:59:47.376400  3153 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:47.461068  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 411) took 1835 ms. Trace:
I20260709 12:59:47.462936  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:47.464167  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:47.393750  3454 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 12:59:47.456046  3493 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
I20260709 12:59:47.461129  1702 pending_rounds.cc:107] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:59:47.496615  1702 raft_consensus.cc:2889] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:47.491354  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 185049us
I20260709 12:59:47.501122  2269 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:47.504001  1600 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:47.460829  1703 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:47.519593  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:47.457036  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1845) took 2120 ms. Trace:
W20260709 12:59:47.530754  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 214630us
I20260709 12:59:47.520612  3289 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:47.534778  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:47.530692  1630 rpcz_store.cc:276] 0709 12:59:45.329019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.213852 (+1884833us) service_pool.cc:224] Handling call
0709 12:59:47.264888 (+ 51036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.355385 (+ 90497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.401056 (+ 45671us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.499379  2268 rpcz_store.cc:276] 0709 12:59:45.421712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.688223 (+266511us) service_pool.cc:224] Handling call
0709 12:59:45.688588 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.689012 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.689050 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.710354 (+ 21304us) log.cc:844] Serialized 26 byte log entry
0709 12:59:46.080488 (+370134us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:46.080602 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.080781 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.214769 (+1133988us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 12:59:47.217732 (+  2963us) raft_consensus.cc:1685] finished
0709 12:59:47.217751 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.256834 (+ 39083us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":534,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":1554,"spinlock_wait_cycles":919581056,"thread_start_us":356725,"threads_started":1,"wal-append.queue_time_us":94897}
W20260709 12:59:47.536123  3500 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
W20260709 12:59:47.537082  3186 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.003s
I20260709 12:59:47.537348  3132 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:47.537460  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:47.540104  3431 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.542711  3431 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:47.549201  3308 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:47.550906  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:47.552778  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:47.460922  3327 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:47.374785  3326 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.456332  3202 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:59:47.542516  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:47.543532  3503 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 12:59:47.543841  3382 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:47.496132  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:47.544749  3384 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:47.545583  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 365) took 1966 ms. Trace:
I20260709 12:59:47.688678  1634 rpcz_store.cc:276] 0709 12:59:45.579189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.345707 (+1766518us) service_pool.cc:224] Handling call
0709 12:59:47.465317 (+119610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.545231 (+ 79914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.545256 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:47.545315 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.545353 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.545407 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.545520 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.692922  3326 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:47.694432  1703 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:47.679077  3327 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:47.695575  3327 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.688832  3382 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:47.698596  3382 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.699718  3202 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:47.700296  3202 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.704634  3508 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:47.705114  3508 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:47.711001  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1514) took 2281 ms. Trace:
I20260709 12:59:47.546948  3423 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:47.453648  3350 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:47.555363  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:47.537500  3186 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:47.522104  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:47.564177  3274 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:47.565789  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:47.567389  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:47.570310  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 369) took 1655 ms. Trace:
I20260709 12:59:47.595054  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:47.605232  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1839) took 2612 ms. Trace:
W20260709 12:59:47.509591  3502 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
W20260709 12:59:47.523712  3275 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.645s	user 0.012s	sys 0.000s
I20260709 12:59:47.546375  3330 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:47.679742  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 175822us
I20260709 12:59:47.738343  1628 rpcz_store.cc:276] 0709 12:59:45.915087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.569284 (+1654197us) service_pool.cc:224] Handling call
0709 12:59:47.569660 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.569891 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.569928 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:47.570004 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.570057 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.570110 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.570241 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:47.749929  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 227974us
I20260709 12:59:47.715097  1632 rpcz_store.cc:276] 0709 12:59:45.429136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.272001 (+1842865us) service_pool.cc:224] Handling call
0709 12:59:47.272341 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.272593 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:47.310303 (+ 37710us) log.cc:844] Serialized 14 byte log entry
0709 12:59:47.710621 (+400318us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:47.710678 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.710727 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.710810 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.710946 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":191777,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":70223,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":108,"thread_start_us":402268,"threads_started":3}
I20260709 12:59:47.766281  3423 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:47.777433  1700 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: [1.3-3.4]
I20260709 12:59:47.778573  3294 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:47.782445  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1529) took 1071 ms. Trace:
I20260709 12:59:47.783018  1635 rpcz_store.cc:276] 0709 12:59:46.711337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.803473 (+ 92136us) service_pool.cc:224] Handling call
0709 12:59:47.594885 (+791412us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaae9c 00007f06daeaaa5b 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 12:59:47.782328 (+187443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5317504}
I20260709 12:59:47.784718  1635 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:47.785478  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 382) took 1110 ms. Trace:
W20260709 12:59:47.793467  3432 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.865s	user 0.011s	sys 0.000s
I20260709 12:59:47.802948  1707 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:47.809744  1709 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:47.738724  3428 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:47.794296  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.851670  1634 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:47.857272  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 372) took 1269 ms. Trace:
I20260709 12:59:47.800742  1702 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:47.852241  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:47.857584  1634 rpcz_store.cc:276] 0709 12:59:46.587659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.763051 (+1175392us) service_pool.cc:224] Handling call
0709 12:59:47.851513 (+ 88462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.857043 (+  5530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.857223 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.851679  1705 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:47.854476  1600 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:47.746512  3289 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:47.740918  3274 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 12:59:47.860463  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 56534.7us
I20260709 12:59:47.861138  1701 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:47.867360  1600 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:47.868151  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 96918.2us
I20260709 12:59:47.872848  3420 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:47.867219  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 373) took 1279 ms. Trace:
I20260709 12:59:47.876552  1628 rpcz_store.cc:276] 0709 12:59:46.588107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.820252 (+1232145us) service_pool.cc:224] Handling call
0709 12:59:47.820563 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.866872 (+ 46309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.866906 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:47.866951 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.866993 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.867049 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.867164 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.879261  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:47.884408  1704 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:47.495364  3388 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:47.860460  3294 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 12:59:47.880004  3422 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.918s	user 0.009s	sys 0.003s
I20260709 12:59:47.554535  3454 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:47.851208  3330 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.878666  3384 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:47.875936  3274 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:47.911123  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.010s	sys 0.006s
I20260709 12:59:47.881771  3509 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:47.919003  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.010s	sys 0.007s
I20260709 12:59:47.773479  3275 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.888988  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:47.813676  3327 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:47.882445  3446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.000s	sys 0.015s
I20260709 12:59:47.874861  3524 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:47.734450  3508 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.793931  3432 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:47.929919  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 60869.6us
W20260709 12:59:47.914574  3499 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 12:59:47.797318  3424 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.943099  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:47.942309  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 395498us
I20260709 12:59:47.785913  1635 rpcz_store.cc:276] 0709 12:59:46.675023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.784134 (+1109111us) service_pool.cc:224] Handling call
0709 12:59:47.784541 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.785151 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.785386 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:47.945291  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:47.917968  3202 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:47.947836  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 401488us
W20260709 12:59:47.949443  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.963274  1626 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:47.937381  3446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.004s	sys 0.016s
I20260709 12:59:47.915629  3428 consensus_queue.cc:1059] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:59:47.744982  1629 rpcz_store.cc:276] 0709 12:59:44.997899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.153085 (+2155186us) service_pool.cc:224] Handling call
0709 12:59:47.222470 (+ 69385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.602561 (+380091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.602608 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:47.602664 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:47.602717 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.604898 (+  2181us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54000893d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:47.604954 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.605127 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873502080}
I20260709 12:59:47.967135  1454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35578 (request call id 322) took 7710 ms. Trace:
I20260709 12:59:47.950217  3524 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:47.971851  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:47.972561  1629 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.974010  3524 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:47.968024  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:47.974583  3186 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:47.974982  1701 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:47.975220  3186 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:47.968365  3216 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:47.947067  3294 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.978488  3216 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:47.979060  3216 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.980238  3294 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:47.981106  3186 raft_consensus.cc:3055] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:47.981527  3186 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:47.982388  3186 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.983778  3186 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.971498  1454 rpcz_store.cc:276] 0709 12:59:40.256832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.256969 (+   137us) service_pool.cc:224] Handling call
0709 12:59:40.286138 (+ 29169us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b540009b354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf39090 00007f06ddfd7f3a 00007f06e3d8e1cc 00007f06e3e8c37e 00007f06e234d2a4 00007f06e234d232 00007f06e234d161 00007f06e234d0dc 00007f06e234c392 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:47.966905 (+7680767us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:43.606911 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:43.607774 (+   863us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:43.607821 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:59:43.607851 (+    30us) tablet.cc:662] Decoding operations
0709 12:59:43.608625 (+   774us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:43.608728 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:43.608768 (+    40us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:59:43.609261 (+   493us) tablet.cc:701] Row locks acquired
0709 12:59:43.609286 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:59:43.609439 (+   153us) write_op.cc:270] Start()
0709 12:59:43.609584 (+   145us) write_op.cc:276] Timestamp: P: 1783601983609393 usec, L: 0
0709 12:59:43.609613 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:59:43.610635 (+  1022us) log.cc:844] Serialized 1759 byte log entry
0709 12:59:44.863339 (+1252704us) op_driver.cc:464] REPLICATION: finished
0709 12:59:45.442755 (+579416us) write_op.cc:301] APPLY: starting
0709 12:59:45.446780 (+  4025us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:45.526624 (+ 79844us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:45.560901 (+ 34277us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:45.606341 (+ 45440us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:45.606616 (+   275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:59:45.606683 (+    67us) write_op.cc:312] APPLY: finished
0709 12:59:45.606979 (+   296us) log.cc:844] Serialized 41 byte log entry
0709 12:59:45.607154 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:45.607254 (+   100us) write_op.cc:454] Released schema lock
0709 12:59:45.607291 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:45.607664 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:45.607687 (+    23us) write_op.cc:454] Released schema lock
0709 12:59:45.707026 (+ 99339us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b540009b354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcc32a 00007f06ddf51f14 00007f06ddf51ec3 00007f06ddf51e38 00007f06ddf51df3 00007f06ddf510dc 00007f06ddf7ae16 00007f06ddf62cbb 00007f06ddf4d39d 00007f06ddf50d75
Metrics: {"mutex_wait_us":6189,"reported_tablets":8,"spinlock_wait_cycles":16088960,"child_traces":[["op",{"apply.queue_time_us":539823,"apply.run_cpu_time_us":8218,"apply.run_wall_time_us":179373,"num_ops":4,"prepare.queue_time_us":794592,"prepare.run_cpu_time_us":25246,"prepare.run_wall_time_us":205239,"raft.queue_time_us":725397,"raft.run_cpu_time_us":154215,"raft.run_wall_time_us":996509,"replication_time_us":1156424,"spinlock_wait_cycles":5139840,"thread_start_us":1591683,"threads_started":4,"wal-append.queue_time_us":223671,"wal-append.run_cpu_time_us":36482,"wal-append.run_wall_time_us":2783821}]]}
I20260709 12:59:47.987529  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:47.988193  1634 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.990212  1629 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:47.994928  3510 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:47.933174  3509 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 12:59:47.948920  3433 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.007s	sys 0.020s
I20260709 12:59:47.986567  3382 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:47.970485  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:47.995507  3509 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.994506  3508 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:47.968894  1627 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:59:47.998951  1524 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:48.000327  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 718028us
I20260709 12:59:48.003857  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:48.004911  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:47.999248  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.999015  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:48.009510  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:48.003077  1701 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:47.969194  1456 catalog_manager.cc:5697] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 2 to 3, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.028893  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:48.030602  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:47.997982  3433 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.007s	sys 0.021s
I20260709 12:59:48.027691  1601 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:48.031942  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:47.997658  3382 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.051939  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:47.998529  3510 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:47.965909  1700 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:48.062016  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:48.015497  3295 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.080243  1706 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:48.064908   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:47.923645  3507 consensus_queue.cc:1059] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.529s
W20260709 12:59:48.088094  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 56007.6us
I20260709 12:59:48.031288  3308 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:48.094929  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 95987.7us
I20260709 12:59:48.095188  1634 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:48.101009  1634 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:48.101748  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1855) took 1345 ms. Trace:
I20260709 12:59:48.101835  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:48.102231  1634 rpcz_store.cc:276] 0709 12:59:46.756373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.100447 (+1344074us) service_pool.cc:224] Handling call
0709 12:59:48.100811 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.101495 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.101690 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:48.103852  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1534) took 1310 ms. Trace:
I20260709 12:59:47.995615  3497 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:59:48.104589  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:48.105523  3497 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:48.105980  3497 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:48.106441  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:48.107484  3308 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:48.107990  3308 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.030745  3358 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:48.107162  3497 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:48.109838  3497 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.110822  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1520) took 2447 ms. Trace:
I20260709 12:59:48.110321  1634 rpcz_store.cc:276] 0709 12:59:46.793878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.103004 (+1309126us) service_pool.cc:224] Handling call
0709 12:59:48.103310 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.103520 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:48.103544 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:48.103587 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:48.103614 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.103673 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.103789 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:48.111230  1626 rpcz_store.cc:276] 0709 12:59:45.663732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.394687 (+1730955us) service_pool.cc:224] Handling call
0709 12:59:47.508873 (+114186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.963678 (+454805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.110581 (+146903us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540007a654. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:48.110769 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044683520}
I20260709 12:59:48.114923  3202 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:48.115360  3202 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:48.115753  3202 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:48.116434  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 383) took 1256 ms. Trace:
I20260709 12:59:48.116003  1456 catalog_manager.cc:5697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 1 to 2, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.117084  1702 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:48.118719  3536 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:48.119302  3536 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:48.120189  3536 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:48.120945  1626 rpcz_store.cc:276] 0709 12:59:46.859778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.115531 (+1255753us) service_pool.cc:224] Handling call
0709 12:59:48.115869 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.116109 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:48.116136 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:48.116203 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:48.116244 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.116295 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.116386 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:48.117319  1634 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:48.052857  3153 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:48.053107  3289 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:48.064147  3294 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:48.151444  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 119592us
I20260709 12:59:48.145228  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 387) took 1058 ms. Trace:
I20260709 12:59:48.152211  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:47.997879  3452 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:59:48.151988  1634 rpcz_store.cc:276] 0709 12:59:47.064450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.116879 (+1052429us) service_pool.cc:224] Handling call
0709 12:59:48.117129 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.122575 (+  5446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.122747 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:48.066102  3510 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:48.076917  3300 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 12:59:48.159430  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.004s	sys 0.011s
W20260709 12:59:48.297752  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.005s	sys 0.012s
W20260709 12:59:48.321336  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 376087us
W20260709 12:59:48.322818  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 174975us
I20260709 12:59:48.095592  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:59:48.325217  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 179177us
I20260709 12:59:48.129124  3153 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 12:59:48.320658  1599 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.511s (SENT) [suppressed 11 similar messages]
W20260709 12:59:48.278431  3346 consensus_meta.cc:287] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.792s	user 0.007s	sys 0.003s
W20260709 12:59:48.159458  3518 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:59:48.010138  3423 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.351491  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:48.079213  3184 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.247s
I20260709 12:59:48.160827  3529 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:48.364002  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:48.353276  3433 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:48.372340  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44721.2us
I20260709 12:59:48.372506  3358 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:48.372601  3432 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.373694  3275 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:48.354547  3496 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.223s	user 0.000s	sys 0.008s
I20260709 12:59:48.375204  3346 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.378264  1703 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:48.378866  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:48.426232  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:48.275918  3382 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.123s
I20260709 12:59:48.396751  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:48.279280  3510 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.412021  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:48.434415  1701 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 3: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:48.325968  3294 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 12:59:48.355418  3504 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
I20260709 12:59:48.146340  3322 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.221s
I20260709 12:59:48.354664  3153 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.336817  3516 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:48.148109  3295 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:48.412952  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:48.456543  3432 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:48.441039  3534 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:48.441875  3527 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.283s	user 0.000s	sys 0.000s
W20260709 12:59:48.444072  3520 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
W20260709 12:59:48.446152  3506 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.505s	user 0.005s	sys 0.005s
I20260709 12:59:48.366993  3428 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:48.336200  3186 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 12:59:48.453076  1554 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:48.455574  3216 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.448994  1551 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:48.397121  3433 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:48.332526  3519 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.519s
W20260709 12:59:48.432889  3511 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.586s	user 0.001s	sys 0.000s
I20260709 12:59:48.469086  1560 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:48.440351  3308 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:48.424443  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1527) took 1747 ms. Trace:
I20260709 12:59:48.496701  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1521) took 2832 ms. Trace:
W20260709 12:59:48.496850  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.350230  3300 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.494776  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:48.555341  1558 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:48.509377  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 145487us
I20260709 12:59:48.517920  3327 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:48.517766  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 418509us
I20260709 12:59:48.425881  3358 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:48.501056  3331 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.581s	user 0.017s	sys 0.000s
I20260709 12:59:48.495428  1555 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:48.494903  3529 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.494776  3534 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:48.488014  3530 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:48.536568  3508 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.000s
W20260709 12:59:48.538769  3330 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.620s	user 0.004s	sys 0.004s
W20260709 12:59:48.540990  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.543339  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:48.543887  1559 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:48.574121  1551 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:48.540849  1631 rpcz_store.cc:276] 0709 12:59:45.664658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.396738 (+1732080us) service_pool.cc:224] Handling call
0709 12:59:47.453817 (+ 57079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.454052 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:47.921960 (+467908us) log.cc:844] Serialized 14 byte log entry
0709 12:59:48.495598 (+573638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:48.495663 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:48.495706 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.495761 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.496634 (+   873us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16609,"prepare.queue_time_us":194566,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":16549,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":27740,"thread_start_us":834941,"threads_started":2}
W20260709 12:59:48.545212  3525 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 12:59:48.546494  3539 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:48.548640  3274 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.601s	user 0.006s	sys 0.001s
W20260709 12:59:48.549474  3531 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:59:48.550309  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1709) took 1468 ms. Trace:
I20260709 12:59:48.552321  3308 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:48.584043  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 477692us
I20260709 12:59:48.551748  3510 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.553321  3295 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:48.561107  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 186730us
I20260709 12:59:48.582399  1553 rpcz_store.cc:276] 0709 12:59:47.081944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.086090 (+  4146us) service_pool.cc:224] Handling call
0709 12:59:47.086381 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.086784 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.086819 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:47.087279 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.171259 (+ 83980us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.173966 (+  2707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.174122 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:48.550085 (+1375963us) raft_consensus.cc:1685] finished
0709 12:59:48.550105 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.550239 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8458,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9729,"thread_start_us":83498,"threads_started":1,"wal-append.queue_time_us":235490}
I20260709 12:59:48.563243  3289 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:48.563382  3497 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:48.532012  3424 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:48.534085  3433 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.523887  3516 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.583978  3294 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.607343  3358 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.540146  1629 rpcz_store.cc:276] 0709 12:59:46.677338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.032010 (+1354672us) service_pool.cc:224] Handling call
0709 12:59:48.129811 (+ 97801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.295738 (+165927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:48.326098 (+ 30360us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:48.332365 (+  6267us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:48.350572 (+ 18207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.368583 (+ 18011us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.414731 (+ 46148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:48.565557  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:48.609699  3546 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:59:48.610359  1705 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:48.574739  1551 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:48.610787  3423 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:48.611282  3423 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:48.611753  1551 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:48.613153  3381 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.696s	user 0.012s	sys 0.000s
I20260709 12:59:48.557245  3428 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:48.581069  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1519) took 2917 ms (client timeout 2187 ms). Trace:
W20260709 12:59:48.583011  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 430875us
I20260709 12:59:48.627755  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:48.573144  3534 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.566381  1555 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:48.595706  2235 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:48.600355  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 659) took 1772 ms. Trace:
I20260709 12:59:48.584252  3274 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.615747  3433 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.634120  1632 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:48.604462  3300 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.571903  3331 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.614693  3216 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.615451  3346 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:48.615705  3516 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.612112  3423 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.636200  3542 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:48.643636  3381 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:48.644234  3381 raft_consensus.cc:697] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:48.644225  3423 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.645581  3381 consensus_queue.cc:237] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:48.646749  3330 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.647223  3331 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:48.647281  3330 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.649583  3330 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.652868  1673 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:48.638696  3509 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.640s	user 0.008s	sys 0.002s
I20260709 12:59:48.657444  3509 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.658316  3433 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.575330  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:48.619194  1558 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 12:59:48.579162  3184 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:48.670912  3184 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:48.629621  1560 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 12:59:48.663542  3331 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:48.673673  3331 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.674618  3428 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.675773  3331 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:48.626368  1627 rpcz_store.cc:269] 0709 12:59:45.663440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.596565 (+933125us) service_pool.cc:224] Handling call
0709 12:59:48.573932 (+1977367us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540007b054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:48.580976 (+  7044us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3037511552}
I20260709 12:59:48.679600  3497 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:48.680133  3497 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:48.631664  1555 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:48.682533  1555 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:48.634393  2262 rpcz_store.cc:276] 0709 12:59:46.827713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.835714 (+  8001us) service_pool.cc:224] Handling call
0709 12:59:47.531822 (+696108us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaeee 0000000000375939 00007f06e2f1e1e0 00007f06e2fe70c4 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 12:59:47.532020 (+   198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.532615 (+   595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.532655 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:47.533225 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.912660 (+379435us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:47.920956 (+  8296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.932334 (+ 11378us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:48.594734 (+662400us) raft_consensus.cc:1685] finished
0709 12:59:48.594806 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.600278 (+  5472us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2031,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":204,"spinlock_wait_cycles":3212544,"thread_start_us":351022,"threads_started":1,"wal-append.queue_time_us":497256}
W20260709 12:59:48.686131  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.610844  3546 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:48.686746  3553 consensus_queue.cc:1059] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:48.687712  3553 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:48.672034  3184 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:48.638406  1702 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.018s	sys 0.008s
W20260709 12:59:48.636988  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 316362us
I20260709 12:59:48.687074  3546 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 12:59:48.639712  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 251193us
I20260709 12:59:48.622485  3202 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:48.698989  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.702791  1702 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.019s	sys 0.008s
W20260709 12:59:48.703933  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 131384us
I20260709 12:59:48.703999  3331 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:48.704946  3331 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:48.705392  3551 consensus_queue.cc:1059] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:48.705510  2234 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:48.705917  3331 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.706749  3551 raft_consensus.cc:3055] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:48.707077  3551 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:48.707317  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:48.708248  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:48.708472  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:48.708967  2268 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:48.708784  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:48.707906  3551 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.709801  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:48.710587  2271 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:48.711162  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:48.711480  3530 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:48.712272  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:48.723685  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.743654  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.661667  3274 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.746099  1707 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:48.746835  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 47367.8us
I20260709 12:59:48.751338  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:48.626230  3539 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:59:48.751964  2268 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:48.726536  3551 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:48.681242  3497 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.770083  3555 raft_consensus.cc:3055] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:48.726429  3330 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:59:48.771587  3539 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.772112  3539 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:48.750665  3516 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:59:48.774039  3358 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:48.774479  3358 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:48.778175  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:48.782795  1635 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:48.783568  3274 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:48.784508  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:48.784376  3274 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.786741  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:48.787611  1627 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:48.787720  3497 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.790794  3510 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.791615  3510 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:48.792479  3510 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:48.792829  3510 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:48.793195  3510 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.794533  3546 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:48.795253  1631 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:48.770658  3555 raft_consensus.cc:740] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:48.787964  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 378) took 2177 ms. Trace:
I20260709 12:59:48.770570  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:48.802376  1632 rpcz_store.cc:276] 0709 12:59:46.613383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.775062 (+1161679us) service_pool.cc:224] Handling call
0709 12:59:47.775670 (+   608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.636244 (+860574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.787719 (+151475us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b540034d5d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:48.787904 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1973893504}
I20260709 12:59:48.800026  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:48.805620  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:48.806519  1631 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.797070  1600 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:48.812546  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:48.816289  1560 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:48.808599  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:48.813402  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:48.818681  1557 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.821357  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:48.822319  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:48.822651  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:48.823167  1558 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
W20260709 12:59:48.827890  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.821620  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:48.831061  1634 raft_consensus.cc:2368] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3.
I20260709 12:59:48.835904  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:48.809754  3322 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:48.841233  3322 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:48.842459  3322 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:48.836874  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 197803us
I20260709 12:59:48.856411  1600 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:48.810439  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:48.775595  3358 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:48.864421  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:48.826450  3539 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:48.855428  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:48.832983  3509 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.904320  2235 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:48.904431  2269 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:48.898643  1633 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:48.906747  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 332059us
I20260709 12:59:48.763229  3289 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:48.862083  3384 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:48.881081  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.824411  3452 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:59:48.855114  3469 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:48.876232  3559 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:48.863809  3330 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:48.919638  2234 leader_election.cc:400] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3.
I20260709 12:59:48.929440  2234 leader_election.cc:403] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:59:48.930105  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 62465.7us
I20260709 12:59:48.919423  3530 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.931598  3452 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:48.920544  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1319865980000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 12:59:48.917687  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:48.833138  3423 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:59:48.927067  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:48.905242  3521 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.945899  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:48.908371  3186 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:59:48.945060  1673 leader_election.cc:336] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.535s (SENT)
I20260709 12:59:48.946081  3550 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:48.946414  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:48.953958  1673 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:48.946574  3433 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:48.947407  2270 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:48.945935  3423 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:48.948101  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:48.833027  3517 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:59:48.950400  1626 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:48.904531  2262 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:48.949517  3274 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:48.915438  1631 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:48.994448  3186 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:48.923170  3548 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:48.876752  3275 raft_consensus.cc:2764] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:48.920965  3384 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:48.948477  3529 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:48.997766  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:48.925483  3543 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:48.951948  1627 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:48.994781  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:48.929003  3559 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 12:59:48.994438  3556 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:59:49.001396  1557 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:49.088696  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:49.011698  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:49.014231  1555 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:48.999588  1600 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:49.090543  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:49.090803  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 91312.5us
I20260709 12:59:49.015718  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:49.044616  1560 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:48.995757  3516 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:49.047000  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:49.049871  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:49.050609  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:49.050992  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 272961us
I20260709 12:59:49.051626  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:49.070257  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 125239us
I20260709 12:59:49.049460  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:49.000423  3423 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:48.999647  3539 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:48.952379  3153 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.954421  3521 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:49.080382  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:49.075768  3384 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:49.071368  3202 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:49.107681  2268 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:49.085115  1635 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:49.109962  1708 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:49.119551  3539 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:49.090409  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:49.087615  3543 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:49.068742  3186 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:49.050709  3433 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:48.949275  3555 consensus_queue.cc:260] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:49.043787  3550 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:49.088588  3575 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:49.587334  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:49.182606  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 59811.7us
I20260709 12:59:49.305251  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:49.141086  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:49.589421  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.589838  2268 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:49.362464  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1678) took 2006 ms. Trace:
I20260709 12:59:49.587365  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:49.472617  1559 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:49.464488  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1842) took 4283 ms. Trace:
I20260709 12:59:49.577258  1551 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:49.453886  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.456782  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1697) took 1676 ms. Trace:
I20260709 12:59:49.324221  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1525) took 2647 ms. Trace:
I20260709 12:59:49.188716  2270 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
W20260709 12:59:49.575565  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:49.576267  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 422710us
W20260709 12:59:49.584259  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.320586  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:49.585073  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:49.585548  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 393310us
I20260709 12:59:49.325745  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:49.591401  1702 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 4: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 12:59:49.754174  2263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.004s	sys 0.008s
I20260709 12:59:49.888128  1628 rpcz_store.cc:276] 0709 12:59:46.676684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.877315 (+1200631us) service_pool.cc:224] Handling call
0709 12:59:47.877532 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:49.068509 (+1190977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:49.068536 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:49.068574 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:49.068605 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.323869 (+255264us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540006d1d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:49.323930 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.324134 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2616967552}
W20260709 12:59:49.891888  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.892760  1633 rpcz_store.cc:276] 0709 12:59:45.181340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.179176 (+1997836us) service_pool.cc:224] Handling call
0709 12:59:47.216829 (+ 37653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.911961 (+1695132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.464159 (+552198us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540006ccd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:49.464387 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3867457792}
I20260709 12:59:49.651782  1557 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:49.887302  2263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.007s	sys 0.011s
I20260709 12:59:49.641507  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:49.591074  1706 rpcz_store.cc:276] 0709 12:59:47.355563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.356524 (+   961us) service_pool.cc:224] Handling call
0709 12:59:47.356882 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.080799 (+723917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.362134 (+1281335us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54001accd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:49.362352 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1663168384}
I20260709 12:59:49.591754  2269 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:49.702914  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:49.899631  1552 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:49.691282  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:49.901808  2265 raft_consensus.cc:2410] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:49.591341  1559 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:49.902907  1704 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:49.110518  3275 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:49.638249  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 49587.4us
W20260709 12:59:49.151063  3534 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.512s	user 0.004s	sys 0.008s
W20260709 12:59:49.209349  3558 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:59:49.149559  3350 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 12:59:49.571419  3551 consensus_meta.cc:287] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.801s	user 0.005s	sys 0.005s
I20260709 12:59:49.589861  3516 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:49.653725  1631 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:49.676666  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:49.908305  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.142364  3512 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:49.938779  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:49.143954  3567 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:59:49.461418  3497 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.002s
W20260709 12:59:49.563045  3510 consensus_meta.cc:287] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.769s	user 0.009s	sys 0.003s
I20260709 12:59:49.895356  1707 rpcz_store.cc:276] 0709 12:59:47.780532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.871181 (+ 90649us) service_pool.cc:224] Handling call
0709 12:59:47.871520 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.748025 (+876505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.456436 (+708411us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b540005d054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:49.456700 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010893184}
W20260709 12:59:49.552942  3530 consensus_meta.cc:287] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.002s
W20260709 12:59:49.913395  1709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.010s	sys 0.008s
I20260709 12:59:49.624574  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:59:49.987068  1709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.010s	sys 0.008s
I20260709 12:59:49.987217  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 12:59:49.987560  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 363111us
I20260709 12:59:49.915401  3544 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.915681  1706 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:49.473096  3216 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:49.701251  3427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.020s	sys 0.036s
I20260709 12:59:49.360069  3423 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:49.994730  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:49.911106  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:49.411439  3519 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:49.453014  3326 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:49.361107  3322 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:49.465159  3308 raft_consensus.cc:3055] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:50.004878  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:49.949092  2264 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:49.890944  2270 pending_rounds.cc:85] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 2
I20260709 12:59:49.991648  3216 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:49.625499  1701 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:49.191969  3294 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:49.142310  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:49.140123  3153 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:49.923044  1673 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.011s	sys 0.009s
I20260709 12:59:49.275385  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:49.141283  3330 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:49.421885  3274 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 12:59:50.011492  1673 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.011s	sys 0.009s
I20260709 12:59:49.929306  1557 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
W20260709 12:59:49.634567  3452 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.702s	user 0.014s	sys 0.001s
I20260709 12:59:49.890872  3319 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:49.322901  3564 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:59:49.142185  3521 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:49.918331  3382 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.122s	user 0.001s	sys 0.029s
I20260709 12:59:49.901577  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:49.572849  3384 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:49.912914  3553 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:49.951309  1553 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:59:49.934937  3358 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:50.032805  3186 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:50.033527  3186 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.034150  3186 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:49.995831  1702 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:50.037465  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 427) took 1114 ms. Trace:
I20260709 12:59:50.038501  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:49.940341  3548 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:50.039404  2267 raft_consensus.cc:2410] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:59:50.039448  3548 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:50.040030  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 552) took 1092 ms. Trace:
I20260709 12:59:50.040390  2267 rpcz_store.cc:276] 0709 12:59:48.947661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.199132 (+251471us) service_pool.cc:224] Handling call
0709 12:59:50.038341 (+839209us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaae9c 00007f06daeaaa5b 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 12:59:50.039962 (+  1621us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10260224}
I20260709 12:59:50.041677  3548 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:50.021025  3330 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:49.997265  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:50.005178  3308 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:50.005517  1558 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:49.355794  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:50.005856  2270 pending_rounds.cc:107] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:59:49.573684  3546 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:49.994355  3427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.023s	sys 0.042s
I20260709 12:59:49.925300  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:50.011857  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:50.011876  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 901681us
I20260709 12:59:50.013887  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:59:50.015305  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 436664us
I20260709 12:59:49.989122  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 415) took 1281 ms. Trace:
I20260709 12:59:49.990938  3530 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.081192  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:50.087072  1701 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:49.945823  3512 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:49.935648  3350 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:49.999221  3431 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:49.926335  3534 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:49.994751  3528 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.997058  3519 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:50.110251  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:50.026083  1704 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:50.020493  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:50.112478  1707 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:50.003861  3326 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:50.030393  1553 pending_rounds.cc:85] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 2
I20260709 12:59:50.055088  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1522) took 4386 ms. Trace:
I20260709 12:59:50.117733  1553 pending_rounds.cc:107] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:59:50.118100  1553 raft_consensus.cc:2917] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:59:50.058482  3300 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:50.020198  3319 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:50.043366  1556 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.046675  1702 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:49.216900  3559 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:49.987004  3510 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:50.050894  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.012s	sys 0.051s
W20260709 12:59:50.123950  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.013s	sys 0.052s
W20260709 12:59:50.053079  3578 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:59:48.688838  3557 consensus_queue.cc:1175] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f1725fe36e349ac85405627f9c93d95" responder_term: 5 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: [4.3-4.3]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:59:50.023460  3382 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.002s	sys 0.029s
I20260709 12:59:50.002681  3551 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:50.037596  3186 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:50.020869  3452 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3.
I20260709 12:59:50.146763  1559 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.115500  3539 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:50.166326  1554 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:50.059324  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1721) took 1504 ms. Trace:
I20260709 12:59:50.041654  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:50.075730  1673 leader_election.cc:336] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.682s (SENT)
I20260709 12:59:50.184468  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:50.077041  2270 raft_consensus.cc:2917] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:59:50.061725  3553 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.185344  2270 raft_consensus.cc:2889] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:50.185798  2270 pending_rounds.cc:107] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:59:50.186151  2270 raft_consensus.cc:2889] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:50.078729  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:50.084553  1709 raft_consensus.cc:2368] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3.
I20260709 12:59:50.047993  1700 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:50.104707  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:49.994151  3544 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:49.988595  3543 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.118438  1553 raft_consensus.cc:2889] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:50.008776  3294 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:50.063802  3433 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:50.057117  3521 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:50.214856  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:50.023873  3274 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:50.084189  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 553) took 1114 ms. Trace:
I20260709 12:59:50.081705  3548 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.116175  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 554) took 1168 ms. Trace:
W20260709 12:59:50.119712  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 127860us
I20260709 12:59:50.227936  2268 rpcz_store.cc:276] 0709 12:59:48.948262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.088913 (+1140651us) service_pool.cc:224] Handling call
0709 12:59:50.116113 (+ 27200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.125437  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:50.229499  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:50.144711  2235 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.509s (SENT)
I20260709 12:59:50.230219  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:50.170773  2271 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:50.123980  3289 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.037907  2269 rpcz_store.cc:276] 0709 12:59:48.925339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.925487 (+   148us) service_pool.cc:224] Handling call
0709 12:59:50.037258 (+1111771us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54007701d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:50.037371 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389955456}
I20260709 12:59:50.169168  1551 rpcz_store.cc:276] 0709 12:59:48.555192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.555380 (+   188us) service_pool.cc:224] Handling call
0709 12:59:48.565956 (+ 10576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:49.408709 (+842753us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b58002105d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddf2b0aa 00007f06ddfad447 00007f06ddfc5fe7 00007f06ddfc77de 00007f06ddfd1b49 00007f06ddfd2416 00007f06ddfced8f 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4
0709 12:59:50.058892 (+650183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.058931 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.058985 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:50.059028 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.059107 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.059251 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33449,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":9945,"spinlock_wait_cycles":62010240}
I20260709 12:59:50.168392  3573 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:50.232204  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:50.055855  3516 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.193238  1559 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:50.193977  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 115342us
W20260709 12:59:50.164000  3580 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:59:50.086751  3216 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:50.213428  1553 pending_rounds.cc:107] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:59:50.278940  1553 raft_consensus.cc:2889] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:50.160871  3550 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:50.217633  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 431) took 1271 ms. Trace:
I20260709 12:59:50.145972  3431 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:50.226374  1701 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
W20260709 12:59:50.235256  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 159572us
I20260709 12:59:50.202785  3581 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.249684  1633 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:50.251106  1558 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:50.288064  1702 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:50.288491  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 267) took 1235 ms. Trace:
I20260709 12:59:50.257745  3542 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.213734  3294 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.210723  3524 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:50.255436  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 110803us
W20260709 12:59:50.304054  2235 leader_election.cc:336] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.613s (SENT)
I20260709 12:59:50.153440  3300 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:50.261545  1551 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:50.306133  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 268) took 1253 ms. Trace:
I20260709 12:59:50.306609  1551 rpcz_store.cc:276] 0709 12:59:49.052854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.246291 (+1193437us) service_pool.cc:224] Handling call
0709 12:59:50.261309 (+ 15018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.305766 (+ 44457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.306060 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.263041  2268 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:50.232923  3559 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.246774  3548 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.251117  1555 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 4: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:50.234953  3529 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:59:50.270038  3544 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:50.250238  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:50.250402  3573 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:50.260391  3586 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:59:50.227566  2262 rpcz_store.cc:276] 0709 12:59:48.947972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.090657 (+142685us) service_pool.cc:224] Handling call
0709 12:59:50.062591 (+971934us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.119998  3528 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:50.235472  3330 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:50.283538  2270 rpcz_store.cc:276] 0709 12:59:48.946335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.946932 (+   597us) service_pool.cc:224] Handling call
0709 12:59:48.947241 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.217298 (+1270057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.217560 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.285575  1709 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:50.083493  2263 rpcz_store.cc:276] 0709 12:59:48.707491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.709790 (+  2299us) service_pool.cc:224] Handling call
0709 12:59:48.710127 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.710382 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:48.999498 (+289116us) log.cc:844] Serialized 14 byte log entry
0709 12:59:49.922212 (+922714us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:49.929831 (+  7619us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:49.937573 (+  7742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.942873 (+  5300us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.953594 (+ 10721us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":596278,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":5585,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":10813,"thread_start_us":1057983,"threads_started":2,"wal-append.queue_time_us":1056042}
I20260709 12:59:50.188277  3308 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.289031  1558 rpcz_store.cc:276] 0709 12:59:49.052630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.247143 (+1194513us) service_pool.cc:224] Handling call
0709 12:59:50.250925 (+  3782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.288217 (+ 37292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.288427 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.291524  3581 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.293424  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:50.228386  3521 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:50.247884  3289 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.374600  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:50.265722  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 557) took 1258 ms. Trace:
I20260709 12:59:50.376276  2269 rpcz_store.cc:276] 0709 12:59:49.007078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.236865 (+1229787us) service_pool.cc:224] Handling call
0709 12:59:50.265002 (+ 28137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.265287 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.265324 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.265380 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:50.265429 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.265501 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.265650 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.314052  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 556) took 1310 ms. Trace:
I20260709 12:59:50.314836  2235 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:50.377663  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:50.327174  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 269) took 1258 ms. Trace:
I20260709 12:59:50.377408  2268 rpcz_store.cc:276] 0709 12:59:48.997594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.236219 (+1238625us) service_pool.cc:224] Handling call
0709 12:59:50.256038 (+ 19819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.307897 (+ 51859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.308133 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:50.335376  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.248317  3512 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.314560  3216 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:50.346989  1556 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 12:59:50.253759  3326 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.355031  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 563) took 1128 ms. Trace:
I20260709 12:59:50.357371  1702 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:50.357895  1701 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:50.400547  2270 rpcz_store.cc:276] 0709 12:59:49.221197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.348872 (+1127675us) service_pool.cc:224] Handling call
0709 12:59:50.349157 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.349330 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.349353 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.349396 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:50.349446 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.349519 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.349670 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.329834  3542 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:59:50.358990  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 260) took 1313 ms. Trace:
W20260709 12:59:50.359076  1599 leader_election.cc:336] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.052s (SENT)
I20260709 12:59:50.402384  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:50.331923  3384 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:50.309530  3431 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:50.368994  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.378307  1551 rpcz_store.cc:276] 0709 12:59:49.068803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.307500 (+1238697us) service_pool.cc:224] Handling call
0709 12:59:50.326593 (+ 19093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.326790 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.326825 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.326878 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:50.326925 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.326982 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.327105 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:50.336197  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 418243us
W20260709 12:59:50.379880  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.405447  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.405970  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.406277  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.406711  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.395226  1556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 270) took 1326 ms (client timeout 1745 ms). Trace:
W20260709 12:59:50.358340  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.407845  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.350111  3275 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:50.355962  3536 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.405086  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:50.412322  1556 rpcz_store.cc:269] 0709 12:59:49.069094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.216182 (+147088us) service_pool.cc:224] Handling call
0709 12:59:50.395139 (+1178957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.382512  3427 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.425312  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:50.380720  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 564) took 1008 ms. Trace:
W20260709 12:59:50.420464  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 127156us
I20260709 12:59:50.422979  1701 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:50.407447  3433 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.388988  3308 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:50.434360  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:50.431632  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:50.384681  2264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 420) took 1673 ms (client timeout 1917 ms). Trace:
I20260709 12:59:50.423097  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:50.430743  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:50.121650  1630 rpcz_store.cc:276] 0709 12:59:45.668756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.535876 (+1867120us) service_pool.cc:224] Handling call
0709 12:59:47.536358 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:48.004862 (+468504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:48.051199 (+ 46337us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:48.337612 (+286413us) log.cc:844] Serialized 26 byte log entry
0709 12:59:48.819899 (+482287us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:48.824702 (+  4803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.855256 (+ 30554us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:50.024444 (+1169188us) raft_consensus.cc:1685] finished
0709 12:59:50.027232 (+  2788us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.047828 (+ 20596us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42450,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":779157,"threads_started":2,"wal-append.queue_time_us":630721}
I20260709 12:59:50.415881  3575 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:50.406764  3350 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:50.417749  3512 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:50.433261  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 129354us
I20260709 12:59:50.417479  3510 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:50.419947  3529 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.424110  3326 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.442970  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:50.444540  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:50.476150  1702 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:50.403574  1559 rpcz_store.cc:276] 0709 12:59:49.045216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.472016 (+426800us) service_pool.cc:224] Handling call
0709 12:59:49.472432 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.102980 (+630548us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4c001888c0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc29ba20 00007f06dc2aca29 00007f06dc272644 00007f06dc299f2d 00007f06dc299b93 00007f06ddfca18b 00007f06ddfcacb5 00007f06ddfc5f30 00007f06ddfc77de 00007f06ddfd1b49 00007f06ddfd2416
0709 12:59:50.358545 (+255565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.358588 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.358643 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:50.358703 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.358782 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:50.358923 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18884,"raft.queue_time_us":1606,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10417,"spinlock_wait_cycles":35925888}
I20260709 12:59:50.438609  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:50.437969  3588 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 12:59:50.446863  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 103835us
I20260709 12:59:50.451017  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:50.435650  3583 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:59:50.426689  3595 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.427076  3534 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:50.453857  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:50.491775  1551 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:50.456630  2235 leader_election.cc:336] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.631s (SENT)
I20260709 12:59:50.492496  2235 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:50.460305  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:50.468691  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:50.477607  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:50.494643  1559 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:50.478969  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:50.446295  3524 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:50.429461  2266 rpcz_store.cc:276] 0709 12:59:49.365471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.185030 (+819559us) service_pool.cc:224] Handling call
0709 12:59:50.374075 (+189045us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.445747  3586 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:50.482775  1556 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:50.480931  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:50.453354  3575 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:50.430737  3427 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:50.453212  3553 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:50.474483  3568 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.481436  3274 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:50.603595  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:50.604290  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.604465  1559 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:50.537498  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:50.559165  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:50.542112  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:50.593116  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 136520us
I20260709 12:59:50.565249  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 12:59:50.438869  2264 rpcz_store.cc:269] 0709 12:59:48.709051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.710882 (+  1831us) service_pool.cc:224] Handling call
0709 12:59:50.359856 (+1648974us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400692dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:50.382264 (+ 22408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2825061248}
I20260709 12:59:50.608829  2268 raft_consensus.cc:2376] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3. Re-sending same reply.
W20260709 12:59:50.633766  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 105696us
W20260709 12:59:50.634474  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 275443us
I20260709 12:59:50.635530  3350 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:50.487291  3597 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:50.535234  3587 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:59:50.518746  3543 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:50.643776  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 162947us
I20260709 12:59:50.644567  2235 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:50.668265  3573 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:50.522743  3539 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:50.606002  3575 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.672051  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:50.681411  2270 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:50.592342  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1544) took 1775 ms. Trace:
I20260709 12:59:50.524742  3589 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.630973  3300 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:50.602856  3548 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:50.669742  3358 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.000s
I20260709 12:59:50.697046  1633 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:50.635936  3350 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:50.708181  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:50.709103  2270 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:50.699833  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:50.640676  3510 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:50.483791  3275 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.716212  3534 raft_consensus.cc:2764] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:50.520475  3588 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:50.710383  3546 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.003s
I20260709 12:59:50.739974  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:50.633701  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 97154.4us
I20260709 12:59:50.639063  1551 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:50.698721  3384 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.694911  3581 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:50.672395  3274 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:59:50.755357  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 110879us
I20260709 12:59:50.703537  3528 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:50.704944  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:50.712045  3350 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:50.703365  3521 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:50.524505  3595 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:50.789665  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 154651us
I20260709 12:59:50.631600  3568 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:50.633687  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 203429us
I20260709 12:59:50.717482  3548 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:50.899847  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 80434.3us
I20260709 12:59:50.754057  3452 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.146s
I20260709 12:59:50.754175  3543 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:50.900468  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:50.697836  3591 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:59:50.739707  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:50.798974  3573 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:50.911077  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 156596us
I20260709 12:59:50.706718  3539 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:50.911999  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:50.903237  3592 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:50.763324  3596 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.701274  3597 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.754494  3534 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.161s
I20260709 12:59:50.923882  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:50.694082  1635 rpcz_store.cc:276] 0709 12:59:48.786223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.808068 (+ 21845us) service_pool.cc:224] Handling call
0709 12:59:49.047588 (+239520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:49.588991 (+541403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.521909 (+932918us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540006c2d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:50.561218 (+ 39309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436106112}
I20260709 12:59:50.904719  3427 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:50.892437  3530 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:59:50.936584  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:50.937788  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:50.704500  3589 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:50.940171  1631 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:50.921389  3521 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:50.944250  2270 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:50.944499  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:50.841955  3384 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:50.918576  3546 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:59:50.916020  3548 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:50.953925  3384 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:50.954883  3548 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:50.933003  3602 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:50.951361  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:50.957432  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:50.958338  1557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 261) took 1912 ms (client timeout 1509 ms). Trace:
I20260709 12:59:50.958662  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:50.959239  3595 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:50.959919  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:50.961277  1560 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:50.961930  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1726) took 1020 ms. Trace:
W20260709 12:59:50.958894  1557 rpcz_store.cc:269] 0709 12:59:49.045493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.088433 (+ 42940us) service_pool.cc:224] Handling call
0709 12:59:50.958134 (+1869701us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b5400311ad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:50.958255 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293562624}
I20260709 12:59:50.952195  3184 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.963923  1557 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:50.930647  3382 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:50.982823  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1727) took 1041 ms. Trace:
I20260709 12:59:50.987525  1557 rpcz_store.cc:276] 0709 12:59:49.941289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.963301 (+1022012us) service_pool.cc:224] Handling call
0709 12:59:50.963689 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.982564 (+ 18875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.982766 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.962947  1560 rpcz_store.cc:276] 0709 12:59:49.941020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.960586 (+1019566us) service_pool.cc:224] Handling call
0709 12:59:50.960924 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.961684 (+   760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.961868 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:50.962844  1701 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:50.900226  3524 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:50.941161  3544 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:50.925475  3573 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:50.930226  3596 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.090808  1702 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:51.038271  1633 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:59:51.030773  3294 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.718s	user 0.010s	sys 0.000s
I20260709 12:59:51.113662  3294 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:51.089624  1703 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:51.115298  1702 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:51.118212  3591 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.118537  3294 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:51.120103  3308 consensus_meta.cc:287] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.000s
I20260709 12:59:51.067605  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.017238  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:51.017473  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:51.132140  2271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 555) took 2183 ms (client timeout 1566 ms). Trace:
I20260709 12:59:50.962451  3274 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.016975  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:50.962646  3521 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:51.121133  3598 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.405s	user 0.001s	sys 0.000s
I20260709 12:59:51.092013  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 400) took 1446 ms. Trace:
W20260709 12:59:51.104034  3559 consensus_meta.cc:287] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.000s
W20260709 12:59:51.255767  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 325683us
I20260709 12:59:51.209830  3616 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:51.142144  2271 rpcz_store.cc:269] 0709 12:59:48.948537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.007408 (+ 58871us) service_pool.cc:224] Handling call
0709 12:59:51.131954 (+2124546us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540039d854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:51.132063 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2441388928}
I20260709 12:59:51.218164  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:51.137998  1700 consensus_meta.cc:287] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.915s	user 0.009s	sys 0.001s
I20260709 12:59:51.089982  3319 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:51.217936  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:51.031049  3597 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 12:59:51.255967  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 330051us
I20260709 12:59:51.131417  3539 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:51.264353  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 340598us
I20260709 12:59:51.196202  1557 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:51.037601  2267 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:51.138484  3326 consensus_meta.cc:287] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.000s
W20260709 12:59:51.265748  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47718us
W20260709 12:59:51.219065  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.268493  3153 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:51.265092  3568 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:51.037657  3528 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.240s
I20260709 12:59:51.032883  3588 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:51.245857  3550 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.054s	sys 0.087s
I20260709 12:59:51.217029  3350 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.269770  3616 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.291607  3617 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:51.292835  3617 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:51.293572  3616 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:51.281713  1635 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 12:59:51.295039  3550 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.055s	sys 0.087s
I20260709 12:59:51.268828  1700 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:51.037822  3382 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.300653  3382 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:51.278816  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1728) took 1337 ms. Trace:
W20260709 12:59:51.136816  3216 consensus_meta.cc:287] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.738s	user 0.008s	sys 0.000s
I20260709 12:59:51.279224  2236 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:51.301322  3432 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.262751  3274 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.301280  1557 rpcz_store.cc:276] 0709 12:59:49.941604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.108062 (+1166458us) service_pool.cc:224] Handling call
0709 12:59:51.195948 (+ 87886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.277341 (+ 81393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.278756 (+  1415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:51.302574  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:51.303383  1557 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:51.302199  3619 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:51.304044  3619 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:51.304194  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1730) took 1362 ms. Trace:
I20260709 12:59:51.302335  3433 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:59:51.305066  1556 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:51.304626  1557 rpcz_store.cc:276] 0709 12:59:49.944953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.302832 (+1357879us) service_pool.cc:224] Handling call
0709 12:59:51.303201 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.303960 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.304139 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:51.267187  3604 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:59:51.305841  3544 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.306560  3544 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.306943  3544 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:51.301956  3432 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.307130  3521 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:51.307319  3544 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.307894  3274 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:51.303452  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 407) took 1019 ms. Trace:
I20260709 12:59:51.309341  1557 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:59:51.217026  3289 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:51.265317  3553 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.268277  1599 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 12:59:51.343611  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 77328.1us
I20260709 12:59:51.344728  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:51.215603  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:51.346578  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 131067us
I20260709 12:59:51.181133  3591 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:51.291896  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:51.245857  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:51.084537  3589 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:51.281314  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.296720  1706 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:51.297084  3539 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:59:51.297891  1700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 358) took 2178 ms (client timeout 2012 ms). Trace:
I20260709 12:59:51.304533  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:51.310403  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 205741us
I20260709 12:59:51.309796  1557 pending_rounds.cc:85] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 4
I20260709 12:59:51.406388  1557 pending_rounds.cc:107] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 12:59:51.406751  1557 raft_consensus.cc:2917] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 12:59:51.407234  1557 raft_consensus.cc:2889] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:51.407147  1673 connection.cc:256] RPC call timeout handler was delayed by -1.8656725129999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.265s for a response
I20260709 12:59:51.408429  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1419) took 1001 ms. Trace:
I20260709 12:59:51.327958  2269 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 12:59:51.351431  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:51.410090  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1729) took 1468 ms. Trace:
W20260709 12:59:51.410502  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 106036us
W20260709 12:59:51.403514  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:51.412865  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.408895  1557 rpcz_store.cc:276] 0709 12:59:50.407316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.305920 (+898604us) service_pool.cc:224] Handling call
0709 12:59:51.309014 (+  3094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.408173 (+ 99159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.408375 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:51.413344  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.281548  3153 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:51.395262  2264 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:51.309477  1629 rpcz_store.cc:276] 0709 12:59:50.283791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.284027 (+   236us) service_pool.cc:224] Handling call
0709 12:59:50.294482 (+ 10455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:50.294978 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.295020 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:50.295766 (+   746us) log.cc:844] Serialized 52 byte log entry
0709 12:59:50.431932 (+136166us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:50.452093 (+ 20161us) log.cc:844] Serialized 14 byte log entry
0709 12:59:50.452288 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.452360 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:51.303264 (+850904us) raft_consensus.cc:1685] finished
0709 12:59:51.303283 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.303399 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3247,"prepare.queue_time_us":26331,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":4258,"raft.queue_time_us":161903,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":42891,"spinlock_wait_cycles":10214784,"thread_start_us":135751,"threads_started":1,"wal-append.queue_time_us":334554}
I20260709 12:59:51.418576  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:51.419131  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 67807.4us
I20260709 12:59:51.419926  1599 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:51.420249  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:51.414777  3153 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.422422  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:51.425828  3616 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:51.426641  3616 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.426890  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:51.427402  3581 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.428481  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:51.429558  3609 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.429450  3542 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:51.421506  3590 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.404884  3553 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.434866  3610 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:51.425666  3358 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.435362  3590 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.435828  3358 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.430490  3528 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:51.437722  3624 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:51.438148  3358 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:51.402513  3274 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.415189  3597 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:51.263891  1627 rpcz_store.cc:276] 0709 12:59:49.640951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.642648 (+  1697us) service_pool.cc:224] Handling call
0709 12:59:49.643117 (+   469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:50.361209 (+718092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.380794 (+ 19585us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:50.470396 (+ 89602us) log.cc:844] Serialized 52 byte log entry
0709 12:59:50.851401 (+381005us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:50.898951 (+ 47550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:50.903913 (+  4962us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:51.051808 (+147895us) raft_consensus.cc:1685] finished
0709 12:59:51.051837 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.087060 (+ 35223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"raft.queue_time_us":37488,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":18331,"thread_start_us":721620,"threads_started":2,"wal-append.queue_time_us":467649}
I20260709 12:59:51.430505  2271 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:59:51.440181  2271 pending_rounds.cc:85] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 4
I20260709 12:59:51.440490  2271 pending_rounds.cc:107] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 12:59:51.440739  2271 raft_consensus.cc:2917] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 12:59:51.423049  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:51.410470  1552 rpcz_store.cc:276] 0709 12:59:49.941875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.256301 (+1314426us) service_pool.cc:224] Handling call
0709 12:59:51.256658 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.256865 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:51.396385 (+139520us) log.cc:844] Serialized 14 byte log entry
0709 12:59:51.409665 (+ 13280us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:51.409727 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:51.409789 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.409874 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.410005 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12178,"prepare.queue_time_us":37383,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"thread_start_us":129413,"threads_started":2}
I20260709 12:59:51.441859  3350 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:51.409408  3216 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:51.443313  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1732) took 1020 ms. Trace:
I20260709 12:59:51.405915  3595 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:51.423115  2236 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:51.438858  3529 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:51.443543  3216 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.444156  3529 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:51.445091  3529 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.445719  1552 rpcz_store.cc:276] 0709 12:59:50.422651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.442325 (+1019674us) service_pool.cc:224] Handling call
0709 12:59:51.442704 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.442938 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.442980 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:51.443051 (+    71us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:51.443109 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.443174 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.443264 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:51.446460  3529 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.441116  2271 raft_consensus.cc:2889] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:51.402732  3604 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.452487  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:51.453847  3546 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:51.455080  3575 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.000s
I20260709 12:59:51.456270  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 12:59:51.409070  1700 rpcz_store.cc:269] 0709 12:59:49.206113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.359901 (+153788us) service_pool.cc:224] Handling call
0709 12:59:49.769464 (+409563us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b58001b3398. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 12:59:51.297776 (+1528312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27337600}
I20260709 12:59:51.463245  3595 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:51.464226  3595 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.464902  3548 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:51.466015  3548 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:51.452267  3289 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.466432  3548 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:51.452057  3610 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:51.467953  3596 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:51.468705  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:51.469519  1702 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:51.469880  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:51.470479  1704 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.470566  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:51.471590  3550 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:51.472486  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:51.471884  3523 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:51.473338  1700 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 2: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:51.473263  3523 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:51.474581  1558 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:51.470598  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1724) took 1530 ms. Trace:
I20260709 12:59:51.475502  1556 rpcz_store.cc:276] 0709 12:59:49.940489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.679818 (+739329us) service_pool.cc:224] Handling call
0709 12:59:50.707906 (+ 28088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.305552 (+597646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.470375 (+164823us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54001815d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:51.470540 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372746496}
I20260709 12:59:51.476732  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.477375  1556 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:51.455448  3546 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:59:51.467803  3548 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:51.473867  1555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 262) took 2428 ms (client timeout 1613 ms). Trace:
I20260709 12:59:51.481516  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1413) took 2682 ms. Trace:
I20260709 12:59:51.484709  1553 rpcz_store.cc:276] 0709 12:59:48.799414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.800687 (+  1273us) service_pool.cc:224] Handling call
0709 12:59:48.823732 (+ 23045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.316291 (+1492559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.481252 (+1164961us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400385754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:51.481448 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2592490752}
I20260709 12:59:51.483582  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1733) took 1036 ms. Trace:
W20260709 12:59:51.486693  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 56307.7us
I20260709 12:59:51.486079  1552 rpcz_store.cc:276] 0709 12:59:50.447718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.446870 (+999152us) service_pool.cc:224] Handling call
0709 12:59:51.483081 (+ 36211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.483262 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.483286 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:51.483324 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:51.483365 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.483419 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.483528 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:51.452765  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 449) took 1008 ms. Trace:
I20260709 12:59:51.497916  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.499121  1553 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:51.502919  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.503729  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.504374  1556 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:51.455530  3575 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.478505  3358 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.506110  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.508829  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.494561  3469 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:51.515194  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:51.516839  1556 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.516912  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.512603  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 408) took 1027 ms. Trace:
I20260709 12:59:51.522966  1630 rpcz_store.cc:276] 0709 12:59:50.485012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.487344 (+  2332us) service_pool.cc:224] Handling call
0709 12:59:50.636262 (+148918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:50.711817 (+ 75555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.717084 (+  5267us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:50.933909 (+216825us) log.cc:844] Serialized 26 byte log entry
0709 12:59:50.984736 (+ 50827us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:50.984794 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.013282 (+ 28488us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:51.510359 (+497077us) raft_consensus.cc:1685] finished
0709 12:59:51.511325 (+   966us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.512547 (+  1222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3751,"raft.queue_time_us":30380,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":21118,"thread_start_us":32361,"threads_started":1,"wal-append.queue_time_us":453142}
I20260709 12:59:51.524668  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:51.525179  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1567) took 1322 ms. Trace:
I20260709 12:59:51.522987  1635 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:51.525583  1705 rpcz_store.cc:276] 0709 12:59:50.202854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.214372 (+ 11518us) service_pool.cc:224] Handling call
0709 12:59:50.246493 (+ 32121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.354437 (+107944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.354482 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.354543 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:50.354589 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.524962 (+1170373us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54001c57d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:51.525004 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.525130 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247627136}
I20260709 12:59:51.528014  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1574) took 1275 ms. Trace:
I20260709 12:59:51.533409  1552 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:51.534850  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.535755  1552 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
W20260709 12:59:51.484537  1555 rpcz_store.cc:269] 0709 12:59:49.045746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.141939 (+ 96193us) service_pool.cc:224] Handling call
0709 12:59:51.473595 (+2331656us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400178754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:51.473752 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412763008}
I20260709 12:59:51.538839  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.546870  1629 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5.
I20260709 12:59:51.531248  1704 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 12:59:51.546684  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.528398  1709 rpcz_store.cc:276] 0709 12:59:50.253125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.278429 (+ 25304us) service_pool.cc:224] Handling call
0709 12:59:50.285408 (+  6979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.355642 (+ 70234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.527852 (+1172210us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b54001df950. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:51.527964 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15410432}
I20260709 12:59:51.498974  2264 rpcz_store.cc:276] 0709 12:59:50.443410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.394334 (+950924us) service_pool.cc:224] Handling call
0709 12:59:51.394820 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.417460 (+ 22640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.450275 (+ 32815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:51.558568  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 445) took 1121 ms. Trace:
I20260709 12:59:51.558990  2270 rpcz_store.cc:276] 0709 12:59:50.437141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.709958 (+272817us) service_pool.cc:224] Handling call
0709 12:59:51.558368 (+848410us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400267854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:51.558511 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427304832}
I20260709 12:59:51.532042  3536 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.563261  1553 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:51.563542  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.566885  1556 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 12:59:51.569527  1552 raft_consensus.cc:2410] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:51.571921  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.577934  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1734) took 1129 ms. Trace:
I20260709 12:59:51.578498  1553 rpcz_store.cc:276] 0709 12:59:50.448051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.548617 (+1100566us) service_pool.cc:224] Handling call
0709 12:59:51.563034 (+ 14417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.577565 (+ 14531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.577854 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:51.531729  3469 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.545192  3544 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.512706  3523 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.607996  3469 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:51.546229  3610 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:51.608893  3634 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:59:51.611196  3153 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.652908  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:51.653728  1629 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 4: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 12:59:51.657959  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.658510  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:51.659598  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.660128  1629 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:51.660871  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:51.614796  3633 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:59:51.664700  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.661820  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.662621  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:51.663610  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:51.667428  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.666527  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:51.648949  3433 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.671298  1600 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:51.613960  3153 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:51.676424  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:51.678932  1552 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:51.679245  1600 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:51.660140  3590 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:51.681855  1524 leader_election.cc:400] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5.
I20260709 12:59:51.682231  1600 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:51.682359  1524 leader_election.cc:403] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:51.683097  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:59:51.682574  1599 leader_election.cc:336] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.702s (SENT)
I20260709 12:59:51.683739  1599 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:51.672358  3595 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.577219  3536 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.677174  3521 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:51.673614  3604 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:51.684180  1555 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:51.674791  3454 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:59:51.686236  3528 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:51.673971  3568 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:59:51.670077  3469 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:59:51.689966  1599 leader_election.cc:336] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.794s (SENT)
I20260709 12:59:51.671835  3616 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:59:51.684755  3382 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:51.686635  3592 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:51.692559  3350 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:51.687047  3596 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5.
I20260709 12:59:51.705531  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.694967  3521 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:51.701174  1555 pending_rounds.cc:85] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 2
I20260709 12:59:51.694813  3604 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.718253  3604 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.719108  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1725) took 1778 ms. Trace:
I20260709 12:59:51.719467  1551 rpcz_store.cc:276] 0709 12:59:49.940746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.830975 (+890229us) service_pool.cc:224] Handling call
0709 12:59:50.833139 (+  2164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.983986 (+150847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:50.984027 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:50.984073 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:50.984113 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.718873 (+734760us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540031e054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:51.718915 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.719056 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":808,"raft.queue_time_us":1577,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":120,"spinlock_wait_cycles":344215808}
I20260709 12:59:51.721024  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.721567  1551 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:51.691702  3595 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:51.724089  3595 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.724268  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1414) took 1785 ms. Trace:
I20260709 12:59:51.691465  3153 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:59:51.724655  1558 rpcz_store.cc:276] 0709 12:59:49.938456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.355528 (+417072us) service_pool.cc:224] Handling call
0709 12:59:51.474406 (+1118878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.474983 (+   577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.724076 (+249093us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400178750. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:51.724214 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2572680064}
I20260709 12:59:51.725482  3153 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:51.726183  3153 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 12:59:51.726626  1703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1698) took 2718 ms (client timeout 1680 ms). Trace:
W20260709 12:59:51.727092  1703 rpcz_store.cc:269] 0709 12:59:49.008512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.015326 (+  6814us) service_pool.cc:224] Handling call
0709 12:59:51.726422 (+2711096us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54001df454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:51.726528 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3325024512}
I20260709 12:59:51.711746  1552 raft_consensus.cc:2410] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:51.730957  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.731560  1552 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:51.731662  3553 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:51.732414  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:51.733560  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.708344  3550 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:51.734751  3550 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:51.735507  3550 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.736591  3550 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:51.736697  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.737314  1631 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 12:59:51.676905  3433 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.699419  3544 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:51.714655  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.717480  1555 pending_rounds.cc:107] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:51.706940  3607 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:59:51.708516  3592 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.708876  3528 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:51.699067  3586 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:59:51.742115  3573 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:51.725875  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.744813  1629 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:51.738767  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:51.712337  3382 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:51.717038  3521 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.752061  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:51.772897  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:51.715979  3575 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:51.764207  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.764976  1558 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:51.753501  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.756086  3592 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.776858  1552 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:51.768393  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.778193  1551 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:51.742503  3536 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:51.745971  1555 raft_consensus.cc:2889] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:51.776643  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:51.777432  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:51.733150  3153 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.782560  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:51.787946  1629 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.783353  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:51.790602  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:51.796381  1674 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:51.786288  3606 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.781013  3573 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.747121  3602 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 12:59:51.794732  3636 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:59:51.809504  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.792626  3428 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.792378  3639 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.823730  3639 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.824105  3639 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.824339  3596 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.811393  1552 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:51.803627  3575 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.801609  3591 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:51.804553  3454 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:51.814698  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.828787  3454 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:51.811964  3428 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:51.829566  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.830051  3433 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:51.830632  1559 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:51.820451  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1719) took 3306 ms. Trace:
I20260709 12:59:51.831157  1554 rpcz_store.cc:276] 0709 12:59:48.514512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.540411 (+ 25899us) service_pool.cc:224] Handling call
0709 12:59:48.549817 (+  9406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.166793 (+1616976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.820200 (+1653407us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540020add4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:51.820385 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3686337792}
I20260709 12:59:51.819346  3512 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:51.834383  3512 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:51.834848  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.836025  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:51.835556  3512 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.808369  3573 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:51.840437  3573 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.794703  3528 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:51.822587  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:51.822762  3595 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.807777  3553 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:51.827996  1629 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:51.829877  3428 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.818622  3588 raft_consensus.cc:3055] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:51.846194  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:51.846531  3588 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:51.847461  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.847826  3588 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.848555  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.849063  3588 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.824882  3596 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.849272  1629 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 12:59:51.821559  3382 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.838297  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:51.820694  3521 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.845288  3623 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.857668  3521 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:51.839754  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.858529  1559 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:51.822404  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1731) took 1401 ms. Trace:
I20260709 12:59:51.841747  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.859448  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:51.811283  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1736) took 1362 ms. Trace:
I20260709 12:59:51.862558  1555 rpcz_store.cc:276] 0709 12:59:50.448633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.562354 (+1113721us) service_pool.cc:224] Handling call
0709 12:59:51.662928 (+100574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.801409 (+138481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.809283 (+  7874us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:51.827832  3575 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.867033  3575 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.844215  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:51.829577  3454 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.871258  3433 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:51.859259  1557 rpcz_store.cc:276] 0709 12:59:50.422399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.413615 (+991216us) service_pool.cc:224] Handling call
0709 12:59:51.414128 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.449431 (+ 35303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.449469 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:51.449510 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:51.449545 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.822154 (+372609us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b54001ff9d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:51.822198 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.822324 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80737152}
I20260709 12:59:51.870572  3596 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:51.873587  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:51.874363  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.875770  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.877835  1628 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:51.873797  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.878712  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.879218  1628 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:51.879143  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:59:51.880470  2268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 438) took 1456 ms (client timeout 1857 ms). Trace:
I20260709 12:59:51.880801  1526 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:51.880921  2268 rpcz_store.cc:269] 0709 12:59:50.423561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.868416 (+1444855us) service_pool.cc:224] Handling call
0709 12:59:51.880412 (+ 11996us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:51.881947  1526 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:51.884511  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:51.884626  3519 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.885650  3519 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:51.858652  3592 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.889443  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:51.898420  1629 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.896524  3590 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:51.902426  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:51.902777  3590 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:51.896000  3289 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:51.902665  2269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 435) took 1479 ms (client timeout 1879 ms). Trace:
W20260709 12:59:51.903813  2269 rpcz_store.cc:269] 0709 12:59:50.422737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.422849 (+   112us) service_pool.cc:224] Handling call
0709 12:59:51.902510 (+1479661us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b5400730354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:51.902610 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937999232}
I20260709 12:59:51.905368  3595 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:51.905759  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:51.875324  3623 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:51.914525  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.876441  3555 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.872646  3536 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:51.909181  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:51.910928  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:51.912179  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:51.919605  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:51.903689  3289 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.920723  1552 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:51.923841  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:51.887259  3596 raft_consensus.cc:2764] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:51.925657  3289 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:51.927006  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 559) took 2844 ms. Trace:
I20260709 12:59:51.927414  2267 rpcz_store.cc:276] 0709 12:59:49.082336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.263582 (+1181246us) service_pool.cc:224] Handling call
0709 12:59:50.317749 (+ 54167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.289489 (+971740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.926734 (+637245us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b540056aed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:51.926926 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502711040}
I20260709 12:59:51.929260  3568 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.922802  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:51.933427  3638 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:59:51.905833  3619 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.932418  3568 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:51.875958  3433 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.916460  3623 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.934731  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:51.969859  1552 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:51.963173  1627 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:51.967221  1707 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:51.968111  1629 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:51.914000  3616 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:51.935178  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1424) took 1484 ms. Trace:
I20260709 12:59:51.971676  1629 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:51.935712  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:51.974478  1632 raft_consensus.cc:1217] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 2.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 12:59:51.924867  3589 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:51.934785  3619 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:51.981827  1628 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:59:51.987706  1632 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:59:51.921355  3604 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:51.971447  3623 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:52.034898  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:52.035871  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.052075  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:52.052908  1552 raft_consensus.cc:2376] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5. Re-sending same reply.
W20260709 12:59:52.057240  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.971801  1556 rpcz_store.cc:276] 0709 12:59:50.450447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.567804 (+1117357us) service_pool.cc:224] Handling call
0709 12:59:51.568310 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.568749 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.568791 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.649464 (+ 80673us) log.cc:844] Serialized 26 byte log entry
0709 12:59:51.767724 (+118260us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:51.768390 (+   666us) log.cc:844] Serialized 14 byte log entry
0709 12:59:51.769622 (+  1232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.769735 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:51.934981 (+165246us) raft_consensus.cc:1685] finished
0709 12:59:51.934999 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:51.935119 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10742,"prepare.queue_time_us":195,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":33,"raft.queue_time_us":10492,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":3482,"thread_start_us":87214,"threads_started":1,"wal-append.queue_time_us":95878}
W20260709 12:59:52.010010  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.903741  3590 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:52.091426  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:52.147461  1599 leader_election.cc:336] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.795s (SENT)
I20260709 12:59:52.148180  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 12:59:52.153159  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.973520  3616 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:52.257059  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:52.261138  1634 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 4. Ops: []
I20260709 12:59:52.266846  1631 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 12:59:52.268121  3643 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:59:52.046048  3589 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:52.185561  3639 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:52.502806  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.503024  1632 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:52.503511  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:52.504025  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.504846  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:52.255302  3521 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:52.436321  3454 consensus_meta.cc:287] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
I20260709 12:59:52.507321  3454 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 12:59:52.383016  3645 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 12:59:52.294143  3644 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:59:52.513969  3639 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 12:59:52.486285  1559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.011s	sys 0.003s
W20260709 12:59:52.514866  1559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.011s	sys 0.003s
W20260709 12:59:52.510501  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 363110us
W20260709 12:59:52.517135  1599 leader_election.cc:336] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.943s (SENT)
W20260709 12:59:52.382565  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.270581  1552 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 12:59:52.518549  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:52.519284  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.519279  1552 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:52.523350  1560 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:52.524544  1560 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:52.526503  1560 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:52.530200  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:52.413532  3592 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:52.336575  1634 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:52.343608  3428 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:52.535014  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1866) took 1003 ms. Trace:
W20260709 12:59:52.540989  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.552277  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 12:59:52.440354  3550 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.703s	user 0.008s	sys 0.002s
W20260709 12:59:52.491014  3573 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
I20260709 12:59:52.559791  1560 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.456336  3568 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:52.557729  1628 rpcz_store.cc:276] 0709 12:59:51.531192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.993829 (+462637us) service_pool.cc:224] Handling call
0709 12:59:51.994189 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.015098 (+ 20909us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:52.185764 (+170666us) log.cc:844] Serialized 14 byte log entry
0709 12:59:52.507372 (+321608us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:52.507421 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:52.534656 (+ 27235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.534757 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.534933 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175120,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":3456,"raft.queue_time_us":1761,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"thread_start_us":321204,"threads_started":1,"wal-append.queue_time_us":320362}
I20260709 12:59:52.573761  1632 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:52.573065  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.546209  3382 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:52.579953  1554 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:52.559010  3523 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.596207  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:52.597446  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 437) took 2174 ms. Trace:
I20260709 12:59:52.597918  2262 rpcz_store.cc:276] 0709 12:59:50.423304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.424024 (+   720us) service_pool.cc:224] Handling call
0709 12:59:52.596091 (+2172067us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaaf8c 00007f06daeaaef6 0000000000375939 00007f06e2f1e1e0 00007f06e2fe70c4 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 12:59:52.597360 (+  1269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6389504}
I20260709 12:59:52.598946  1559 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:52.558768  1700 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 12:59:52.608310  3589 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:52.609714  3588 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.751s	user 0.008s	sys 0.003s
I20260709 12:59:52.613660  3432 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:52.566948  3652 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:59:52.582046  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:52.590951  1632 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:52.619438  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.593865  1560 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:52.580921  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:52.560514  3454 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 12:59:52.615455  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.559721  3590 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:52.624034  3590 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:52.574615  3516 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.006s	sys 0.024s
I20260709 12:59:52.621512  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:52.575129  3573 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:52.622099  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:52.617714  3575 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.002s
I20260709 12:59:52.593549  3427 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 12:59:52.620626  3289 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.000s
I20260709 12:59:52.630399  1551 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:52.626363  3382 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:52.633085  3382 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:52.633834  1629 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:52.634055  3555 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.712s	user 0.006s	sys 0.004s
I20260709 12:59:52.504719  3616 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:52.634850  1553 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:52.635013  3616 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.635073  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:52.635360  3603 consensus_queue.cc:1175] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "87144ea1a4a14ab8b942fb426159f031" responder_term: 4 status { last_received { term: 3 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:59:52.636066  1629 raft_consensus.cc:2410] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:59:52.628074  3619 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.002s
I20260709 12:59:52.625954  3588 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.638222  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 12:59:52.628371  3621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.020s	sys 0.044s
I20260709 12:59:52.623222  3604 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:52.639212  1628 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
W20260709 12:59:52.628749  3516 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.006s	sys 0.025s
I20260709 12:59:52.629702  3575 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:52.629331  3432 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:52.667872  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 1.40922e+06us
W20260709 12:59:52.722589  1599 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.047s (SENT)
I20260709 12:59:52.666749  1632 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:52.636857  3322 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.724843  3433 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 12:59:52.727377  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 88367.8us
I20260709 12:59:52.745337  3322 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:52.666183  3428 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:52.725306  3621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.025s	sys 0.044s
I20260709 12:59:52.728271  3619 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:52.736248  3512 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:52.746012  1600 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:52.725865  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 87738.2us
I20260709 12:59:52.748977  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1737) took 1083 ms. Trace:
I20260709 12:59:52.786921  1553 rpcz_store.cc:276] 0709 12:59:51.665683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.665831 (+   148us) service_pool.cc:224] Handling call
0709 12:59:51.677675 (+ 11844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.636225 (+958550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.748729 (+112504us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b5400177d54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:52.748913 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200774016}
I20260709 12:59:52.663560  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:52.636935  3427 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:52.762617  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 1.33956e+06us
I20260709 12:59:52.762013  3153 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:52.798410  1601 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:52.754675  3432 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:52.775408  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.803747  1526 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:52.636951  3289 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:52.775904  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:52.809370  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:52.776216  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:52.776772  3216 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:52.776882  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:52.777740  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:52.778582  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:52.779513  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 877614us
I20260709 12:59:52.779601  3624 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:52.780921  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:52.785385  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 62838.4us
W20260709 12:59:52.683291  1673 leader_election.cc:336] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.566s (SENT)
I20260709 12:59:52.784873  3590 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:52.761608  3542 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:52.792935  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47012.1us
I20260709 12:59:52.655123  3573 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:52.795504  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 416) took 1037 ms. Trace:
I20260709 12:59:52.757987  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:52.804323  2236 leader_election.cc:400] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3.
W20260709 12:59:52.827415  1599 leader_election.cc:336] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.143s (SENT)
I20260709 12:59:52.775293  3593 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:52.805986  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:52.836192  1632 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.772765  3619 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.806450  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:52.806946  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:52.838364  3619 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.812281  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:52.640517  3454 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.155s
I20260709 12:59:52.839594  3454 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:52.839918  3454 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:52.812961  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:52.840667  1556 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:52.840786  3590 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:52.841308  3590 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:52.841675  3590 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.797928  3622 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:52.818558  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:52.843333  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:52.805509  3432 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:52.823597  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 140355us
W20260709 12:59:52.844586  1673 leader_election.cc:336] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.641s (SENT)
I20260709 12:59:52.844967  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:52.730052  3523 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:59:52.848513  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:59:52.814752  3623 consensus_meta.cc:287] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.005s
I20260709 12:59:52.811194  3521 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.811053  3557 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:52.830102  1634 rpcz_store.cc:276] 0709 12:59:51.758600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.595175 (+836575us) service_pool.cc:224] Handling call
0709 12:59:52.595530 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.632045 (+ 36515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:52.632075 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:52.632115 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:52.632143 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.795273 (+163130us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54003372d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:52.795321 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.795448 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83572608}
I20260709 12:59:52.830718  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:52.794523  3358 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:59:52.831384  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:52.831755  3542 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:52.839835  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:52.845816  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.814899  3544 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.844101  1632 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 12:59:52.823746  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:52.865790  1701 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:52.814877  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:52.835863  3593 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:52.770836  3588 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:52.811156  3300 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 12:59:52.852159  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 45108.7us
I20260709 12:59:52.811328  3589 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:59:52.838511  1558 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.814329  3433 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:59:52.858129  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:52.847052  1674 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:52.870808  1634 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:52.871253  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 43868.1us
W20260709 12:59:52.904752  1599 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.192s (SENT)
I20260709 12:59:52.905640  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:59:52.904114  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 60880us
I20260709 12:59:52.849936  3606 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:52.834617  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1563) took 1311 ms (client timeout 1641 ms). Trace:
I20260709 12:59:52.904049  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1568) took 1101 ms. Trace:
I20260709 12:59:52.911583  1634 rpcz_store.cc:276] 0709 12:59:51.803174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.854444 (+1051270us) service_pool.cc:224] Handling call
0709 12:59:52.870563 (+ 16119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.903795 (+ 33232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.903992 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.854861  1555 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:59:52.910179  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 63193.2us
I20260709 12:59:52.916492  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:52.921622  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:52.867609  3573 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:52.875485  3622 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 12:59:52.919389  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 72392.1us
I20260709 12:59:52.855523  3623 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:52.953172  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:52.876936  3593 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.862066  3604 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:59:52.952924  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:52.959900  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:52.875742  3544 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:52.910627  3654 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:53.090224  3664 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:59:53.079423  1601 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:52.958328  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.120000  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1565) took 1328 ms. Trace:
I20260709 12:59:53.120184  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:52.950356  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:53.121402  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:52.905081  3519 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:53.121937  3596 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.120432  1629 rpcz_store.cc:276] 0709 12:59:51.791477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.636747 (+845270us) service_pool.cc:224] Handling call
0709 12:59:52.653110 (+ 16363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:52.683182 (+ 30072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:52.683237 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:52.691443 (+  8206us) log.cc:844] Serialized 26 byte log entry
0709 12:59:52.812761 (+121318us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:52.812790 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.812838 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:53.119818 (+306980us) raft_consensus.cc:1685] finished
0709 12:59:53.119835 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.119945 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24719,"raft.queue_time_us":24937,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":2641,"thread_start_us":76514,"threads_started":1,"wal-append.queue_time_us":123850}
W20260709 12:59:53.093212  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:52.996812  1558 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 12:59:52.885512  3529 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:52.928298  1701 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:53.092417  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:52.922796  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:53.124509  1557 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:52.996939  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.122624  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:53.124933  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 310128us
W20260709 12:59:53.054852  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 223538us
I20260709 12:59:53.106953  1559 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:52.919734  3550 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:53.184221  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:53.165809  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 243067us
I20260709 12:59:53.172660  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:52.920665  3607 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:53.179049  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 56588.5us
I20260709 12:59:53.185534  3604 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:53.069761  3548 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.121989  1700 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 3: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:53.185993  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:53.194437  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:53.186096  2262 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:53.186717  3589 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:53.189234  1524 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 12:59:53.130111  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.189877  1560 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 3: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:53.063349  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:52.957791  3216 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:53.170527  1709 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 12:59:53.232384  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:52.905033  3619 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.064385  3427 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:53.165056  3591 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:53.189162  3289 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:52.956990  3590 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:53.199414  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.082520  3575 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:53.072613  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:59:53.070889  3661 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 12:59:52.913192  1630 rpcz_store.cc:269] 0709 12:59:51.523422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.524813 (+  1391us) service_pool.cc:224] Handling call
0709 12:59:52.663283 (+1138470us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 12:59:52.832204 (+168921us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13445376}
I20260709 12:59:53.126304  3557 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:53.163918  3529 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.174888  3654 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:53.166668  3616 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.234958  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:53.236549  1552 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:53.237716  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:53.238355  1629 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.238441  3588 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:53.239562  1703 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:53.239984  3423 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.242410  2267 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.243388  3675 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:53.243963  1705 raft_consensus.cc:2368] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:53.244376  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 363) took 3241 ms. Trace:
I20260709 12:59:53.244529  3619 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:53.245163  3623 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:53.335577  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 146418us
I20260709 12:59:53.248782  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1755) took 1372 ms. Trace:
I20260709 12:59:53.202370  3607 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.227754  3589 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:53.255204  3551 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:53.256644  3674 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:53.232416  3672 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:53.243397  3544 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:53.251132  3553 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.189759  3550 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:53.055363  3573 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.260018  3300 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:53.261544  3427 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:52.958005  3555 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:53.355748  3555 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:53.356590  3555 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.069435  3432 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.359524  3432 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:53.268397  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:53.122529  3596 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:53.275597  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 364359us
W20260709 12:59:53.277392  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:53.363622  1599 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.837s (SENT) [suppressed 31 similar messages]
I20260709 12:59:53.092893  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1564) took 1425 ms. Trace:
I20260709 12:59:53.284951  1559 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 12:59:52.952766  3542 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.317759  3593 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.369939  3542 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:53.371294  3593 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:53.318193  3678 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:53.320026  1626 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.373530  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:53.373909  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 402) took 3727 ms. Trace:
I20260709 12:59:53.374354  1626 rpcz_store.cc:276] 0709 12:59:49.646444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.652597 (+  6153us) service_pool.cc:224] Handling call
0709 12:59:49.652982 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.372487 (+3719505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.373684 (+  1197us) spinlock_profiling.cc:243] Waited 3.67 s on lock 0x7b540034dad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:53.373849 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8433717504}
I20260709 12:59:53.375468  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:53.376178  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:53.324689  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1573) took 1416 ms. Trace:
I20260709 12:59:53.376780  1707 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 12:59:53.279240  3539 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.377636  3539 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.329746  1706 rpcz_store.cc:276] 0709 12:59:50.003133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.003299 (+   166us) service_pool.cc:224] Handling call
0709 12:59:50.003608 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.403410 (+1399802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.244160 (+1840750us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54000a78d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:53.244320 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2973554944}
I20260709 12:59:53.078615  3622 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.331849  2265 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:53.321035  3603 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.251120  1601 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:53.338366  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:53.338627  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:53.412318  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 161312us
I20260709 12:59:53.412431  2268 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:53.338219  1554 rpcz_store.cc:276] 0709 12:59:51.876138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.514584 (+638446us) service_pool.cc:224] Handling call
0709 12:59:52.514895 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:52.584939 (+ 70044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.248106 (+663167us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b540031e054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:53.248299 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141202688}
I20260709 12:59:53.339856  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:53.413056  1601 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:53.289966  3557 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.329339  2264 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:53.334877  3591 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:53.337885  3519 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:53.336052  3588 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:53.353410  3300 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.339740  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:53.343117  3589 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:53.364837  3544 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:53.345950  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:53.377233  3153 consensus_meta.cc:287] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.572s	user 0.002s	sys 0.007s
W20260709 12:59:53.325834  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 160127us
I20260709 12:59:53.381143  1706 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:53.288141  3529 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:53.376802  1629 rpcz_store.cc:276] 0709 12:59:51.908634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.201960 (+1293326us) service_pool.cc:224] Handling call
0709 12:59:53.238177 (+ 36217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.324396 (+ 86219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.324616 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:53.382591  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:53.417683  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:53.451540  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 69031.9us
I20260709 12:59:53.383013  1626 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:53.383965  1707 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:59:53.439277  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.396543  1701 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:53.380110  3539 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:53.449190  3542 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.447099  3544 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.344103  3677 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:53.351900  3550 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:53.342059  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:53.353608  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:53.365011  3289 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.369241  3596 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:53.416775  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 78498.9us
I20260709 12:59:53.415442  1601 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:59:53.394737  3647 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.208s	user 0.004s	sys 0.011s
I20260709 12:59:53.423177  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:53.457818  1700 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 12:59:53.426318  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:53.414333  3624 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.024s	sys 0.032s
W20260709 12:59:53.424140  3521 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.004s
I20260709 12:59:53.414495  3672 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:53.419157  3592 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.471977  2266 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.449992  1704 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:53.417160  3666 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.350167  3553 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:53.421423  3679 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:53.452654  3590 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:53.473985  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:59:53.476155  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47715.9us
I20260709 12:59:53.477017  2271 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 12:59:53.479534  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64168.6us
I20260709 12:59:53.524370  1706 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:53.524850  1601 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:53.524451  2236 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:53.416635  3603 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.526700  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:53.526981  3689 raft_consensus.cc:3055] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:53.527823  3689 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 12:59:53.479969  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.473573  3623 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:59:53.482116  1632 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:59:53.484787  3322 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:53.479777  2268 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
W20260709 12:59:53.532868  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1872) took 1873 ms (client timeout 1954 ms). Trace:
W20260709 12:59:53.492362  3597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.002s	sys 0.001s
W20260709 12:59:53.534966  3597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.002s	sys 0.001s
I20260709 12:59:53.538436  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:53.521456  3521 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:53.515269  3153 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:53.496232  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:53.500324  1705 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.419657  3591 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:53.502135  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.454768  2262 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:53.538753  2264 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:53.538487  3623 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:53.548156  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:53.548873  2264 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 12:59:53.424789  3593 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:59:53.424845  3588 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.552532  3588 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:53.459123  3300 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:53.457669  3544 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:53.471000  3427 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:53.504292  3624 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.025s	sys 0.032s
I20260709 12:59:53.519372  1703 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:53.553799  3427 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.533082  3590 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:53.477636  3677 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.554260  3427 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:53.451764  3676 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.554759  1629 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:53.475795  2267 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:53.412459  3675 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.455200  3542 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.509744  3616 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:53.532578  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:53.531070  3679 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:53.528786  3603 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:53.492807  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 273) took 1605 ms. Trace:
I20260709 12:59:53.539563  3670 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.543617  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:53.544195  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:53.576826  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44334.5us
I20260709 12:59:53.459224  3519 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.548213  3623 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:53.506587  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:53.501194  3289 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.595043  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1438) took 1888 ms. Trace:
I20260709 12:59:53.472293  3539 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.514904  3596 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 12:59:53.533380  1631 rpcz_store.cc:269] 0709 12:59:51.659564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.753153 (+ 93589us) service_pool.cc:224] Handling call
0709 12:59:53.532689 (+1779536us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54003381d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:53.532813 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125965568}
I20260709 12:59:53.533883  3678 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:59:53.599426  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:53.584502  3544 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.567539  3423 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:53.567795  3674 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:53.568670  3431 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:59:53.569197  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44832.1us
I20260709 12:59:53.606925  1558 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:53.569891  3694 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.572104  3553 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.554838  3676 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.532505  3551 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.578893  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:53.364362  1627 rpcz_store.cc:276] 0709 12:59:51.662508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.738655 (+1076147us) service_pool.cc:224] Handling call
0709 12:59:52.739178 (+   523us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:52.739676 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:52.739727 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:52.747033 (+  7306us) log.cc:844] Serialized 52 byte log entry
0709 12:59:52.835146 (+ 88113us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:52.849214 (+ 14068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.853376 (+  4162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:53.074579 (+221203us) raft_consensus.cc:1685] finished
0709 12:59:53.080176 (+  5597us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.088169 (+  7993us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":112,"thread_start_us":71893,"threads_started":1,"wal-append.queue_time_us":156444}
I20260709 12:59:53.576009  1552 rpcz_store.cc:276] 0709 12:59:51.887135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.523283 (+636148us) service_pool.cc:224] Handling call
0709 12:59:52.523757 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.289243 (+765486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.492466 (+203223us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54001ff4d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:53.492729 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638899456}
I20260709 12:59:53.581401  1601 leader_election.cc:400] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3.
I20260709 12:59:53.583887  3557 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:53.584102  3592 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:53.549988  2264 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:53.642874  3656 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:53.643422  3656 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:53.643816  3656 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.644096  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 12:59:53.586787  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80328.7us
I20260709 12:59:53.528680  3689 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.541839  3673 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.555500  3530 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.595522  1557 rpcz_store.cc:276] 0709 12:59:51.706804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.826896 (+1120092us) service_pool.cc:224] Handling call
0709 12:59:53.124356 (+297460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.164642 (+ 40286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.594860 (+430218us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54002db9d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:53.594988 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635146112}
I20260709 12:59:53.549999  3591 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:53.614195  3452 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 12:59:53.583389  3693 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:59:53.623795  3694 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.600049  1631 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:53.600469  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:53.563014  3590 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:53.558290  3675 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:53.562700  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:53.611203  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:53.584362  3677 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:53.586333  3616 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:53.615110  1705 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.603613  3542 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:53.625085  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46583.1us
I20260709 12:59:53.622920  3431 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:53.625205  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:53.601428  3573 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:53.613905  3544 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.603281  3539 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.614727  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:53.586156  3666 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:59:53.555439  3153 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.652506  1551 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:59:53.653112  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:53.718789  1633 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:53.662916  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:53.719842  1557 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 4: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:53.665803  3423 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:59:53.672443  3624 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:59:53.662222  3530 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:53.636170  1599 leader_election.cc:336] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.142s (SENT)
I20260709 12:59:53.730826  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 12:59:53.731609  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 95519.2us
W20260709 12:59:53.732029  1599 leader_election.cc:336] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.169s (SENT)
I20260709 12:59:53.640386  3592 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:53.696830  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:53.706523  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:53.652248  3690 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.663529  3557 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.710439  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:53.663400  3452 consensus_queue.cc:1243] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 6.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:59:53.674950  2266 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:53.626222  3382 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:59:53.641618  3551 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.665731  3694 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:53.683133  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:53.760403  1701 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:53.724123  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:53.684942  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:53.737334  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:53.646625  3623 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.744719  2268 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:53.709921  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:53.747637  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:53.671506  3590 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.662395  3662 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 12:59:53.723309  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:53.600111  3672 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.762638  1705 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:53.784626  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:53.762568  1552 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:53.737280  3592 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:53.760133  3588 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.766144  3669 consensus_queue.cc:1059] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:53.769724  2267 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:53.770596  3623 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:53.771066  1702 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 3: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:53.771627  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:53.802205  2268 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:53.772689  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:53.773699  3589 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:53.778825  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.780443  1701 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 12:59:53.786795  1599 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:53.661962  3673 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.792249  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:53.806283  1705 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:53.807191  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:53.754204  2263 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:53.740378  3670 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:53.808823  1701 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:53.754169  3555 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:53.808090  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:53.752352  3557 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.787443  3431 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.893512  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:53.893904  1701 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:53.755216  3596 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:53.752061  3550 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.902402  3275 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.905205  3275 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.906303  1709 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:53.907291  3275 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:53.815958  3300 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:59:53.819396  3666 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:53.908100  3666 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:53.908502  3666 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:53.799222  3616 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.911993  3581 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:53.749109  3690 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.919515  1559 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:53.920859  1559 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:59:53.922264  3581 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:53.922659  3581 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:53.923454  3581 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.925130  3687 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.925657  3687 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.928381  3687 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:53.924690  3581 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:53.931197  3322 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:53.931769  3322 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:53.932834  3322 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.903149  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:53.935343  2268 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:53.921706  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1571) took 2089 ms. Trace:
I20260709 12:59:53.936666  1632 rpcz_store.cc:276] 0709 12:59:51.832750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:52.870145 (+1037395us) service_pool.cc:224] Handling call
0709 12:59:52.913788 (+ 43643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.531275 (+617487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.921368 (+390093us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b5400088ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:53.921617 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1306422528}
I20260709 12:59:53.934788  1633 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:53.950955  1706 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:53.952044  1702 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:53.955298  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:53.956202  2268 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:53.957338  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:53.801407  3588 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.729604  3679 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.960971  1553 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:53.820142  3573 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:53.917528  3656 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:53.921823  3529 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:53.976248  1552 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 12:59:53.892812  3555 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:53.981612  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 78125.3us
W20260709 12:59:54.387189  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.387977  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.389019  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.390092  2268 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 5: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:54.328986  3539 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:54.092598  3676 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:54.334339  3153 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:54.327942  3697 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.579s	user 0.001s	sys 0.000s
I20260709 12:59:53.939255  3617 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:53.983003  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.341114  3698 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.614s	user 0.001s	sys 0.000s
W20260709 12:59:54.388005  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.953536  3596 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:54.399577  3596 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:54.401886  3656 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:54.173377  3550 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 12:59:54.438877  1631 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.012s	sys 0.076s
W20260709 12:59:54.439507  1631 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.013s	sys 0.077s
W20260709 12:59:54.462386  1560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.003s	sys 0.016s
W20260709 12:59:54.463006  1560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.003s	sys 0.017s
W20260709 12:59:54.193104  3427 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 12:59:54.068588  3573 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 12:59:54.469127  3616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.006s	sys 0.012s
I20260709 12:59:54.471288  3428 raft_consensus.cc:3055] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:54.471781  3428 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:54.472784  3428 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:54.473776  1630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.023s	sys 0.060s
W20260709 12:59:54.474218  1630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.024s	sys 0.060s
I20260709 12:59:54.477878  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:54.480948  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 675) took 1200 ms. Trace:
I20260709 12:59:54.481509  2265 rpcz_store.cc:276] 0709 12:59:53.280908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.287328 (+  6420us) service_pool.cc:224] Handling call
0709 12:59:53.287724 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.412024 (+124300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.480660 (+1068636us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b5400267854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:54.480876 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98965248}
I20260709 12:59:54.483222  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:54.489189  1553 consensus_meta.cc:287] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
W20260709 12:59:54.493383  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 104413us
I20260709 12:59:54.522998  2265 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:54.521414  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 12:59:54.522354  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.523892  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.524508  1553 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
W20260709 12:59:54.521414  1673 connection.cc:256] RPC call timeout handler was delayed by -1.5413611899999751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 12:59:54.527544  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.962138  1555 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:54.389715  3706 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
W20260709 12:59:54.470229  3616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.006s	sys 0.012s
I20260709 12:59:54.474197  3428 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:54.531605  2265 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:54.494128  3557 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:54.534260  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:54.563189  2268 raft_consensus.cc:2376] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5. Re-sending same reply.
I20260709 12:59:54.564369  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.564901  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:54.536657  2269 raft_consensus.cc:2368] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5.
I20260709 12:59:54.465106  3427 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:54.004678  3553 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:54.390770  3322 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:54.182271  3275 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:54.543882  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:53.982185  3607 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:54.493584  3544 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:54.532522  3666 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.624s	user 0.012s	sys 0.001s
I20260709 12:59:54.552657  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.553036  3551 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:54.068866  3675 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:54.520668  3617 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:54.574067  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:54.017408  3454 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:54.573637  3557 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:54.579612  3427 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:54.597592  3719 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:54.603014  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:54.565122  2268 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:54.543766  3573 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:54.621510  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.583339  3589 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:54.626492  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 97899.4us
I20260709 12:59:54.603524  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:54.570987  3300 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:59:54.587662  3673 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:54.627154  1673 connection.cc:256] RPC call timeout handler was delayed by -1.330932402999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24660000000000004s for a response
W20260709 12:59:54.635514  1673 connection.cc:256] RPC call timeout handler was delayed by -1.2443611899999496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 12:59:54.636462  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.624632  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:54.637483  1673 connection.cc:256] RPC call timeout handler was delayed by -1.186032402999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2627s for a response
W20260709 12:59:54.637952  1673 connection.cc:256] RPC call timeout handler was delayed by -1.0808533689999535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 12:59:54.638047  2268 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 5: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 12:59:54.638401  1673 connection.cc:256] RPC call timeout handler was delayed by -1.071853368999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 12:59:54.640290  1673 connection.cc:256] RPC call timeout handler was delayed by -1.0070533689999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 12:59:54.586596  3275 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:54.613076  3666 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:54.647543  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.634090  3588 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:54.652390  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1572) took 2792 ms. Trace:
I20260709 12:59:54.655392  1634 rpcz_store.cc:276] 0709 12:59:51.860349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.187018 (+1326669us) service_pool.cc:224] Handling call
0709 12:59:53.187455 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.328291 (+140836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.328327 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.328370 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:53.328409 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.652164 (+1323755us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540006d1d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:54.652219 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.652334 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":323416320}
I20260709 12:59:54.620721  3516 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 12:59:54.663410  3709 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:54.665220  3529 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:54.672549  3623 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.867s	user 0.007s	sys 0.000s
I20260709 12:59:54.673389  1554 raft_consensus.cc:2410] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:54.674286  3607 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.674813  3607 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:54.683089  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 136396us
I20260709 12:59:54.684726  2268 raft_consensus.cc:2368] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5.
I20260709 12:59:54.685092  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:54.626149  3557 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:54.689600  1599 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.857s (SENT)
I20260709 12:59:54.695170  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:54.686333  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.697037  2268 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:54.698504  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:54.700157  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.676985  3607 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:54.626019  3719 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:54.685765  3672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.011s	sys 0.005s
W20260709 12:59:54.712191  3714 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:54.724742  3568 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:54.725312  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.725103  3727 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:54.727301  3555 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:54.728562  3557 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:54.651371  3617 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:54.720156  3672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.011s	sys 0.006s
I20260709 12:59:54.731619  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1597) took 1964 ms. Trace:
I20260709 12:59:54.732017  1708 rpcz_store.cc:276] 0709 12:59:52.767685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.189722 (+422037us) service_pool.cc:224] Handling call
0709 12:59:53.500821 (+311099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.501055 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.501092 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.501150 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:53.501191 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.501269 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.731462 (+1230193us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400387cd0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:54.731566 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620812672}
W20260709 12:59:54.734457  3581 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.805s	user 0.003s	sys 0.005s
I20260709 12:59:54.725442  3568 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:54.730480  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1772) took 1151 ms. Trace:
I20260709 12:59:54.736073  1553 rpcz_store.cc:276] 0709 12:59:53.579375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.579499 (+   124us) service_pool.cc:224] Handling call
0709 12:59:54.730326 (+1150827us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b540031ea54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:54.730427 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678300544}
I20260709 12:59:54.739359  3529 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.739931  3529 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:54.759405  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:54.723673  3607 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:54.760149  1701 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:54.727368  3275 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:54.762136  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 12:59:54.764216  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 69393.9us
I20260709 12:59:54.766933  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:54.772130  1707 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:54.768759  1708 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:54.772043  3730 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:54.774770  3729 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:54.811312  3695 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.115s	user 0.000s	sys 0.015s
I20260709 12:59:54.780416  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:54.781432  1631 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:54.786269  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 684) took 1364 ms. Trace:
I20260709 12:59:54.782649  3719 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:54.773412  3666 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:54.794754  3731 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.795270  3723 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.761211  3607 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:54.798355  1551 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:59:54.806051  2263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 456) took 4062 ms (client timeout 2192 ms). Trace:
I20260709 12:59:54.809211  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 428) took 1142 ms. Trace:
I20260709 12:59:54.812853  3529 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:54.814462  2269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 670) took 1620 ms (client timeout 2008 ms). Trace:
I20260709 12:59:54.771593  3275 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:54.817269  3454 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:54.820089  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1767) took 1242 ms. Trace:
W20260709 12:59:54.866393  2269 rpcz_store.cc:269] 0709 12:59:53.194075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.194200 (+   125us) service_pool.cc:224] Handling call
0709 12:59:54.814212 (+1620012us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400404054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:54.814374 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3085137152}
I20260709 12:59:54.866652  1554 rpcz_store.cc:276] 0709 12:59:53.578065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.578621 (+   556us) service_pool.cc:224] Handling call
0709 12:59:54.818368 (+1239747us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540030b454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:54.820024 (+  1656us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2412337920}
I20260709 12:59:54.867852  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:54.826185  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 1.29852e+06us
I20260709 12:59:54.769410  2265 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:54.776787  3690 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:54.838553  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:54.787959  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.844657  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:54.846962  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 88863us
I20260709 12:59:54.878152  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:54.843600  3729 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:54.842344  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:54.880553  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.851053  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 90961.7us
W20260709 12:59:54.881100  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.852473  1559 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:54.859018  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:54.861292  3734 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.882120  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:54.862322  1633 rpcz_store.cc:276] 0709 12:59:53.666575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.723776 (+ 57201us) service_pool.cc:224] Handling call
0709 12:59:54.809028 (+1085252us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b540018f1d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:54.809136 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396584832}
I20260709 12:59:54.886807  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:54.871351  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 570) took 1150 ms. Trace:
I20260709 12:59:54.867852  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:54.875821  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 186285us
I20260709 12:59:54.772105  3568 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:54.879606  1554 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:54.879823  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:54.881003  1631 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:54.883242  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:54.856076  1630 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:54.895920  2269 raft_consensus.cc:2376] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3. Re-sending same reply.
I20260709 12:59:54.896163  1628 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:54.904444  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 585) took 1171 ms. Trace:
I20260709 12:59:54.889912  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:54.904628  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:54.887568  1551 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 12:59:54.901252  1599 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.879s (SENT)
W20260709 12:59:54.903246  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.878783  3592 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.065s	user 0.007s	sys 0.007s
I20260709 12:59:54.895332  2265 rpcz_store.cc:276] 0709 12:59:53.720850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.602673 (+881823us) service_pool.cc:224] Handling call
0709 12:59:54.871271 (+268598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.904908  2269 rpcz_store.cc:276] 0709 12:59:53.733332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.867598 (+1134266us) service_pool.cc:224] Handling call
0709 12:59:54.904380 (+ 36782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.908949  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.906638  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:54.905694  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:54.910880  1599 leader_election.cc:336] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 3.229s (SENT)
I20260709 12:59:54.912663  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:54.905292  1554 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:54.915030  1551 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:54.914943  2236 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 12:59:54.916127  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:54.916815  1554 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:54.918112  1554 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:54.918422  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:54.919261  1559 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:54.924795  1559 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:59:54.925850  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.926724  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 591) took 1165 ms. Trace:
W20260709 12:59:54.927151  1673 leader_election.cc:336] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.529s (SENT)
I20260709 12:59:54.927608  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:54.927176  2265 rpcz_store.cc:276] 0709 12:59:53.761453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.908728 (+1147275us) service_pool.cc:224] Handling call
0709 12:59:54.926652 (+ 17924us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.929699  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.931017  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.931859  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 578) took 1200 ms. Trace:
I20260709 12:59:54.932300  2265 rpcz_store.cc:276] 0709 12:59:53.731351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.930766 (+1199415us) service_pool.cc:224] Handling call
0709 12:59:54.931802 (+  1036us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.880987  3690 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:59:54.938774  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.939317  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.939148  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:54.939870  2269 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:54.940711  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:54.941219  2269 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:54.942427  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.942911  1524 connection.cc:256] RPC call timeout handler was delayed by -1.7988228560000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1998s for a response
I20260709 12:59:54.895720  3726 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:54.922420  3676 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:54.840265  3730 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:54.880599  3528 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
W20260709 12:59:54.947913  1599 leader_election.cc:336] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.967s (SENT)
I20260709 12:59:54.925464  3550 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:54.943962  1524 connection.cc:256] RPC call timeout handler was delayed by -1.7898228560000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
I20260709 12:59:54.887276  3529 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:59:54.843384  2262 rpcz_store.cc:276] 0709 12:59:53.422555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.454267 (+ 31712us) service_pool.cc:224] Handling call
0709 12:59:53.454580 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.547318 (+ 92738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.785882 (+1238564us) spinlock_profiling.cc:243] Waited 58.1 ms on lock 0x7b5400711720. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddf46dc0 00007f06ddfd2a02 00007f06ddfcedd6 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2
0709 12:59:54.786173 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133606272}
I20260709 12:59:54.952615  1599 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:54.957906  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:54.953850  3730 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:54.961454  3730 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:54.955099  1524 connection.cc:256] RPC call timeout handler was delayed by -1.7466228560000445s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
I20260709 12:59:54.962744  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:54.963208  1524 connection.cc:256] RPC call timeout handler was delayed by -1.5972228560000303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
I20260709 12:59:54.860046  3731 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:54.862095  2263 rpcz_store.cc:269] 0709 12:59:50.743430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.959672 (+216242us) service_pool.cc:224] Handling call
0709 12:59:54.805811 (+3846139us) spinlock_profiling.cc:243] Waited 2.79 s on lock 0x7b540064c8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:54.805943 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6425317120}
I20260709 12:59:54.963687  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:54.984889  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:54.985110  1524 connection.cc:256] RPC call timeout handler was delayed by -1.5783228559999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
I20260709 12:59:54.954916  2269 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 12:59:54.942612  3668 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:54.862488  3723 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:54.903903  3573 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:59:55.010259  3668 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:55.010612  3573 raft_consensus.cc:3055] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:55.011041  3573 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:55.011874  3573 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.011605  3668 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.013052  3573 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:54.937037  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 584) took 1195 ms. Trace:
I20260709 12:59:55.014183  2267 rpcz_store.cc:276] 0709 12:59:53.733044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.787607 (+1054563us) service_pool.cc:224] Handling call
0709 12:59:54.927939 (+140332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.963843  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 576) took 1233 ms. Trace:
I20260709 12:59:55.015003  2265 rpcz_store.cc:276] 0709 12:59:53.730771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.933037 (+1202266us) service_pool.cc:224] Handling call
0709 12:59:54.963784 (+ 30747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:54.962816  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:54.936681  3275 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 12:59:54.983453  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 88093.2us
I20260709 12:59:55.016335  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:55.016439  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.017079  3603 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.017423  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:55.017582  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:54.926162  3592 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:54.952031  3676 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.018718  3676 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.019229  3382 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:55.019603  3592 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:55.019656  3382 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:54.942008  3153 consensus_queue.cc:1059] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:59:55.020205  3382 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.020812  3153 raft_consensus.cc:3055] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:55.021209  3153 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:54.903956  3737 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:55.022218  3737 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:55.022045  3153 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.022647  3737 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:54.985541  1524 connection.cc:256] RPC call timeout handler was delayed by -1.4183478870000386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2223s for a response
W20260709 12:59:55.023381  1524 connection.cc:256] RPC call timeout handler was delayed by -1.3112677060000237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 12:59:55.023737  1524 connection.cc:256] RPC call timeout handler was delayed by -1.1508228560000475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2718s for a response
I20260709 12:59:54.985643  1629 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 4: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:55.024855  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:55.025416  1629 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:54.986819  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.026535  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 572) took 1298 ms. Trace:
I20260709 12:59:54.952790  3550 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.952984  3528 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:54.905918  3734 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:54.993527  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:54.998860  3743 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:54.967464  3738 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:59:54.950837  3735 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:54.939194  3607 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.016559  3275 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:54.956238  3719 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:54.985333  1626 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:55.026960  2269 rpcz_store.cc:276] 0709 12:59:53.728221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.986520 (+1258299us) service_pool.cc:224] Handling call
0709 12:59:55.026452 (+ 39932us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:55.087738  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.087854  3607 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.088332  2269 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:54.988914  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.089881  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.090468  1628 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 12:59:55.091291  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:55.092213  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.094260  3275 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.095098  3730 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:55.096421  3275 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:54.997925  2268 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:54.955963  3732 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 12:59:55.051412  3683 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:55.097769  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 461) took 1456 ms. Trace:
I20260709 12:59:55.097886  3683 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:55.052496  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:55.098183  2268 rpcz_store.cc:276] 0709 12:59:53.641830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.761726 (+1119896us) service_pool.cc:224] Handling call
0709 12:59:55.097715 (+335989us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:55.098688  1633 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:55.098717  3382 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.099292  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.099916  2268 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:54.982903  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:55.057439  1632 raft_consensus.cc:2410] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:55.057315  3550 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.056679  3528 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:55.060177  3729 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:55.061407  3734 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:55.062107  3592 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:55.064432  1701 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 3: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:53.516692   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:55.057003  3153 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.065208  3723 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:55.066247  3733 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:59:55.066718  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 12:59:55.054793  2264 consensus_meta.cc:287] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.359s	user 0.011s	sys 0.003s
I20260709 12:59:55.001811  3731 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:55.065784  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:55.081238  1629 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
W20260709 12:59:55.082077  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 194118us
I20260709 12:59:55.100754  1628 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:55.130991  1633 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
W20260709 12:59:55.123293  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 196170us
W20260709 12:59:55.132411  1673 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.836s (SENT)
I20260709 12:59:55.139688  2271 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:55.139956  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49450.5us
W20260709 12:59:55.141487  1673 leader_election.cc:336] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.918s (SENT)
I20260709 12:59:55.141956  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.124794  2264 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:55.137319  2262 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.133222  2263 raft_consensus.cc:2376] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3. Re-sending same reply.
I20260709 12:59:55.140990  3528 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.150985  3528 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.150913  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.152081  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 279) took 1505 ms. Trace:
W20260709 12:59:55.152757  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.153546  3557 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:55.154059  3557 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.156040  3557 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:55.156462  3557 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.158690  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:55.158856  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:55.159482  1559 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 12:59:55.159806  1524 connection.cc:256] RPC call timeout handler was delayed by -1.0338550380000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
I20260709 12:59:55.134846  3726 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:55.163975  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.164603  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:55.152448  1557 rpcz_store.cc:276] 0709 12:59:53.646981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.768492 (+121511us) service_pool.cc:224] Handling call
0709 12:59:53.768886 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.954015 (+185129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.954076 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:53.954568 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:59:54.190776 (+236208us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:54.631225 (+440449us) log.cc:844] Serialized 14 byte log entry
0709 12:59:55.151559 (+520334us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b18003ba2e0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 12:59:55.151732 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.151799 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:55.151836 (+    37us) raft_consensus.cc:1685] finished
0709 12:59:55.151912 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.152026 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14824,"prepare.queue_time_us":460861,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":5857,"raft.queue_time_us":522764,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":167,"spinlock_wait_cycles":3611392,"thread_start_us":786031,"threads_started":3,"wal-append.queue_time_us":676095}
I20260709 12:59:55.144434  3603 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:55.170097  3557 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.147457  3724 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:55.148754  1673 leader_election.cc:336] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.093s (SENT)
I20260709 12:59:55.182507  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:55.186890  2266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 679) took 1846 ms (client timeout 2243 ms). Trace:
W20260709 12:59:55.185074  1673 leader_election.cc:336] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.127s (SENT)
W20260709 12:59:55.187503  2266 rpcz_store.cc:269] 0709 12:59:53.340397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.346201 (+  5804us) service_pool.cc:224] Handling call
0709 12:59:55.186652 (+1840451us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b5400583254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:55.186815 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209426688}
I20260709 12:59:55.190603  3681 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:55.192282  1524 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 12:59:55.192287  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.201504  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:55.203322  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.204356  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.207690  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:55.191123  3681 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:55.168783  3726 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.196831  3723 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:55.212760  3590 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:55.214636  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.218457  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.219022  1629 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:55.228725  1628 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:55.218497  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.212137  3427 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:55.225189  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.234274  1524 leader_election.cc:400] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5.
I20260709 12:59:55.234696  1524 leader_election.cc:403] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:55.197165  3428 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:55.176050  3676 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.208423  3553 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:55.221163  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1775) took 1634 ms. Trace:
I20260709 12:59:55.239174  3322 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:55.240514  3555 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:59:55.221854  3539 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:55.258546  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.247637  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1613) took 1558 ms. Trace:
I20260709 12:59:55.259446  1626 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:55.259619  1702 rpcz_store.cc:276] 0709 12:59:53.689473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.816945 (+127472us) service_pool.cc:224] Handling call
0709 12:59:53.951804 (+134859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.954330 (+  2526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.247368 (+1293038us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b54001c57d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:55.247564 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27258112}
I20260709 12:59:55.229980  3656 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:55.262140  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.262992  2269 raft_consensus.cc:2368] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5.
I20260709 12:59:55.262924  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.263653  1632 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:55.263821  1673 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:55.242015  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.231849  3427 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:55.267071  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.267858  1524 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.242069  3623 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.270136  2269 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 5: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 12:59:55.255816  3751 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:59:55.241313  3553 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 12:59:55.254102  3713 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.597s	user 0.003s	sys 0.001s
I20260709 12:59:55.273132  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:55.246832  3715 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.582s	user 0.000s	sys 0.004s
I20260709 12:59:55.252070  3707 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.277866  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.249634  3604 raft_consensus.cc:3055] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:55.274075  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:55.268249  3719 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:55.287338  3275 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.287703  3719 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:55.288035  3672 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:55.287858  3275 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.288446  3672 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:55.288574  3719 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.289271  3672 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.251083  3555 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:55.289743  3719 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:55.271759  3752 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:59:55.278611  2269 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:55.282734  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:55.278471  3707 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.320750  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:55.281026  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:55.321843  1706 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:55.251798  3689 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.289935  3275 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:55.283696  1708 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:55.268539  3734 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:59:55.284171  3568 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:55.284253  3743 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:55.281615  3604 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:55.256937  3737 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.285957  3454 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:55.240762  1555 rpcz_store.cc:276] 0709 12:59:53.586302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.639947 (+ 53645us) service_pool.cc:224] Handling call
0709 12:59:53.708925 (+ 68978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:54.540885 (+831960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.220829 (+679944us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400372b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:55.221082 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447684480}
I20260709 12:59:55.286638  3683 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.269058  3322 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:55.270411  3427 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:55.292557  1704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1714) took 3380 ms (client timeout 2010 ms). Trace:
I20260709 12:59:55.277746  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.315284  3555 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:55.291301  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.271605  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:55.272802  3428 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:55.297890  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 12:59:55.279247  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 153962us
I20260709 12:59:55.276736  3553 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.274380  3723 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:55.262054  3656 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:55.280306  3153 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.324465  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:55.323463  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:55.371026  2269 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 3: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:55.293187  1700 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:55.326588  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:55.294602  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:55.290887  3666 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:55.332792  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:55.332888  1553 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:55.360498  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:55.339915  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:55.362735  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.342268  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 681) took 1973 ms. Trace:
W20260709 12:59:55.344165  3712 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.670s	user 0.000s	sys 0.003s
I20260709 12:59:55.342294  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.392359  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.394411  1634 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 5: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:55.394624  2265 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:55.359385  1554 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:55.356359  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 84822.6us
W20260709 12:59:55.342202  1704 rpcz_store.cc:269] 0709 12:59:51.911760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.911900 (+   140us) service_pool.cc:224] Handling call
0709 12:59:55.292359 (+3380459us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54000b7a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:55.292494 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3512532864}
I20260709 12:59:55.396119  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:55.354547  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:55.375489  1635 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:55.376444  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1602) took 2602 ms. Trace:
W20260709 12:59:55.376201  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 98539.2us
W20260709 12:59:55.403565  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 49105.6us
I20260709 12:59:55.404088  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:55.405167  1674 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:55.378327  1706 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.378365  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:55.403405  1709 rpcz_store.cc:276] 0709 12:59:52.774188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.232825 (+458637us) service_pool.cc:224] Handling call
0709 12:59:53.233157 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.906927 (+673770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.376208 (+1469281us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b5400220454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:55.376383 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547618560}
I20260709 12:59:55.407006  1709 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:55.369570  1557 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:55.335656  1630 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:59:55.331408  3734 consensus_queue.cc:1243] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:59:55.361035  3275 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.342782  3743 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:55.426821  3743 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:55.339294  3683 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:55.427155  3755 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:59:55.426815  3738 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:59:55.403069  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.426964  3275 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.431824  3275 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:55.437500  3427 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.338622  3454 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.392174  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.438867  3454 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.440448  3707 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:55.330823  3754 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:55.342895  3557 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:55.411217  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:55.334357  3676 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:55.412171  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.402645  3521 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:55.413228  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:55.463254  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50107.7us
I20260709 12:59:55.464198  1674 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.359716  3737 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:55.339447  3322 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:55.478502  3322 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.480819  3737 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:55.356194  3672 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.481369  3737 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.484650  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:55.361646  3590 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:55.377287  3679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.009s	sys 0.047s
I20260709 12:59:55.486368  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:55.368781  3694 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:59:55.393114  3730 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:55.487159  1628 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.487469  3730 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:55.411926  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1605) took 2594 ms. Trace:
I20260709 12:59:55.438988  1559 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:55.398288  2270 rpcz_store.cc:276] 0709 12:59:53.381165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.381343 (+   178us) service_pool.cc:224] Handling call
0709 12:59:53.381579 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.555959 (+174380us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:53.575718 (+ 19759us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.702083 (+126365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.702132 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:53.702175 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.281487 (+1579312us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b18003e5840. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419
0709 12:59:55.341978 (+ 60491us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b540005ee54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:55.342056 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.342211 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26100,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":2679,"raft.queue_time_us":75,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":5898,"spinlock_wait_cycles":409920640,"thread_start_us":125941,"threads_started":1,"wal-append.queue_time_us":184302,"wal-append.run_cpu_time_us":1024,"wal-append.run_wall_time_us":1009110}
I20260709 12:59:55.498258  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:55.349383  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.443895  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 51797us
I20260709 12:59:55.499265  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:55.393172  3735 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:55.427054  3756 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:59:55.505605  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:55.452378  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:55.454332  2265 raft_consensus.cc:2410] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:55.454996  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 281) took 1807 ms. Trace:
I20260709 12:59:55.396198  1524 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:55.509459  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 113351us
I20260709 12:59:55.508805  1560 rpcz_store.cc:276] 0709 12:59:53.647640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.913217 (+265577us) service_pool.cc:224] Handling call
0709 12:59:53.913541 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.913745 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.913770 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:53.914194 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:59:54.463489 (+549295us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:54.571737 (+108248us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.575172 (+  3435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.575251 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:55.253234 (+677983us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 12:59:55.443082 (+189848us) raft_consensus.cc:1685] finished
0709 12:59:55.454800 (+ 11718us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.454940 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12782,"prepare.queue_time_us":210870,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":2612,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":19141,"spinlock_wait_cycles":76988160,"thread_start_us":656678,"threads_started":2,"wal-append.queue_time_us":716057}
I20260709 12:59:55.411098  3592 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 12:59:55.466193  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:55.422377  3666 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.543648  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:55.471933  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1865) took 3954 ms (client timeout 1680 ms). Trace:
I20260709 12:59:55.472292  1631 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:55.486382  3734 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:55.486856  3679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.009s	sys 0.048s
I20260709 12:59:55.369131  3656 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.425235  3568 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:55.425822  3326 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:55.419296  3723 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:55.489187  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:55.486368  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.375783  3153 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.499924  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.488361  3730 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.454566  3607 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:55.571837  1635 rpcz_store.cc:269] 0709 12:59:51.517844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.526603 (+  8759us) service_pool.cc:224] Handling call
0709 12:59:53.072426 (+1545823us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 12:59:55.471645 (+2399219us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54002fadd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:55.471826 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4464665728}
I20260709 12:59:55.600769  3326 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:55.611577  3326 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.612730  3326 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.573659  3734 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.614501  3734 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.343448  3555 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.616163  3555 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.450091  3754 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.618243  3754 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:55.618302  3707 consensus_queue.cc:1175] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7e99891af85f4b10aa1cc2da6aa33082" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
W20260709 12:59:55.626155  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.631484  3681 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.633998  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.511618  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.634933  2269 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:55.516386  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 462) took 1874 ms. Trace:
I20260709 12:59:55.636225  2265 rpcz_store.cc:276] 0709 12:59:53.642133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.410983 (+1768850us) service_pool.cc:224] Handling call
0709 12:59:55.516319 (+105336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:55.470717  3516 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.518710  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:55.503049  3735 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:55.496896  1703 rpcz_store.cc:276] 0709 12:59:52.807636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.351026 (+543390us) service_pool.cc:224] Handling call
0709 12:59:53.504123 (+153097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:53.554002 (+ 49879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.374506 (+1820504us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54003e12d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:55.401901 (+ 27395us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336261376}
I20260709 12:59:55.335006  3604 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:55.651237  3604 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.650906  3735 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.652283  3735 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.461824  3521 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.654829  3521 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.486560  3590 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.458760  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:55.658461  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.578979  3731 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:55.579067  1558 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:55.580150  1706 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 12:59:55.581574  3322 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:55.583784  3528 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.542629  3431 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.517510  3694 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:59:55.585646  3427 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:55.587124  3737 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:55.587939  3553 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.668548  3553 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:55.588450  3573 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.002s
I20260709 12:59:55.589999  1634 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:55.669421  1634 pending_rounds.cc:85] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 2
I20260709 12:59:55.669678  1634 pending_rounds.cc:107] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:55.669919  1634 raft_consensus.cc:2889] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:55.670261  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.590373  3666 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:55.579138  3623 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5.
W20260709 12:59:55.673174  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.673768  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.673869  3737 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:55.581811  3454 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.674983  3737 consensus_queue.cc:1059] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:55.675190  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:55.676301  3737 raft_consensus.cc:3055] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:55.676702  3737 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:55.677173  3454 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:55.592654  1554 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:55.594214  1628 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:55.595837  2262 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 12:59:55.689456  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 597) took 1160 ms. Trace:
I20260709 12:59:55.595790  3550 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.503644  3690 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:55.596769  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 83634.7us
I20260709 12:59:55.602655  2270 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 12:59:55.544224  3557 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:55.694661  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.604641  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 104781us
W20260709 12:59:55.608377  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 90766.7us
I20260709 12:59:55.609270  3607 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:55.697418  3557 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.697512  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:59:55.636855  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 125381us
I20260709 12:59:55.677819  3454 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.701761  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:55.644198  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.632922  3681 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:55.645998  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 127378us
W20260709 12:59:55.607390  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.608301  3679 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.659335  2263 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:55.708472  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 12:59:55.660050  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 194000us
I20260709 12:59:55.660960  3731 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:55.662515  3739 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:55.645569  3428 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:55.653716  3732 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:55.660696  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:55.658516  3590 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.674853  3322 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:55.681371  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:55.682067  1704 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:55.683295  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:55.683961  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:55.717478  1707 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:55.717518  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:55.717816  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:55.695785  1526 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.718240  1706 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:55.696290  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.697970  3557 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.698076  3607 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.419242  3747 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:55.698805  1708 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:55.698678  3690 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.703042  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:55.703651  2269 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 12:59:55.703747  2234 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:55.710189  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:55.710778  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:55.677537  3737 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.706207  3454 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.716411  3732 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.725656  3732 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.726926  3454 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:55.720458  3747 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:55.727553  3747 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.728084  3153 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:55.713292  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 473) took 1782 ms. Trace:
I20260709 12:59:55.729454  2263 rpcz_store.cc:276] 0709 12:59:53.930668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.412486 (+1481818us) service_pool.cc:224] Handling call
0709 12:59:55.711687 (+299201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:55.730517  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:55.731719  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:55.732890  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.733351  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.715034  3767 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:55.731122  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.707223  3623 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:59:55.711948  3568 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:59:55.720990  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:55.713516  3731 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:55.700758  3550 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:55.736470  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:55.773504  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 77805.9us
I20260709 12:59:55.705207  3427 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:55.727545  3454 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.738399  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 470) took 2037 ms. Trace:
I20260709 12:59:55.774704  3428 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.774799  2269 rpcz_store.cc:276] 0709 12:59:53.700962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.730197 (+2029235us) service_pool.cc:224] Handling call
0709 12:59:55.737664 (+  7467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:55.775357  3428 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.776401  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.776971  2269 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:55.705950  3730 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:55.689885  2262 rpcz_store.cc:276] 0709 12:59:54.530018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.054598 (+524580us) service_pool.cc:224] Handling call
0709 12:59:55.689398 (+634800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:55.777752  3428 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:55.756937  1709 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 12:59:55.774056  1633 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 12:59:55.665165  3528 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.666189  3431 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.740804  2234 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:59:55.788609  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 47886.9us
I20260709 12:59:55.789285  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:59:55.764571  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.777797  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.746397  1707 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:55.756228  1706 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 12:59:55.693459  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 380) took 2016 ms. Trace:
I20260709 12:59:55.750689  1601 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 12:59:55.794608  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44022.7us
I20260709 12:59:55.795326  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 12:59:55.771965  1524 leader_election.cc:400] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5.
I20260709 12:59:55.796869  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.784097  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:55.799878  1708 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 12:59:55.779722  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:55.786185  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:55.801401  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:55.805845  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:55.806509  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.740975  3676 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:55.778559  3553 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:55.820744  1632 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:55.820914  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:55.821642  1632 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:55.736025  3690 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:55.768590  1703 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:55.804260  3428 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.734318  3767 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:55.779369  3322 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.842589  3767 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.843075  3289 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:55.844307  2264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 460) took 2202 ms (client timeout 2142 ms). Trace:
W20260709 12:59:55.844727  2264 rpcz_store.cc:269] 0709 12:59:53.641587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.643728 (+  2141us) service_pool.cc:224] Handling call
0709 12:59:55.844116 (+2200388us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5400672ad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:55.844236 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58899328}
I20260709 12:59:55.733976  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:55.846962  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.847589  2263 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:55.847945  1704 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:55.849080  1704 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:55.849232  3322 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:55.740607  3747 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.784360  3427 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 12:59:55.822894  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 103442us
I20260709 12:59:55.830065  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:55.820483  3550 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:55.827626  3672 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:55.807873  3688 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:55.834012  1557 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:55.804808  3604 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:55.807725  3555 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:55.779142  3730 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.833269  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:55.878820  1551 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:55.835146  1632 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.879487  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:55.879751  1632 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.808287  3666 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:55.809901  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:55.811060  3676 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.804394  3326 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:55.802371  1705 rpcz_store.cc:276] 0709 12:59:53.677037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.807813 (+130776us) service_pool.cc:224] Handling call
0709 12:59:53.814987 (+  7174us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:53.815319 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.815345 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:53.902684 (+ 87339us) log.cc:844] Serialized 52 byte log entry
0709 12:59:55.401465 (+1498781us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b18003547c0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 12:59:55.514347 (+112882us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:55.574076 (+ 59729us) log.cc:844] Serialized 14 byte log entry
0709 12:59:55.574434 (+   358us) log.cc:844] Serialized 14 byte log entry
0709 12:59:55.664760 (+ 90326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.664848 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:55.692981 (+ 28133us) raft_consensus.cc:1685] finished
0709 12:59:55.693004 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.693398 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31595,"prepare.queue_time_us":70010,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"raft.queue_time_us":38538,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":27838,"spinlock_wait_cycles":60720896,"thread_start_us":202744,"threads_started":2,"wal-append.queue_time_us":1697632}
W20260709 12:59:55.889047  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 79225.1us
I20260709 12:59:55.757544  3732 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.745332  3734 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.811342  3592 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:55.833214  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:55.907814  1552 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:55.760874  3754 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.822309  3764 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.871865  1558 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:55.760898  3521 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.845875  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.850241  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:55.833791  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:55.833415  3690 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:55.878334  3555 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:55.869796  3322 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:55.871002  3550 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.886656  1635 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:55.869448  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:55.889786  1601 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:55.877239  3688 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.910140  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:55.860970  3557 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.860277  3428 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.912061  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 12:59:55.914640  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:55.872766  3289 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:59:55.893054  3676 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.927994  1709 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:55.888928  3326 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.871735  3656 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.906064  3604 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:55.971696  3719 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:55.956182  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:55.962543  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 72829.5us
I20260709 12:59:55.986389  1552 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:55.986820  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:55.962571  1628 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:55.964447  1705 raft_consensus.cc:2410] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:55.946432  3592 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.946535  3591 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.958374  3553 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:55.927377  3672 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:55.960673  3555 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:55.978813  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 66836.3us
I20260709 12:59:55.963330  3550 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.970862  3688 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:55.952065  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 12:59:56.076643  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 210905us
I20260709 12:59:55.985533  1702 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:59:56.082515  1702 pending_rounds.cc:85] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 2
I20260709 12:59:56.082890  1702 pending_rounds.cc:107] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:59:56.083158  1702 raft_consensus.cc:2889] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:55.988095  1557 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 12:59:55.955471  3694 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:59:55.990829  3671 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:55.991240  1555 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:55.991626  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:55.992136  3592 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.992525  3730 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:55.931160  3764 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.992883  3591 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:55.974961  3322 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:55.993335  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:55.994522  3747 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:55.995143  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 12:59:55.996628  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.977326  3454 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:55.983562  3773 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:56.003096  3528 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:55.980898  3326 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:56.004055  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:56.004243  3734 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:56.004338  3521 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:56.005817  3557 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:55.980171  3516 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:55.961041  3690 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.957074  3590 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:55.941982  3427 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:56.112576  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.986083  3719 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:55.996398  3604 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:56.155894  1552 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:56.158253  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.159101  1708 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:56.166018  1705 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:56.171422  3732 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:56.144482  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:56.173430  1557 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:59:56.176798  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.178699  3672 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:56.251272  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 700) took 1340 ms. Trace:
I20260709 12:59:56.252151  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:56.257644  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:56.166833  2262 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:56.278574  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.279171  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.279453  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 201567us
I20260709 12:59:56.394367  1632 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:56.280114  3671 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:56.393472  2270 rpcz_store.cc:276] 0709 12:59:54.911100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.543367 (+632267us) service_pool.cc:224] Handling call
0709 12:59:56.251069 (+707702us) spinlock_profiling.cc:243] Waited 58.3 ms on lock 0x7b54004e7fd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:56.251204 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134010240}
W20260709 12:59:56.279212  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 187464us
I20260709 12:59:56.262005  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:56.258437  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 689) took 2723 ms. Trace:
I20260709 12:59:56.285823  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:56.388283  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.116137  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:56.158970  3773 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:56.248865  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:56.449647  1626 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:56.119340  3776 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:56.249046  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 1622) took 1482 ms (client timeout 1680 ms). Trace:
I20260709 12:59:56.393049  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:59:56.480880  1701 rpcz_store.cc:269] 0709 12:59:54.766472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.766620 (+   148us) service_pool.cc:224] Handling call
0709 12:59:56.248844 (+1482224us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54000a82d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:56.248990 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543402240}
I20260709 12:59:56.482138  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:56.444337  2268 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:56.403522  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:56.426379  1552 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 12:59:56.499527  2268 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 12:59:56.500857  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:56.501633  2268 raft_consensus.cc:2376] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4. Re-sending same reply.
I20260709 12:59:56.444613  1634 raft_consensus.cc:2376] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4. Re-sending same reply.
I20260709 12:59:56.446596  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:56.448125  1558 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:59:56.512804  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:56.515045  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:56.178819  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:56.472466  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:56.444124  2271 rpcz_store.cc:276] 0709 12:59:53.534943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.581163 (+ 46220us) service_pool.cc:224] Handling call
0709 12:59:53.583932 (+  2769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:55.140114 (+1556182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.258188 (+1118074us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400465ad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:56.258364 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3577788288}
I20260709 12:59:56.403270  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 12:59:56.406178  1585 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:36797 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:36797 timed out after 15.000s (SENT)
I20260709 12:59:56.531527  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 12:59:56.260900  2267 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.001s
W20260709 12:59:56.266180  3731 consensus_meta.cc:287] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260709 12:59:56.250483  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:56.532532  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:56.268700  3591 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:56.541682  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:56.232503  3754 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:56.335857  3454 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.545158  2270 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:56.254467  3666 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:56.403986  3521 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.548703  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:56.322499  3719 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:56.404310  3777 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
W20260709 12:59:56.543197  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 139872us
I20260709 12:59:56.410331  3790 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:56.223600  3553 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:56.237321  3767 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:56.180465  3592 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:56.252215  3764 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:56.402637  3322 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:57.291510  1629 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
W20260709 12:59:56.659193  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.292845  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1915) took 1055 ms. Trace:
I20260709 12:59:57.293421  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1912) took 1056 ms. Trace:
W20260709 12:59:57.285099  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.293669  1634 rpcz_store.cc:276] 0709 12:59:56.237602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.514730 (+277128us) service_pool.cc:224] Handling call
0709 12:59:57.292516 (+777786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.296073  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:57.297760  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1748) took 1109 ms. Trace:
I20260709 12:59:57.298221  1701 rpcz_store.cc:276] 0709 12:59:56.188514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.550295 (+361781us) service_pool.cc:224] Handling call
0709 12:59:57.297589 (+747294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.299736  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 12:59:57.269716  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.006s	sys 0.008s
W20260709 12:59:56.755342  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.294580  1629 rpcz_store.cc:276] 0709 12:59:56.236923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.392777 (+155854us) service_pool.cc:224] Handling call
0709 12:59:57.293310 (+900533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.283370  3802 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:56.739586  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 348819us
I20260709 12:59:57.301218  3802 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:57.301934  3802 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.302177  1629 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:57.302639  1701 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:56.470927  1632 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:57.300673  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1909) took 1058 ms. Trace:
W20260709 12:59:56.668905  1599 leader_election.cc:336] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 3.531s (SENT)
I20260709 12:59:56.570261  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:57.306061  1705 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 3: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:57.306147  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1605) took 1104 ms. Trace:
W20260709 12:59:57.306624  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1742) took 1318 ms (client timeout 1700 ms). Trace:
I20260709 12:59:57.306588  1632 rpcz_store.cc:276] 0709 12:59:56.201614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.257318 (+ 55704us) service_pool.cc:224] Handling call
0709 12:59:57.305894 (+1048576us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:57.307132  1705 rpcz_store.cc:269] 0709 12:59:55.988663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.540220 (+551557us) service_pool.cc:224] Handling call
0709 12:59:57.306561 (+766341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.308368  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:57.308497  1632 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:57.309211  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1606) took 1068 ms. Trace:
I20260709 12:59:57.309270  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1738) took 1350 ms. Trace:
I20260709 12:59:57.303972  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1747) took 1142 ms. Trace:
I20260709 12:59:57.302964  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1914) took 1065 ms. Trace:
I20260709 12:59:57.309940  1701 rpcz_store.cc:276] 0709 12:59:56.161051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.299255 (+1138204us) service_pool.cc:224] Handling call
0709 12:59:57.303179 (+  3924us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.309660  1632 rpcz_store.cc:276] 0709 12:59:56.241089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.307527 (+1066438us) service_pool.cc:224] Handling call
0709 12:59:57.308019 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.308947 (+   928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.309159 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.311010  1629 rpcz_store.cc:276] 0709 12:59:56.237370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.300956 (+1063586us) service_pool.cc:224] Handling call
0709 12:59:57.301545 (+   589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.302655 (+  1110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.302886 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.309707  1705 rpcz_store.cc:276] 0709 12:59:55.959068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.307939 (+1348871us) service_pool.cc:224] Handling call
0709 12:59:57.309197 (+  1258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.303539  1630 rpcz_store.cc:276] 0709 12:59:56.236220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.291655 (+1055435us) service_pool.cc:224] Handling call
0709 12:59:57.292926 (+  1271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.293839 (+   913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:57.293884 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:57.293978 (+    94us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:57.294157 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.294305 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.294479 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:57.294442  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:57.659895  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.012s	sys 0.013s
I20260709 12:59:56.447000  3568 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:56.474550  3773 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:56.668002  3622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.015s	sys 0.053s
I20260709 12:59:56.539785  3676 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:56.562726  3671 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:56.563762  3557 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:57.715929  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.540056  3550 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:56.569680  3555 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:57.720752  3550 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 12:59:56.658360  3710 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.016s	sys 0.000s
I20260709 12:59:57.721226  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 465) took 4049 ms. Trace:
I20260709 12:59:56.569942  2266 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 5: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:57.721743  2270 rpcz_store.cc:276] 0709 12:59:53.671884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.544479 (+2872595us) service_pool.cc:224] Handling call
0709 12:59:56.544812 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.720531 (+1175719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.720974 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:57.722903  2266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 615) took 1632 ms (client timeout 1850 ms). Trace:
W20260709 12:59:57.723492  2266 rpcz_store.cc:269] 0709 12:59:56.090275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.250200 (+159925us) service_pool.cc:224] Handling call
0709 12:59:57.722612 (+1472412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.723093  3568 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:56.617017  2271 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 3 LEARNER]: Advancing to term 5
I20260709 12:59:56.570942  3785 raft_consensus.cc:2764] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:59:57.721797  3710 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.282s	user 0.016s	sys 0.057s
I20260709 12:59:56.206593  2264 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 12:59:56.542801  2267 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
W20260709 12:59:57.730659  2264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 707) took 1816 ms (client timeout 1529 ms). Trace:
I20260709 12:59:56.532446  3775 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:56.567138  3679 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.855s	user 0.010s	sys 0.000s
W20260709 12:59:57.055505  3738 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.008s	sys 0.008s
I20260709 12:59:57.288616  3801 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 12:59:56.767141  3783 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:59:56.864087  3781 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:59:57.748559  2264 rpcz_store.cc:269] 0709 12:59:55.914412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.983810 (+ 69398us) service_pool.cc:224] Handling call
0709 12:59:57.730450 (+1746640us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.756366  3454 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:56.540669  3668 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 1.218s
W20260709 12:59:57.758471  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.183s	user 0.000s	sys 0.010s
I20260709 12:59:57.758394  3782 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:57.758951  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 12:59:57.760298  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 445873us
I20260709 12:59:57.760156  3521 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:57.761293  1704 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 12:59:57.773039  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.225s	user 0.000s	sys 0.011s
I20260709 12:59:56.720445  3694 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.763850  2271 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:59:57.069857  3427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.011s	sys 0.006s
I20260709 12:59:57.775451  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 464) took 4117 ms. Trace:
W20260709 12:59:57.775812  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 1.30344e+06us
I20260709 12:59:57.775970  2271 rpcz_store.cc:276] 0709 12:59:53.668130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.540714 (+2872584us) service_pool.cc:224] Handling call
0709 12:59:56.612430 (+ 71716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.775099 (+1162669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.775388 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.777053  3782 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:57.777963  2271 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 3 LEARNER]: Advancing to term 4
I20260709 12:59:57.778394  3790 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:56.768277  3326 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.000s
W20260709 12:59:57.790653  3427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.016s	sys 0.016s
I20260709 12:59:57.791152  3689 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.792438  1627 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 12:59:57.792158  3326 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:57.721738  3550 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.626044  3731 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:57.794880  3550 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:57.761643  3656 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:57.797603  3676 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:57.762701  3799 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:56.549322  3788 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:57.790827  2269 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:57.799113  3799 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:57.800846  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 451) took 1378 ms. Trace:
I20260709 12:59:57.801280  1629 rpcz_store.cc:276] 0709 12:59:56.422148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.729774 (+1307626us) service_pool.cc:224] Handling call
0709 12:59:57.772144 (+ 42370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.800444 (+ 28300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:57.800475 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:57.800536 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:57.800572 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.800630 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.800765 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:56.852437  3688 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.720s	user 0.009s	sys 0.004s
I20260709 12:59:57.802883  3688 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:57.803606  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:57.805415  3688 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:56.860924  3690 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:57.806514  3754 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.806910  3799 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:57.807314  3754 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:57.792225  3689 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:57.813637  2267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 702) took 2282 ms (client timeout 1712 ms). Trace:
I20260709 12:59:57.807638  3799 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:57.814415  2268 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:57.814251  2267 rpcz_store.cc:269] 0709 12:59:55.492628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.659344 (+166716us) service_pool.cc:224] Handling call
0709 12:59:57.771922 (+2112578us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.814798  3799 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:57.815862  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 12:59:57.817938  3622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.610s	user 0.054s	sys 0.088s
I20260709 12:59:57.803664  3326 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:57.821331  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:57.835074  3804 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.834911  3557 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:57.836061  3799 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:57.836133  3782 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:57.836877  2267 raft_consensus.cc:2368] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4.
I20260709 12:59:57.809764  3754 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:57.781113  3790 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:57.842307  2271 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:57.845454  3550 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:57.845741  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:57.846412  1706 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:57.836818  1703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 1624) took 2161 ms (client timeout 1718 ms). Trace:
W20260709 12:59:57.850262  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 473099us
I20260709 12:59:57.837014  3568 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:57.846392  2234 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:57.854676  3804 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:57.855674  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1633) took 2149 ms. Trace:
I20260709 12:59:57.855978  3454 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:57.856801  3790 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:57.856992  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 1.18816e+06us
I20260709 12:59:57.859871  3382 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:57.861371  3764 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.863538  3773 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:57.864537  3679 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:57.865075  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 581) took 4121 ms. Trace:
I20260709 12:59:57.865149  3428 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:56.894907  3604 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:57.866163  3802 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.003s
I20260709 12:59:57.840138  3521 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:57.869552  3431 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:57.870211  3694 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:57.871078  3530 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:57.872335  3557 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:57.851533  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 580) took 4117 ms. Trace:
I20260709 12:59:57.906932  2271 rpcz_store.cc:276] 0709 12:59:53.731906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.777107 (+4045201us) service_pool.cc:224] Handling call
0709 12:59:57.777572 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.848634 (+ 71062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.848824 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:57.879217  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 12:59:57.880028  2262 consensus_meta.cc:287] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.373s	user 0.013s	sys 0.010s
I20260709 12:59:57.875310  1707 rpcz_store.cc:276] 0709 12:59:55.702263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.791923 (+ 89660us) service_pool.cc:224] Handling call
0709 12:59:55.792208 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:55.908445 (+116237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.908473 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:55.908511 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:55.908540 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.845747 (+1937207us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400233a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:57.845812 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.851344 (+  5532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266942848}
I20260709 12:59:57.885099  3731 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:57.883296  2264 rpcz_store.cc:276] 0709 12:59:53.732180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.805174 (+4072994us) service_pool.cc:224] Handling call
0709 12:59:57.805642 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.805936 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:57.805968 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:57.828693 (+ 22725us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:57.841659 (+ 12966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.847192 (+  5533us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.853582 (+  6390us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:57.853148  1703 rpcz_store.cc:269] 0709 12:59:55.674807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.674918 (+   111us) service_pool.cc:224] Handling call
0709 12:59:57.836375 (+2161457us) spinlock_profiling.cc:243] Waited 92.6 ms on lock 0x7b54001accd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:57.836578 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213073664}
I20260709 12:59:57.888746  3788 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:56.540447  3776 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:57.880323  3801 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:57.887677  1701 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
W20260709 12:59:57.886363  3738 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.327s	user 0.018s	sys 0.012s
W20260709 12:59:58.042423  2269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 611) took 2345 ms (client timeout 2621 ms). Trace:
I20260709 12:59:58.152833  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1913) took 1895 ms. Trace:
W20260709 12:59:58.013360  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 134361us
I20260709 12:59:57.951047  1552 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:59:57.925256  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:58.257572  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 458) took 4616 ms. Trace:
I20260709 12:59:58.257807  3776 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:58.269865  3767 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:58.043983  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 450) took 1622 ms. Trace:
I20260709 12:59:58.254568  3322 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 12:59:58.266120  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.007s	sys 0.013s
W20260709 12:59:58.271239  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.008s	sys 0.014s
I20260709 12:59:57.925071  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:57.915617  2262 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
W20260709 12:59:57.919026  1599 connection.cc:256] RPC call timeout handler was delayed by -1.2008055279999894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30560000000000004s for a response
I20260709 12:59:57.916226  2267 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:58.035941  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1469) took 2738 ms. Trace:
W20260709 12:59:58.030742  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.269131  1456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35556 (request call id 317) took 17628 ms (client timeout 15000 ms). Trace:
I20260709 12:59:58.042980  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1472) took 2724 ms. Trace:
I20260709 12:59:58.272900  1707 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:58.085400  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 224877us
W20260709 12:59:58.185269  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.027401  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1736) took 2107 ms (client timeout 2032 ms). Trace:
W20260709 12:59:58.133198  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 122512us
W20260709 12:59:58.293219  1599 connection.cc:256] RPC call timeout handler was delayed by -1.1771759860000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:59:58.149751  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1741) took 2169 ms (client timeout 1896 ms). Trace:
W20260709 12:59:58.041383  1704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1730) took 2162 ms (client timeout 1906 ms). Trace:
I20260709 12:59:58.257514  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 12:59:58.298833  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 452716us
W20260709 12:59:58.005532  3777 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 12:59:58.152937  2269 rpcz_store.cc:269] 0709 12:59:55.696698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.820683 (+123985us) service_pool.cc:224] Handling call
0709 12:59:58.042152 (+2221469us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b540039d854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:58.042353 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4478604544}
I20260709 12:59:57.936666  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 12:59:58.329478  1701 rpcz_store.cc:269] 0709 12:59:55.984205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.313969 (+1329764us) service_pool.cc:224] Handling call
0709 12:59:58.149660 (+835691us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:58.326707  1559 rpcz_store.cc:276] 0709 12:59:55.305212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.305388 (+   176us) service_pool.cc:224] Handling call
0709 12:59:55.305776 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.497454 (+191678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.029289 (+2531835us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400180954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:58.029801 (+   512us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305836928}
I20260709 12:59:58.296933  1553 rpcz_store.cc:276] 0709 12:59:55.297171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.298106 (+   935us) service_pool.cc:224] Handling call
0709 12:59:55.326194 (+ 28088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:55.392734 (+ 66540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.030495 (+2637761us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b54001815d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:58.035696 (+  5201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11630336}
I20260709 12:59:58.029242  3454 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:58.263509  3590 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:57.952041  3769 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:57.927740  3773 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:58.206130  3679 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.354497  3679 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:58.354734  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:58.344744  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.327478  1705 rpcz_store.cc:269] 0709 12:59:55.919590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.027052 (+2107462us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:58.027304 (+   252us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:57.937613  3688 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:57.926748  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:58.301453  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.298592  2270 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:57.925967  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:58.270211  3716 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:57.937223  3707 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.004822  3428 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:57.893652  3802 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:58.260040  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1611) took 4909 ms. Trace:
W20260709 12:59:58.265147  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 446) took 2099 ms (client timeout 1562 ms). Trace:
I20260709 12:59:58.343863  3769 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 12:59:58.328083  1704 rpcz_store.cc:269] 0709 12:59:55.879114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.879235 (+   121us) service_pool.cc:224] Handling call
0709 12:59:58.041063 (+2161828us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54001fcf54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:58.041287 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4230488320}
I20260709 12:59:58.160729  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 569) took 4425 ms. Trace:
I20260709 12:59:58.343200  1629 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:59:58.344164  3454 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 12:59:57.937482  3557 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:57.942765  3746 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:58.215386  3675 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:58.345238  3724 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.348263  3694 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:58.299734  3669 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.300390  3553 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:58.177446  3775 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:58.350983  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1631) took 2658 ms. Trace:
I20260709 12:59:58.349838  1453 catalog_manager.cc:5697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 3 to 4, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.336875  3738 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.175236  3812 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:58.217005  3786 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.361048  3767 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.255544  3788 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:57.929702  3719 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:58.153470  1634 rpcz_store.cc:276] 0709 12:59:56.237153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.297388 (+1060235us) service_pool.cc:224] Handling call
0709 12:59:57.297983 (+   595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:57.298653 (+   670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:57.298681 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:57.299496 (+   815us) log.cc:844] Serialized 26 byte log entry
0709 12:59:57.684746 (+385250us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:57.684810 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.684905 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:58.132650 (+447745us) raft_consensus.cc:1685] finished
0709 12:59:58.132669 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.132819 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":421663,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"thread_start_us":384651,"threads_started":1,"wal-append.queue_time_us":830376}
I20260709 12:59:58.343289  3804 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 12:59:58.367560  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 431231us
I20260709 12:59:58.363096  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.366988  2271 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
W20260709 12:59:58.368314  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1733) took 2474 ms (client timeout 2200 ms). Trace:
I20260709 12:59:58.366453  3766 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:59:58.301463  3322 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:58.369226  1526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.529s (SENT) [suppressed 26 similar messages]
I20260709 12:59:58.373934  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:57.937925  3521 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:58.355639  2267 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:58.374639  1629 pending_rounds.cc:85] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 1
I20260709 12:59:57.937517  3764 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:58.375674  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.350144  3710 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.941512  3743 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.376516  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.633809  1557 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:58.633549  3724 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.635147  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.636057  1557 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:58.636195  3724 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:58.636963  3553 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:58.490302  1704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1740) took 2482 ms (client timeout 2247 ms). Trace:
I20260709 12:59:58.640720  1552 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
W20260709 12:59:58.621407  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.370566  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1745) took 2247 ms (client timeout 2010 ms). Trace:
W20260709 12:59:58.414350  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.641352  1701 rpcz_store.cc:269] 0709 12:59:55.889818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.342085 (+2452267us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:58.364090 (+ 22005us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:58.631585  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1634) took 2926 ms. Trace:
I20260709 12:59:58.706435  2269 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 12:59:58.710206  1704 rpcz_store.cc:269] 0709 12:59:55.970577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.404658 (+2434081us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:58.452883 (+ 48225us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:58.626514  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1637) took 2904 ms. Trace:
W20260709 12:59:58.618762  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.344280  2262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 705) took 2435 ms (client timeout 2160 ms). Trace:
I20260709 12:59:58.417553  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.366899  3716 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:58.370795  3590 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:58.413440  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:58.744199  1706 rpcz_store.cc:276] 0709 12:59:55.704671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.792661 (+ 87990us) service_pool.cc:224] Handling call
0709 12:59:55.792906 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.882558 (+2089652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.631235 (+748677us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400126454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:58.631510 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4710475008}
I20260709 12:59:58.596619  1635 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:58.598271  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 469) took 4902 ms. Trace:
W20260709 12:59:58.602412  1628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1597) took 2905 ms (client timeout 2621 ms). Trace:
W20260709 12:59:58.710511  1705 rpcz_store.cc:269] 0709 12:59:56.118039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.358574 (+2240535us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:58.365342 (+  6768us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:58.583187  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 459) took 4941 ms. Trace:
W20260709 12:59:58.394644  2234 leader_election.cc:336] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Timed out: RequestConsensusVote RPC to 127.0.107.194:39441 timed out after 1.562s (SENT)
I20260709 12:59:58.611939  1560 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:58.576488  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1889) took 3617 ms. Trace:
I20260709 12:59:58.595432  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1636) took 2883 ms. Trace:
I20260709 12:59:58.712235  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.640050  1629 pending_rounds.cc:107] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:59:58.633899  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:58.764534  2270 rpcz_store.cc:276] 0709 12:59:53.695662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.723684 (+4028022us) service_pool.cc:224] Handling call
0709 12:59:58.292999 (+569315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.367564 (+ 74565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.597937 (+230373us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400730350. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:58.598162 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307975936}
I20260709 12:59:58.755116  1708 rpcz_store.cc:276] 0709 12:59:55.722448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.823029 (+100581us) service_pool.cc:224] Handling call
0709 12:59:55.862788 (+ 39759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:56.277483 (+414695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.625941 (+2348458us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400387cd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:58.626319 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681027456}
I20260709 12:59:58.762743  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.766343  1629 raft_consensus.cc:2889] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:58.765976  1631 rpcz_store.cc:276] 0709 12:59:54.958896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.962150 (+  3254us) service_pool.cc:224] Handling call
0709 12:59:55.471917 (+509767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:55.572132 (+100215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.575971 (+3003839us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54002fadd0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:58.576249 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171750144}
I20260709 12:59:58.585644  1555 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:58.619400  3731 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.766083  1709 rpcz_store.cc:276] 0709 12:59:55.712229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.807023 (+ 94794us) service_pool.cc:224] Handling call
0709 12:59:55.855854 (+ 48831us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.977309 (+121455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.594867 (+2617558us) spinlock_profiling.cc:243] Waited 71.8 ms on lock 0x7b54000a7dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:58.595227 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165174016}
W20260709 12:59:58.773365  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 396992us
I20260709 12:59:58.580847  3555 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:58.775235  1632 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:58.776978  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.764664  1628 rpcz_store.cc:269] 0709 12:59:55.697128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.697273 (+   145us) service_pool.cc:224] Handling call
0709 12:59:58.601873 (+2904600us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400355a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:58.602177 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601102592}
I20260709 12:59:58.764940  2268 rpcz_store.cc:276] 0709 12:59:53.641300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.541408 (+2900108us) service_pool.cc:224] Handling call
0709 12:59:57.769032 (+1227624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.815050 (+ 46018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.582324 (+767274us) spinlock_profiling.cc:243] Waited 42.3 ms on lock 0x7b540063f954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:58.582919 (+   595us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540063f950. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:58.583118 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2669383808}
I20260709 12:59:58.581525  3726 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:58.619176  3810 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.412997  3749 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.589401  3689 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:58.744174  1702 rpcz_store.cc:276] 0709 12:59:55.692394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.728456 (+ 36062us) service_pool.cc:224] Handling call
0709 12:59:55.728770 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:56.083693 (+354923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.341003 (+2257310us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540005d054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:58.350771 (+  9768us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589667584}
I20260709 12:59:58.800293  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 298) took 2948 ms. Trace:
I20260709 12:59:58.800868  1558 rpcz_store.cc:276] 0709 12:59:55.825267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.169027 (+343760us) service_pool.cc:224] Handling call
0709 12:59:56.169454 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:56.540215 (+370761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.608364 (+2068149us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54001d38d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:58.773407 (+165043us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640183552}
I20260709 12:59:58.656062  3746 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 12:59:58.801909  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.802484  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.803340  1558 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 12:59:58.802908  3746 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.804111  3746 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:58.805078  3801 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:58.734861  3802 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:58.806387  3797 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.806643  2267 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:58.806963  3797 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.807536  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 589) took 5064 ms. Trace:
I20260709 12:59:58.808446  3810 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:58.809348  3797 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:58.811086  3810 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:58.812093  3666 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.812268  3775 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:58.812688  3666 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.813730  3815 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:58.814360  3764 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:58.814885  3666 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:58.814567  3815 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.814996  3764 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.815282  1709 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:58.816001  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 397) took 2569 ms. Trace:
I20260709 12:59:58.815653  3764 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:58.816320  1709 rpcz_store.cc:276] 0709 12:59:56.246938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.814669 (+2567731us) service_pool.cc:224] Handling call
0709 12:59:58.815064 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.815731 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.815930 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:58.817106  3815 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:58.818467  3275 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:58.818454  1453 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.819320  3275 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:58.820888  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:58.821164  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 447) took 2655 ms. Trace:
I20260709 12:59:58.821689  1560 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 12:59:58.821403  3669 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.821533  1635 rpcz_store.cc:276] 0709 12:59:56.165584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.563104 (+397520us) service_pool.cc:224] Handling call
0709 12:59:56.563481 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:58.820254 (+2256773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.820895 (+   641us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b540019a5d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:58.821110 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4674776960}
I20260709 12:59:58.823016  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:58.823779  3797 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:58.823964  3669 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:58.824261  2269 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:59:58.824461  3797 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:58.824901  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 590) took 5070 ms. Trace:
I20260709 12:59:58.825287  2269 rpcz_store.cc:276] 0709 12:59:53.754588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.823595 (+5069007us) service_pool.cc:224] Handling call
0709 12:59:58.823951 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.824676 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.824849 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:58.826380  3275 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:58.826617  3775 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:58.827711  3778 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:58.828078  3778 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:58.829151  3778 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 12:59:58.780939  1704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1746) took 2630 ms (client timeout 2154 ms). Trace:
I20260709 12:59:58.787914  3710 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.831797  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:58.788343  1559 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:58.789162  3716 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:58.371143  1700 rpcz_store.cc:276] 0709 12:59:53.350750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.533997 (+183247us) service_pool.cc:224] Handling call
0709 12:59:55.292718 (+1758721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:55.381319 (+ 88601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.259583 (+2878264us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54000b7a50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:58.259857 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4007251712}
I20260709 12:59:58.784554  3590 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:58.846000  1552 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:58.792323  3521 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:58.793654  2265 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:58.370975  1627 rpcz_store.cc:269] 0709 12:59:56.165289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.166122 (+   833us) service_pool.cc:224] Handling call
0709 12:59:58.264903 (+2098781us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540018f1d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:58.265060 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2896470400}
W20260709 12:59:58.708264  1703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1731) took 2814 ms (client timeout 2160 ms). Trace:
W20260709 12:59:58.810089  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 396801us
I20260709 12:59:58.810807  3662 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:58.819526  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 449) took 2398 ms. Trace:
I20260709 12:59:58.785584  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 12:59:58.831519  1704 rpcz_store.cc:269] 0709 12:59:56.144390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.754970 (+2610580us) service_pool.cc:211] Skipping call since client already timed out
0709 12:59:58.774676 (+ 19706us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:59:58.270869  1630 rpcz_store.cc:276] 0709 12:59:56.421851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.726077 (+1304226us) service_pool.cc:224] Handling call
0709 12:59:57.726676 (+   599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.802659 (+ 75983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:57.802703 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:57.802774 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:57.802816 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.043709 (+240893us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b540034e9d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:58.043758 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.043906 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126081280}
I20260709 12:59:58.813798  1708 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:58.830713  3778 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:58.830909  3553 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:58.910640  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 396) took 2648 ms. Trace:
I20260709 12:59:58.911055  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:58.912199  1627 raft_consensus.cc:2410] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:59:58.913259  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:58.842933  3738 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.911072  1708 rpcz_store.cc:276] 0709 12:59:56.246683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.812958 (+2566275us) service_pool.cc:224] Handling call
0709 12:59:58.813429 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.895068 (+ 81639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.895346 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:58.830215  3812 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:58.838792  1626 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
W20260709 12:59:58.785267  1673 leader_election.cc:336] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.017s (SENT)
I20260709 12:59:58.835780  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:58.840898  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 12:59:58.414894  3622 consensus_queue.cc:1059] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.371s
I20260709 12:59:58.842404  1634 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:58.841985  1707 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:58.413825  3428 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:58.413338  3707 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.793532  3557 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.849483  1706 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:58.850185  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 12:59:58.757788  2262 rpcz_store.cc:269] 0709 12:59:55.913790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.994879 (+ 81089us) service_pool.cc:224] Handling call
0709 12:59:58.337300 (+2342421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:58.808058  2267 rpcz_store.cc:276] 0709 12:59:53.743531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.805735 (+5062204us) service_pool.cc:224] Handling call
0709 12:59:58.806327 (+   592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.807257 (+   930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.807459 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:58.853022  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 586) took 5119 ms. Trace:
I20260709 12:59:58.852013  3811 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:59:58.854982  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:58.855849  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 440) took 2948 ms. Trace:
I20260709 12:59:58.856813  3710 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:58.838996  3786 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:58.857115  3590 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 12:59:58.859809  3825 log.cc:927] Time spent T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:59:58.861296  3322 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:58.861598  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:58.269948  2263 rpcz_store.cc:276] 0709 12:59:53.641011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.848186 (+2207175us) service_pool.cc:224] Handling call
0709 12:59:55.848513 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.880699 (+ 32186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.885774 (+  5075us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:55.959390 (+ 73616us) log.cc:844] Serialized 26 byte log entry
0709 12:59:56.321552 (+362162us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:56.388754 (+ 67202us) log.cc:844] Serialized 14 byte log entry
0709 12:59:56.389039 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.389168 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:58.257132 (+1867964us) raft_consensus.cc:1685] finished
0709 12:59:58.257174 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.257380 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":67610,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":57570,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":5753,"thread_start_us":365419,"threads_started":2,"wal-append.queue_time_us":786139}
I20260709 12:59:58.862497  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:58.863329  3731 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.863350  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.864804  3797 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:58.846541  3743 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:58.866541  3679 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:58.866710  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.867048  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:58.868919  3521 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:58.870141  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.850835  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:58.872388  1632 rpcz_store.cc:276] 0709 12:59:56.421540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.715852 (+1294312us) service_pool.cc:224] Handling call
0709 12:59:57.730639 (+ 14787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.786327 (+1055688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.819288 (+ 32961us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540035be54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:58.819446 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2399307648}
I20260709 12:59:58.874707  1705 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:59:58.820716  1453 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 2 to 4, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:58.833015  3764 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:58.848014  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 61223.7us
I20260709 12:59:58.892273  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:58.892625  3662 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:58.892998  2271 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:58.893937  1553 raft_consensus.cc:2410] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:58.414233  3769 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.836956  3669 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 12:59:58.926781  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 73204.3us
I20260709 12:59:58.932211  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:58.832489  3767 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:58.870298  3749 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:58.933864  2270 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:59.281778  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 475) took 4708 ms. Trace:
W20260709 12:59:59.201972  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.990998  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 12:59:58.936095  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 64574.8us
I20260709 12:59:59.290337  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 697) took 4383 ms. Trace:
I20260709 12:59:59.290149  2271 rpcz_store.cc:276] 0709 12:59:54.573969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.892315 (+4318346us) service_pool.cc:224] Handling call
0709 12:59:58.892724 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.281485 (+388761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.281717 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.292446  1628 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:59.292438  2270 rpcz_store.cc:276] 0709 12:59:54.907465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.933018 (+4025553us) service_pool.cc:224] Handling call
0709 12:59:58.933444 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.289984 (+356540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.290269 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:59.161199  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 796731us
I20260709 12:59:59.297345  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 394) took 3045 ms. Trace:
I20260709 12:59:59.299010  1706 rpcz_store.cc:276] 0709 12:59:56.246016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.780393 (+2534377us) service_pool.cc:224] Handling call
0709 12:59:58.839267 (+ 58874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.284607 (+445340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.284812 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:59.299561  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.281575  1705 pending_rounds.cc:85] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 3
I20260709 12:59:59.305291  1705 pending_rounds.cc:107] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:59:59.305686  1705 raft_consensus.cc:2889] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:59.294611  2265 rpcz_store.cc:276] 0709 12:59:53.733613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.792997 (+5059384us) service_pool.cc:224] Handling call
0709 12:59:58.793434 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.852788 (+ 59354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.852969 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:58.976840  1673 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:59.312865  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1796) took 1108 ms. Trace:
I20260709 12:59:59.313320  1553 rpcz_store.cc:276] 0709 12:59:58.204602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.344351 (+139749us) service_pool.cc:224] Handling call
0709 12:59:59.312798 (+968447us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.324165  3669 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:59.325009  3662 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:59.326084  3707 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:59.326536  3669 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:59.328194  3428 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:59.328796  3557 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:59.328902  1701 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
W20260709 12:59:58.871013  1703 rpcz_store.cc:269] 0709 12:59:55.880400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.926410 (+2046010us) service_pool.cc:224] Handling call
0709 12:59:58.695182 (+768772us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:59.329587  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1743) took 3329 ms (client timeout 2870 ms). Trace:
I20260709 12:59:59.330330  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:59.330538  3767 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:59.331032  1557 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:59.296952  1707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 395) took 3036 ms (client timeout 1744 ms). Trace:
W20260709 12:59:59.331672  1707 rpcz_store.cc:269] 0709 12:59:56.246408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.924820 (+1678412us) service_pool.cc:224] Handling call
0709 12:59:59.283217 (+1358397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.332546  1556 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:59.332966  1552 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:59.333513  1551 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:59:59.330010  1701 rpcz_store.cc:269] 0709 12:59:56.000732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.777755 (+2777023us) service_pool.cc:224] Handling call
0709 12:59:59.329516 (+551761us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.351163  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1795) took 1128 ms. Trace:
I20260709 12:59:59.356401  2268 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 12:59:59.330384  1524 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:59.351639  1557 rpcz_store.cc:276] 0709 12:59:58.203897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.330556 (+1126659us) service_pool.cc:224] Handling call
0709 12:59:59.330885 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.331435 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.331618 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:59.351548  1601 connection.cc:256] RPC call timeout handler was delayed by -1.0616311089999613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 12:59:59.368839  1560 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:59.357362  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 489) took 1418 ms. Trace:
I20260709 12:59:59.371294  2268 rpcz_store.cc:276] 0709 12:59:57.939069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.783235 (+844166us) service_pool.cc:224] Handling call
0709 12:59:59.357273 (+574038us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:59.375710  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44310.3us
I20260709 12:59:59.380465  1635 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 4: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 12:59:59.384374  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:59.388406  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1798) took 1166 ms. Trace:
I20260709 12:59:59.390820  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 456) took 1089 ms. Trace:
I20260709 12:59:59.391446  1635 rpcz_store.cc:276] 0709 12:59:58.301548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.862224 (+560676us) service_pool.cc:224] Handling call
0709 12:59:59.390736 (+528512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.395458  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:59:58.297461  1456 rpcz_store.cc:269] 0709 12:59:40.640388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.640516 (+   128us) service_pool.cc:224] Handling call
0709 12:59:58.268842 (+17628326us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:48.580956 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:48.610928 (+ 29972us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:48.610980 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:59:48.611001 (+    21us) tablet.cc:662] Decoding operations
0709 12:59:48.611505 (+   504us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:48.611613 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:48.611649 (+    36us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:48.612098 (+   449us) tablet.cc:701] Row locks acquired
0709 12:59:48.612145 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:59:48.612327 (+   182us) write_op.cc:270] Start()
0709 12:59:48.612462 (+   135us) write_op.cc:276] Timestamp: P: 1783601988612249 usec, L: 0
0709 12:59:48.612498 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:59:48.613233 (+   735us) log.cc:844] Serialized 919 byte log entry
0709 12:59:50.738698 (+2125465us) op_driver.cc:464] REPLICATION: finished
0709 12:59:51.495593 (+756895us) write_op.cc:301] APPLY: starting
0709 12:59:51.507144 (+ 11551us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:51.518671 (+ 11527us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:51.545669 (+ 26998us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:51.652967 (+107298us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:51.653280 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:59:51.653368 (+    88us) write_op.cc:312] APPLY: finished
0709 12:59:51.653625 (+   257us) log.cc:844] Serialized 29 byte log entry
0709 12:59:52.524907 (+871282us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06daec50ac 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b
0709 12:59:52.796137 (+271230us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.804790 (+  8653us) write_op.cc:454] Released schema lock
0709 12:59:52.812507 (+  7717us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:52.854125 (+ 41618us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:52.856860 (+  2735us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":909265,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":721228,"apply.run_cpu_time_us":72895,"apply.run_wall_time_us":1357873,"num_ops":2,"prepare.queue_time_us":445143,"prepare.run_cpu_time_us":22532,"prepare.run_wall_time_us":320671,"raft.queue_time_us":452321,"raft.run_cpu_time_us":23191,"raft.run_wall_time_us":596275,"replication_time_us":2085639,"spinlock_wait_cycles":12099968,"thread_start_us":2276085,"threads_started":5,"wal-append.queue_time_us":1453626,"wal-append.run_cpu_time_us":41814,"wal-append.run_wall_time_us":3391931}]]}
I20260709 12:59:59.402268  1631 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:59.403013  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 458) took 1068 ms. Trace:
I20260709 12:59:59.403422  1631 rpcz_store.cc:276] 0709 12:59:58.334951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.794948 (+459997us) service_pool.cc:224] Handling call
0709 12:59:59.402934 (+607986us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.388998  1560 rpcz_store.cc:276] 0709 12:59:58.205509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.344567 (+1139058us) service_pool.cc:224] Handling call
0709 12:59:59.345031 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.370667 (+ 25636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.371563 (+   896us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.407696  3737 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:59.407826  3749 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 12:59:59.408617  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.408962  3669 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.409765  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:59.411237  1634 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 12:59:59.411590  1453 catalog_manager.cc:5697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 3, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 12:59:59.415238  1626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1908) took 3179 ms (client timeout 2870 ms). Trace:
I20260709 12:59:59.334503  1555 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
W20260709 12:59:59.418262  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 87968.7us
W20260709 12:59:59.419306  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 646034us
I20260709 12:59:59.420727  3622 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:59.421360  3557 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:59.432266  1559 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 12:59:59.432952  1552 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:59.429469  1551 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
W20260709 12:59:59.434176  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.266404  3603 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.288s
W20260709 12:59:59.435741  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.447487  1558 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:59.448392  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1734) took 3540 ms. Trace:
I20260709 12:59:59.464395  1705 rpcz_store.cc:276] 0709 12:59:55.896632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.769258 (+2872626us) service_pool.cc:224] Handling call
0709 12:59:58.851217 (+ 81959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.401641 (+550424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.437129 (+ 35488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.446343  1560 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:59.440536  1599 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.054s	sys 0.102s
W20260709 12:59:59.466459  1599 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.054s	sys 0.103s
W20260709 12:59:59.439447  1626 rpcz_store.cc:269] 0709 12:59:56.235967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.545834 (+309867us) service_pool.cc:224] Handling call
0709 12:59:59.414974 (+2869140us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54002fa3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:59.415141 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3557115776}
W20260709 12:59:59.434221  2269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.025s	sys 0.086s
I20260709 12:59:59.458216  3732 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.423228  3719 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 12:59:59.470299  2269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.026s	sys 0.086s
W20260709 12:59:59.468468  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 84165.2us
W20260709 12:59:59.466771  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 648258us
W20260709 12:59:59.473716  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.474151  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1794) took 1311 ms. Trace:
I20260709 12:59:59.293331  1633 rpcz_store.cc:276] 0709 12:59:55.818118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.818257 (+   139us) service_pool.cc:224] Handling call
0709 12:59:55.818579 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.818951 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:55.829873 (+ 10922us) log.cc:844] Serialized 14 byte log entry
0709 12:59:55.902018 (+ 72145us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:55.907482 (+  5464us) log.cc:844] Serialized 26 byte log entry
0709 12:59:55.907643 (+   161us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:55.907675 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.907734 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:58.585800 (+2678066us) raft_consensus.cc:1685] finished
0709 12:59:58.585851 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.766809 (+180958us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12519,"prepare.queue_time_us":31537,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":48,"raft.queue_time_us":5499,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":12326,"thread_start_us":62267,"threads_started":1,"wal-append.queue_time_us":138084}
I20260709 12:59:59.449728  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 703) took 3947 ms. Trace:
I20260709 12:59:59.476122  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1480) took 1207 ms. Trace:
I20260709 12:59:59.282243  3454 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:59.501896  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:59.503316  1558 rpcz_store.cc:276] 0709 12:59:58.160608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.331856 (+1171248us) service_pool.cc:224] Handling call
0709 12:59:59.399616 (+ 67760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.463897 (+ 64281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.464134 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:59.504184  1673 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.018s (SENT)
I20260709 12:59:59.500533  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:59.450080  3775 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:59.511387  1560 rpcz_store.cc:276] 0709 12:59:58.259785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.423984 (+1164199us) service_pool.cc:224] Handling call
0709 12:59:59.446092 (+ 22108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.466479 (+ 20387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.466808 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.513504  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:59.514701  1673 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:59.521588  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:59.518641  1701 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 12:59:59.463332  3707 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.529312  2265 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:59.440773  3767 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:59.505720  2270 rpcz_store.cc:276] 0709 12:59:55.492927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.312644 (+3819717us) service_pool.cc:224] Handling call
0709 12:59:59.439518 (+126874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.439901 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.439940 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:59.439998 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:59.440051 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.440127 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.440268 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":10606}
I20260709 12:59:59.474061  3428 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 12:59:59.456096  3622 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:59.465993  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:59.536861  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 614) took 3447 ms. Trace:
I20260709 12:59:59.506806  3607 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:59.554731  1558 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:59.554541  3607 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:59.556293  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:59.556809  3607 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:59.558980  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 459) took 1181 ms. Trace:
I20260709 12:59:59.559394  1634 rpcz_store.cc:276] 0709 12:59:58.366735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.508316 (+1141581us) service_pool.cc:224] Handling call
0709 12:59:59.535924 (+ 27608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.548172 (+ 12248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.548208 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:59.548259 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:59.548301 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.548371 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.548488 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12435}
I20260709 12:59:59.553567  2265 rpcz_store.cc:276] 0709 12:59:56.089903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.365513 (+3275610us) service_pool.cc:224] Handling call
0709 12:59:59.470269 (+104756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.529751 (+ 59482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.536791 (+  7040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.542802  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:59.544193  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:58.374517  2266 rpcz_store.cc:276] 0709 12:59:53.711071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.724889 (+4013818us) service_pool.cc:224] Handling call
0709 12:59:57.725438 (+   549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:57.726000 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:57.830619 (+104619us) log.cc:844] Serialized 14 byte log entry
0709 12:59:57.913123 (+ 82504us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:57.923954 (+ 10831us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:57.924033 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.988442 (+ 64409us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.136272 (+147830us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":584,"prepare.queue_time_us":247665,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":105,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":180,"thread_start_us":113413,"threads_started":2,"wal-append.queue_time_us":393747}
I20260709 12:59:59.477330  1453 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 3, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.561959  1705 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.550787  1707 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 12:59:59.551270  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46555.5us
I20260709 12:59:59.462594  1630 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 12:59:59.557071  2268 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:59.520694  3557 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 12:59:59.538750  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:59.563905  3749 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:59.570896  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 454) took 1270 ms. Trace:
W20260709 12:59:59.567497  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.518849  3775 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:59.473114  3669 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:59.569357  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:59.586440  1559 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 12:59:59.579708  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:59.606228  1631 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:59.579605  3624 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:59:59.580359  3778 consensus_meta.cc:287] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.000s
I20260709 12:59:59.582873  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 12:59:59.558409  3769 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:59.586304  1626 rpcz_store.cc:276] 0709 12:59:58.300783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.467150 (+1166367us) service_pool.cc:224] Handling call
0709 12:59:59.508719 (+ 41569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.570471 (+ 61752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.570515 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:59.570575 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:59.570622 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.570696 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.570830 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.568344  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:59.585492  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 12:59:59.573271  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1416666239999813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
I20260709 12:59:59.607066  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 455) took 1306 ms. Trace:
I20260709 12:59:59.619684  1631 rpcz_store.cc:276] 0709 12:59:58.301132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.404252 (+1103120us) service_pool.cc:224] Handling call
0709 12:59:59.579543 (+175291us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 12:59:59.606982 (+ 27439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7660928}
I20260709 12:59:59.622062  3812 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:59.622380  1526 leader_election.cc:336] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.010s (SENT)
I20260709 12:59:59.622920  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 12:59:59.627355  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.634869  3669 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 12:59:59.638115  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 115595us
I20260709 12:59:59.621865  1453 catalog_manager.cc:5697] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 3, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.643059  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:59.647106  1629 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:59.649454  3666 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:59.649995  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:59.651063  3669 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:59.651538  3669 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 12:59:59.651973  3669 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:59.653539  1599 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:59.641446  1453 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 2, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 12:59:59.655704  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 139446us
I20260709 12:59:59.654382  3719 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:59.657235  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:59.657569  1703 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 12:59:59.664716  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1609) took 1085 ms. Trace:
I20260709 12:59:59.665261  1634 rpcz_store.cc:276] 0709 12:59:58.579542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.600193 (+1020651us) service_pool.cc:224] Handling call
0709 12:59:59.642967 (+ 42774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.664217 (+ 21250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.664260 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:59.664324 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:59.664381 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.664465 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.664631 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.532166  3710 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.089s
W20260709 12:59:59.670595  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 71033.8us
W20260709 12:59:59.712373  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 208234us
I20260709 12:59:59.563434  3707 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:59.749198  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1482) took 1488 ms. Trace:
I20260709 12:59:59.747571  1600 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:59.563854  3428 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 12:59:59.717492  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:59.749689  1551 rpcz_store.cc:276] 0709 12:59:58.260703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.782391 (+521688us) service_pool.cc:224] Handling call
0709 12:59:59.749019 (+966628us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54000aa854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 12:59:59.749126 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934566272}
W20260709 12:59:59.745999  2235 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.052s	sys 0.126s
W20260709 12:59:59.755967  2235 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.055s	sys 0.126s
I20260709 12:59:59.772035  1707 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
W20260709 12:59:59.756348  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 957043us
I20260709 12:59:59.671115  3767 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.783043  1559 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:59:59.774999  1674 connection.cc:256] RPC call timeout handler was delayed by -1.3161517949999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 12:59:59.784322  1674 connection.cc:256] RPC call timeout handler was delayed by -1.0842928549999442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 12:59:59.787796  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 12:59:59.784734  1674 connection.cc:256] RPC call timeout handler was delayed by -1.0704517949999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
I20260709 12:59:59.786602  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 285) took 3825 ms. Trace:
W20260709 12:59:59.792040  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.650013  3666 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 12:59:59.671185  3778 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:59.716989  3607 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 12:59:59.795210  1628 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:59.672441  3322 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:59.790972  1554 rpcz_store.cc:276] 0709 12:59:55.812193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.814346 (+  2153us) service_pool.cc:224] Handling call
0709 12:59:55.814648 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:58.615748 (+2801100us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b1800005c20. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddb774bc 00007f06daec548b 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06ddfc7060 00007f06ddfc7bfb 00007f06ddfd264b
0709 12:59:58.616036 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.616073 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:58.616749 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 12:59:59.026589 (+409840us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:59.026637 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.311200 (+284563us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:59.636897 (+325697us) raft_consensus.cc:1685] finished
0709 12:59:59.636923 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.637246 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55655,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6558,"spinlock_wait_cycles":2550144,"thread_start_us":475462,"threads_started":2,"wal-append.queue_time_us":922144}
W20260709 12:59:59.804104  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 150652us
I20260709 12:59:59.614532  3732 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:59.682129  3738 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:59.718477  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1611) took 1132 ms. Trace:
I20260709 12:59:59.717931  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:59.824067  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:59.778075  3603 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:59.658711  3719 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 12:59:59.773272  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 709) took 1951 ms. Trace:
I20260709 12:59:59.787024  3749 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.799897  1701 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 12:59:59.680176  3811 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:59.799737  3666 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.829203  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:59.830545  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:59.830258  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:59.846961  1628 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 12:59:59.800315  3778 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 12:59:59.842875  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 12:59:59.805279  3786 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:59.796794  3754 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.847627  1635 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:59.854076  3738 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:59.863816  1701 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:59.844326  3811 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.828553  3603 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.865146  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 12:59:59.865056  1707 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 12:59:59.808722  3521 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:59:59.843533  3731 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 12:59:59.865635  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:59.809496  3607 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 12:59:59.861348  3662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.002s	sys 0.050s
I20260709 12:59:59.871125  2235 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 12:59:59.818576  1627 rpcz_store.cc:276] 0709 12:59:58.580361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.339405 (+759044us) service_pool.cc:224] Handling call
0709 12:59:59.712528 (+373123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.814699  3767 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:59.887203  1707 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:59.888810  2268 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:59.865428  3738 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.871505  3811 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:59.892954  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:59.812310  3775 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:59.830080  3557 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:59.876466  3778 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:59.873960  3732 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 12:59:59.914450  2266 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:59.908008  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:59.925843  1701 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 12:59:59.926841  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:59.928017  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:59.907480  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 12:59:59.929250  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:59.831400  2267 rpcz_store.cc:276] 0709 12:59:57.808788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.361267 (+1552479us) service_pool.cc:224] Handling call
0709 12:59:59.473786 (+112519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.595002 (+121216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.614755 (+ 19753us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:59.619647 (+  4892us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:59.679780 (+ 60133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.717607 (+ 37827us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.759902 (+ 42295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:59.908881  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:59.930464  3731 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:59.930958  3731 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.908380  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:59.931597  3731 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:59.932302  3775 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:59.910403  3767 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 12:59:59.923175  3716 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:59.903952  3738 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:59.934412  3521 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:59.934890  3521 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.935262  3521 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:59.916859  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 93616.7us
I20260709 12:59:59.926841  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:59.875041  1700 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:59.876729  3603 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:59.882678  3662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.002s	sys 0.051s
I20260709 12:59:59.826673  3622 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 12:59:59.925704  3786 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:59.910334  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 12:59:59.937952  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:59.967006  1707 raft_consensus.cc:2410] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:59.899801  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 12:59:59.967904  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 12:59:59.951612  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 12:59:59.929983  1701 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 12:59:59.931777  1709 raft_consensus.cc:2376] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4. Re-sending same reply.
I20260709 12:59:59.943624  3764 consensus_queue.cc:1059] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:59:59.974313  3764 raft_consensus.cc:3055] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:59.974844  3764 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 12:59:59.976066  3764 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:59.864843  3754 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:59.931716  3428 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 12:59:59.907382  3666 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:59.998389  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 12:59:59.879240  3749 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 12:59:59.920966  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 12:59:59.930974  1627 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 13:00:00.013136  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:00.013319  2235 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:00.013945  1705 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:00.016388  1635 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:00.020581  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:00.020155  1556 consensus_meta.cc:287] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.012s
I20260709 13:00:00.021425  1556 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:00.023172  1634 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:00.048249  1702 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:00.093364  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:00.094327  3607 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:00.094870  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:00.098429  3707 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:00.103000  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:00.103704  1558 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:59.999356  3767 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:00:00.109146  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:00.094430  1554 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:00.106884  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:00.045641  3764 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:00.108013  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:00.121567  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:00.119554  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.019s	sys 0.034s
W20260709 13:00:00.122748  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.019s	sys 0.034s
W20260709 13:00:00.123195  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 564370us
I20260709 13:00:00.123989  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:00.124595  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:00.125571  1559 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:00.104306  3454 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:00.127931  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:00.128762  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:00.131695  2269 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.000s	sys 0.025s
I20260709 13:00:00.105448  3428 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:00.041584  2263 raft_consensus.cc:2376] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5. Re-sending same reply.
W20260709 13:00:00.138918  2269 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.000s	sys 0.025s
I20260709 13:00:00.143457  1704 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:00.108793  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:00.108964  3786 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:00.150733  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:00.152383  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:00.139498  3743 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.767s	user 0.008s	sys 0.004s
I20260709 13:00:00.154758  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:00.157797  1554 raft_consensus.cc:2410] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 7 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:00:00.140898  3454 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.201035  3454 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:00.208381  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:00.160926  3737 consensus_meta.cc:287] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.722s	user 0.007s	sys 0.003s
I20260709 13:00:00.161389  3666 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:00.161616  3769 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.005s
I20260709 13:00:00.152724  3786 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.167330  3797 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:00.149036  3607 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.169257  1700 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:00.170224  3624 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:00.172088  1556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1799) took 1920 ms (client timeout 1620 ms). Trace:
I20260709 13:00:00.236585  1631 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 13:00:00.173345  3603 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:00.174384  3669 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.522s	user 0.013s	sys 0.009s
I20260709 13:00:00.174319  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:00.245239  1709 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:00.175233  1557 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:00.175765  3792 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.178407  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 453) took 1878 ms. Trace:
I20260709 13:00:00.235845  3786 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:00.180047  3675 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:00.182204  1628 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:00.182291  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:00.183826  3754 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:00.184581  3778 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:00.186651  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.188666  1706 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 13:00:00.190284  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 463) took 1370 ms. Trace:
I20260709 13:00:00.190573  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 457) took 1888 ms. Trace:
W20260709 13:00:00.258140  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 510796us
I20260709 13:00:00.258315  1635 rpcz_store.cc:276] 0709 12:59:58.302009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.392703 (+1090694us) service_pool.cc:224] Handling call
0709 12:59:59.585344 (+192641us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:00:00.190409 (+605065us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540034eed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:00.190516 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543003264}
I20260709 13:00:00.191123  3738 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:00.198421  3428 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:00.211258  1704 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:00.236423  1705 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
W20260709 13:00:00.238355  1556 rpcz_store.cc:269] 0709 12:59:58.251757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.257010 (+  5253us) service_pool.cc:224] Handling call
0709 13:00:00.171857 (+1914847us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b5400312ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:00.171980 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2298101504}
I20260709 13:00:00.178655  3767 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.247685  1632 rpcz_store.cc:276] 0709 12:59:58.300464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.462385 (+1161921us) service_pool.cc:224] Handling call
0709 12:59:59.507537 (+ 45152us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:59.533143 (+ 25606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.533182 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:59.568039 (+ 34857us) log.cc:844] Serialized 26 byte log entry
0709 12:59:59.882903 (+314864us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:59.882942 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.883061 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:00.178112 (+295051us) raft_consensus.cc:1685] finished
0709 13:00:00.178139 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.178337 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":310377,"threads_started":1,"wal-append.queue_time_us":588496}
I20260709 13:00:00.234397  3797 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:00.235417  2271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.002s	sys 0.026s
I20260709 13:00:00.257651  1634 rpcz_store.cc:276] 0709 12:59:58.819640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.666578 (+846938us) service_pool.cc:224] Handling call
0709 12:59:59.753720 (+ 87142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.023687 (+269967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.182001 (+158314us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540007f3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:00.190223 (+  8222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619208576}
W20260709 13:00:00.279498  2271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.003s	sys 0.026s
W20260709 13:00:00.279575  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 437507us
I20260709 13:00:00.251986  3675 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:00.289147  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:00.306716  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.288233  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:00.246166  3607 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:00.272579  3812 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:00.344344  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 63890.1us
I20260709 13:00:00.256384  3792 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:00.353235  3763 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.353858  3763 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:00.354342  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 600261us
I20260709 13:00:00.356423  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:00.271862  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1479) took 2012 ms. Trace:
W20260709 13:00:00.363754  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.250640  3669 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:00.353547  3737 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:00.309832  3675 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:00.403249  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.027s	sys 0.059s
W20260709 13:00:00.472527  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.027s	sys 0.059s
W20260709 13:00:00.472947  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 607888us
I20260709 13:00:00.473773  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:00.359905  1553 rpcz_store.cc:276] 0709 12:59:58.259334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.385729 (+1126395us) service_pool.cc:224] Handling call
0709 12:59:59.458982 (+ 73253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.459291 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:59.459691 (+   400us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.271404 (+811713us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:00.271476 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:00.271539 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.271627 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.271791 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":850,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":274494,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":811195,"threads_started":2,"wal-append.queue_time_us":462573}
W20260709 13:00:00.526960  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.527885  3743 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.528154  1524 connection.cc:256] RPC call timeout handler was delayed by -2.0522983869999507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28700000000000003s for a response
I20260709 13:00:00.528560  3743 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:00.523759  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:00.538712  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:00.539641  1700 raft_consensus.cc:2376] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3. Re-sending same reply.
I20260709 13:00:00.542392  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:00.543488  1702 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:00.574322  1674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.009s	sys 0.014s
W20260709 13:00:00.574787  1674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.009s	sys 0.014s
I20260709 13:00:00.523313  3710 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:00.589514  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:00.590122  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:00.592093  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 578873us
I20260709 13:00:00.596091  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:00.524031  3749 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:00.627965  1703 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.017s	sys 0.021s
I20260709 13:00:00.533178  3737 raft_consensus.cc:697] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:00.588806  1673 leader_election.cc:336] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.464s (SENT)
I20260709 13:00:00.374284  3767 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:00.545958  3669 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:00.575659  3322 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.004s	sys 0.019s
I20260709 13:00:00.608812  3557 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:00.672930  3322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.005s	sys 0.019s
I20260709 13:00:00.673210  3557 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:00.673403  3322 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:00.674404  3557 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:00.674661  3322 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:00.586640  3788 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.019s	sys 0.013s
W20260709 13:00:00.676524  3788 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.020s	sys 0.014s
I20260709 13:00:00.546123  3607 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:00.575111  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 637240us
W20260709 13:00:00.590319  3811 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.682s	user 0.011s	sys 0.008s
W20260709 13:00:00.572626  3590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.011s	sys 0.016s
I20260709 13:00:00.439646  3707 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.164s
I20260709 13:00:00.586954  3710 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:00.628913  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 440072us
W20260709 13:00:00.626127  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 96081.2us
W20260709 13:00:00.610781  3775 consensus_meta.cc:287] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.678s	user 0.011s	sys 0.000s
I20260709 13:00:00.530706  3666 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:00:00.663193  1626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.005s	sys 0.026s
W20260709 13:00:00.696848  1626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.005s	sys 0.026s
I20260709 13:00:00.666235  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:00.677696  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:00.650887  1703 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.018s	sys 0.022s
W20260709 13:00:00.694222  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.010s	sys 0.028s
I20260709 13:00:00.700444  1632 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:00.701870  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.010s	sys 0.028s
I20260709 13:00:00.668830  3603 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:00.629060  3428 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:00.702942  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:00.686097  3590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.012s	sys 0.016s
W20260709 13:00:00.702468  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 524904us
I20260709 13:00:00.703554  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:00.731570  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1615) took 1928 ms. Trace:
I20260709 13:00:00.704083  2270 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:00.716598  3666 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:00.762987  2269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.007s	sys 0.015s
W20260709 13:00:00.765720  2269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.007s	sys 0.015s
I20260709 13:00:00.766592  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 474) took 6348 ms. Trace:
I20260709 13:00:00.699941  3710 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:00.769874  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 66396us
I20260709 13:00:00.764307  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:00.700419  3847 consensus_queue.cc:1059] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:00:00.773581  1632 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 13:00:00.775089  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:00.767141  2269 rpcz_store.cc:276] 0709 12:59:54.418642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.839746 (+4421104us) service_pool.cc:224] Handling call
0709 12:59:58.855794 (+ 16048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:58.856244 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.856280 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:58.856841 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 12:59:59.506783 (+649942us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:00.153939 (+647156us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.766220 (+612281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.766310 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:00.766361 (+    51us) raft_consensus.cc:1685] finished
0709 13:00:00.766373 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.766524 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":728,"prepare.queue_time_us":931662,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":107710,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":10213,"thread_start_us":1865591,"threads_started":3,"wal-append.queue_time_us":1009489}
I20260709 13:00:00.741828  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:00.760135  3607 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:00.742543  3743 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:00.808202  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:00.809034  1632 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 13:00:00.690882  3811 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:00.813222  3835 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:00:00.741066  3669 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 13:00:00.816586  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 227833us
I20260709 13:00:00.816929  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:00.824774  3737 consensus_queue.cc:237] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:00.775390  3778 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:00:00.827630  3811 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:00.828413  1551 raft_consensus.cc:2368] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6.
W20260709 13:00:00.804081  2233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.003s	sys 0.016s
W20260709 13:00:00.814354  3454 consensus_meta.cc:287] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.004s
I20260709 13:00:00.771998  3749 consensus_queue.cc:1059] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:00:00.841768  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:00.814894  3590 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:00.843587  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 76544.3us
W20260709 13:00:00.845587  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.847545  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:00.797181  3603 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:00:00.836134  2233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.004s	sys 0.017s
I20260709 13:00:00.854461  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:00.855341  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 82946.9us
I20260709 13:00:00.829845  3743 raft_consensus.cc:3055] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:00.865302  3749 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:00.866751  3749 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:00.867157  3749 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:00.868063  3749 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:00.869547  3749 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:00.870411  1558 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.760s	user 0.000s	sys 0.010s
I20260709 13:00:00.872023  1558 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
W20260709 13:00:00.873515  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 277538us
I20260709 13:00:00.803767  3854 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:00:00.854003  3521 consensus_meta.cc:287] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.918s	user 0.008s	sys 0.005s
W20260709 13:00:00.890906  1673 leader_election.cc:336] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.466s (SENT)
I20260709 13:00:00.847491  3590 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.883845  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:00.867800  3731 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.936s	user 0.000s	sys 0.019s
I20260709 13:00:00.893855  3858 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:00.848603  3454 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:00.900063  3852 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:00:00.930510  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46782us
I20260709 13:00:00.931507  1674 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:00.902163  3521 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:00.904948  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:00.870394  3743 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:00.894502  3607 raft_consensus.cc:3055] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:00.910686  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 478) took 5993 ms. Trace:
I20260709 13:00:00.935858  2271 rpcz_store.cc:276] 0709 12:59:54.917728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.292866 (+4375138us) service_pool.cc:224] Handling call
0709 12:59:59.330795 (+ 37929us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:59.375409 (+ 44614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.375449 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:59.405141 (+ 29692us) log.cc:844] Serialized 26 byte log entry
0709 13:00:00.280015 (+874874us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:00.655094 (+375079us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.852346 (+197252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.852435 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:00.910427 (+ 57992us) raft_consensus.cc:1685] finished
0709 13:00:00.910450 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.910615 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6040,"prepare.queue_time_us":293383,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":164320,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":46678,"thread_start_us":1425654,"threads_started":3,"wal-append.queue_time_us":1204369}
I20260709 13:00:00.912153  3792 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:00.913272  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1624) took 1095 ms. Trace:
I20260709 13:00:00.938448  1628 rpcz_store.cc:276] 0709 12:59:59.823389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.870921 (+ 47532us) service_pool.cc:224] Handling call
0709 13:00:00.913034 (+1042113us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540018e7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:00.913190 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492978048}
W20260709 13:00:00.914619  3850 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:00:00.914911  3764 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:00.916184  3763 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:00.850449  3857 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:00.921504  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.892441  3847 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:00.898504  3590 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:00.938452  3603 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:00.954453  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:00.935675  3607 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:00.954273  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:00.963050  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:00.928710  3731 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:00.944767  3767 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:00.973774  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:00.950629  3847 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:00.956918  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:00.983146  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 129880us
I20260709 13:00:00.954253  3603 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:00.962611  3557 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:00.985417  3857 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:00.996675  3837 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:01.007927  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 45020.6us
I20260709 13:00:01.008097  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:01.008580  3863 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:00:01.008951  1708 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:01.009536  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:01.009410  3743 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.010185  3428 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:01.010591  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:01.088912  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.013196  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:00.956354  3866 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:01.016090  3521 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:00.975078  3854 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.017203  1628 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:01.077430  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.085927  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:01.085371  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:01.099071  2266 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.086560  1702 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:00.969058  3851 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:01.091867  2235 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:01.096357  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 85895us
I20260709 13:00:01.126437  1674 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:01.099071  1701 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:00.974702  3763 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:01.130332  3763 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.130990  3763 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:01.101243  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:01.134192  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:01.109701  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:01.109841  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:01.135603  1700 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:01.111008  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:01.136644  2268 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:01.138592  1709 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 13:00:01.110047  3607 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.137799  1700 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:01.088445  3428 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:01.116935  3786 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.844s	user 0.011s	sys 0.003s
I20260709 13:00:01.117503  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:01.085589  3839 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:00:01.074981  3767 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:00:01.118847  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.109393  3863 raft_consensus.cc:3055] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:01.058756  3837 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:01.119339  1628 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:00:01.097116  1673 leader_election.cc:336] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.627s (SENT)
I20260709 13:00:01.133670  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1648) took 1449 ms. Trace:
I20260709 13:00:01.142731  3607 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.164592  2268 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
W20260709 13:00:01.123306  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.060464  3557 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.106626  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:01.169476  3557 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.169904  1708 raft_consensus.cc:2376] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6. Re-sending same reply.
I20260709 13:00:01.143460  3786 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.173408  3786 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:01.149277  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.149557  3863 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:01.178366  3863 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.180095  3863 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:01.181983  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:01.183583  1708 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:01.154690  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:01.150687  3837 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.189069  3837 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:01.161161  1703 rpcz_store.cc:276] 0709 12:59:59.684191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.749225 (+ 65034us) service_pool.cc:224] Handling call
0709 12:59:59.827645 (+ 78420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.879273 (+ 51628us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:00.735283 (+856010us) log.cc:844] Serialized 14 byte log entry
0709 13:00:01.127579 (+392296us) log.cc:844] Serialized 14 byte log entry
0709 13:00:01.133066 (+  5487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:01.133174 (+   108us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:01.133261 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.133394 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.133584 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9641,"prepare.queue_time_us":869569,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":2872,"raft.queue_time_us":29971,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":26583,"spinlock_wait_cycles":5155712,"thread_start_us":1031264,"threads_started":4,"wal-append.queue_time_us":194940}
W20260709 13:00:01.169497  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.146157  1702 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:01.202221  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:01.203172  1703 raft_consensus.cc:2376] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3. Re-sending same reply.
I20260709 13:00:01.141713  1709 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:01.016606  3603 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:01.143121  3428 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:01.316256  2266 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:01.322597  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:01.323462  2266 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:01.325239  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:01.315603  3710 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
W20260709 13:00:01.333053  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 205476us
I20260709 13:00:01.318960  3866 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:01.320394  3857 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.344872  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:01.335008  3851 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:01.331964  3873 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:00:01.323168  3786 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:01.321632  3743 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:01.320901  3858 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:01.379006  1708 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
W20260709 13:00:01.333194  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.397972  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 380851us
I20260709 13:00:01.350310  3866 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.338675  3454 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:01.125002  3854 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.417748  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:01.369611  3851 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:01.338702  3710 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.448287  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:01.449054  3885 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:01.449416  3854 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:01.411247  3866 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:01.450579  2264 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 4 LEARNER]: Advancing to term 5
I20260709 13:00:01.454137  3884 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:01.371098  3749 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:00:01.506740  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1478) took 3248 ms. Trace:
W20260709 13:00:01.566927  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.567790  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 477933us
I20260709 13:00:01.567018  1557 rpcz_store.cc:276] 0709 12:59:58.258805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.384818 (+1126013us) service_pool.cc:224] Handling call
0709 13:00:00.175047 (+790229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.245790 (+ 70743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.458752 (+1212962us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400312ed0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:01.506666 (+ 47914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673671040}
I20260709 13:00:01.567085  3885 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:01.571832  3885 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.582676  2269 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:01.597481  1701 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:01.590099  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:01.399941  3847 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:01.581840  2271 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:01.599316  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:01.604161  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 204945us
W20260709 13:00:01.584698  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 239941us
I20260709 13:00:01.514204  3778 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.607707  1674 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:01.564271  3521 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:01.507313  3767 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
W20260709 13:00:01.613963  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.619771  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.433368  3851 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:01.506712  1627 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:01.443959  3786 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.624506  1674 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:01.624610  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.604123  2262 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:01.641207  3428 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.607438  3858 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.670110  3893 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:00:01.617723  3778 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.678419  3778 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:01.611338  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:01.527424  3557 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:01.682144  3557 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:01.455248  3454 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:01.612222  3675 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.081s	user 0.011s	sys 0.004s
I20260709 13:00:01.683300  3454 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.683744  3675 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:01.684818  2267 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:01.455741  3763 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:01.688027  3675 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:01.650642  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.662120  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.665760  3868 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:02.514324  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.514297  3868 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:01.660084  3855 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.711s	user 0.004s	sys 0.000s
I20260709 13:00:01.632938  3884 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:02.203547  3857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.014s	sys 0.019s
W20260709 13:00:02.363919  3866 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.797s	user 0.006s	sys 0.005s
I20260709 13:00:02.518707  3884 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.695292  3786 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:02.517943  2236 connection.cc:256] RPC call timeout handler was delayed by -2.475939595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
I20260709 13:00:02.517256  3868 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:02.520018  2236 connection.cc:256] RPC call timeout handler was delayed by -2.32923959499999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260709 13:00:02.520401  2236 connection.cc:256] RPC call timeout handler was delayed by -2.3121395950000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:00:02.518972  3857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.014s	sys 0.020s
W20260709 13:00:02.520609  2236 connection.cc:256] RPC call timeout handler was delayed by -2.2563395949999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
W20260709 13:00:02.521579  2236 connection.cc:256] RPC call timeout handler was delayed by -2.1492395949999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
I20260709 13:00:02.519695  3884 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:02.521962  2236 connection.cc:256] RPC call timeout handler was delayed by -2.0394395949999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
W20260709 13:00:02.524427  2236 connection.cc:256] RPC call timeout handler was delayed by -1.5516571830000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
W20260709 13:00:02.524964  2236 connection.cc:256] RPC call timeout handler was delayed by -1.5327395950000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.261s for a response
W20260709 13:00:02.525434  2236 connection.cc:256] RPC call timeout handler was delayed by -1.0035395950000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31980000000000003s for a response
I20260709 13:00:02.519124  3866 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:02.524399  3857 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.534869  3786 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:02.542001  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:02.544837  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:02.540927  3857 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.546586  2271 raft_consensus.cc:2368] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4.
I20260709 13:00:02.547730  3857 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:02.547739  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:02.549402  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:02.550858  3851 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.918s	user 0.016s	sys 0.001s
I20260709 13:00:02.551038  2271 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:02.551462  3851 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:02.553134  3710 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:02.555531  3866 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:02.557116  3884 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:02.564543  1702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.993s	user 0.017s	sys 0.017s
W20260709 13:00:02.565001  1702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.018s	sys 0.018s
I20260709 13:00:02.560598  3884 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:02.565829  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1680) took 1388 ms. Trace:
I20260709 13:00:02.566295  1702 rpcz_store.cc:276] 0709 13:00:01.177495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.192733 (+ 15238us) service_pool.cc:224] Handling call
0709 13:00:01.193119 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:01.560293 (+367174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.560331 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:01.571616 (+ 11285us) log.cc:844] Serialized 52 byte log entry
0709 13:00:02.565418 (+993802us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:02.565461 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.565542 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.565591 (+    49us) raft_consensus.cc:1685] finished
0709 13:00:02.565602 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.565749 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":238989,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":11184,"thread_start_us":1121805,"threads_started":2,"wal-append.queue_time_us":791491}
I20260709 13:00:02.569025  3851 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:02.573438  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:02.574965  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:02.575690  2271 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:02.577329  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1619) took 2797 ms (client timeout 1953 ms). Trace:
I20260709 13:00:02.584965  2271 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:02.586205  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:02.587054  2271 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:02.587949  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:02.589461  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:02.589985  2271 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:02.577878  1631 rpcz_store.cc:269] 0709 12:59:59.780119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.791694 (+ 11575us) service_pool.cc:224] Handling call
0709 13:00:02.577081 (+2785387us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b540008a2d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:02.577249 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947211136}
I20260709 13:00:02.599942  2271 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:02.601707  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:02.603472  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:02.604360  2271 raft_consensus.cc:2410] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:02.605929  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:02.606791  2271 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:02.608614  2271 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:00:02.611327  3879 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 1.208s	user 0.004s	sys 0.001s
I20260709 13:00:00.761065  1629 rpcz_store.cc:276] 0709 12:59:58.803479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.648098 (+844619us) service_pool.cc:224] Handling call
0709 12:59:59.716811 (+ 68713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.771805 (+ 54994us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:00.280864 (+509059us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.731204 (+450340us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:00.731261 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:00.731307 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.731376 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.731507 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8279,"prepare.queue_time_us":508256,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":18733,"thread_start_us":854031,"threads_started":2}
I20260709 13:00:02.618482  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 490) took 3073 ms. Trace:
I20260709 13:00:02.620692  2270 rpcz_store.cc:276] 0709 12:59:59.545413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.554193 (+  8780us) service_pool.cc:224] Handling call
0709 12:59:59.554620 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.762118 (+1207498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.618136 (+1856018us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540056aed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:02.618406 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2642812800}
W20260709 13:00:02.624516  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1808624390000659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
W20260709 13:00:02.626143  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1619624390000354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 13:00:02.626544  1526 connection.cc:256] RPC call timeout handler was delayed by -1.14394977500001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 13:00:02.626848  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1313624390000427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
W20260709 13:00:02.627797  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1304497750000451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 13:00:02.628408  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1286497750000422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:00:02.629348  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0638497749999942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:00:02.630309  1526 connection.cc:256] RPC call timeout handler was delayed by -1.012549775000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 13:00:02.630707  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0107497750000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 13:00:02.631451  3899 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:02.632098  3899 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:02.635223  3899 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:02.636622  1551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 303) took 2708 ms (client timeout 1793 ms). Trace:
W20260709 13:00:02.637166  1551 rpcz_store.cc:269] 0709 12:59:59.927892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.948549 (+ 20657us) service_pool.cc:224] Handling call
0709 13:00:02.636332 (+2687783us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b5400311ad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:02.636508 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976604032}
I20260709 13:00:02.647488  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:02.648876  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:02.649791  1557 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 4: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:02.650770  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:02.652487  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:02.652940  1560 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:02.653630  2262 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:02.654474  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:02.656466  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 1656) took 2559 ms (client timeout 1816 ms). Trace:
W20260709 13:00:02.657001  1705 rpcz_store.cc:269] 0709 13:00:00.096809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.108915 (+ 12106us) service_pool.cc:224] Handling call
0709 13:00:02.656293 (+2547378us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54000b8454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:02.656396 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291029376}
I20260709 13:00:02.670789  3521 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:02.672289  2236 leader_election.cc:336] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.562s (SENT)
I20260709 13:00:02.672765  2236 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:02.674094  3521 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:02.674257  3428 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:02.674376  3857 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:02.681660  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.635461  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:02.683293  3428 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:02.683394  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 1.04809e+06us
I20260709 13:00:02.684667  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:02.687980  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:02.688846  3899 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:02.694502  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:02.696448  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:02.699739  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:02.700461  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.701767  3899 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:02.702430  3899 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:02.703656  3899 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.707484  3428 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:02.708644  3428 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:02.709036  3428 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:00:02.714399  2236 leader_election.cc:336] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.744s (SENT)
I20260709 13:00:02.715819  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:02.716943  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:02.709465  3428 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.719640  2265 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:02.721746  3912 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:02.726707  1599 leader_election.cc:400] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4.
I20260709 13:00:02.727133  1599 leader_election.cc:403] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:00:02.721900  3738 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:02.730299  3738 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4.
I20260709 13:00:02.730479  3899 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:02.727895  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:02.732422  3521 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:02.731232  3899 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:00:02.734576  3521 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:02.737032  3521 raft_consensus.cc:3055] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:00:02.737329  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.737493  3521 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:02.734637  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:02.739203  1630 raft_consensus.cc:2410] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:02.739699  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1921) took 2068 ms. Trace:
I20260709 13:00:02.740095  1630 rpcz_store.cc:276] 0709 13:00:00.671024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.684942 (+ 13918us) service_pool.cc:224] Handling call
0709 13:00:02.734444 (+2049502us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:00:02.739637 (+  5193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45876992}
I20260709 13:00:02.739137  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:02.742875  3521 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.745183  3521 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:02.746711  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1622) took 2950 ms. Trace:
I20260709 13:00:02.747133  1626 rpcz_store.cc:276] 0709 12:59:59.796043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.917105 (+121062us) service_pool.cc:224] Handling call
0709 12:59:59.917527 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:59.917958 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.917998 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:00.014085 (+ 96087us) log.cc:844] Serialized 26 byte log entry
0709 13:00:00.697334 (+683249us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:00.697378 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.697453 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:01.658790 (+961337us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:02.746357 (+1087567us) raft_consensus.cc:1685] finished
0709 13:00:02.746382 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.746648 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25470,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":29792,"spinlock_wait_cycles":5305600,"thread_start_us":589199,"threads_started":1,"wal-append.queue_time_us":811770}
I20260709 13:00:02.744208  3666 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:02.749797  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.750212  3914 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.751591  3914 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.755951  3914 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:02.756758  3886 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:02.758289  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:02.760766  1599 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:02.757727  3886 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:02.765060  3886 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.766531  3719 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:02.767838  3710 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:02.768237  1453 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.892s	user 0.007s	sys 0.013s
W20260709 13:00:02.768613  1453 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.893s	user 0.007s	sys 0.013s
I20260709 13:00:02.770339  3886 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:02.771780  3764 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:02.777295  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 723) took 1232 ms. Trace:
W20260709 13:00:02.777519  1526 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.529s (SENT)
I20260709 13:00:02.777920  2267 rpcz_store.cc:276] 0709 13:00:01.534341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.546278 (+ 11937us) service_pool.cc:224] Handling call
0709 13:00:01.601607 (+ 55329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.685243 (+ 83636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.765758 (+1080515us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b5400566b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:02.765993 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183094144}
W20260709 13:00:02.778825  1526 leader_election.cc:336] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.544s (SENT)
I20260709 13:00:02.779670  1526 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:02.781080  3914 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:02.773615  3764 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 13:00:02.782737  1526 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.546s (SENT)
I20260709 13:00:02.783231  1526 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:02.783293  1705 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 13:00:02.783876  3707 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:02.784750  3914 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:02.785724  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:02.786367  1526 leader_election.cc:336] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.603s (SENT)
I20260709 13:00:02.786419  2263 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
W20260709 13:00:02.787292  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080010bfe0 after lost signal to thread 434
I20260709 13:00:02.736388  3738 raft_consensus.cc:1064] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 13:00:02.790897  3857 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.791494  3857 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.791179  3738 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:02.795600  1601 connection.cc:256] RPC call timeout handler was delayed by -1.1418953240000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
I20260709 13:00:02.796584  3786 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:02.797323  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:02.797595  3786 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.798094  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:02.799216  1705 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:02.799736  1526 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.675s (SENT)
I20260709 13:00:02.796926  3666 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:02.800076  2235 connection.cc:256] RPC call timeout handler was delayed by -3.833256429999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:00:02.800537  2235 connection.cc:256] RPC call timeout handler was delayed by -3.6397564299999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260709 13:00:02.800437  3666 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:02.802102  2235 leader_election.cc:336] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.578s (SENT)
I20260709 13:00:02.802979  3666 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:02.803177  2235 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.793s (SENT)
I20260709 13:00:02.809173  3888 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:02.808243  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 1.18387e+06us
I20260709 13:00:02.785743  3707 raft_consensus.cc:3055] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:02.824314  3707 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:02.824834  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:02.825594  1707 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:02.825403  3707 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.826735  3707 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:02.827075  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:02.818544  1627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.189s	user 0.007s	sys 0.019s
I20260709 13:00:02.828680  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:02.828362  1627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.007s	sys 0.020s
I20260709 13:00:02.829857  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:02.830336  3454 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:02.831123  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1936) took 1373 ms. Trace:
W20260709 13:00:02.806556  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.808487  3858 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.831501  1627 rpcz_store.cc:276] 0709 13:00:01.457607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.627369 (+169762us) service_pool.cc:224] Handling call
0709 13:00:01.627830 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.628142 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.628182 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.628816 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.830572 (+1201756us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:02.830615 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.830680 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.830747 (+    67us) raft_consensus.cc:1685] finished
0709 13:00:02.830757 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.831046 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1201152,"threads_started":1,"wal-append.queue_time_us":733635}
I20260709 13:00:02.832785  3858 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.833423  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:02.810068  3857 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:02.819061  3743 consensus_meta.cc:287] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.427s	user 0.015s	sys 0.012s
W20260709 13:00:02.836681  3845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.276s	user 0.011s	sys 0.032s
W20260709 13:00:02.837085  3845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.011s	sys 0.032s
I20260709 13:00:02.837124  3858 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:02.837726  3858 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.838234  3858 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.840401  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:02.842203  3920 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.842700  3920 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.844300  1702 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:02.850781  1601 connection.cc:256] RPC call timeout handler was delayed by -1.0534340490000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 13:00:01.688187  3763 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:02.852237  3743 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:02.852806  3763 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.853168  3743 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.856117  3743 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:02.853432  3763 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:02.857391  3743 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.860160  3763 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:02.864810  3778 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:02.803308  1526 leader_election.cc:336] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.677s (SENT)
I20260709 13:00:02.865993  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:02.865736  3778 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:00:02.872115  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:02.873548  1701 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
W20260709 13:00:02.873354  2264 consensus_meta.cc:287] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.307s	user 0.008s	sys 0.016s
I20260709 13:00:02.857960  3743 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.893231  3719 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:02.897856  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:02.898368  1551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:38648
I20260709 13:00:02.898727  1702 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 13:00:02.899240  1551 raft_consensus.cc:606] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:02.900027  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:02.900938  1709 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:02.901244  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:02.900960  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:02.903013  1704 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:02.902885  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:02.901770  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:02.900183  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:02.875665  3920 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:02.906312  1705 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:00:02.907059  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 103795us
I20260709 13:00:02.924576  1701 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
W20260709 13:00:02.925093  1526 leader_election.cc:336] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.700s (SENT)
I20260709 13:00:02.925674  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:02.927369  1701 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:02.908300  3719 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:02.909444  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:02.912199  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:02.912729  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:02.915253  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 152182us
I20260709 13:00:02.940876  1632 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:02.932730  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:02.941135  1599 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:02.934605  1526 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:02.892012  3912 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:02.941162  1708 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:02.943184  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:02.894747  3710 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:02.945351  1705 raft_consensus.cc:2410] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:02.947346  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:02.947813  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:02.952420  1632 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:02.960000  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:02.969085  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:02.969332  3763 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:02.990072  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:02.985694  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:02.974123  1556 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:02.949184  3707 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:02.959515  3778 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:02.971458  3917 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:02.991216  3918 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:03.083556  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.102695  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.003144  3778 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:03.110816  1708 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
W20260709 13:00:03.110993  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 151147us
I20260709 13:00:03.107764  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.112178  1705 raft_consensus.cc:2368] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4.
I20260709 13:00:03.118181  1707 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
W20260709 13:00:03.120949  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.108350  1701 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 13:00:03.108525  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:03.108881  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 183833us
I20260709 13:00:03.109145  3912 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.019547  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 721) took 1579 ms. Trace:
I20260709 13:00:02.986479  3920 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
W20260709 13:00:03.107545  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 174930us
W20260709 13:00:03.130805  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.131927  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:03.122102  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.123656  1599 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:03.123885  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.133819  1708 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:03.134488  1705 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 13:00:03.135596  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.136184  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.136605  1701 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:03.124881  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 219852us
W20260709 13:00:03.125630  1526 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.744s (SENT)
I20260709 13:00:03.137712  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.137750  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.144484  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:03.146824  3915 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:03.148715  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.149852  1526 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.815s (SENT)
I20260709 13:00:03.150456  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:03.151294  3915 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:03.151453  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.152441  2234 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:03.105809  3918 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:03.158648  1526 leader_election.cc:336] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.884s (SENT)
I20260709 13:00:03.159600  1705 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 13:00:03.161813  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.162676  1708 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:03.165727  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.167232  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:03.168856  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:03.170794  1701 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 13:00:03.156361  3858 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:03.172400  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.175220  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.175766  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.176733  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.177384  1701 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:03.126852  3428 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.163699  3845 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:03.183946  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.178397  1701 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:03.179651  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:03.180188  1526 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.896s (SENT)
I20260709 13:00:03.104883  3710 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.181568  3918 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.173738  3763 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:03.184877  1526 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:03.189755  1705 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:03.191371  1705 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:03.175449  1627 raft_consensus.cc:2410] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:03.130517  2264 rpcz_store.cc:276] 0709 13:00:01.419883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.426302 (+  6419us) service_pool.cc:224] Handling call
0709 13:00:01.450411 (+ 24109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.946964 (+1496553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.951014 (+  4050us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.960720 (+  9706us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:02.972717 (+ 11997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.994167 (+ 21450us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.999346 (+  5179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39224,"raft.queue_time_us":84005,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":87}
I20260709 13:00:03.156458  3917 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:00:03.196765  3916 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:03.197048  3917 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:03.192229  3923 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:03.198407  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.198154  3923 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.199694  3839 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:03.197574  3917 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.201324  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.203866  1708 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:03.185707  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.205142  1701 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 13:00:03.200176  3839 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:03.208621  3839 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:03.209262  3915 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:03.209944  3839 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:03.211369  1526 leader_election.cc:336] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.906s (SENT)
I20260709 13:00:03.183665  3743 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:03.216444  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.217329  1701 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:03.192458  3778 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.206377  3917 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.249558  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.249617  3624 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:00:03.283190  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.283697  1708 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:03.283895  1701 raft_consensus.cc:2376] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5. Re-sending same reply.
I20260709 13:00:03.284607  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.284852  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.285336  1708 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:03.285454  1701 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.249825  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.288314  1705 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
W20260709 13:00:03.255574  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44276.7us
I20260709 13:00:03.289484  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.290694  1705 raft_consensus.cc:2368] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6.
W20260709 13:00:03.289650  1526 leader_election.cc:336] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.032s (SENT)
I20260709 13:00:03.291527  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:03.286136  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:03.295399  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 171861us
W20260709 13:00:03.295295  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 143027us
I20260709 13:00:03.302910  3920 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:03.304399  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:03.306702  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:03.308075  2263 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.310011  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:03.305873  2264 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:03.315757  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:03.320600  2262 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:03.321010  2263 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:03.320626  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:03.322189  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:03.323264  2270 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 13:00:03.323612  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.324549  2265 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:03.321394  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:03.325248  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.325448  1599 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:03.332597  1705 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:03.250263  3778 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:03.301275  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.334484  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.358820  1701 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:03.288400  3923 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:03.359544  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 69948.4us
I20260709 13:00:03.360564  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:03.362071  1526 leader_election.cc:336] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.154s (SENT)
W20260709 13:00:03.360718  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 191965us
I20260709 13:00:03.363471  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:03.383021  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:03.332695  3934 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:03.384094  1526 leader_election.cc:336] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.160s (SENT)
I20260709 13:00:03.389005  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:03.345188  3868 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:03.389098  1599 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:03.343848  3937 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:03.341965  3557 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:00:03.392242  3738 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:03.392593  2267 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:03.362048  3428 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:03.341688  3845 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:00:03.386145  3719 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:03.383550  3743 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:03.361505  3797 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.417984  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:03.420250  3938 consensus_queue.cc:1175] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6923294c847b48ebb577e0935d316aa3" responder_term: 6 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: [5.7-5.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:03.422320  3877 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
W20260709 13:00:03.424531  3929 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:00:03.426739  1526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.171s (SENT) [suppressed 66 similar messages]
I20260709 13:00:03.427840  3731 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:03.427984  1526 leader_election.cc:336] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.200s (SENT)
I20260709 13:00:03.428501  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:03.392869  3839 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:00:03.392973  3937 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:03.396821  3763 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:03.394059  3738 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.401566  3322 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:03.417063  3719 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:03.436108  1526 leader_election.cc:336] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.247s (SENT)
I20260709 13:00:03.438818  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:03.416143  2263 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:03.445220  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:03.450304  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:03.453492  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:03.450357  3917 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.459535  3743 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:03.462386  3931 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.234s	user 0.000s	sys 0.002s
W20260709 13:00:03.462930  3935 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:00:03.434625  3763 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.463843  3763 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.449730  3719 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.435292  3738 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:03.493402  1700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.880s	user 0.017s	sys 0.020s
I20260709 13:00:03.435313  3937 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.472631  3839 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:03.473067  3917 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:03.475277  3786 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:03.476267  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:03.476907  1627 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.438843  3557 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:03.476016  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:03.432579  3936 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:00:03.505918  1629 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:00:03.482806  3933 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:00:03.448084  3940 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 13:00:03.477751  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47042us
W20260709 13:00:03.511215  1526 leader_election.cc:336] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.269s (SENT)
I20260709 13:00:03.511639  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:03.483876  3763 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.485917  3719 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:03.495379  1700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.887s	user 0.017s	sys 0.022s
W20260709 13:00:03.503800  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 50725.9us
W20260709 13:00:03.516141  1526 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.951s (SENT)
I20260709 13:00:03.517284  1526 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:03.518999  1526 leader_election.cc:336] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.870s (SENT)
W20260709 13:00:03.520119  1526 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.976s (SENT)
I20260709 13:00:03.520651  1526 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:03.480664  3743 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.526175  3719 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:03.526690  3845 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:03.522415  1629 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:03.509856  2264 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.532696  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:03.532727  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.512065  3839 raft_consensus.cc:697] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:03.553540  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.566206  1558 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:03.510387  3917 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:00:03.547755  3557 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:03.551658  3912 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:03.554158  3624 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:03.586383  2269 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.989s	user 0.020s	sys 0.006s
I20260709 13:00:03.587261  2269 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
W20260709 13:00:03.587868  2269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 722) took 2142 ms (client timeout 2237 ms). Trace:
W20260709 13:00:03.588284  2269 rpcz_store.cc:269] 0709 13:00:01.445956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.447737 (+  1781us) service_pool.cc:224] Handling call
0709 13:00:03.587807 (+2140070us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:03.593680  1600 connection.cc:256] RPC call timeout handler was delayed by -1.8792519060000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
I20260709 13:00:03.595160  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:03.598542  1558 raft_consensus.cc:2410] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:00:03.608507  1633 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.032s	user 0.024s	sys 0.018s
W20260709 13:00:03.609061  1633 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.032s	user 0.025s	sys 0.018s
I20260709 13:00:03.612722  3797 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:03.614449  3590 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 2.656s	user 0.017s	sys 0.013s
W20260709 13:00:03.615621  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.616505  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.577155  3764 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:03.619680  2264 raft_consensus.cc:2410] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:00:03.622748  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.623356  1600 connection.cc:256] RPC call timeout handler was delayed by -1.7487519059999954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
W20260709 13:00:03.624202  1600 connection.cc:256] RPC call timeout handler was delayed by -1.7469519059999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 13:00:03.624646  1600 connection.cc:256] RPC call timeout handler was delayed by -1.7037519060000363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:00:03.625103  1600 connection.cc:256] RPC call timeout handler was delayed by -1.6443519059999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 13:00:03.625610  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.586678  3710 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:03.626331  1600 connection.cc:256] RPC call timeout handler was delayed by -1.6056519059999914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 13:00:03.627578  1600 connection.cc:256] RPC call timeout handler was delayed by -1.5219519060000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 13:00:03.628312  1600 connection.cc:256] RPC call timeout handler was delayed by -1.4682728720000569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
W20260709 13:00:03.628803  1600 connection.cc:256] RPC call timeout handler was delayed by -1.4373519060000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
W20260709 13:00:03.629297  1600 connection.cc:256] RPC call timeout handler was delayed by -1.391451906000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 13:00:03.629742  1600 connection.cc:256] RPC call timeout handler was delayed by -1.3311519060000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
W20260709 13:00:03.630501  1600 connection.cc:256] RPC call timeout handler was delayed by -1.230711465000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
I20260709 13:00:03.631361  3917 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.632097  3917 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:03.614928  3590 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:03.636531  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:03.639444  1556 raft_consensus.cc:2410] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:00:03.639679  1600 connection.cc:256] RPC call timeout handler was delayed by -1.1776050720000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:00:03.640066  1600 connection.cc:256] RPC call timeout handler was delayed by -1.138917097999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
I20260709 13:00:03.590867  3857 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:03.551219  3839 consensus_queue.cc:237] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:03.641438  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:03.643863  1526 leader_election.cc:336] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.113s (SENT)
I20260709 13:00:03.640205  3710 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.645651  3763 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:03.622694  3764 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:03.649674  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:03.654450  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:03.657312  1558 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:03.637784  3590 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:03.657398  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1935) took 2465 ms. Trace:
W20260709 13:00:03.666106  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.658725  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:03.591504  3624 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.672495  3624 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:03.672578  3847 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:03.667794  1633 rpcz_store.cc:276] 0709 13:00:01.192458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.575805 (+383347us) service_pool.cc:224] Handling call
0709 13:00:01.576148 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.576547 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:03.609442 (+2032895us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.657028 (+ 47586us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.657087 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:03.657140 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.657219 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.657341 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":794772,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":111,"thread_start_us":2079788,"threads_started":2}
I20260709 13:00:03.674208  1626 raft_consensus.cc:2410] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:03.674865  3764 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:03.675935  3764 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.679129  3738 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.681506  3738 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:03.682449  1634 raft_consensus.cc:2368] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5.
W20260709 13:00:03.683984  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.684579  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.684906  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.687091  1551 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
W20260709 13:00:03.688074  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.689010  3917 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:03.689895  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46071us
I20260709 13:00:03.689684  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.647409  3923 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:03.692145  1704 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:03.695355  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:03.697548  2264 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:03.698410  2266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 494) took 1169 ms (client timeout 1527 ms). Trace:
W20260709 13:00:03.698947  2266 rpcz_store.cc:269] 0709 13:00:02.529091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.694966 (+1165875us) service_pool.cc:224] Handling call
0709 13:00:03.698330 (+  3364us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:03.701836  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.654063  3710 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:03.703037  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:03.664842  3840 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:03.705041  2270 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.668941  3521 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:03.715802  3322 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:00:03.726783  3811 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:00:03.656808  3936 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:00:03.703980  3590 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:00:03.734472  3557 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:03.735468  3915 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:03.735884  3915 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:03.736660  3888 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:03.736734  3915 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.738188  3915 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:03.740012  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.741895  3932 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:03.742367  3932 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:03.742488  1704 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:03.743219  3932 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:03.725134  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.743609  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.744715  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.745422  1701 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 13:00:03.746316  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.746521  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.746718  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.746960  1701 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 13:00:03.747327  1705 raft_consensus.cc:2410] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:03.747334  1708 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:03.747862  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.748577  1701 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 13:00:03.749418  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:03.750780  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 2.11617e+06us
I20260709 13:00:03.751889  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.752178  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:03.737339  3937 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.704340  3923 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.737815  3888 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:03.753123  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.895622  3521 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:03.910873  1701 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:03.911598  3521 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:03.907058  3603 consensus_meta.cc:287] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 2.586s	user 0.009s	sys 0.011s
I20260709 13:00:03.912968  3603 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:03.914405  1630 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:03.915771  1627 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:03.918334  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 468) took 1007 ms. Trace:
W20260709 13:00:03.868773  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.919452  1630 rpcz_store.cc:276] 0709 13:00:02.911143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.911309 (+   166us) service_pool.cc:224] Handling call
0709 13:00:02.911705 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.914896 (+1003191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.917812 (+  2916us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540034e9d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:03.918262 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2305687424}
I20260709 13:00:03.778939  3922 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.143s
I20260709 13:00:03.922257  3922 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:03.922745  3922 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:03.923049  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1931) took 3176 ms. Trace:
I20260709 13:00:03.753160  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.924180  1705 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:03.923519  1628 rpcz_store.cc:276] 0709 13:00:00.746943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.151762 (+404819us) service_pool.cc:224] Handling call
0709 13:00:01.152751 (+   989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.153364 (+   613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.153405 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.159994 (+  6589us) log.cc:844] Serialized 26 byte log entry
0709 13:00:01.430008 (+270014us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:01.430082 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.430173 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.922603 (+2492430us) raft_consensus.cc:1685] finished
0709 13:00:03.922624 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.922992 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":995,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":98722,"threads_started":1,"wal-append.queue_time_us":253707,"wal-append.run_cpu_time_us":2942,"wal-append.run_wall_time_us":1117887}
I20260709 13:00:03.924758  1558 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:03.757629  3851 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.168s
I20260709 13:00:03.883555  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1750) took 1056 ms. Trace:
I20260709 13:00:03.926772  1558 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:03.926790  1707 rpcz_store.cc:276] 0709 13:00:02.826705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.826815 (+   110us) service_pool.cc:224] Handling call
0709 13:00:03.883287 (+1056472us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54001def54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:03.883480 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643763072}
I20260709 13:00:03.927510  2267 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:00:03.929231  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080010be40 after lost signal to thread 1492
I20260709 13:00:03.830623  2266 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:03.776495  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.933504  1706 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:03.806288  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.769214  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.935477  2234 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:03.936235  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 184144us
I20260709 13:00:03.936946  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:03.755620  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.937631  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:03.769075  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:03.873538  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.849074  2264 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:03.944615  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.949070  1701 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:03.951143  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:03.941092  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:03.952472  1709 raft_consensus.cc:2368] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6.
I20260709 13:00:03.953465  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:03.954979  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1765) took 1052 ms. Trace:
I20260709 13:00:03.955101  1708 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:03.955446  1709 rpcz_store.cc:276] 0709 13:00:02.900698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.907916 (+  7218us) service_pool.cc:224] Handling call
0709 13:00:03.873263 (+965347us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b58001b3398. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:00:03.953033 (+ 79770us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11958656}
I20260709 13:00:03.956018  2234 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:03.956722  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:03.956825  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.980137  1701 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.954193  1556 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:03.980513  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:03.982336  2235 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:03.906929  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.988466  1526 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:03.988826  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:03.989871  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:03.992206  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.992878  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.989969  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:03.953362  3764 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:03.996169  1557 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:03.776934  3731 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.015590  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:04.014628  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.999784  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.014672  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:03.995162  3851 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:04.019516  3622 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:04.014923  3848 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 3.202s	user 0.004s	sys 0.004s
I20260709 13:00:04.010305  3775 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:03.752804  3557 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.266s
I20260709 13:00:04.034328  3775 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:04.034880  3775 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.035313  3775 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.017709  3707 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:04.014228  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.997216  3769 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:04.036979  3769 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.037401  3769 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:04.038996  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 51955.3us
I20260709 13:00:04.006078  1526 leader_election.cc:400] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6.
I20260709 13:00:04.046309  1526 leader_election.cc:403] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:03.994876  1703 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:04.046932  3847 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.049360  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1766) took 1148 ms. Trace:
I20260709 13:00:04.049294  3847 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:04.058359  1703 rpcz_store.cc:276] 0709 13:00:02.900938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.907404 (+  6466us) service_pool.cc:224] Handling call
0709 13:00:03.906749 (+999345us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b58001b3398. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:00:04.049285 (+142536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12448000}
I20260709 13:00:04.059983  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 473) took 1145 ms. Trace:
I20260709 13:00:04.059868  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:03.986694  3778 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:04.060449  1635 rpcz_store.cc:276] 0709 13:00:02.914489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.973143 (+ 58654us) service_pool.cc:224] Handling call
0709 13:00:04.059797 (+1086654us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b540035be54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:04.059923 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1178107648}
I20260709 13:00:04.061255  3847 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:04.049693  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:04.051025  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.051172  3764 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.054128  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.054404  3603 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:04.055168  3916 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:00:04.055968  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080034cf80 after lost signal to thread 1584
I20260709 13:00:04.064309  3916 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:04.064605  1557 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:04.065892  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.066577  1557 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:04.066831  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1679) took 2889 ms. Trace:
I20260709 13:00:03.985407  3858 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:04.067447  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.069620  1559 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 13:00:04.069859  1557 raft_consensus.cc:2410] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:04.067943  3858 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.061987  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:04.086803  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80927.8us
I20260709 13:00:03.934121  3932 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.087457  1704 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:04.090337  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:04.071357  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080035f760 after lost signal to thread 1659
I20260709 13:00:04.091439  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.092473  2270 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:04.092589  1556 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:04.093019  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.076658  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:04.093631  1626 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 13:00:04.088533  1635 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:04.016848  3624 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:04.099748  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:04.099905  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:04.100915  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:04.101697  1634 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:04.102701  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.103459  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:04.103739  1558 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:04.094427  1635 pending_rounds.cc:85] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 6
W20260709 13:00:04.105027  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 124601us
I20260709 13:00:04.105540  1635 pending_rounds.cc:107] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:04.105878  1635 raft_consensus.cc:2889] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:04.108944  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.080153  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:04.071269  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:04.110349  1709 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.953509  3936 raft_consensus.cc:2764] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:04.098778  1706 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:04.029652  3710 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:04.112087  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.119156  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.119907  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:04.116183  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:04.121282  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.121959  1559 raft_consensus.cc:2368] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 6.
I20260709 13:00:04.110522  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:04.127683  1701 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:04.090178  3858 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:04.114176  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:04.064651  3731 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:04.116122  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:04.135229  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.129592  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:04.145416  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.060868  1703 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:04.096565  3849 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6.
I20260709 13:00:04.146555  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:04.088621  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:04.147156  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.147619  1557 raft_consensus.cc:2368] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5.
I20260709 13:00:04.147946  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:04.148411  1632 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:00:04.145215  3731 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.149600  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:04.149753  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:04.150065  3885 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.150342  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:04.151130  3889 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:04.152776  3710 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:04.094580  3764 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:04.158385  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:04.067277  1700 rpcz_store.cc:276] 0709 13:00:01.177111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.177658 (+   547us) service_pool.cc:224] Handling call
0709 13:00:01.178311 (+   653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.342158 (+163847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.342192 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.342709 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:00:03.522833 (+2180124us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:03.623326 (+100493us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.810842 (+187516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.066423 (+255581us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000b7a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:04.066473 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:04.066522 (+    49us) raft_consensus.cc:1685] finished
0709 13:00:04.066624 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.066770 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32228,"prepare.queue_time_us":105412,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":160337,"raft.run_cpu_time_us":525,"raft.run_wall_time_us":5441,"spinlock_wait_cycles":347016448,"thread_start_us":2096468,"threads_started":3,"wal-append.queue_time_us":1376509,"wal-append.run_cpu_time_us":10753,"wal-append.run_wall_time_us":1018439}
W20260709 13:00:04.161341  1552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 300) took 4531 ms (client timeout 1578 ms). Trace:
I20260709 13:00:04.135366  3778 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:00:04.162402  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.239499  1559 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:04.163095  1453 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35568 (request call id 319) took 20919 ms (client timeout 15000 ms). Trace:
I20260709 13:00:04.167794  3916 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:04.120814  3749 raft_consensus.cc:2764] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:04.120704  3872 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:04.172780  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:04.245671  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 73001.6us
I20260709 13:00:04.246583  2234 leader_election.cc:400] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5.
I20260709 13:00:04.246454  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.173530  3837 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:04.181033  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:04.258049  1707 raft_consensus.cc:2368] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5.
I20260709 13:00:04.258124  1559 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:04.199120  1709 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:04.203408  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:04.153791  3707 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:04.204716  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 116161us
W20260709 13:00:04.261868  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.262149  1526 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:04.143332  3884 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:04.207958  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 58445.3us
W20260709 13:00:04.208882  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 226644us
I20260709 13:00:04.207333  1556 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:04.276028  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.038398  3922 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:04.204494  3923 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:04.208462  3866 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:04.236116  1552 rpcz_store.cc:269] 0709 12:59:59.630403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.926548 (+296145us) service_pool.cc:224] Handling call
0709 13:00:04.161055 (+4234507us) spinlock_profiling.cc:243] Waited 3.45 s on lock 0x7b5400178754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:04.161223 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7925577984}
I20260709 13:00:04.244899  3872 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.247053  2234 leader_election.cc:403] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:04.179690  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:04.282542  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.209900  3731 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.210006  3915 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.247828  1631 raft_consensus.cc:2410] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:04.250169  1455 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:04.250986  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.172843  3775 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:04.252182  1628 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:00:04.240392  1453 rpcz_store.cc:269] 0709 12:59:43.243578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.243701 (+   123us) service_pool.cc:224] Handling call
0709 12:59:43.564237 (+320536us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b540009b354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf39090 00007f06ddfd7f3a 00007f06e3d8e1cc 00007f06e3e8c37e 00007f06e234d2a4 00007f06e234d232 00007f06e234d161 00007f06e234d0dc 00007f06e234c392 00007f06dc30a48c 00007f06dc3098c6
0709 12:59:43.595520 (+ 31283us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b5400002490. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeab640 00007f06e3d82b76 00007f06e3e8cc3e 00007f06e234d2a4 00007f06e234d232 00007f06e234d161 00007f06e234d0dc 00007f06e234c392 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:04.162986 (+20567466us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:00.741267 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:00.965993 (+224726us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:00.974904 (+  8911us) write_op.cc:435] Acquired schema lock
0709 13:00:00.982806 (+  7902us) tablet.cc:662] Decoding operations
0709 13:00:01.013667 (+ 30861us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:01.013771 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:01.013815 (+    44us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:00:01.014830 (+  1015us) tablet.cc:701] Row locks acquired
0709 13:00:01.014878 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:00:01.015104 (+   226us) write_op.cc:270] Start()
0709 13:00:01.015289 (+   185us) write_op.cc:276] Timestamp: P: 1783602001015012 usec, L: 0
0709 13:00:01.015325 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:00:01.108213 (+ 92888us) log.cc:844] Serialized 2904 byte log entry
0709 13:00:02.845292 (+1737079us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b180033b380. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:03.018892 (+173600us) op_driver.cc:464] REPLICATION: finished
0709 13:00:03.188586 (+169694us) write_op.cc:301] APPLY: starting
0709 13:00:03.190224 (+  1638us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:03.190578 (+   354us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:03.190648 (+    70us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:03.194418 (+  3770us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:03.194889 (+   471us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:00:03.194953 (+    64us) write_op.cc:312] APPLY: finished
0709 13:00:03.195611 (+   658us) log.cc:844] Serialized 59 byte log entry
0709 13:00:03.195903 (+   292us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:03.196071 (+   168us) write_op.cc:454] Released schema lock
0709 13:00:03.196164 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:03.223090 (+ 26926us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:03.224472 (+  1382us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3108292,"reported_tablets":13,"spinlock_wait_cycles":40483456,"child_traces":[["op",{"apply.queue_time_us":164415,"apply.run_cpu_time_us":4904,"apply.run_wall_time_us":21406,"num_ops":7,"prepare.queue_time_us":803152,"prepare.run_cpu_time_us":19281,"prepare.run_wall_time_us":940643,"raft.queue_time_us":142933,"raft.run_cpu_time_us":11774,"raft.run_wall_time_us":173396,"replication_time_us":1983936,"spinlock_wait_cycles":21443328,"thread_start_us":3358323,"threads_started":4,"wal-append.queue_time_us":363535,"wal-append.run_cpu_time_us":28257,"wal-append.run_wall_time_us":1354929}]]}
I20260709 13:00:04.252884  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.239549  1630 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.255200  3786 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:04.255503  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:04.255893  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:04.256412  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.182514  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:04.288625  3872 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:04.259729  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.271821  1709 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:04.271267  3849 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:04.229001  1627 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:04.314491  3885 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:04.278578  1556 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:04.317508  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.318190  1556 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:04.319283  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.319872  1556 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:04.320210  2263 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:04.320649  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.321462  1556 raft_consensus.cc:2410] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:04.313856  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:04.283454  1634 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:04.276394  3557 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:04.290845  1706 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:04.291303  2264 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:04.293493  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:04.327279  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.328441  1599 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:04.329398  2266 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:04.296583  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:04.294198  3624 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5.
I20260709 13:00:04.308192  1455 catalog_manager.cc:5697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 3, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.297646  3847 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:04.259848  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080031b640 after lost signal to thread 1733
W20260709 13:00:04.340916  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080029d740 after lost signal to thread 2295
I20260709 13:00:04.303496  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:04.306948  1629 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:04.291417  3590 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:04.241071  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:04.280210  3936 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:00:04.322958  2265 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:04.323698  1709 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:04.273912  3884 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.358978  3884 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.299140  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.329526  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:04.332576  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:04.360204  1552 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:04.360327  2270 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:04.361860  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.333242  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.335222  3738 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:04.360332  1703 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:04.335883  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.337579  3775 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:04.355510  1632 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:04.353688  1455 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.363816  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.354310  3603 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:04.375725  1455 catalog_manager.cc:5697] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:04.377322  1556 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 13:00:04.382237  3603 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:04.382572  1555 raft_consensus.cc:2368] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 6.
I20260709 13:00:04.383248  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.383658  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.384554  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.385010  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.385342  1559 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:04.387782  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1763) took 1488 ms. Trace:
I20260709 13:00:04.388270  1702 rpcz_store.cc:276] 0709 13:00:02.899760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.907679 (+  7919us) service_pool.cc:224] Handling call
0709 13:00:03.553400 (+645721us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b58001b3398. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:00:04.387388 (+833988us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b54000a7dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:04.387702 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576896512}
I20260709 13:00:04.390758  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.391634  1558 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:04.392400  1558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:38648
I20260709 13:00:04.393018  1558 raft_consensus.cc:606] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:04.357196  3847 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:04.394677  3916 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:04.383285  3603 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:04.396049  3847 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:04.396211  3923 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:04.396435  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.396713  3923 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:00:04.395874  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.398109  1552 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:04.403029  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:04.403949  2266 raft_consensus.cc:2376] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6. Re-sending same reply.
I20260709 13:00:04.368693  3521 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:04.413861  2270 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:04.430399  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.361853  3743 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.464550  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.393558  3769 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:04.357564  3885 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:04.467729  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.468570  1559 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:04.375149  3849 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:04.485972  1628 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:04.361948  3889 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:00:04.360989  3866 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:00:04.466216  1703 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:04.496949  1559 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:04.497035  1708 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:04.469615  3888 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:04.504482  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 241295us
I20260709 13:00:04.507535  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:04.510856  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:04.511654  3590 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:04.512419  3590 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.507575  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:04.509378  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.512965  3624 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:00:04.513118  3775 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:04.514819  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:04.532829  1555 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:04.533201  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:04.516040  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:04.516880  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:04.512729  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:04.540256  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:04.540992  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:04.517211  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:04.544899  1552 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:04.516479  3764 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:04.512778  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:04.551608  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:04.537796  1633 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.541625  3937 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:04.516412  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:04.535363  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.555847  1559 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:04.544682  3731 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:04.541090  1631 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:04.524205  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:04.557895  1629 raft_consensus.cc:2410] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:04.522891  1551 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:00:04.558895  1551 pending_rounds.cc:85] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 5
I20260709 13:00:04.397873  3923 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:04.560664  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:04.562731  1551 pending_rounds.cc:107] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:04.563441  1551 raft_consensus.cc:2889] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:04.574928  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:04.573771  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:04.577757  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:04.576773  1629 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:04.585906  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:04.587313  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:04.589852  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:04.593432  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:04.593742  1635 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:04.596441  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 340640us
I20260709 13:00:04.592409  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.601890  1706 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:04.596853  1628 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:04.605403  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 244548us
I20260709 13:00:04.606328  1632 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:04.520110  3915 raft_consensus.cc:476] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:04.608270  2236 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:04.606289  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:04.573782  3963 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:04.559304  3775 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.613570  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:04.613497  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.620416  1554 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:04.622427  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.623025  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.592602  3778 raft_consensus.cc:2764] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:04.598666  3786 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:04.598352  3857 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.612141  3837 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:04.614301  2263 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:04.608527  1555 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:04.551131  3888 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:04.636013  1631 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:04.636193  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.621392  3963 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.616047  3932 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:04.620275  3738 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:04.617223  3973 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:04.645382  2236 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:04.646159  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:04.627650  3915 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:04.623018  3849 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:04.666380  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:04.639405  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.628281  3624 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:04.651748  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.667236  1551 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:04.667577  1559 raft_consensus.cc:2376] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6. Re-sending same reply.
I20260709 13:00:04.652925  1703 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:04.655053  3731 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:04.648581  3963 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.658811  3769 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:04.659371  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:04.615836  3886 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:00:04.628113  3775 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:04.718660  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 59365.7us
I20260709 13:00:04.664762  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.666961  1629 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:04.670879  2236 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:00:04.657130  3965 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:00:04.726600  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:04.724610  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:04.728377  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:04.730506  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:04.728410  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 57655.7us
I20260709 13:00:04.732785  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:04.734563  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:04.736873  1551 raft_consensus.cc:2376] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5. Re-sending same reply.
I20260709 13:00:04.640378  1555 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:04.650123  3972 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:04.631088  3557 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:04.720377  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:04.788754  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 68482.4us
I20260709 13:00:04.769727  2236 leader_election.cc:400] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5.
I20260709 13:00:04.712174  3857 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:04.670286  3889 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:04.809149  1633 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:04.739079  3937 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:04.817744  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.820561  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.769696  3778 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:04.666163  3738 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:04.767481  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:04.669611  3764 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:04.778875  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 48518.6us
I20260709 13:00:04.781495  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:04.821446  1559 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:04.774121  3932 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:04.824429  1631 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.800642  3938 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:04.711388  3754 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:00:04.832268  1706 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:04.833307  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.825289  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.843537  1554 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:04.795174  3866 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:04.822721  3966 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 13:00:04.725560  3973 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:00:04.800508  3847 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:00:04.823877  3778 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:04.863432  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 322515us
I20260709 13:00:04.814661  3937 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:04.772506  1551 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:04.794097  3969 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:00:04.919030  3839 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:04.895195  3977 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:00:04.949970  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:00:04.927321  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 277473us
I20260709 13:00:04.828068  3916 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.124s
I20260709 13:00:04.940037  3778 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:04.989864  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.996330  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.886530  1703 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:04.876276  3749 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:04.999174  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:05.000015  1551 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.896916  3938 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:04.896399  3775 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:04.946632  3937 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:04.837922  3889 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:04.839290  3764 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:04.929181  3866 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:00:05.080005  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 130162us
I20260709 13:00:05.118919  1600 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:04.990938  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:04.822841  3972 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 13:00:05.092329  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.987320  3603 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.826843  3884 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 13:00:05.120570  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 129737us
I20260709 13:00:05.131592  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:05.123718  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.003973  3749 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:04.945039  3932 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 13:00:05.006688  3973 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:05.084789  3857 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.083364  3743 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:05.148914  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 357559us
I20260709 13:00:05.151248  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:05.152956  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:05.153941  2270 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:05.143952  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:04.950246  3839 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:05.181546  1631 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:05.190562  1705 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:05.196851  2270 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:05.140144  1551 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:04.875583  3738 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:04.846274  1555 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.180372  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.167850  1560 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
W20260709 13:00:05.204555  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.204381  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:05.211831  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.213050  1560 raft_consensus.cc:2393] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:05.213644  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:05.214401  2270 raft_consensus.cc:2368] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6.
I20260709 13:00:05.214464  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.215366  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:05.216018  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:05.216171  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:05.230962  2271 raft_consensus.cc:2393] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:00:05.216717  3978 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.292s	user 0.000s	sys 0.000s
I20260709 13:00:05.191447  3847 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:05.218324  3764 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:05.218542  3970 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.351s	user 0.000s	sys 0.002s
W20260709 13:00:05.219568  3971 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:00:04.988516  3557 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:05.140779  3973 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:05.210455  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.144657  3603 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.240229  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.234333  3974 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:00:05.241159  3992 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:05.181216  3989 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:05.208635  3993 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:05.242151  3922 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:05.242581  3983 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:00:05.243283  3749 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.200944  3938 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:05.216056  3985 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 13:00:05.310576  3976 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.468s	user 0.004s	sys 0.000s
I20260709 13:00:05.246394  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1810) took 1137 ms. Trace:
I20260709 13:00:05.241199  3624 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:05.249969  3889 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:05.250464  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1812) took 1106 ms. Trace:
W20260709 13:00:05.250962  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 1698) took 1443 ms (client timeout 1502 ms). Trace:
W20260709 13:00:05.253070  3858 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.052s	user 0.011s	sys 0.000s
I20260709 13:00:05.253456  3884 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:05.258061  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.351876  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.352788  1554 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:05.182627  3743 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:05.354486  3743 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.279273  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:05.284942  2234 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:05.358948  1551 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:05.359127  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 74269.9us
I20260709 13:00:05.360467  3786 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:05.336717  1701 rpcz_store.cc:276] 0709 13:00:04.144508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.540646 (+396138us) service_pool.cc:224] Handling call
0709 13:00:04.540991 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.541337 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.541366 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.541867 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.940962 (+399095us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:04.998250 (+ 57288us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.998536 (+   286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.998634 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.250219 (+251585us) raft_consensus.cc:1685] finished
0709 13:00:05.250252 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.250398 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1015,"prepare.queue_time_us":61372,"prepare.run_cpu_time_us":127,"prepare.run_wall_time_us":10215,"raft.queue_time_us":2515,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":9770,"thread_start_us":396685,"threads_started":1,"wal-append.queue_time_us":663566}
I20260709 13:00:05.361116  3786 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:05.286259  3980 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:00:05.361966  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.189922  3857 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.372572  3857 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:05.305720  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:05.313170  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:05.275347  2262 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:05.375451  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:05.374954  3974 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:05.376376  2271 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:05.377444  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:05.353739  3963 consensus_meta.cc:287] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.000s
W20260709 13:00:05.285476  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 151885us
I20260709 13:00:05.257359  3847 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:00:05.315331  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 196505us
I20260709 13:00:05.234335  3972 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:05.336800  1705 rpcz_store.cc:269] 0709 13:00:03.807364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.182188 (+374824us) service_pool.cc:224] Handling call
0709 13:00:05.250740 (+1068552us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54001c4dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:05.250889 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2043586432}
I20260709 13:00:05.331414  1704 rpcz_store.cc:276] 0709 13:00:04.108627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.507447 (+398820us) service_pool.cc:224] Handling call
0709 13:00:04.507817 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.508231 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.508266 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.508793 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.940483 (+431690us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:04.940527 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.940601 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.246109 (+305508us) raft_consensus.cc:1685] finished
0709 13:00:05.246130 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.246326 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26113,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":105,"thread_start_us":431197,"threads_started":1,"wal-append.queue_time_us":672936}
I20260709 13:00:05.360291  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:05.295640  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.362234  3786 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.287711  1552 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:05.365260  3749 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:05.365953  3590 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.853s	user 0.015s	sys 0.000s
W20260709 13:00:05.366696  3981 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:00:05.307127  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:05.430754  1560 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.379136  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:05.432050  2270 raft_consensus.cc:2368] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6.
I20260709 13:00:05.380458  2271 raft_consensus.cc:2368] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6.
I20260709 13:00:05.283504  3764 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:00:05.352993  1630 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.043s	user 0.011s	sys 0.000s
I20260709 13:00:05.416352  1600 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:05.440302  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 240190us
I20260709 13:00:05.441190  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 734) took 1059 ms. Trace:
W20260709 13:00:05.436478  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 223701us
W20260709 13:00:05.417277  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 171827us
I20260709 13:00:05.441740  2264 rpcz_store.cc:276] 0709 13:00:04.382332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.400474 (+ 18142us) service_pool.cc:224] Handling call
0709 13:00:04.481125 (+ 80651us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.481449 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.481475 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.481931 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.635343 (+153412us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:04.635389 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.642969 (+  7580us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.440954 (+797985us) raft_consensus.cc:1685] finished
0709 13:00:05.440974 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.441126 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":153029,"threads_started":1,"wal-append.queue_time_us":355249}
W20260709 13:00:05.409476  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 215718us
I20260709 13:00:05.444173  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:05.445102  2264 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:05.445809  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:05.397840  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1695) took 1628 ms. Trace:
I20260709 13:00:05.445969  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:05.445935  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:05.441416  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:05.447266  3884 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.447852  3884 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:05.374966  3837 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.735s	user 0.006s	sys 0.006s
I20260709 13:00:05.449199  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:05.446470  1709 rpcz_store.cc:276] 0709 13:00:03.769485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.372028 (+602543us) service_pool.cc:224] Handling call
0709 13:00:04.372351 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:04.372569 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:04.726892 (+354323us) log.cc:844] Serialized 14 byte log entry
0709 13:00:05.323460 (+596568us) log.cc:844] Serialized 14 byte log entry
0709 13:00:05.397383 (+ 73923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:05.397457 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:05.397521 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.397609 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.397759 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93274,"prepare.queue_time_us":135738,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":38279,"raft.queue_time_us":73648,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":32157,"thread_start_us":830107,"threads_started":3,"wal-append.queue_time_us":592748}
I20260709 13:00:05.450224  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:05.462162  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:05.462833  2270 raft_consensus.cc:2410] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 5 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:00:05.450569  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.448377  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:05.446228  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:05.464249  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:05.465953  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:05.469612  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.470618  1554 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:05.341691  3624 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:05.477888  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:05.479032  2270 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:05.471292  1706 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:05.415870  3847 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.473378  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:05.435917  3970 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:00:05.473420  1599 leader_election.cc:400] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6.
I20260709 13:00:05.480611  1599 leader_election.cc:403] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:05.477861  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:05.481918  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:05.448338  3889 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:05.307894  3866 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:05.489929  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:05.491496  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.492075  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.492208  1709 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:05.495225  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:05.497200  2270 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:05.306524  3839 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.469269  3731 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:05.477851  3754 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:05.430011  3972 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.450743  1630 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:05.391799  3858 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.479508  3837 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:05.522652  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 428) took 1767 ms. Trace:
W20260709 13:00:05.522595  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 74295.3us
I20260709 13:00:05.523908  4004 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:05.525734  1555 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.439332  3590 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.526536  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1502) took 1468 ms. Trace:
I20260709 13:00:05.452011  3963 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.507503  3999 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:05.533852  1600 leader_election.cc:400] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 6.
I20260709 13:00:05.535718  1558 rpcz_store.cc:276] 0709 13:00:04.052498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.393976 (+341478us) service_pool.cc:224] Handling call
0709 13:00:04.430655 (+ 36679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.430972 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.430995 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.431441 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.668807 (+237366us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:04.668847 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.668924 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.521190 (+852266us) raft_consensus.cc:1685] finished
0709 13:00:05.521213 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.521351 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8694,"raft.queue_time_us":142786,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":10740,"thread_start_us":174318,"threads_started":1,"wal-append.queue_time_us":393347}
I20260709 13:00:05.553336  1600 leader_election.cc:403] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:05.528517  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:05.532707  1707 rpcz_store.cc:276] 0709 13:00:03.754871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.271292 (+516421us) service_pool.cc:224] Handling call
0709 13:00:04.271643 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.271996 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.272023 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.272541 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.555798 (+283257us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:04.608945 (+ 53147us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.609179 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.609258 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.522408 (+913150us) raft_consensus.cc:1685] finished
0709 13:00:05.522438 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.522590 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":578,"prepare.queue_time_us":57050,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4231,"raft.queue_time_us":1103,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":9805,"thread_start_us":278284,"threads_started":1,"wal-append.queue_time_us":510451}
W20260709 13:00:05.546183  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.526909  3754 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.521306  3993 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:05.528465  3889 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:05.523072  3710 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:05.549405  3839 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:05.550976  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 77647.7us
W20260709 13:00:05.541693  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 100339us
I20260709 13:00:05.552794  2271 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:05.556474  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:05.529037  3989 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:05.556528  2270 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:05.538427  4004 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:05.561810  2266 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:05.540845  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1941) took 1461 ms. Trace:
I20260709 13:00:05.532446  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1690) took 1775 ms. Trace:
I20260709 13:00:05.392115  3973 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:05.565582  3996 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:00:05.548270  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 93974.9us
I20260709 13:00:05.570906  3993 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.566206  4006 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 13:00:05.561517  3622 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.530s	user 0.019s	sys 0.000s
I20260709 13:00:05.575788  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:05.544629  3979 consensus_queue.cc:1175] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6923294c847b48ebb577e0935d316aa3" responder_term: 5 status { last_received { term: 5 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 5 index: 5 } }
I20260709 13:00:05.584882  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:05.588146  2270 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:05.561575  3754 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:05.567374  3872 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.242s	user 0.000s	sys 0.014s
I20260709 13:00:05.607903  4000 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.564112  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 736) took 1178 ms. Trace:
I20260709 13:00:05.563323  3889 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.566769  3916 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:05.563922  3764 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:05.612687  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:05.612929  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:05.572765  3603 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:05.625413  2270 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:00:05.626205  1634 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
W20260709 13:00:05.591922  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 174319us
I20260709 13:00:05.619367  3999 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6.
W20260709 13:00:05.631762  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 167613us
I20260709 13:00:05.561506  4002 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:00:05.635350  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 51705.2us
I20260709 13:00:05.635401  2268 raft_consensus.cc:2410] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:05.657058  1600 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:05.620334  3937 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.619952  3710 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 6.
I20260709 13:00:05.589910  1630 rpcz_store.cc:276] 0709 13:00:04.076676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.088965 (+ 12289us) service_pool.cc:224] Handling call
0709 13:00:05.538018 (+1449053us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:05.641501  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:05.647012  1701 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:05.653049  1704 pending_rounds.cc:85] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 2
I20260709 13:00:05.642351  3884 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:05.638077  3622 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:05.660637  4018 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:05.661157  1703 consensus_meta.cc:287] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.000s
I20260709 13:00:05.643888  3889 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:05.670118  1704 pending_rounds.cc:107] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:00:05.680145  1704 raft_consensus.cc:2889] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:05.671422  1673 leader_election.cc:400] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6.
I20260709 13:00:05.648248  3666 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.644550  4020 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.648918  3764 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:05.656411  3731 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.677686  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:05.678059  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.680344  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:05.702085  1673 leader_election.cc:403] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:05.704073  1560 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:05.704909  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:05.705407  1560 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.665582  4003 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.707260  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 489) took 1187 ms. Trace:
I20260709 13:00:05.712670  1629 rpcz_store.cc:276] 0709 13:00:04.520307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.768109 (+247802us) service_pool.cc:224] Handling call
0709 13:00:04.768548 (+   439us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:04.785974 (+ 17426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.786011 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:04.815369 (+ 29358us) log.cc:844] Serialized 52 byte log entry
0709 13:00:05.277097 (+461728us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:05.277150 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.278111 (+   961us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.706999 (+428888us) raft_consensus.cc:1685] finished
0709 13:00:05.707021 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.707174 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":495,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":17200,"thread_start_us":405947,"threads_started":1,"wal-append.queue_time_us":614425}
I20260709 13:00:05.714541  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:05.708627  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:05.638113  3872 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:05.672359  3885 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:05.665712  3858 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:05.708873  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:05.736963  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 67437.5us
I20260709 13:00:05.738761  1673 leader_election.cc:400] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6.
I20260709 13:00:05.738921  2266 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:05.722291  1560 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:05.661432  3989 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.642426  4000 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:05.644919  4004 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:05.766826  4004 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:05.740870  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 165271us
I20260709 13:00:05.707746  3764 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:05.739548  1673 leader_election.cc:403] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:05.743914  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.710482  3710 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:05.701751  3938 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:05.784965  1557 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 4: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:05.707950  3972 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:05.751173  4009 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:00:05.810967  3847 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:05.680166  4018 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:05.740835  4003 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:05.715497  4020 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.746657  4010 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:05.754482  3962 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:05.823032  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 53576.5us
I20260709 13:00:05.754995  3995 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.758304  4013 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:05.759706  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:05.760246  3521 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:05.762195  4014 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:05.763163  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:05.764948  2235 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:05.771265  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:05.668637  3915 consensus_queue.cc:1059] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:00:05.793231  3937 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:05.592202  1700 rpcz_store.cc:276] 0709 13:00:03.756605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.274684 (+518079us) service_pool.cc:224] Handling call
0709 13:00:04.306300 (+ 31616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.311771 (+  5471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.311811 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.313321 (+  1510us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.611350 (+298029us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:04.619297 (+  7947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.627782 (+  8485us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.253770 (+625988us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:05.500712 (+246942us) raft_consensus.cc:1685] finished
0709 13:00:05.500741 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.529757 (+ 29016us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2598,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"spinlock_wait_cycles":56383232,"thread_start_us":280059,"threads_started":1,"wal-append.queue_time_us":425255}
I20260709 13:00:05.711441  3666 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:05.803046  3778 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.765s	user 0.005s	sys 0.008s
I20260709 13:00:05.711167  3622 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:00:05.638398  2267 rpcz_store.cc:276] 0709 13:00:04.383132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.386216 (+  3084us) service_pool.cc:224] Handling call
0709 13:00:04.386670 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.387167 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.387205 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.388012 (+   807us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.611622 (+223610us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:04.616221 (+  4599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.623321 (+  7100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.548337 (+925016us) raft_consensus.cc:1685] finished
0709 13:00:05.548362 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.561225 (+ 12863us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2566,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":123,"thread_start_us":197716,"threads_started":1,"wal-append.queue_time_us":559378}
I20260709 13:00:05.747975  3590 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:05.804028  3872 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:05.715629  3731 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.783324  3884 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:05.812157  4012 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:00:05.751416  4024 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6.
I20260709 13:00:05.818387  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:05.820629  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.746659  1703 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:05.746644  3707 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:05.747536  4007 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:05.822094  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 102123us
I20260709 13:00:05.824702  4029 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:05.826077  4006 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:05.826961  3710 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:05.899314  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:05.827806  3938 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:05.828644  1554 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:05.901288  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1629) took 1385 ms. Trace:
I20260709 13:00:05.880241  3778 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.767817  4000 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:05.901700  1634 rpcz_store.cc:276] 0709 13:00:04.515437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.515665 (+   228us) service_pool.cc:224] Handling call
0709 13:00:05.901132 (+1385467us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540034dfd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:05.901232 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501624704}
I20260709 13:00:05.902956  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:05.897895  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:05.845055  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.904291  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 728) took 1618 ms. Trace:
W20260709 13:00:05.848030  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 83167us
I20260709 13:00:05.906697  2235 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:05.904300  2264 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:05.908192  3857 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:05.908696  3857 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.909073  3857 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:05.909282  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1953) took 1240 ms. Trace:
I20260709 13:00:05.909879  1627 rpcz_store.cc:276] 0709 13:00:04.668740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.842460 (+173720us) service_pool.cc:224] Handling call
0709 13:00:04.988389 (+145929us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:05.126850 (+138461us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:05.139440 (+ 12590us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:05.236235 (+ 96795us) log.cc:844] Serialized 26 byte log entry
0709 13:00:05.553216 (+316981us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:05.556233 (+  3017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.561368 (+  5135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.908988 (+347620us) raft_consensus.cc:1685] finished
0709 13:00:05.909029 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.909203 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7938,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":17152,"thread_start_us":159194,"threads_started":1,"wal-append.queue_time_us":245139}
I20260709 13:00:05.911701  3731 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:05.913232  3847 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:05.913916  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1702) took 1280 ms. Trace:
I20260709 13:00:05.913522  4007 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.914363  1703 rpcz_store.cc:276] 0709 13:00:04.633126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.875771 (+242645us) service_pool.cc:224] Handling call
0709 13:00:04.886370 (+ 10599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.894341 (+1007971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.913852 (+ 19511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:05.915633  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:05.916242  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:05.832932  1558 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:05.823320  4010 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.920127  4010 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.833884  3885 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6.
I20260709 13:00:05.849226  4013 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.857182  4019 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.839712  3962 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.861157  4020 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:05.868711  3764 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:05.874698  2262 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.001s
I20260709 13:00:05.874953  3922 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:05.948855  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 234373us
I20260709 13:00:05.876543  3754 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:05.876448  3624 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.879253  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.954804  1560 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:05.952605  4018 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:05.955497  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:05.955919  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.956630  1560 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:05.847000  4014 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.965104  4014 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:05.966121  3922 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.968725  3922 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:05.852463  3972 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:05.891825  3884 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:05.965783  3624 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:05.891834  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.977999  1559 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:05.979210  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.895937  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:05.899168  4028 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:05.846758  3995 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.903277  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:05.985450  1551 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:05.903731  1554 raft_consensus.cc:2376] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6. Re-sending same reply.
I20260709 13:00:05.904790  2268 rpcz_store.cc:276] 0709 13:00:04.285412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.285521 (+   109us) service_pool.cc:224] Handling call
0709 13:00:05.904108 (+1618587us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400267854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:05.904233 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2973132672}
I20260709 13:00:05.831096  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:05.987699  2266 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:05.850220  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:05.928534  1558 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:05.989517  3884 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:05.990231  1700 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:05.992614  3764 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:05.994380  3778 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:05.936584  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:05.996834  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 60377.7us
I20260709 13:00:05.996965  3884 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:05.997395  3884 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:05.941560  4007 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:05.945521  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 207063us
I20260709 13:00:05.934559  3888 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:05.952344  1524 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:05.998538  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:05.997812  3884 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:05.999224  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 47203.8us
I20260709 13:00:05.947875  4019 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:05.956780  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:05.964213  4003 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:05.964488  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:05.880623  3743 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.525s	user 0.013s	sys 0.000s
I20260709 13:00:05.958716  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:05.980657  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 84808.7us
I20260709 13:00:05.999380  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:05.958125  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.953492  2262 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
W20260709 13:00:06.012176  1556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1535) took 1581 ms (client timeout 1909 ms). Trace:
I20260709 13:00:05.999251  1705 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:06.046757  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:05.997920  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.050601  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:06.049739  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:06.053716  4043 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:06.055186  3995 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:06.057284  4043 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:06.057869  4043 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:06.059151  1555 consensus_meta.cc:287] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.002s
I20260709 13:00:06.058753  4043 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.058996  4010 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.059846  1555 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:00:06.060246  1555 pending_rounds.cc:85] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 5
I20260709 13:00:06.060503  1555 pending_rounds.cc:107] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:06.060559  3707 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:06.060770  1555 raft_consensus.cc:2889] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:06.060974  3707 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:06.061558  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1530) took 1779 ms. Trace:
I20260709 13:00:06.061595  4010 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:06.013288  4042 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:00:06.062337  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 103740us
I20260709 13:00:06.076475  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:06.069407  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:06.082176  1601 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:05.984805  4018 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:06.070187  1560 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:06.011516  3849 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:06.072757  1558 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:06.011330  3993 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:06.082232  1551 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:06.078666  1600 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:06.049399  1556 rpcz_store.cc:269] 0709 13:00:04.430648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.464163 (+ 33515us) service_pool.cc:224] Handling call
0709 13:00:06.011947 (+1547784us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540030b454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:06.012116 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451209088}
W20260709 13:00:06.088356  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 89076.4us
W20260709 13:00:06.071683  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 73833.4us
I20260709 13:00:06.094686  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:06.095186  1674 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.092336  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:06.097924  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.099861  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.103328  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:06.104894  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:06.027832  3962 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:06.063335  3995 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:06.063165  2267 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:06.082321  4002 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.077450  4000 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:06.073217  3888 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.077553  4045 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:06.062265  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:06.085050  3979 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:06.084740  3872 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:06.087754  3624 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:06.115065  1559 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:06.113722  3995 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.123216  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:06.112751  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:06.087092  4010 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.127180  3769 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:06.174428  4010 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.176923  4010 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:06.127810  4020 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.089458  3849 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:06.130483  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 51843.7us
I20260709 13:00:06.131458  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:06.101563  4015 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.062495  3743 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:06.135694  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:06.136446  4014 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.101140  4028 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:06.135886  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:06.190069  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 54247.6us
I20260709 13:00:06.102856  3885 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:06.169502  4024 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:06.064436  3754 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:06.131106  3886 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.062083  3707 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:06.164108  3973 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.164677  4035 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:06.121577  3622 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:00:06.137478  4003 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.168511  1552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:38648
I20260709 13:00:06.198987  3839 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:06.134245  3847 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.181838  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:06.061995  1555 rpcz_store.cc:276] 0709 13:00:04.281731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.547763 (+266032us) service_pool.cc:224] Handling call
0709 13:00:04.594601 (+ 46838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.525358 (+930757us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540024f2a0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddf44a1d 00007f06ddf2b1a4 00007f06ddfad447 00007f06ddfc5fe7 00007f06ddfc77de 00007f06ddfd1b49 00007f06ddfd2416 00007f06ddfced8f 00007f06ddfce83e 00007f06e2f93419
0709 13:00:06.061296 (+535938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.061503 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242016128}
I20260709 13:00:06.169179  3624 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:06.146823  3995 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.084650  3710 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:00:06.189597  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:06.134931  4000 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:06.170830  3979 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:06.189043  3849 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:06.203135  4047 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:00:06.204264  1629 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:06.135370  4002 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:06.142203  3872 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.206977  1630 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:06.211825  1552 raft_consensus.cc:606] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:06.198928  4045 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:06.176251  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.235853  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:06.232743  4024 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:06.236529  3666 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:06.270699  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1833) took 1117 ms. Trace:
I20260709 13:00:06.271075  1559 rpcz_store.cc:276] 0709 13:00:05.153196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.029141 (+875945us) service_pool.cc:224] Handling call
0709 13:00:06.029522 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.141588 (+112066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.265398 (+123810us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b5400312ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:06.270620 (+  5222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195797888}
W20260709 13:00:06.241510  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 119325us
I20260709 13:00:06.209164  4035 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:06.254091  1552 raft_consensus.cc:614] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:06.235044  3839 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.256793  1704 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:06.257575  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 81425.1us
W20260709 13:00:06.239550  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 57778.8us
I20260709 13:00:06.276556  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:06.277669  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.248431  4029 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:06.250262  3707 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.280485  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.282465  4028 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:06.277313  3731 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:00:06.286018  4053 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:06.286375  4028 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:06.277149  4020 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:00:06.287024  3624 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.285526  3666 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:06.288147  3666 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.288482  3666 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.282984  3769 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:00:06.292338  3769 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:06.292759  3769 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:06.271755  4014 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:06.270574  3932 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.274392  3980 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.294993  3932 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.295866  3980 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:06.297652  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.298517  3743 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:06.298888  3932 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:06.285516  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:06.302007  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:06.303324  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:06.304406  1559 raft_consensus.cc:2410] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:06.311708  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:06.313696  3964 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 1.749s	user 0.000s	sys 0.011s
I20260709 13:00:06.284564  4029 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:06.315002  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 329) took 2373 ms. Trace:
I20260709 13:00:06.315362  4029 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.317062  1553 rpcz_store.cc:276] 0709 13:00:03.941897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.942074 (+   177us) service_pool.cc:224] Handling call
0709 13:00:03.948170 (+  6096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:03.948794 (+   624us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:03.948827 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:03.985406 (+ 36579us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.284173 (+298767us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:04.284213 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.284327 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:06.197521 (+1913194us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:06.314659 (+117138us) raft_consensus.cc:1685] finished
0709 13:00:06.314680 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.314928 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":32551,"spinlock_wait_cycles":74907392,"thread_start_us":268780,"threads_started":1,"wal-append.queue_time_us":467785}
I20260709 13:00:06.275465  3885 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:06.281190  1703 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:06.337803  2266 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 13:00:06.338140  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:06.343230  4017 raft_consensus.cc:3055] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:06.310871  3857 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.343714  4017 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:06.298590  3979 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.347007  3857 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:06.350793  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:06.351037  3884 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:06.352665  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:06.353037  3622 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:06.353814  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:06.293753  3769 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:06.355737  4046 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.398s	user 0.006s	sys 0.000s
I20260709 13:00:06.356242  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.356381  3769 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.357388  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:06.358170  1553 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:06.278656  3839 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.312403  1559 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:06.361703  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:06.354671  4010 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.370536  3666 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:06.372920  3666 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:06.369083  4010 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.366632  4014 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:06.381305  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.384402  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:06.385231  1559 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:06.386464  1559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:38648
I20260709 13:00:06.382958  4035 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.279428  3749 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:00:06.299583  4003 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.146s
I20260709 13:00:06.485798  1559 raft_consensus.cc:606] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:06.486600  1559 raft_consensus.cc:614] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:06.449162  1557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1512) took 2314 ms (client timeout 1655 ms). Trace:
W20260709 13:00:06.490808  1557 rpcz_store.cc:269] 0709 13:00:04.134678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.231788 (+ 97110us) service_pool.cc:224] Handling call
0709 13:00:06.448867 (+2217079us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400177854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:06.449076 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3535599872}
I20260709 13:00:06.353056  3884 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:06.397421  3889 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.001s
W20260709 13:00:06.396667  3988 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.201s	user 0.002s	sys 0.002s
I20260709 13:00:06.396317  4019 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:06.394526  4002 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:06.395932  4000 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:06.513181  3916 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:06.397025  3710 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:00:06.513913  3916 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.393661  3923 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:06.510789  3884 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:06.518539  3884 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:06.519765  3884 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.521504  3884 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.346544  4017 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:06.436827  3775 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.523186  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 430) took 2736 ms. Trace:
I20260709 13:00:06.389737  4010 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:06.531325  1702 rpcz_store.cc:276] 0709 13:00:03.787383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.389201 (+601818us) service_pool.cc:224] Handling call
0709 13:00:04.389566 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.400709 (+ 11143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.400755 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.458431 (+ 57676us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.811332 (+352901us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:04.822418 (+ 11086us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.822756 (+   338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.822846 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.914328 (+1091482us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b1800454900. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:06.279579 (+365251us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:06.282592 (+  3013us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b1800454900. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2522 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:06.522869 (+240277us) raft_consensus.cc:1685] finished
0709 13:00:06.522902 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.523103 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17065,"prepare.queue_time_us":12282,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":41624,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":8567,"spinlock_wait_cycles":30877568,"thread_start_us":308203,"threads_started":1,"wal-append.queue_time_us":470148}
I20260709 13:00:06.540808  3963 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:06.529435  4035 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.546460  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:06.548951  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:06.549611  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:06.551144  1632 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:06.551633  2265 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 13:00:06.552124  3778 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.553284  4013 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:06.537907  3775 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.553858  3749 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.554461  3749 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.555670  3775 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:06.558701  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:06.561053  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:06.561793  1626 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:06.552814  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:06.563403  1632 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:06.563441  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 635) took 1245 ms. Trace:
I20260709 13:00:06.564064  2264 rpcz_store.cc:276] 0709 13:00:05.318213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.445683 (+127470us) service_pool.cc:224] Handling call
0709 13:00:06.563161 (+1117478us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54004e7fd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:06.563360 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040732416}
I20260709 13:00:06.564745  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:06.557107  3749 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:06.394797  4024 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:06.523908  3889 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:06.588712  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.591568  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:06.589669  2234 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:06.592392  1708 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.029s	sys 0.119s
W20260709 13:00:06.593062  1708 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.029s	sys 0.119s
I20260709 13:00:06.607066  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.578114  2263 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:06.553849  3778 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.639108  1701 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:06.650802  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1825) took 1528 ms. Trace:
I20260709 13:00:06.651265  1551 rpcz_store.cc:276] 0709 13:00:05.122527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.010296 (+887769us) service_pool.cc:224] Handling call
0709 13:00:06.010817 (+   521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.093658 (+ 82841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.650507 (+556849us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b5400311ad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:06.650735 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163502976}
I20260709 13:00:06.639672  3837 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:06.616153  3923 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.640239  3775 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:06.663779  3775 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.664219  3775 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:06.643333  3996 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:00:06.598067  3963 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 13:00:06.687050  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 410400us
I20260709 13:00:06.661456  3837 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.691185  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.677345  3707 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:06.707154  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:06.708187  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 388603us
W20260709 13:00:06.708221  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.710062  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:06.713653  1631 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:06.696872  3857 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.715557  1635 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:06.663784  3923 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.701656  3837 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.719158  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:06.705080  3749 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:06.705729  4018 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.032s
W20260709 13:00:06.739840  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.733238  1630 raft_consensus.cc:2410] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:00:06.749181  4018 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.006s	sys 0.032s
I20260709 13:00:06.759527  1635 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:06.757937  1552 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
W20260709 13:00:06.732076  4057 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:00:06.734874  3973 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.006s
I20260709 13:00:06.729884  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:06.771781  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:06.774506  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:06.775367  2270 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:06.772507  1628 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:06.772639  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:06.750056  4060 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:00:06.778509  2264 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:06.780001  1558 raft_consensus.cc:2410] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:06.783463  2264 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:06.732451  4007 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.791519  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:06.718672  3707 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:06.760982  3749 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:06.733960  4029 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.793985  1635 raft_consensus.cc:2410] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:06.808039  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1826) took 1685 ms. Trace:
I20260709 13:00:06.794873  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:06.799475  4007 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.809207  3839 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:06.817294  4007 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:06.808579  1554 rpcz_store.cc:276] 0709 13:00:05.122830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.002661 (+879831us) service_pool.cc:224] Handling call
0709 13:00:06.003015 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.003379 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.003410 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.050013 (+ 46603us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.204926 (+154913us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:06.205004 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.205142 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:06.807757 (+602615us) raft_consensus.cc:1685] finished
0709 13:00:06.807785 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.807961 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11646,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"thread_start_us":135043,"threads_started":1,"wal-append.queue_time_us":521574}
I20260709 13:00:06.793377  3889 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:06.811050  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:06.835095  2269 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.015s	sys 0.059s
W20260709 13:00:06.835510  2269 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.015s	sys 0.059s
I20260709 13:00:06.841172  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:06.841624  1632 raft_consensus.cc:2410] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:06.841812  1635 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:06.801236  3603 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.041s	sys 0.046s
W20260709 13:00:06.846076  1674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.055s	sys 0.112s
W20260709 13:00:06.846454  1674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.055s	sys 0.112s
W20260709 13:00:06.846710  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 567302us
I20260709 13:00:06.847532  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.851248  1673 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:06.857877  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:06.847136  4015 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.654s	user 0.003s	sys 0.008s
W20260709 13:00:06.847411  3603 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.041s	sys 0.046s
I20260709 13:00:06.840896  3915 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.886902  3707 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:06.887223  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 437) took 1223 ms (client timeout 1550 ms). Trace:
W20260709 13:00:06.887607  1701 rpcz_store.cc:269] 0709 13:00:05.663515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.672192 (+  8677us) service_pool.cc:224] Handling call
0709 13:00:06.887033 (+1214841us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b540018a6d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:06.887164 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2076931840}
I20260709 13:00:06.890419  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:06.891153  1551 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:06.893671  3749 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:06.889671  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:06.898711  1554 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.873652  4015 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:06.867038  3624 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.008s	sys 0.025s
I20260709 13:00:06.906867  1551 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:06.853842  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:06.915632  1554 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
W20260709 13:00:06.923651  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 69895us
I20260709 13:00:06.865387  3889 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.874221  3866 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:06.861209  4066 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:06.932222  2265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 529) took 1781 ms (client timeout 2058 ms). Trace:
W20260709 13:00:06.940160  2265 rpcz_store.cc:269] 0709 13:00:05.150549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.150916 (+   367us) service_pool.cc:224] Handling call
0709 13:00:06.932008 (+1781092us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400416754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:06.932146 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3199665024}
I20260709 13:00:06.878609  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:06.933292  1635 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
W20260709 13:00:06.942386  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 216948us
I20260709 13:00:06.943313  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:06.917114  4013 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.855893  4010 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:00:06.947428  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:06.948112  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:06.952033  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:06.930589  3888 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:06.929926  3624 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.012s	sys 0.025s
I20260709 13:00:06.983629  1599 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:06.997475  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.002111  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.003113  1635 raft_consensus.cc:2410] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:06.930871  3769 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:00:06.949904  3839 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:07.007893  3916 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.001845  4003 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:07.010756  3837 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:06.954319  3923 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:06.949424  4013 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:06.996003  3888 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.012467  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:07.002235  2263 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:07.002328  3885 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.957604  3915 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:00:07.037067  3915 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:07.055011  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:06.951084  3889 consensus_queue.cc:1059] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:00:07.029198  3916 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:07.030534  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:07.030840  4013 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:07.020733  4038 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:06.979808  3884 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:00:07.025084  4003 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:07.042888  3888 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.072196  1554 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:07.053964  3707 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:07.085752  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.053931  3915 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:07.079700  3995 consensus_meta.cc:287] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.824s	user 0.008s	sys 0.004s
I20260709 13:00:07.080346  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 640) took 1640 ms. Trace:
I20260709 13:00:07.037777  3775 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.086468  3884 consensus_queue.cc:1243] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:07.105911  3857 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:07.142859  2267 rpcz_store.cc:276] 0709 13:00:05.436302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.901102 (+464800us) service_pool.cc:224] Handling call
0709 13:00:06.062425 (+161323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.130725 (+ 68300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.058786 (+928061us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400289bd0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:07.076274 (+ 17488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370124032}
I20260709 13:00:07.122797  4029 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:07.131664  3995 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.195632  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:07.196568  1635 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:07.126813  3707 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:07.166975  4029 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.167568  4007 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:07.211129  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.235776  1635 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:07.197566  4013 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.288414  1626 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:07.290438  1635 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:07.290469  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 338536us
I20260709 13:00:07.291747  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:07.215649  3624 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:07.167949  4003 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.183359  3915 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.293370  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:07.285948  3837 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:07.331969  1635 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:00:07.335556  4078 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:00:07.337888  3707 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:07.296072  3885 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:07.339052  4080 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:07.339151  3885 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.339641  3885 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:07.340507  4079 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
W20260709 13:00:07.341322  4074 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:00:07.329394  3769 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.303786  3624 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.342710  3769 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.343552  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1557) took 1035 ms. Trace:
I20260709 13:00:07.343933  1557 rpcz_store.cc:276] 0709 13:00:06.308518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.504303 (+195785us) service_pool.cc:224] Handling call
0709 13:00:06.527905 (+ 23602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.575603 (+ 47698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.575650 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.581002 (+  5352us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.903803 (+322801us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b48000030d8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:00:06.940928 (+ 37125us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:06.940972 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.941052 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.343253 (+402201us) raft_consensus.cc:1685] finished
0709 13:00:07.343275 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.343494 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42744,"raft.queue_time_us":53727,"raft.run_cpu_time_us":3140,"raft.run_wall_time_us":320041,"spinlock_wait_cycles":51665792,"thread_start_us":300821,"threads_started":1,"wal-append.queue_time_us":564252}
I20260709 13:00:07.345325  3769 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:07.345860  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1641) took 1342 ms. Trace:
I20260709 13:00:07.346300  1634 rpcz_store.cc:276] 0709 13:00:06.003927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.004058 (+   131us) service_pool.cc:224] Handling call
0709 13:00:06.070365 (+ 66307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.091864 (+ 21499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.091893 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.101446 (+  9553us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.748449 (+647003us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b1800258400. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:00:07.018748 (+270299us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:07.018800 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.018970 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.345581 (+326611us) raft_consensus.cc:1685] finished
0709 13:00:07.345600 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.345803 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23282,"raft.queue_time_us":44738,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":11701,"spinlock_wait_cycles":10323840,"thread_start_us":270040,"threads_started":1,"wal-append.queue_time_us":1045407}
I20260709 13:00:07.268337  4029 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.349061  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1554) took 1041 ms. Trace:
I20260709 13:00:07.236404  4007 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.351065  1559 rpcz_store.cc:276] 0709 13:00:06.307660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.502842 (+195182us) service_pool.cc:224] Handling call
0709 13:00:06.503344 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.565722 (+ 62378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.565754 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.566334 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.924027 (+357693us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:06.924069 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.924142 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.348777 (+424635us) raft_consensus.cc:1685] finished
0709 13:00:07.348800 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.348984 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71645,"raft.queue_time_us":65196,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":5419,"thread_start_us":355304,"threads_started":1,"wal-append.queue_time_us":511814}
W20260709 13:00:07.349689  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 135579us
I20260709 13:00:07.356889  1634 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:07.362571  1635 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:07.333223  3884 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:07.293067  4013 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.345168  3624 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:07.359196  3915 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.372210  4024 raft_consensus.cc:3055] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:07.377740  3778 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:07.379957  3980 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:07.382134  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 515307us
I20260709 13:00:07.382004  3885 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.382910  1674 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:07.383921   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:07.384626  3922 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:07.384856  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.385965  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.386643  1634 raft_consensus.cc:2368] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6.
I20260709 13:00:07.387015  4038 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:07.387367  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.387567  4038 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.388020  1634 raft_consensus.cc:2368] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4.
I20260709 13:00:07.388741  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.388950  2266 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:07.389269  1634 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 13:00:07.370935  4020 raft_consensus.cc:1064] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 13:00:07.390547  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:07.391364  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:07.385020  3922 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:07.392005  1674 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:07.396124  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:07.375929  4072 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:00:07.372494  3775 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:07.371582  3884 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:07.400309  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:07.402240  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.400233  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:07.403396  3995 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:07.403965  2263 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:07.374390  4024 raft_consensus.cc:740] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:07.403971  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.405069  3922 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.416895  2271 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:07.407372  3866 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:07.433020  4099 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:07.433337  3749 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:07.433687  4099 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:07.433918  3749 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:07.433717  3885 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:07.436069  3885 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:07.436853   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:07.436584  3885 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.437505  2262 raft_consensus.cc:2368] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7.
I20260709 13:00:07.416138  3886 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:07.438680  3886 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:07.439157  3886 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.413511  3847 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.441345  1524 leader_election.cc:400] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7.
I20260709 13:00:07.434836  4099 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:07.442986  1635 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:07.442778  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.444350  1628 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 3.
I20260709 13:00:07.450894  4013 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:07.452768  3884 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:07.453859  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1562) took 1140 ms. Trace:
W20260709 13:00:07.454664  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 62732.9us
I20260709 13:00:07.460812  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:07.454259  1556 rpcz_store.cc:276] 0709 13:00:06.316985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.524222 (+207237us) service_pool.cc:224] Handling call
0709 13:00:06.524650 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.571034 (+ 46384us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:06.953693 (+382659us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.353534 (+399841us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.354374 (+   840us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.354557 (+   183us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:07.354611 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.354717 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.453660 (+ 98943us) raft_consensus.cc:1685] finished
0709 13:00:07.453679 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.453806 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50120,"prepare.queue_time_us":444932,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":57815,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":15461,"thread_start_us":775574,"threads_started":2,"wal-append.queue_time_us":454545}
I20260709 13:00:07.469550  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:07.469969  2264 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 5 LEARNER]: Advancing to term 6
I20260709 13:00:07.470443  2263 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:07.472445  3938 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.472609  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:07.473179  2263 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.472976  3938 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:07.425639  3866 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:07.478382  1705 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:07.479168  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:07.479761  1634 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.475911  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:07.477485  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.480515  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:07.481336  1705 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.438671  3749 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:07.484068  1708 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:07.485663  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:07.418910  4004 consensus_queue.cc:1059] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:00:07.505594  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:07.505906  2264 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 6 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:00:07.506594  1706 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:07.519384  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:07.520220  1632 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:07.524770  3872 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:07.527560  4087 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.327s	user 0.002s	sys 0.000s
W20260709 13:00:07.529443  4077 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.325s	user 0.001s	sys 0.001s
I20260709 13:00:07.453676  3995 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.532781  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:07.533492  1634 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:07.535619  3743 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.535583  1705 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:07.540683  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.506560  2264 pending_rounds.cc:85] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 5
I20260709 13:00:07.537115  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:07.541476  2264 pending_rounds.cc:107] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:00:07.541769  2264 raft_consensus.cc:2889] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 6 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:07.442677  3915 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:00:07.531452  1601 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:07.542021  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.539072  1556 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:07.539567  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:07.544193  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:07.545789  1634 raft_consensus.cc:2393] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:07.548898  2234 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:07.485122  4029 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:07.537042  4094 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:00:07.552088  1634 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:07.557855  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:07.559599  1634 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:00:07.454001  3847 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.550594  3624 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:07.565102  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:07.579104  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:07.580646  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:07.549440  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:07.479040  3557 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:00:07.535583  3603 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:00:07.564072  1632 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:07.569814  1627 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:07.554004  3837 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:07.591953  2268 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEARNER]: Advancing to term 6
I20260709 13:00:07.552668  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:07.593627  1628 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.547577  3743 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.550750  4075 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:07.551100  4035 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:07.548297  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:07.599752  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 337) took 1844 ms. Trace:
I20260709 13:00:07.600322  1560 rpcz_store.cc:276] 0709 13:00:05.755702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.046736 (+291034us) service_pool.cc:224] Handling call
0709 13:00:06.047107 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.086906 (+ 39799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.599457 (+1512551us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b54002dc3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:07.599688 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52240256}
W20260709 13:00:07.602466  1558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 345) took 1523 ms (client timeout 1537 ms). Trace:
W20260709 13:00:07.603053  1558 rpcz_store.cc:269] 0709 13:00:06.078639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.102292 (+ 23653us) service_pool.cc:224] Handling call
0709 13:00:07.602208 (+1499916us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54000c8fd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:07.602392 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375711104}
I20260709 13:00:07.605687  1635 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:07.544068  3995 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.574040  3624 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.573791  3857 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:07.556437  3979 consensus_queue.cc:1059] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:00:07.584395  3885 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:07.608914  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 153064us
I20260709 13:00:07.586468  3786 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:07.747000  1553 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:07.702422  1634 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:07.487538  4024 consensus_queue.cc:260] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:07.589658  4002 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:07.595109  3872 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:07.734381  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:07.767979  1556 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.688565  4106 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:07.743086  1600 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:07.784873  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:00:07.739581  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 136092us
I20260709 13:00:07.604322  3938 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:07.753641  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:07.754191  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:07.788461  1554 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:07.758754  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1642) took 1754 ms. Trace:
I20260709 13:00:07.760847  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:07.761826  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:07.591352  3749 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.138s
I20260709 13:00:07.706441  3624 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:07.764557  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:07.855955  4097 log.cc:927] Time spent T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:00:07.764792  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:07.688474  3837 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:07.592542  3888 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.734820  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:07.786355  1633 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:07.763185  3786 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.765873  1700 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:07.789676  1629 rpcz_store.cc:276] 0709 13:00:06.004246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.022419 (+ 18173us) service_pool.cc:224] Handling call
0709 13:00:06.022878 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.251273 (+228395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.758410 (+1507137us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540007a654. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:07.758648 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416702336}
W20260709 13:00:07.830089  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.836021  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:07.895941  1554 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.789036  1558 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
W20260709 13:00:07.836426  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 82908.4us
I20260709 13:00:07.790421  3754 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:07.838362  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:07.839679  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:07.840106  1556 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:07.840953  3885 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:07.843590  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:07.761358  3731 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.589807  3866 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.869660  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:07.929416  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.940905  1554 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:07.941286  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:07.942718  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:07.852444  2268 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:07.782631  4106 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.786094  3872 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:07.734582  3857 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.792348  3979 raft_consensus.cc:2764] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:00:07.836678  4093 log.cc:927] Time spent T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 13:00:07.753885  3999 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.850795  3743 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:07.852044  3938 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:07.879485  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:07.876227  4063 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.045s	sys 0.030s
I20260709 13:00:07.911316  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:07.865082  4100 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:07.867169  4105 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.959295  1705 raft_consensus.cc:2410] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:07.962075  3872 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.964700  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:07.965020  4107 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:07.965540  4082 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.728s	user 0.002s	sys 0.000s
I20260709 13:00:07.929368  3885 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:07.966377  4102 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:00:07.967006  3857 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:07.948496  4106 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.973300  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:07.986931  1706 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:07.960184  3938 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:07.960153  4063 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.045s	sys 0.031s
I20260709 13:00:07.923377  3754 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.975745  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:07.957253  4016 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:07.960860  3932 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.930390  3731 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:07.967453  4104 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
I20260709 13:00:07.945837  4101 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:00:07.965677  4114 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:07.960251  3999 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:07.979441  4089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.003s	sys 0.011s
I20260709 13:00:07.967023  4110 consensus_queue.cc:1059] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:00:08.072664  4110 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:08.073202  4110 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:08.073561  3754 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:08.074307  4110 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:08.076023  4110 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.078238  3847 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:07.973088  3749 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:00:08.079002  3749 consensus_queue.cc:1243] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:07.986073  4107 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:08.080202  3885 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:08.079954  4107 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:07.989962  3938 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:07.974877  3872 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.081960  3786 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:08.083678  3872 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:07.971741  4100 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:08.085498  3731 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:07.993760  4111 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.085600  4100 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:07.972102  4105 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:08.092631  4089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.003s	sys 0.012s
I20260709 13:00:07.983484  3837 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:08.105935  4103 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:00:07.994392  3932 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.150653  3888 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:08.151917  4066 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.201s	user 0.013s	sys 0.002s
I20260709 13:00:08.152175  3999 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:07.994490  4016 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:08.156620  3886 consensus_meta.cc:287] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.004s
I20260709 13:00:08.059480  4114 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:08.163242  3886 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:08.160135  4066 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:08.183029  3886 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:08.165676  4016 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:08.183478  4105 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:08.169176  3932 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:08.165707  4038 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.003s
I20260709 13:00:08.183028  4114 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:08.184302  4038 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.186623  4038 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:08.163653  4107 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:08.187027  3938 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:08.187068  4111 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:08.209050  4106 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:07.925640  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.247061  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.008s	sys 0.010s
W20260709 13:00:08.247716  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.008s	sys 0.011s
I20260709 13:00:07.944018  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:07.949335  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:07.947453  1555 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 13:00:08.251643  1554 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.252483  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1566) took 1364 ms. Trace:
I20260709 13:00:08.253197  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:08.251581  1553 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:08.254578  1555 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:08.253105  1551 rpcz_store.cc:276] 0709 13:00:06.887708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.927791 (+ 40083us) service_pool.cc:224] Handling call
0709 13:00:06.929322 (+  1531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.957742 (+ 28420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.977908 (+ 20166us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.978801 (+   893us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.332908 (+354107us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:07.355300 (+ 22392us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.355758 (+   458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.355832 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.251770 (+895938us) raft_consensus.cc:1685] finished
0709 13:00:08.251813 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.252180 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1290,"prepare.queue_time_us":25383,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":11724,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":9282,"spinlock_wait_cycles":11365632,"thread_start_us":306204,"threads_started":1,"wal-append.queue_time_us":378720}
I20260709 13:00:08.255796  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.257886  1551 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:07.944844  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:08.263025  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.263092  1556 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:08.270490  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.003s	sys 0.002s
W20260709 13:00:08.271236  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.004s	sys 0.002s
I20260709 13:00:07.956851  1560 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:08.273497  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 692951us
W20260709 13:00:08.285954  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.009s	sys 0.006s
W20260709 13:00:08.286718  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.010s	sys 0.006s
W20260709 13:00:08.287447  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.288652  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 503844us
I20260709 13:00:08.291395  1600 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:08.296193  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:00:08.312405  1701 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.000s	sys 0.017s
W20260709 13:00:08.313046  1701 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.000s	sys 0.017s
I20260709 13:00:08.315747  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:08.324633  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.325161  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:07.988248  1705 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 2.
I20260709 13:00:08.326798  1702 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:08.327489  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.327901  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.328914  1702 raft_consensus.cc:2368] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4.
I20260709 13:00:08.329092  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:07.991547  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.329865  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.331099  1706 raft_consensus.cc:2410] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:00:08.331671  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.332152  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.332582  1702 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 13:00:08.333539  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.325805  1708 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:08.337157  1703 raft_consensus.cc:2368] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6.
I20260709 13:00:08.349653  1706 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:08.329808  1705 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 13:00:08.351858  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 646) took 1569 ms. Trace:
I20260709 13:00:08.354640  3743 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:08.355952  3872 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:08.356741  3915 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.356971  3847 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:08.202369  3938 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:08.363422  3979 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.363916  3666 raft_consensus.cc:3055] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:08.364342  4002 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:08.305497  1556 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 13:00:08.333742  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.426129  1600 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:08.456564  3872 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:08.457366  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.460620  3872 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:08.461869  4120 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:08.462260  3979 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:08.464526  1706 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:08.464973  3979 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:08.426559  3666 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:08.472931  1626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1645) took 1763 ms (client timeout 1681 ms). Trace:
I20260709 13:00:08.473379  3666 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:08.474802  3666 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:08.478093  4086 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.227s	user 0.017s	sys 0.032s
W20260709 13:00:08.479813  4096 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.125s	user 0.028s	sys 0.059s
I20260709 13:00:08.467549  3847 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:08.482609  3889 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:08.483215  3847 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:08.484642  4106 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:08.484848  1552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1549) took 2200 ms (client timeout 1699 ms). Trace:
I20260709 13:00:08.470495  1703 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:00:08.467028  1628 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.872s	user 0.013s	sys 0.008s
W20260709 13:00:08.485379  1552 rpcz_store.cc:269] 0709 13:00:06.284814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.285270 (+   456us) service_pool.cc:224] Handling call
0709 13:00:08.484458 (+2199188us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b540031e054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:08.484649 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833598848}
I20260709 13:00:08.493799  1706 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
W20260709 13:00:08.473502  1626 rpcz_store.cc:269] 0709 13:00:06.709478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.709729 (+   251us) service_pool.cc:224] Handling call
0709 13:00:08.472395 (+1762666us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b540018e7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:08.472615 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448214912}
I20260709 13:00:08.484767  4011 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.539258  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 237581us
W20260709 13:00:08.532791  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 249391us
W20260709 13:00:08.504253  4118 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.445s	user 0.002s	sys 0.011s
I20260709 13:00:08.483222  3889 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:08.382658  2270 rpcz_store.cc:276] 0709 13:00:06.782210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.789782 (+  7572us) service_pool.cc:224] Handling call
0709 13:00:06.790234 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.790700 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:06.790739 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.792734 (+  1995us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.054252 (+261518us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:07.054298 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.054371 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.964964 (+910593us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:08.350991 (+386027us) raft_consensus.cc:1685] finished
0709 13:00:08.351048 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.351524 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8780,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":4152,"spinlock_wait_cycles":86368000,"thread_start_us":217746,"threads_started":1,"wal-append.queue_time_us":359243}
I20260709 13:00:08.598237  1554 raft_consensus.cc:2410] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:00:08.601749  2235 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.921s (SENT) [suppressed 32 similar messages]
I20260709 13:00:08.573925  1628 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:08.612712  3872 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.614849  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1660) took 1076 ms. Trace:
I20260709 13:00:08.619647  1628 rpcz_store.cc:276] 0709 13:00:07.538227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.552438 (+ 14211us) service_pool.cc:224] Handling call
0709 13:00:08.614753 (+1062315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:08.625566  1708 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
W20260709 13:00:08.632813  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.633041  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.014s	sys 0.074s
I20260709 13:00:08.633077  1704 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
W20260709 13:00:08.633631  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.014s	sys 0.074s
I20260709 13:00:08.634326  4038 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:08.634845  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.635102  4038 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:08.635687  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.636354  4038 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:08.638305  4110 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:08.638120  4126 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
W20260709 13:00:08.638720  1707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.010s	sys 0.014s
W20260709 13:00:08.639204  1707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.010s	sys 0.014s
I20260709 13:00:08.639457  4126 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:08.639093  4110 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.639920  4126 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:08.640085  4114 consensus_queue.cc:1059] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
W20260709 13:00:08.641171  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 304671us
I20260709 13:00:08.642774  3915 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 13:00:08.647898  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.002s	sys 0.023s
W20260709 13:00:08.648233  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.002s	sys 0.023s
I20260709 13:00:08.648612  4110 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:08.654173  4119 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.654872  4119 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:08.657438  4119 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:08.658906  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 61813.8us
I20260709 13:00:08.641223  4126 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.661619  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:08.662600  1629 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:08.662271  4011 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.664808  4011 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:08.482627  4016 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.264s
I20260709 13:00:08.672731  1553 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:00:08.673807  3889 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:08.675899  3889 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.675736  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:08.682536  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52977.7us
I20260709 13:00:08.684098  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:08.684878  3938 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.687135  4013 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:08.687728  4013 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:08.688747  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:08.689458  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.689934  1632 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:08.690155  4004 raft_consensus.cc:3055] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:08.690353  1552 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 2.
I20260709 13:00:08.690685  4004 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:08.691213  1702 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:00:08.691609  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.692651  1557 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:08.692715  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:08.693681  1554 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.694190  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.694664  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 533) took 3477 ms. Trace:
I20260709 13:00:08.691635  1702 pending_rounds.cc:85] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 5
I20260709 13:00:08.688860  4003 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:08.662645  4126 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.685736  3847 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:08.687258  4071 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.562s	user 0.001s	sys 0.019s
I20260709 13:00:08.645774  3872 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.695995  1702 pending_rounds.cc:107] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:00:08.720049  1702 raft_consensus.cc:2889] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:08.689148  4013 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.720679  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.698592  4003 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.695092  2269 rpcz_store.cc:276] 0709 13:00:05.181389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.181743 (+   354us) service_pool.cc:224] Handling call
0709 13:00:05.206745 (+ 25002us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:05.207264 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:06.189238 (+981974us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b180037d380. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06e19c73c7 00007f06ddfd99a7 00007f06ddfe90bf 00007f06ddfe9038
0709 13:00:06.835849 (+646611us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.080940 (+245091us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.164711 (+ 83771us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.164930 (+   219us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:07.164985 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.165089 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.476664 (+1311575us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:08.629839 (+153175us) raft_consensus.cc:1685] finished
0709 13:00:08.629870 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.658212 (+ 28342us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15952,"prepare.queue_time_us":616372,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":26903,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":21600,"spinlock_wait_cycles":74013824,"thread_start_us":828807,"threads_started":2,"wal-append.queue_time_us":308162}
W20260709 13:00:08.729207  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.717969  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:08.729913  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:08.719797  3847 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:08.738170  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:08.741514  2263 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.268s	user 0.013s	sys 0.004s
I20260709 13:00:08.742735  4013 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:08.743896  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.745250  3872 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:08.746804  1555 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:08.722865  4007 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:08.751637  1553 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.724803  4003 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.685808  3938 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:08.758013  1632 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 5: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:08.758131  4091 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:08.692097  4004 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.760303  2263 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:08.766583  4107 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.767071  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:08.767297  4107 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:08.760282  4045 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.776208  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 653) took 1307 ms. Trace:
I20260709 13:00:08.776338  4045 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.776862  2263 rpcz_store.cc:276] 0709 13:00:07.471648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.472334 (+   686us) service_pool.cc:224] Handling call
0709 13:00:08.776082 (+1303748us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:08.779255  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 494) took 2233 ms (client timeout 1716 ms). Trace:
W20260709 13:00:08.779701  1630 rpcz_store.cc:269] 0709 13:00:06.545931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.546124 (+   193us) service_pool.cc:224] Handling call
0709 13:00:08.778824 (+2232700us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540035be54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:08.779039 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426936576}
I20260709 13:00:08.784418  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.785027  1632 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:08.786047  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.786316  3938 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:08.786650  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:08.787503  1630 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:08.788228  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 513) took 1241 ms. Trace:
I20260709 13:00:08.788887  1555 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:08.788635  1634 rpcz_store.cc:276] 0709 13:00:07.546439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.574115 (+ 27676us) service_pool.cc:224] Handling call
0709 13:00:07.574907 (+   792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.748315 (+173408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.787707 (+1039392us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540006c7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:08.788040 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292456320}
I20260709 13:00:08.471225   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:08.796854  3849 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:08.798475  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.769913  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:08.803334  4063 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.804236  4063 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.819602  3995 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:08.821933  4004 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:08.836618  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 81199.9us
I20260709 13:00:08.837275  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 754) took 1370 ms. Trace:
I20260709 13:00:08.838096  1600 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:08.837857  2262 rpcz_store.cc:276] 0709 13:00:07.467248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.483611 (+ 16363us) service_pool.cc:224] Handling call
0709 13:00:08.836822 (+1353211us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b540064c8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:08.837067 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039125888}
I20260709 13:00:08.843782  4017 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:08.855254  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.810098  3872 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:08.850670  4063 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:08.873489  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 206190us
I20260709 13:00:08.877846  1703 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:08.879403  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:08.881245  4125 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.103s	user 0.002s	sys 0.002s
I20260709 13:00:08.881955  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1846) took 1148 ms. Trace:
I20260709 13:00:08.882388  1560 rpcz_store.cc:276] 0709 13:00:07.733207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.733752 (+   545us) service_pool.cc:224] Handling call
0709 13:00:08.881626 (+1147874us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b5400177854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:08.881781 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168681856}
I20260709 13:00:08.882838  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1730) took 1422 ms. Trace:
I20260709 13:00:08.883219  1707 rpcz_store.cc:276] 0709 13:00:07.460426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.460540 (+   114us) service_pool.cc:224] Handling call
0709 13:00:07.460916 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.884376 (+423460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:07.884434 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.885052 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 13:00:08.639826 (+754774us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:08.639892 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.639969 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.877571 (+237602us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:08.882566 (+  4995us) raft_consensus.cc:1685] finished
0709 13:00:08.882586 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.882768 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31770,"raft.queue_time_us":127763,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5264,"spinlock_wait_cycles":76342400,"thread_start_us":1112925,"threads_started":2,"wal-append.queue_time_us":786878}
W20260709 13:00:08.887056  3624 consensus_meta.cc:287] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.992s	user 0.004s	sys 0.010s
I20260709 13:00:08.887678  3624 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.892042  1554 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:08.859994  4107 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:08.906469  1553 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:08.912837  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.913611  1707 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
W20260709 13:00:08.915989  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 159068us
I20260709 13:00:08.918918  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:08.919023  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 81141.3us
I20260709 13:00:08.920177  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.920776  1707 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:08.921581  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.922076  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.922647  1707 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:08.862357  3847 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:08.953904  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.954569  1553 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:08.953341  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:08.964803  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.961756  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.972397  1524 leader_election.cc:400] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6.
I20260709 13:00:08.973003  1524 leader_election.cc:403] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:08.970752  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:08.974521  1555 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 13:00:08.976745  1707 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:08.978127  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:08.978484  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.979431  1558 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 13:00:08.951424  3624 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:08.979620  1707 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:08.984083  1556 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
W20260709 13:00:08.985371  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 153822us
I20260709 13:00:08.983115  1560 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:08.995668  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:08.997069  1557 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.999163  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 751) took 1558 ms. Trace:
W20260709 13:00:09.000291  4134 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:00:09.002210  1703 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.005990  1551 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 13:00:09.008221  4003 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:09.019645  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 104654us
W20260709 13:00:09.021574  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.025442  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.027894  1703 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:09.034232  1524 leader_election.cc:400] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4.
I20260709 13:00:09.044144  1524 leader_election.cc:403] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:09.009816  4141 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:09.046380  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 61990.7us
I20260709 13:00:09.059245  4013 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:09.059398  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:09.060480  4111 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:09.064447  3849 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:09.065511  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.999639  2265 rpcz_store.cc:276] 0709 13:00:07.401016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.402334 (+  1318us) service_pool.cc:224] Handling call
0709 13:00:08.838552 (+1436218us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 13:00:08.838928 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.839351 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:08.839748 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.956197 (+116449us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:08.956250 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:08.956293 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.956348 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.959035 (+  2687us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":179,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":30476,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":24158,"spinlock_wait_cycles":17699456,"thread_start_us":87336,"threads_started":1,"wal-append.queue_time_us":148982}
I20260709 13:00:09.065076  3849 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.053872  4017 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6.
I20260709 13:00:09.082726  1559 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:00:09.083302  1559 pending_rounds.cc:85] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 5
I20260709 13:00:09.083578  1559 pending_rounds.cc:107] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:00:09.083855  1559 raft_consensus.cc:2889] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:09.086923  4018 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.087603  4018 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:09.089246  4140 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:09.089751  4140 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.090176  4140 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.094305  4147 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:09.094961  4147 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.099715  4126 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:09.100286  3624 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:09.100371  4126 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.101190  3624 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.053529  4107 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:09.102424  4107 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.103283  4126 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:09.103487  3624 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:09.103875  4126 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:09.104467  4126 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.104853  4107 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:09.105888  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:09.106920  4126 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:09.108322  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:09.110212  1634 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:09.110189  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:09.121174  1630 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:09.121487  1557 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:09.125524  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:09.120631  1627 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:00:09.076921  3849 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.126798  1627 pending_rounds.cc:85] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 4
W20260709 13:00:09.131711  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.133652  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:09.110579  4002 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.075518  4111 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:00:09.131842  1627 pending_rounds.cc:107] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260709 13:00:09.152846  1627 raft_consensus.cc:2917] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
I20260709 13:00:09.163787  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:09.170981  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:09.174875  2266 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:09.195237  2270 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.147800  4119 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:09.144971  4144 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.201975  4110 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:00:09.204824  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:09.205538  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:09.145859  4002 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:09.203828  4144 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.200307  4063 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:00:09.205641  4119 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.217347  4003 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:09.220759  4017 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:00:09.344985  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 441) took 1580 ms (client timeout 1910 ms). Trace:
I20260709 13:00:09.345494  1705 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:09.372567  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:09.329838  1627 raft_consensus.cc:2889] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:09.284515  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.321033  2266 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:00:09.222431  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 443) took 1383 ms. Trace:
I20260709 13:00:09.223212  1706 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:09.378563  2266 pending_rounds.cc:85] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 4
I20260709 13:00:09.384845  2266 pending_rounds.cc:107] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.5
I20260709 13:00:09.385614  2266 raft_consensus.cc:2917] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Aborting config change with OpId 5.5: Aborted: Op aborted by new leader
W20260709 13:00:09.374840  1708 rpcz_store.cc:269] 0709 13:00:07.833786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.837436 (+  3650us) service_pool.cc:224] Handling call
0709 13:00:09.344658 (+1507222us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54001fde54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:09.344902 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930427264}
I20260709 13:00:09.379767  1704 rpcz_store.cc:276] 0709 13:00:07.839246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.839393 (+   147us) service_pool.cc:224] Handling call
0709 13:00:09.222139 (+1382746us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54001c52d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:09.222349 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945146240}
I20260709 13:00:09.180076  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:09.220830  2236 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:09.276862  4135 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.481s	user 0.000s	sys 0.003s
W20260709 13:00:09.199774  4145 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:00:09.227424  4013 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4.
I20260709 13:00:09.224597  2265 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:09.366452  4131 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.394390  2264 raft_consensus.cc:2410] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 8 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 13:00:09.221326  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:09.369782  4081 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 2.347s	user 0.019s	sys 0.011s
W20260709 13:00:09.371297  3889 consensus_meta.cc:287] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.695s	user 0.008s	sys 0.005s
I20260709 13:00:09.367017  3915 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:09.327404  4004 consensus_meta.cc:287] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.005s
I20260709 13:00:09.399086  2266 raft_consensus.cc:2889] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:09.425671  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:09.388721  4017 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:09.337797  3872 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.410390  2268 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:09.410588  4123 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:00:09.421607  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 257947us
I20260709 13:00:09.391496  4110 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:09.340606  4143 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:00:09.423069  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:09.400372  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 176594us
I20260709 13:00:09.337402  3778 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:00:09.405287  4003 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:00:09.485734  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64603.6us
I20260709 13:00:09.404223  4114 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:09.428215  4063 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:09.368548  4140 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:09.493813  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 77888.9us
I20260709 13:00:09.422111  2263 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:09.431164  3963 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:09.447986  4152 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:00:09.461094  3754 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:00:09.478664  4119 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:09.502456  4119 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:09.502871  4119 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.503202  4119 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:09.490943  1557 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:09.488292  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1731) took 2026 ms. Trace:
I20260709 13:00:09.505131  4110 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:09.505362  1709 rpcz_store.cc:276] 0709 13:00:07.462058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.462341 (+   283us) service_pool.cc:224] Handling call
0709 13:00:07.462632 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.545113 (+ 82481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:07.545146 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.565089 (+ 19943us) log.cc:844] Serialized 26 byte log entry
0709 13:00:08.489744 (+924655us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b18003e19a0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:00:08.724042 (+234298us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:08.724115 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.731632 (+  7517us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:09.275978 (+544346us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:09.487873 (+211895us) raft_consensus.cc:1685] finished
0709 13:00:09.487905 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.488090 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33896,"raft.queue_time_us":126200,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":20335,"spinlock_wait_cycles":180627584,"thread_start_us":213588,"threads_started":2,"wal-append.queue_time_us":1205503}
I20260709 13:00:09.507535  1552 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:09.508479  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:09.495167  1674 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:09.491042  4141 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:09.471830  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 251247us
I20260709 13:00:09.462620  4017 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:09.470520  3872 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:09.468973  4131 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:09.483532  4004 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:09.510114  1601 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:09.512632  4161 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:09.512732  4156 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:09.483654  4144 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:09.520730  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.522233  1526 leader_election.cc:400] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4.
I20260709 13:00:09.522445  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:09.526710  4123 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:09.520900  4114 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:09.520651  4161 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.524024  4110 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:00:09.538370  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:09.546096  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:09.540884  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.544361  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:09.531210  4114 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:09.560112  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 68409.3us
I20260709 13:00:09.533888  4013 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.562127  4013 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.564266  4013 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:09.550232  4004 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.565779  4004 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.567804  4004 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:09.549856  4160 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:09.570647  4160 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.571050  4160 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.569538  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:09.557111  4002 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:09.561633  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:09.574649  4147 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:09.574781  4002 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:09.576090  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.525534  4003 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.540340  4161 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:09.553663  4133 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.941s	user 0.001s	sys 0.001s
W20260709 13:00:09.597384  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 66693.1us
I20260709 13:00:09.589082  3743 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.561666  2263 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:09.605109  3775 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:09.606549  3743 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:09.608048  3866 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:09.608726  3743 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:09.609071  4123 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:09.595690  4147 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:00:09.610777  4147 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:09.611119  4147 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:09.611995  4147 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.613270  4147 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.589044  4141 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:09.614457  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:09.601892  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:09.615145  1552 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.604247  4110 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:09.616181  4110 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.616554  4110 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.597132  4140 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:09.617898  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:09.619948  1674 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:09.601437  4017 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:09.622354  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:09.538434  4156 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:09.624966  4108 raft_consensus.cc:2764] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:09.625388  1526 leader_election.cc:400] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6.
I20260709 13:00:09.625721  4101 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:09.627967  4137 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.833s	user 0.000s	sys 0.002s
I20260709 13:00:09.628000  4013 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:09.628935  4013 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:09.632148  3847 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:09.636099  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.637212  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.637610  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.637683  3849 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:09.638573  1627 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:09.639077  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:09.640482  3849 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:09.641063  3849 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:09.642649  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 112282us
I20260709 13:00:09.643363  4024 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.643579  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:09.644661  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:09.644869  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.645736  3775 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEARNER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:09.645968  1553 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:09.646420  1553 pending_rounds.cc:85] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 6
I20260709 13:00:09.646642  1553 pending_rounds.cc:107] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:00:09.646937  1553 raft_consensus.cc:2889] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:09.647418  3775 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:09.648947  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:09.649614  1553 raft_consensus.cc:2376] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4. Re-sending same reply.
I20260709 13:00:09.636909  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1856) took 1139 ms. Trace:
W20260709 13:00:09.651746  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 93044.1us
I20260709 13:00:09.652060  1559 rpcz_store.cc:276] 0709 13:00:08.497635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.522110 (+ 24475us) service_pool.cc:224] Handling call
0709 13:00:08.597127 (+ 75017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.084427 (+487300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.633378 (+548951us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400182754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:09.636849 (+  3471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958862080}
I20260709 13:00:09.656865  1557 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:09.659075  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:09.641595  3849 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.661314  2270 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:09.663550  1600 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:09.663210  3847 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:09.663902  4119 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.664794  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:09.633704  4148 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:09.668869  4159 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:00:09.673595  1552 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:09.675141  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:09.673338  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:09.676822  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.679958  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:09.676422  1627 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:09.685349  4119 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:09.686097  2235 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:09.686323  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:09.687183  1555 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:09.687811  3963 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:09.686355  1560 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:09.688354  3963 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:09.685187  3775 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:00:09.690205  3624 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:09.693769  3847 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:09.696161  4142 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:00:09.689508  3963 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:09.696877  4035 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:09.698901  4110 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:09.683846  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:09.717397  1559 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:09.703440  3849 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:09.709240  1551 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:09.670533  4148 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:09.715342  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47257.1us
W20260709 13:00:09.718595  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 66102.8us
W20260709 13:00:09.711618  4162 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 13:00:09.725601  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45757.8us
I20260709 13:00:09.719826  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:09.742645  1552 raft_consensus.cc:2376] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7. Re-sending same reply.
I20260709 13:00:09.717514  4101 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:09.747189  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:09.737558  4148 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:09.751470  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:09.758256  4147 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:09.760815  1627 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 5: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:09.725044  4123 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:09.767725  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:09.751821  4131 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:09.751669  4101 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:09.776880  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:09.774302  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 56415.2us
I20260709 13:00:09.780665  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:09.781994  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:09.746250  3769 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:00:09.782079  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:09.785141  1708 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:09.787467  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:09.776152  4038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.009s	sys 0.010s
I20260709 13:00:09.783238  4101 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:09.796867  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 50136.4us
I20260709 13:00:09.778751  4123 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:10.045562  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:09.851210  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1828) took 1535 ms. Trace:
I20260709 13:00:09.880489  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:09.806558  1707 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:09.834439  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:09.825021  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:09.989223  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 55579.8us
I20260709 13:00:09.913518  1708 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:09.803259  1704 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:09.821208  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:09.851788  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1820) took 1888 ms. Trace:
W20260709 13:00:09.802569  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 49256.1us
I20260709 13:00:09.942411  1674 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:09.930467  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.866532  3923 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:09.852581  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:09.837545  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:10.088862  1701 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:09.837183  1700 raft_consensus.cc:2410] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:00:09.783031  4109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.816s	user 0.004s	sys 0.028s
I20260709 13:00:09.841746  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:10.093595  1632 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:10.076005  1706 rpcz_store.cc:276] 0709 13:00:08.316012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.532957 (+216945us) service_pool.cc:224] Handling call
0709 13:00:09.223043 (+690086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.380973 (+157930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.850977 (+470004us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54001c52d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:09.851141 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398092032}
I20260709 13:00:10.084580  1627 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:09.804195  1702 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:09.840101  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:09.849494  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:09.788223  4141 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:09.941437  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:09.839459  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:10.096024  1629 raft_consensus.cc:2410] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:09.804975  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:09.798549  4063 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:09.896266  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 86064.1us
I20260709 13:00:09.814502  4099 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:10.072957  4038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.415s	user 0.010s	sys 0.010s
I20260709 13:00:09.995427  4018 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:09.796608  4155 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:10.097026  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 292184us
I20260709 13:00:09.846818  3603 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:09.839766  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:10.092258  4107 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.999501  3889 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:10.117902  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.849234  4160 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:09.837496  4003 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:09.786262  3754 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.304s
I20260709 13:00:10.099828  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1669) took 1315 ms. Trace:
I20260709 13:00:09.849857  4156 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:09.938366  3872 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:09.880537  4131 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.837924  4110 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:10.101377  1633 raft_consensus.cc:2393] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:09.865865  4045 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:10.143934  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:10.096239  4109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.130s	user 0.004s	sys 0.029s
I20260709 13:00:09.992806  4170 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:09.864203  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:10.095153  3923 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:10.104460  4126 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:10.104847  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:10.105582  3922 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.103089  4147 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.102972  4143 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:10.106549  4115 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:10.106367  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:10.104890  2234 connection.cc:256] RPC call timeout handler was delayed by -1.7410370550000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
I20260709 13:00:10.107806  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:10.108333  3999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.327s	user 0.003s	sys 0.014s
W20260709 13:00:10.193368  3999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.428s	user 0.003s	sys 0.014s
W20260709 13:00:10.195690  1599 leader_election.cc:336] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.058s (SENT)
I20260709 13:00:10.196206  1599 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:10.196359  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:10.197366  1706 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
W20260709 13:00:10.198448  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:10.112454  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.120916  4107 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 13:00:10.200929  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.112722  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:09.841315  4165 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:00:10.202153  1703 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.086952  1705 rpcz_store.cc:276] 0709 13:00:07.963523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.422518 (+458995us) service_pool.cc:224] Handling call
0709 13:00:09.345232 (+922714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.377354 (+ 32122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.851592 (+474238us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54001fde50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:09.851736 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856308608}
I20260709 13:00:09.992076  4161 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:10.119305  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 177026us
I20260709 13:00:09.837349  4108 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.267s
I20260709 13:00:10.120276  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:10.206734  1627 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:10.100608  4063 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:09.811126  4035 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.293s
I20260709 13:00:10.100858  4099 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.098150  4141 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:10.122830  1629 rpcz_store.cc:276] 0709 13:00:08.784318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.852292 (+1067974us) service_pool.cc:224] Handling call
0709 13:00:10.099770 (+247478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.118875  4101 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:10.132972  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 191646us
I20260709 13:00:10.217705  2235 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:10.113431  3603 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:10.134160  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:10.134547  4160 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:10.146275  1552 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:10.148643  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:10.118209  3889 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:00:10.149286  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.209761  4063 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.156114  1626 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:10.157883  2262 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 4: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:10.215689  4099 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.154315  4126 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.166531  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:10.233173  1635 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.167219  4147 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:10.168006  4029 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.116596  4155 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:10.191411  1631 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:10.192229  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:10.192515  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:10.192880  4113 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.198233  4017 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:10.199393  4143 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:10.203226  2234 connection.cc:256] RPC call timeout handler was delayed by -1.0576884540000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:00:10.245575  2234 connection.cc:256] RPC call timeout handler was delayed by -1.0307408659999737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 13:00:10.111696  1634 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:10.245482  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:10.246881  1552 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:00:10.203789  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 391447us
I20260709 13:00:10.127835  4018 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:00:10.151708  4170 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.115988  4007 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:10.218884  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.252744  4141 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:10.253911  4141 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.254136  4170 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.256567  4017 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:10.256999  4017 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:10.257372  4017 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.143858  4123 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:10.220172  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:10.223896  1709 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:10.144825  4131 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:10.152969  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 52869.3us
I20260709 13:00:10.219053  4148 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:10.160400  3923 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:10.241835  1703 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:10.242360  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:10.242527  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:10.244151  1557 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:10.244385  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:10.250885  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 81046.3us
I20260709 13:00:10.242687  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 656) took 1141 ms. Trace:
W20260709 13:00:10.273111  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 67074.8us
I20260709 13:00:10.234488  4126 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.208468  4115 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:10.270258  4189 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:10.240958  3979 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.254015  4101 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:10.282850  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:10.279901  1674 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:10.279121  4119 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:10.258245  3849 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:10.283771  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:10.289943  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:10.278884  2262 rpcz_store.cc:276] 0709 13:00:09.099520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.126536 (+ 27016us) service_pool.cc:224] Handling call
0709 13:00:09.864034 (+737498us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaeee 0000000000375939 00007f06e2f1e1e0 00007f06e2fe70c4 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:00:10.240985 (+376951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10891008}
I20260709 13:00:10.286578  4119 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.292642  4119 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.286369  3979 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:10.292065  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:10.299827  1630 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:10.302011  4007 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:10.310361  1524 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:10.241190  4029 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:10.310540  4196 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:10.244143  3889 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:10.284070  3923 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:10.245015  4113 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:10.324262  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:10.324842  1558 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.324851  1552 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:10.320828  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:10.279973  4189 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:10.301111  4176 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:00:10.288911  3849 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:10.330734  3849 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:10.295599  4187 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:10.326344  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:10.309918  4007 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:10.327075  1559 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
W20260709 13:00:10.320676  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46763.2us
I20260709 13:00:10.334098  1629 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:10.311318  4110 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:10.321753  4108 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:10.353134  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:10.352233  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 134654us
I20260709 13:00:10.354996  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:10.319974  4196 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.356456  4003 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:10.328191  4189 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:10.361274  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 51000.4us
I20260709 13:00:10.335316  4187 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.336666  3889 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:10.363270  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.338419  3847 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.352417  4108 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:10.402182  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46159.1us
W20260709 13:00:10.403720  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.362391  4003 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.354444  4179 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:10.401859  4108 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:10.362526  4196 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.364698  4187 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.421526  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:10.424460  1559 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:10.425942  2270 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:10.425814  1552 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:10.428797  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:10.434561  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.434775  2271 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:10.429242  4193 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:10.435779  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:10.435914  4193 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:10.438393  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:10.439913  1554 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:10.353327  4143 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:10.441293  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:10.370318  4109 raft_consensus.cc:2764] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:10.451923  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:10.419937  4192 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:10.369974  4110 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:10.433455  4179 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:10.406641  3847 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:10.398207  4045 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:00:10.470424  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:10.425997  4147 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:10.510277  4179 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:10.513147  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 419718us
I20260709 13:00:10.501042  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:10.501885  1635 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:10.419098  4003 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.500785  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:10.507827  2263 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:10.509940  4131 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:10.532864  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.518623  4148 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:10.508703  4196 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:10.425554  4115 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:10.989391  4194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.027s
I20260709 13:00:10.519414  2269 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:10.714710  1555 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:11.006868  4191 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:10.539575  4185 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:00:11.133883  4091 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:11.128734  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 707474us
I20260709 13:00:10.598861  4099 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:11.134874  4091 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:11.025590  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.625550  1634 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 13:00:11.137008  3999 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:10.811623  1673 connection.cc:256] RPC call timeout handler was delayed by -1.0647160320000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260709 13:00:11.108168  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.601663  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:10.567442  4198 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:11.082526  4126 consensus_meta.cc:287] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.786s	user 0.005s	sys 0.006s
I20260709 13:00:10.702353  4110 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:10.552182  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:11.118564  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:11.181329  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1592) took 1056 ms. Trace:
I20260709 13:00:10.596354  3922 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:11.137020  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 521) took 1296 ms (client timeout 1645 ms). Trace:
W20260709 13:00:11.186707  1634 rpcz_store.cc:269] 0709 13:00:09.840485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.873561 (+ 33076us) service_pool.cc:224] Handling call
0709 13:00:11.136964 (+1263403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.753571  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:10.623426  1558 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
W20260709 13:00:11.128372  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.182178  1551 rpcz_store.cc:276] 0709 13:00:10.124470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.124832 (+   362us) service_pool.cc:224] Handling call
0709 13:00:10.135145 (+ 10313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:10.135497 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:10.135539 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:10.136212 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 13:00:10.218225 (+ 82013us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:10.218262 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.218335 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:11.181045 (+962710us) raft_consensus.cc:1685] finished
0709 13:00:11.181069 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.181266 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":81532,"threads_started":1,"wal-append.queue_time_us":143196}
I20260709 13:00:10.669085  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:11.140915  4194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.007s	sys 0.034s
W20260709 13:00:10.666965  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1836) took 2240 ms (client timeout 2166 ms). Trace:
W20260709 13:00:11.141683  4017 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.884s	user 0.012s	sys 0.022s
W20260709 13:00:11.152994  4119 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.860s	user 0.012s	sys 0.000s
W20260709 13:00:10.818149  4170 consensus_meta.cc:287] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.006s
W20260709 13:00:10.988680  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.192150  1553 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:11.193560  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:11.197427  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:11.124845  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 841146us
I20260709 13:00:11.145629  4161 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:10.592694  2271 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
W20260709 13:00:10.771989  1455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 230) took 23704 ms (client timeout 15000 ms). Trace:
W20260709 13:00:11.195722  1701 rpcz_store.cc:269] 0709 13:00:08.453168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.457006 (+  3838us) service_pool.cc:224] Handling call
0709 13:00:10.666756 (+2209750us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400233f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:10.666881 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3750476672}
I20260709 13:00:10.566514  4196 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:11.153705  4187 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.721s	user 0.007s	sys 0.002s
I20260709 13:00:11.127686  4113 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:11.203639  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:11.222258  1634 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:11.191551  1552 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.152007  4099 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:10.640542  4193 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:11.130960  3849 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.151523  4045 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:11.093475  4063 consensus_meta.cc:287] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.855s	user 0.009s	sys 0.002s
I20260709 13:00:11.140853  4198 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:11.209038  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:11.243921  1704 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:11.209270  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:10.595984  1633 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:00:11.114816  4029 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:10.567023  4131 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.638185  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:10.573700  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 135758us
I20260709 13:00:11.127239  4107 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:10.664955  1700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 444) took 2821 ms (client timeout 1921 ms). Trace:
I20260709 13:00:11.204761  4017 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:11.248555  3963 raft_consensus.cc:670] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:11.208988  4170 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:11.244863  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:11.245936  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:11.210594  3922 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:11.247267  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:11.185701  4126 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.255792  4099 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.294389  1552 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
W20260709 13:00:11.258436  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.267647  1632 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:10.593075  3603 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:11.240260  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:11.297410  1628 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.271147  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:11.273552  4020 raft_consensus.cc:1068] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Unable to promote non-voter 6923294c847b48ebb577e0935d316aa3: Illegal state: Replica 4f1725fe36e349ac85405627f9c93d95 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:00:11.220258  4191 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.274909  3979 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:11.276841  4003 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.001s
I20260709 13:00:11.247087  4198 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:11.269730  4107 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.244527  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:11.248229  4196 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.207346  4119 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 13:00:11.281415  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 145293us
I20260709 13:00:11.282174  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1983) took 1412 ms. Trace:
I20260709 13:00:11.344149  1634 rpcz_store.cc:276] 0709 13:00:09.860416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.228814 (+1368398us) service_pool.cc:224] Handling call
0709 13:00:11.243704 (+ 14890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.255672 (+ 11968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.255701 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.272288 (+ 16587us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:11.272332 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.272390 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.272519 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:11.344828  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.284099  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:11.252492  4203 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.288019  1702 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:11.274729  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:11.303515  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 524) took 1362 ms. Trace:
I20260709 13:00:11.247009  4063 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.244890  4045 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.310590  3922 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.355597  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:11.356364  1702 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:11.332157  4020 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.235244  4187 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 13:00:11.303611  3889 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.937s	user 0.011s	sys 0.001s
I20260709 13:00:11.278483  4199 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:11.266891  1700 rpcz_store.cc:269] 0709 13:00:07.840470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.314824 (+474354us) service_pool.cc:224] Handling call
0709 13:00:10.661758 (+2346934us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54000b7054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:10.661935 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3496257792}
W20260709 13:00:11.345566  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.364507  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:11.365015  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.365428  1627 raft_consensus.cc:2368] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7.
I20260709 13:00:11.305109  4099 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.303980  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:11.348425  1632 rpcz_store.cc:276] 0709 13:00:09.933379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.238392 (+1305013us) service_pool.cc:224] Handling call
0709 13:00:11.253105 (+ 14713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.295855 (+ 42750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.296075 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.357599  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:11.369568  1702 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:11.319383  1553 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 13:00:11.286764  4131 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.359318  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:11.371078  1708 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
W20260709 13:00:11.357555  3923 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.031s	user 0.012s	sys 0.000s
I20260709 13:00:11.361311  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:11.362210  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:11.372087  1707 raft_consensus.cc:2393] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 3: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:11.372388  1701 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:11.332726  4003 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:11.345583  1704 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 1.
I20260709 13:00:11.347648  4194 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.368374  1630 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 6. Ops: []
I20260709 13:00:11.376793  1559 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:11.372099  1634 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:11.376398  1553 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:11.357941  4202 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:11.378674  4216 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.378787  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 525) took 1386 ms. Trace:
I20260709 13:00:11.370370  4211 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.379817  4017 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:11.349902  4205 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:00:11.364416  4199 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:11.382897  4189 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.011s	user 0.012s	sys 0.000s
I20260709 13:00:11.446357  4189 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.383333  1560 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:11.449801  1560 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:11.437037  3849 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:00:11.450855  2266 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:11.383472  4003 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:11.383683  4207 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:00:11.384239  4206 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:00:11.384742  4191 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:11.385186  1632 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:11.452188  4063 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:11.356431  4024 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:00:11.356199  4123 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:00:11.349951  4196 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:11.354432  4203 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:11.375227  4108 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.921s	user 0.011s	sys 0.001s
W20260709 13:00:11.215385  1455 rpcz_store.cc:269] 0709 12:59:47.067141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.067420 (+   279us) service_pool.cc:224] Handling call
0709 13:00:10.771654 (+23704234us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:04.738988 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:04.986207 (+247219us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:04.988531 (+  2324us) write_op.cc:435] Acquired schema lock
0709 13:00:04.994598 (+  6067us) tablet.cc:662] Decoding operations
0709 13:00:05.222321 (+227723us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:05.222420 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:05.222457 (+    37us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:00:05.222922 (+   465us) tablet.cc:701] Row locks acquired
0709 13:00:05.222945 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:00:05.223136 (+   191us) write_op.cc:270] Start()
0709 13:00:05.223276 (+   140us) write_op.cc:276] Timestamp: P: 1783602005223079 usec, L: 0
0709 13:00:05.223304 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:00:05.321290 (+ 97986us) log.cc:844] Serialized 1686 byte log entry
0709 13:00:05.709145 (+387855us) op_driver.cc:464] REPLICATION: finished
0709 13:00:05.994333 (+285188us) write_op.cc:301] APPLY: starting
0709 13:00:05.994427 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:05.994629 (+   202us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:05.994768 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:06.001189 (+  6421us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:06.001411 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:00:06.001466 (+    55us) write_op.cc:312] APPLY: finished
0709 13:00:06.011549 (+ 10083us) log.cc:844] Serialized 41 byte log entry
0709 13:00:06.011743 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:06.011852 (+   109us) write_op.cc:454] Released schema lock
0709 13:00:06.011906 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:06.012301 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:06.012336 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":53873,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":258477,"apply.run_cpu_time_us":3554,"apply.run_wall_time_us":17961,"num_ops":4,"prepare.queue_time_us":268993,"prepare.run_cpu_time_us":19096,"prepare.run_wall_time_us":819052,"raft.queue_time_us":93040,"raft.run_cpu_time_us":20094,"raft.run_wall_time_us":278797,"replication_time_us":456035,"thread_start_us":514325,"threads_started":4,"wal-append.queue_time_us":239145,"wal-append.run_cpu_time_us":11333,"wal-append.run_wall_time_us":1452301}]]}
W20260709 13:00:11.390481  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 86590.7us
I20260709 13:00:11.372718  3889 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:11.392776  1703 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:11.346668  4107 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:11.410234  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:11.386004  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:11.392613  4099 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:11.396075  4131 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:11.413864  1630 rpcz_store.cc:276] 0709 13:00:09.992388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.355015 (+1362627us) service_pool.cc:224] Handling call
0709 13:00:11.368201 (+ 13186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.378508 (+ 10307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.378712 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.406253  2236 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:11.390957  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:11.420819  1705 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:11.421425  4115 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:11.363804  1628 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:11.426781  1701 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:11.441318  4211 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.443538  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:11.367153  4020 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:11.456182  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1600) took 1144 ms. Trace:
W20260709 13:00:11.551345  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 91657.2us
I20260709 13:00:11.597008  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:11.550928  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 763) took 1115 ms. Trace:
I20260709 13:00:11.405952  2267 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:11.396783  4170 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:11.557513  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:11.390573  4126 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:11.597859  1701 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:11.396903  4119 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:11.637679  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.597958  2264 rpcz_store.cc:276] 0709 13:00:10.435852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.450939 (+ 15087us) service_pool.cc:224] Handling call
0709 13:00:11.413281 (+962342us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 13:00:11.417040 (+  3759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.442517 (+ 25477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.442559 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.442608 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:11.550625 (+108017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.550702 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.550854 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3455232}
W20260709 13:00:11.745352  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 150005us
W20260709 13:00:11.586894  4219 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:00:11.597443  1557 rpcz_store.cc:276] 0709 13:00:10.311437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.312278 (+   841us) service_pool.cc:224] Handling call
0709 13:00:10.322621 (+ 10343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:10.429805 (+107184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.429836 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:11.145283 (+715447us) log.cc:844] Serialized 52 byte log entry
0709 13:00:11.345611 (+200328us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:11.345743 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.345836 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:11.455893 (+110057us) raft_consensus.cc:1685] finished
0709 13:00:11.455926 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.456117 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":239939,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"thread_start_us":290715,"threads_started":2,"wal-append.queue_time_us":265987}
I20260709 13:00:11.599505  1552 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:11.390800  4113 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:11.417650  4187 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:11.580678  4024 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.779192  1556 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:11.453881  4045 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:11.405956  4215 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.376s
I20260709 13:00:11.744194  4099 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:11.775347  4205 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:11.801446  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 389808us
I20260709 13:00:11.452768  4063 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:11.780283  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.390273  4194 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.791635  4131 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:11.863108  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:11.867781  1526 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:11.738438  4108 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:11.775174  4007 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:00:11.738797  4115 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.879573  4113 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:11.440279  4216 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.780875  3889 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:11.815408  4024 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:11.984711  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:11.962505  1706 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:11.993552  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 71037.5us
W20260709 13:00:11.932497  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 375064us
I20260709 13:00:11.836229  4217 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:11.998709  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 627353us
I20260709 13:00:12.000800  1701 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
W20260709 13:00:11.983248  4220 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:00:11.982429  4218 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:00:12.006851  4107 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:12.007920  4115 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:12.008024  4020 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:12.008966  3849 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:12.011613  4216 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:11.884424  4194 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:11.861575  4045 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:12.013705  4045 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:12.014201  4045 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.887364  4017 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:12.018463  1599 connection.cc:256] RPC call timeout handler was delayed by -1.5093655640000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24660000000000004s for a response
I20260709 13:00:11.965313  4170 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:12.018935  4196 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:12.019311  4170 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:12.019590  4123 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:12.020399  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.020169  4123 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.020298  4170 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.023999  4211 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:12.024610  4211 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.025101  4211 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.026227  1555 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 13:00:12.026345  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1985) took 2165 ms (client timeout 2383 ms). Trace:
W20260709 13:00:12.026829  1629 rpcz_store.cc:269] 0709 13:00:09.861063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.288511 (+427448us) service_pool.cc:224] Handling call
0709 13:00:12.026176 (+1737665us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b540034dfd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:12.026288 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82475392}
I20260709 13:00:12.027341  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:12.029711  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1979) took 2170 ms. Trace:
I20260709 13:00:12.034586  4108 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:12.030781  2269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 659) took 2922 ms (client timeout 1970 ms). Trace:
W20260709 13:00:12.056182  2269 rpcz_store.cc:269] 0709 13:00:09.107909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.108059 (+   150us) service_pool.cc:224] Handling call
0709 13:00:12.030566 (+2922507us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400671e54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:12.030678 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3243925376}
I20260709 13:00:12.033653  1600 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:11.852247  4189 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:12.028035  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:12.047403  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46107.5us
I20260709 13:00:12.030485  4187 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:12.050149  1633 rpcz_store.cc:276] 0709 13:00:09.859102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.455018 (+595916us) service_pool.cc:224] Handling call
0709 13:00:10.455382 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.248948 (+793566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.029453 (+780505us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b540011fb54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:12.029653 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228413312}
I20260709 13:00:12.038568  4126 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:12.059706  3603 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:12.063596  4003 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:11.441859  4202 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.066079  4187 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.066828  4202 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:12.068681  4187 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:12.074805  3889 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:11.886917  4205 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:12.076572  4205 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.078114  4119 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.862083  4099 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.078662  4119 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.080574  4099 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:12.081166  4119 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:12.081840  4198 consensus_meta.cc:287] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.000s
I20260709 13:00:12.082307  4198 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.082851  4211 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:12.084115  4024 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:12.084261  4198 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:12.085386  4123 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:11.982954  4203 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:12.061260  1629 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:11.976962  4215 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:12.090402  4215 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.092630  4215 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:12.093024  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 103860us
W20260709 13:00:12.093385  1673 connection.cc:256] RPC call timeout handler was delayed by -1.5858580529999813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
I20260709 13:00:12.094005  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:12.094821  1673 connection.cc:256] RPC call timeout handler was delayed by -1.4884319870000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 13:00:12.095193  1673 connection.cc:256] RPC call timeout handler was delayed by -1.481045182999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 13:00:12.095516  1673 connection.cc:256] RPC call timeout handler was delayed by -1.4805580529999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
I20260709 13:00:11.884395  4091 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:12.098855  1673 connection.cc:256] RPC call timeout handler was delayed by -1.2730651250000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260709 13:00:12.099215  1673 connection.cc:256] RPC call timeout handler was delayed by -1.081631987000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
I20260709 13:00:12.106328  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.107194  1553 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:12.099112  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:11.890331  4131 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.112432  4194 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:00:12.114658  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.115236  2269 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:12.116297  3847 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:12.116370  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:12.117146  2266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 766) took 1680 ms (client timeout 2016 ms). Trace:
I20260709 13:00:11.875972  4063 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:12.117514  2266 rpcz_store.cc:269] 0709 13:00:10.437114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.439554 (+  2440us) service_pool.cc:224] Handling call
0709 13:00:12.116959 (+1677405us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400269154. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:12.117083 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611279616}
I20260709 13:00:12.143523  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1871) took 1706 ms. Trace:
I20260709 13:00:12.143962  1559 rpcz_store.cc:276] 0709 13:00:10.437022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.437708 (+   686us) service_pool.cc:224] Handling call
0709 13:00:10.438073 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.377227 (+939154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.143248 (+766021us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b5400385754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:12.143457 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2154480000}
I20260709 13:00:12.146867  1632 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:12.043143  4217 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.152976  4217 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:12.155435  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1765) took 2161 ms. Trace:
I20260709 13:00:12.155902  1705 rpcz_store.cc:276] 0709 13:00:09.994432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.203054 (+208622us) service_pool.cc:224] Handling call
0709 13:00:10.207918 (+  4864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.600226 (+1392308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.145548 (+545322us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000b7a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:12.155359 (+  9811us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2789067136}
I20260709 13:00:12.111167  4170 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:12.174680  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.174800  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:12.177606  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 65461.9us
I20260709 13:00:12.181255  1635 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.181783  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:12.183729  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:12.178377  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 133482us
I20260709 13:00:12.185111  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:12.112628  4091 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:12.186606  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:12.191398  1601 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:12.191591  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.190814  1707 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:12.194199  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:12.194962  1709 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:12.187916  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:12.197144  3603 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:12.197557  3603 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:12.197692  3938 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:12.190761  3999 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.198014  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.206884  1708 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:12.198899  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:12.200071  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.210002  1701 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:12.195951  1633 raft_consensus.cc:2376] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5. Re-sending same reply.
I20260709 13:00:12.154740  4201 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:12.219504  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:12.222730  1705 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:12.222847  1673 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Timed out: RequestConsensusVote RPC to 127.0.107.194:39441 timed out after 1.681s (SENT)
W20260709 13:00:12.236122  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 52493.6us
I20260709 13:00:12.218509  3999 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.206106  3938 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.237933  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:12.238319  3938 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:12.239668  1700 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:12.240500  4045 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.238884  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:12.198004  3603 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.252897  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.242357  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.245965  1635 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:12.236155  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:12.199548  4017 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:12.224520  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:12.206372  4211 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:12.214583  4194 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:12.253561  1552 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:12.216569  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.254261  1707 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:12.263470  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0305092109999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:00:12.258530  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:12.263900  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0282569820000163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260709 13:00:12.264235  1554 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
W20260709 13:00:12.264407  1526 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.099s (SENT)
I20260709 13:00:12.258708  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.264882  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:12.265518  1559 raft_consensus.cc:2410] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:12.259289  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.266605  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:12.267474  1551 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:12.267566  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44767.6us
I20260709 13:00:12.266661  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.255525  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:12.258853  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:12.263670  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.221613  4091 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:12.282812  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:12.253289  4227 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:12.285045  4227 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.285305  1556 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:12.285422  4227 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:12.285880  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:12.286705  4155 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:12.287667  1560 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:12.284446  1633 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 3: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:12.290302  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.291036  1627 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:12.291853  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:12.292861  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:12.294255  3999 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:12.257025  4201 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:12.295620  4201 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:12.296622  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.298112  4211 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:12.298398  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.299520  4091 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.303297  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.303918  1560 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:12.303948  4199 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:12.284050  2262 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:12.306344  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.307461  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1838) took 1100 ms. Trace:
I20260709 13:00:12.307544  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:12.307928  1706 rpcz_store.cc:276] 0709 13:00:11.207434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.207630 (+   196us) service_pool.cc:224] Handling call
0709 13:00:11.228097 (+ 20467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.004552 (+776455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.307259 (+302707us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54000b8454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:12.307409 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638637952}
I20260709 13:00:12.308911  4217 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:12.309417  4217 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:12.309641  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.310317  4217 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.311012  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 764) took 1874 ms. Trace:
I20260709 13:00:12.311396  2267 rpcz_store.cc:276] 0709 13:00:10.436216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.446302 (+ 10086us) service_pool.cc:224] Handling call
0709 13:00:12.310846 (+1864544us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400404054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:12.310954 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349587712}
I20260709 13:00:12.311800  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.312645  1635 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:12.314344  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:12.321846  2265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 761) took 1886 ms (client timeout 1992 ms). Trace:
W20260709 13:00:12.322504  2265 rpcz_store.cc:269] 0709 13:00:10.435196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.451494 (+ 16298us) service_pool.cc:224] Handling call
0709 13:00:12.314214 (+1862720us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:00:12.321767 (+  7553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3879808}
I20260709 13:00:12.261399  4203 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:12.323645  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.323859  4203 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:12.324306  4203 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:12.324369  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:12.289690  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:12.315225  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 712096us
I20260709 13:00:12.330667  1633 raft_consensus.cc:2393] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:12.293807  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.266795  4113 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:12.334853  4199 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.335404  4199 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.339154  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.325968  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:12.344134  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 119706us
I20260709 13:00:12.345094  2236 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:12.347198  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.347859  1627 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:12.358889  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.359608  1600 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:12.360459  1600 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:12.362735  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.383158  1707 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:12.380550  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:12.386591  4187 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:12.386801  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:12.387917  4187 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:12.376780  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:12.389216  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.344691  4211 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:12.398597  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1840) took 1173 ms. Trace:
I20260709 13:00:12.398102  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.351305  4045 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:00:12.392830  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.393406  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:12.402748  2264 raft_consensus.cc:2410] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:12.399091  1703 rpcz_store.cc:276] 0709 13:00:11.225431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.225603 (+   172us) service_pool.cc:224] Handling call
0709 13:00:12.397911 (+1172308us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54001c52d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:12.398016 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238395776}
I20260709 13:00:12.384119  4113 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:12.346653  4017 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:00:12.390833  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:12.408632  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:12.384374  4131 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:12.412019  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 471907us
W20260709 13:00:12.401161  3872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.765s	user 0.017s	sys 0.021s
W20260709 13:00:12.425280  3872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.789s	user 0.017s	sys 0.021s
I20260709 13:00:12.425264  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:12.400671  3999 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:12.426755  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.431382  1627 raft_consensus.cc:2368] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4.
I20260709 13:00:12.395604  4063 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:12.398067  3922 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:12.368574  4003 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:12.429206   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:12.429910  2266 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:00:12.433204  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 241916us
I20260709 13:00:12.440316  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.443653  2264 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:12.443768  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:12.408316  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:12.459494  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 68756.9us
I20260709 13:00:12.460157  2235 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:12.401091  4211 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.460822  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:12.462805  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:12.463824  1627 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:12.427191  4119 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:12.488114  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.489602  1635 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:12.432731  3922 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.492116  4119 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.498365  4119 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.499172  3938 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.501835  3938 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:12.502758  1634 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:12.506330  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.507755  1627 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:12.508312  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1682) took 1259 ms. Trace:
I20260709 13:00:12.508368  4227 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.508718  1627 rpcz_store.cc:276] 0709 13:00:11.248951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.507289 (+1258338us) service_pool.cc:224] Handling call
0709 13:00:12.507586 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.508105 (+   519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.508262 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.510434  4003 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.514420  2264 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:12.519881  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:12.489868  4007 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:00:12.521286  2264 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:12.526770  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.527875  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:12.559353  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:12.559374  1554 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:12.493084  4216 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:12.495311  3849 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:12.533810  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:12.566429  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.570098  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:12.570513  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 394540us
I20260709 13:00:12.496035  3922 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:12.572788  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.462383  4017 consensus_queue.cc:1243] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:12.490170  4189 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:12.575143  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.576774  2265 raft_consensus.cc:2393] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:00:12.582207  1599 leader_election.cc:336] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.790s (SENT)
I20260709 13:00:12.583279  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.594415  1705 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:12.584617  2266 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:12.490554  3847 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:00:12.526621  4045 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:12.587410  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:12.588459  4227 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:12.488585  4194 consensus_queue.cc:1059] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:00:12.593456  1709 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:12.526428  4063 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:12.605365  1635 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:12.577207  3849 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:12.605937  1599 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.818s (SENT)
I20260709 13:00:12.609740  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.571875  4187 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:12.577442  4216 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.530392  4155 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 13:00:12.616827  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.570917  4236 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:12.619149  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.651960  2265 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:12.652658  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.653497  1704 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 13:00:12.528716  3938 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
W20260709 13:00:12.612568  4126 consensus_meta.cc:287] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.549s	user 0.005s	sys 0.005s
I20260709 13:00:12.632369  4187 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.632660  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:12.655066  1706 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:12.632913  1702 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:12.633369  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:12.634559  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.658586  1707 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 13:00:12.635581  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.609376  4196 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.600889  4199 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:12.602834  4189 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:12.662257  1709 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 13:00:12.634385  3999 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:12.669389  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:12.679311  1704 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:12.628067  4227 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.649323  3849 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.649031  4216 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.674717  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:12.681162  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 237473us
I20260709 13:00:12.685824  2265 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:12.611164  3603 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.657884  4187 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:12.687453  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:12.691468  1601 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:12.661114  4126 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:12.671728  4236 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:12.683357  3999 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.702530  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:12.703204  4233 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:00:12.703527  3603 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:12.758004  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1681) took 1533 ms. Trace:
I20260709 13:00:12.655685  4063 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.706897  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:12.709143  4240 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:12.710583  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1680) took 1506 ms. Trace:
I20260709 13:00:12.791368  1632 rpcz_store.cc:276] 0709 13:00:11.204585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.775719 (+571134us) service_pool.cc:224] Handling call
0709 13:00:12.146635 (+370916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.147276 (+   641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.710324 (+563048us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b540018e7d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:12.710487 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":807012736}
I20260709 13:00:12.714656  4113 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:12.717724  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.693181  4045 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:12.720041  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 114198us
I20260709 13:00:12.672353  4189 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.794248  2266 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:12.794541  1599 leader_election.cc:336] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.840s (SENT)
I20260709 13:00:12.585476  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:12.722513  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 355777us
I20260709 13:00:12.777935  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:12.795909  1554 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 5: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:12.778841  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:12.780215  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.796576  1556 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:12.796649  1557 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:12.684234  4227 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:12.781836  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.801362  1552 raft_consensus.cc:2410] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:12.693902  4242 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:12.789768  2265 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:12.793885  1553 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 5: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:12.795035  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:12.781018  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.797693  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.741024  4007 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:12.808231  4211 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:12.808387  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:12.818171  4007 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:12.819193  4007 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.819825  4215 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:12.820425  4215 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:12.821724  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1676) took 1644 ms. Trace:
I20260709 13:00:12.822091  1628 rpcz_store.cc:276] 0709 13:00:11.176945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.595960 (+419015us) service_pool.cc:224] Handling call
0709 13:00:11.596285 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.798515 (+202230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.798568 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.839179 (+ 40611us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.368784 (+529605us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:12.368827 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.369875 (+  1048us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.821510 (+451635us) raft_consensus.cc:1685] finished
0709 13:00:12.821533 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.821670 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37919,"raft.queue_time_us":43864,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":20340,"thread_start_us":476361,"threads_started":1,"wal-append.queue_time_us":722388}
I20260709 13:00:12.826411  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:12.826699  4238 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:12.787979  4156 raft_consensus.cc:2764] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:12.815083  2270 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:12.810169  1453 catalog_manager.cc:5697] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.833354  2269 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:12.820492  4007 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:12.797610  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.838165  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.837283  1555 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
W20260709 13:00:12.838115  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 373278us
I20260709 13:00:12.846611  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.777937  1631 rpcz_store.cc:276] 0709 13:00:11.224396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.982639 (+758243us) service_pool.cc:224] Handling call
0709 13:00:11.983094 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.983550 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.983582 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.984087 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.241297 (+257210us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b180044d580. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:00:12.614456 (+373159us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:12.614498 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.614571 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.724744 (+110173us) raft_consensus.cc:1685] finished
0709 13:00:12.724763 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.757896 (+ 33133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":787,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":8851,"spinlock_wait_cycles":82912000,"thread_start_us":372953,"threads_started":1,"wal-append.queue_time_us":684629}
W20260709 13:00:12.850849  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.807703  3603 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:12.862560  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.867965  1559 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:12.863040  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1978) took 3016 ms. Trace:
I20260709 13:00:12.821477  4215 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.864723  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:12.871080  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 445891us
I20260709 13:00:12.800665  3938 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:12.872462  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.918774  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1678) took 1732 ms. Trace:
I20260709 13:00:12.928436  1556 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
W20260709 13:00:12.928566  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 57318.4us
I20260709 13:00:12.868744  1626 rpcz_store.cc:276] 0709 13:00:09.858674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.438456 (+579782us) service_pool.cc:224] Handling call
0709 13:00:10.438792 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:10.470619 (+ 31827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.470658 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:12.120153 (+1649495us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b2c0005c228. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2
0709 13:00:12.207910 (+ 87757us) log.cc:844] Serialized 52 byte log entry
0709 13:00:12.723095 (+515185us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:12.723128 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.723198 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.835178 (+111980us) raft_consensus.cc:1685] finished
0709 13:00:12.835205 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.847430 (+ 12225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":609164,"raft.queue_time_us":35074,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":12335,"spinlock_wait_cycles":13369088,"thread_start_us":460770,"threads_started":1,"wal-append.queue_time_us":547988}
I20260709 13:00:12.956579  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:12.956993  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 162484us
W20260709 13:00:12.959478  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.804667  4203 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.932979  2266 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:12.933570  1630 rpcz_store.cc:276] 0709 13:00:11.186537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.598258 (+411721us) service_pool.cc:224] Handling call
0709 13:00:12.037335 (+439077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.037726 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.037759 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:12.069545 (+ 31786us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.395561 (+326016us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:12.395600 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.395666 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.724055 (+328389us) raft_consensus.cc:1685] finished
0709 13:00:12.724074 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.894862 (+170788us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b540034dfd0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:12.918695 (+ 23833us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":590,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":9876,"spinlock_wait_cycles":603863296,"thread_start_us":325633,"threads_started":1,"wal-append.queue_time_us":538899}
I20260709 13:00:12.896425  4242 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:12.965533  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:12.861949  4131 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:12.977301  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:12.979770  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:12.980762  1555 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:12.966404  1453 catalog_manager.cc:5697] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.979821  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:12.934667  2263 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:12.874683  3603 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:12.988260  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.988929  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.991603  1634 raft_consensus.cc:2410] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:12.830266  4236 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:12.997289  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:12.997921  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:12.997978  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:13.007687  2266 raft_consensus.cc:2393] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:13.003731  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:13.005039  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:13.009022  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:13.007017  1626 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 13:00:13.011631  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:13.012336  1635 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:13.005995  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 484973us
I20260709 13:00:13.003547  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:13.014444  1632 raft_consensus.cc:2410] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:13.014292  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:12.971297  4131 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:12.980943  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:13.028244  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 442857us
I20260709 13:00:13.019793  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:13.020915  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:13.023041  1634 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:12.995522  3603 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:13.030905  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:13.042744  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 351382us
I20260709 13:00:12.955997  3938 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:13.018508  1453 catalog_manager.cc:5697] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 4, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:13.043874  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:13.018327  1673 leader_election.cc:400] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4.
W20260709 13:00:13.019203  4205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.012s	sys 0.008s
I20260709 13:00:13.048164  1673 leader_election.cc:403] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:13.046277  1674 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:13.050071  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:13.051414  1628 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:13.048961  4003 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:13.061102  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:13.065375  4249 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:00:13.067274  4045 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:13.067915  4253 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:12.988677  4187 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:13.072693  4246 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:13.073190  3849 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:13.074059  4250 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.074949  1601 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:13.030961  4201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.020s
I20260709 13:00:13.069600  3999 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:13.343976  4201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.008s	sys 0.032s
I20260709 13:00:13.052865  4108 consensus_queue.cc:1059] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.292s
W20260709 13:00:13.336198  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.345625  4260 raft_consensus.cc:3055] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:13.346408  4260 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:13.346740  3999 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:13.348088  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 273196us
I20260709 13:00:13.347754  4260 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:13.349221  4155 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:13.349437  4260 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:13.285919  4063 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:13.065833  2265 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:13.352085  1601 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:13.078042  2264 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:13.172649  4227 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:13.353050  4265 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:13.354007  4265 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:13.103334  1633 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
W20260709 13:00:13.354810  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 308606us
I20260709 13:00:13.052419  2262 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:13.129115  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 331196us
I20260709 13:00:13.356868  1703 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:13.355002  4265 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:13.359797  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:13.197636  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 183449us
W20260709 13:00:13.353839  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 360999us
I20260709 13:00:13.147781  1631 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:00:13.362294  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:13.078788  1634 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:13.084707  1453 catalog_manager.cc:5697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.367324  2266 raft_consensus.cc:2410] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:13.359092  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:00:13.087738  4248 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:00:13.365829  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:13.383494  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.371788  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:13.364529  1631 pending_rounds.cc:85] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 7
I20260709 13:00:13.390210  1631 pending_rounds.cc:107] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:00:13.390926  1631 raft_consensus.cc:2889] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:13.368764  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.357020  4063 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:13.390147  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:13.397079  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:13.397943  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:13.398923  1703 raft_consensus.cc:2410] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:13.397190  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:13.399421  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 388166us
I20260709 13:00:13.399777  1700 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:13.397986  1701 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:13.400775  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:13.049770  4194 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:13.079717  4217 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:13.302470  4131 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:13.405282  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 533) took 1253 ms. Trace:
I20260709 13:00:13.403343  4123 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:13.077975  4216 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:13.363641  4205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.019s	sys 0.010s
I20260709 13:00:13.370263  4250 consensus_queue.cc:1243] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:00:13.173172  4258 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:00:13.402254  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:13.227365  4254 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:13.082643  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.414973  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:13.444568  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:13.421921  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.395466  4198 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:13.412644  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 53645.6us
I20260709 13:00:13.435061  2269 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:13.393277  4267 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:13.436299  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.436712  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:13.422827  1627 rpcz_store.cc:276] 0709 13:00:12.152067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.509593 (+357526us) service_pool.cc:224] Handling call
0709 13:00:12.509901 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.554821 (+ 44920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.554867 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:12.574477 (+ 19610us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.995424 (+420947us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:13.044977 (+ 49553us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.045248 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.045337 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.405050 (+359713us) raft_consensus.cc:1685] finished
0709 13:00:13.405069 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.405211 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46348,"prepare.queue_time_us":50025,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":99148,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":46567,"thread_start_us":374630,"threads_started":1,"wal-append.queue_time_us":721278}
I20260709 13:00:13.357226  4045 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:00:13.081626  3922 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:13.413091  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:13.401432  4063 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.453315  2262 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:13.420262  4155 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:00:13.453958  1701 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:13.531526  1700 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:13.458189  1631 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:13.404821  4262 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:13.532742  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.415506  1453 catalog_manager.cc:5697] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.532897  2266 raft_consensus.cc:2376] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5. Re-sending same reply.
W20260709 13:00:13.533339  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 444543us
I20260709 13:00:13.457401  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:13.533833  1709 pending_rounds.cc:85] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 1
I20260709 13:00:13.538694  1709 pending_rounds.cc:107] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:00:13.539354  1709 raft_consensus.cc:2889] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:13.424795  4203 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:13.540709  1601 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:13.411523  4263 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:13.534446  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:13.479291  4119 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.980s	user 0.008s	sys 0.003s
I20260709 13:00:13.420527  4003 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:13.441947  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:13.534157  2264 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:13.439806  4156 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:13.482766  4170 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.293s	user 0.008s	sys 0.006s
I20260709 13:00:13.471225  2263 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:13.544814  1703 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:13.464387  4264 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:00:13.549697  1453 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:00:13.543296  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:13.462239  4017 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:13.529767  4267 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.553139  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:13.549551  4242 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:13.540336  4189 consensus_meta.cc:287] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.725s	user 0.005s	sys 0.005s
I20260709 13:00:13.553622  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:13.471766  4187 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:13.542951  4250 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:00:13.555474  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 113667us
I20260709 13:00:13.457728  4268 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:13.441402  4194 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:00:13.443176  4254 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:13.456136  3938 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:13.454398  4252 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:13.536909  4063 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:13.461001  4216 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:13.650522  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 203869us
I20260709 13:00:13.659946  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:13.648846  4115 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
W20260709 13:00:13.663941  4273 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:00:13.443322  4227 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:00:13.664701  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.664978  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.665127  4216 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:13.665676  2263 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:13.579770  1705 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:00:13.666594  1627 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:13.657934  4252 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.470489  4201 raft_consensus.cc:3055] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:13.585134  4236 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:13.585597  4003 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:13.552363  4156 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.582304  4170 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:13.586704  4017 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:13.582598  4091 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.587487  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.588023  4267 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:13.588290  4275 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 13:00:13.565201  4261 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:13.589779  4270 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:00:13.556713  4196 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.885s	user 0.013s	sys 0.000s
I20260709 13:00:13.476783  3603 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:13.585522  1453 catalog_manager.cc:5697] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 5, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.465935  3849 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:13.482141  4259 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 13:00:13.611351  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:13.618115  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 217441us
I20260709 13:00:13.605937  2267 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:13.689013  4236 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:13.661335  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:13.716076  1674 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:13.716645  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 55409.7us
I20260709 13:00:13.714802  2264 raft_consensus.cc:2376] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6. Re-sending same reply.
I20260709 13:00:13.582767  2266 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:13.606159  4242 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:13.686349  4262 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:13.666651  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.669576  4201 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:13.651238  4254 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:13.687733  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.606505  4189 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:13.676230  4156 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:13.673547  4123 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:00:13.702988  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.668886  4198 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:13.670253  4252 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:13.712893  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.562180  4119 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:13.667080  1705 pending_rounds.cc:85] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 2
I20260709 13:00:13.765892  1705 pending_rounds.cc:107] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:00:13.766218  1705 raft_consensus.cc:2889] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:13.766068  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:13.726280  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:13.564399  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.727344  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:13.732496  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.718247  1524 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:13.690342  4115 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:00:13.736678  1453 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 5 to 6, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.692162  4126 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:00:13.691982  4253 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:00:13.740785  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:13.741214  1553 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:13.712205  4196 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:13.738194  2271 raft_consensus.cc:2376] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6. Re-sending same reply.
I20260709 13:00:13.691409  4017 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:13.694808  4091 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:13.758713  2263 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:13.730542  4216 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:13.795450  2264 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:13.768193  4215 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:13.798944  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:13.799214  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1858) took 1232 ms. Trace:
I20260709 13:00:13.766157  3922 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:13.732867  4259 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:13.799602  1708 rpcz_store.cc:276] 0709 13:00:12.566824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.566963 (+   139us) service_pool.cc:224] Handling call
0709 13:00:12.588054 (+ 21091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.020722 (+432668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.020769 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.041455 (+ 20686us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.406128 (+364673us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:13.587621 (+181493us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:13.618930 (+ 31309us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.648356 (+ 29426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.648433 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.772744 (+124311us) raft_consensus.cc:1685] finished
0709 13:00:13.799017 (+ 26273us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.799153 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27017,"prepare.queue_time_us":269558,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":3757,"raft.queue_time_us":263127,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":6662,"spinlock_wait_cycles":156426112,"thread_start_us":907885,"threads_started":3,"wal-append.queue_time_us":380569}
I20260709 13:00:13.769618  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.770989  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:13.786728  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:13.785601  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:13.706148  4261 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:13.811185  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:13.825619  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 109619us
I20260709 13:00:13.811772  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1886) took 1094 ms. Trace:
I20260709 13:00:13.811934  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.814378  1627 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:13.826979  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:13.818152  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 99998.9us
I20260709 13:00:13.825042  1629 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:13.763957  2266 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:13.826721  1560 rpcz_store.cc:276] 0709 13:00:12.716957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.721308 (+  4351us) service_pool.cc:224] Handling call
0709 13:00:12.779755 (+ 58447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.800799 (+ 21044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.800831 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:12.831764 (+ 30933us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.185112 (+353348us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:13.185165 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.185439 (+   274us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.589184 (+403745us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:13.798296 (+209112us) raft_consensus.cc:1685] finished
0709 13:00:13.798328 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.811691 (+ 13363us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23900,"raft.run_cpu_time_us":45,"raft.run_wall_time_us":45,"spinlock_wait_cycles":64679296,"thread_start_us":336175,"threads_started":1,"wal-append.queue_time_us":610206}
I20260709 13:00:13.834764  1674 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:13.825354  1453 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:00:13.861284  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 93639.5us
I20260709 13:00:13.861280  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:13.795637  4216 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.869019  4242 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:13.809018  3603 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:13.769591  4155 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:00:13.805058  4215 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:13.872550  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:13.881047  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:13.830765  4108 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:13.825018  4259 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:13.885702  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.887233  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:13.883833  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:13.771091  4268 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:00:13.888441  1551 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:13.866272  4216 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:13.886168  1453 catalog_manager.cc:5697] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:13.921285  1453 catalog_manager.cc:5697] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 3, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.870242  4299 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:00:13.923807  1554 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:13.874480  2262 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:13.885061  4275 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:13.931250  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.862124  4285 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:13.934334  1453 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 3, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:13.947299  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 60161.7us
W20260709 13:00:13.953080  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 304130us
I20260709 13:00:13.959064  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:13.961122  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 51123us
I20260709 13:00:13.865304  4203 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:13.880353  4260 consensus_meta.cc:287] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.001s
I20260709 13:00:13.971303  2268 raft_consensus.cc:2410] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 8 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 13:00:13.969905  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:13.939378  4265 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.939385  4283 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.882457  4045 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:13.955989  4286 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:14.008497  1635 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:14.009922  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:13.980589  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:13.952171  4123 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:13.831154  4236 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:13.958696  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.879230  4262 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:13.950776  4285 raft_consensus.cc:697] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:13.977284  4163 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.958453  3849 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:14.011899  1600 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:14.016553  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:14.036046  2262 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:14.036978  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:14.037544  2262 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:13.874092  4196 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.106s
I20260709 13:00:13.975169  4291 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.017370  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:14.058352  2268 raft_consensus.cc:2376] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6. Re-sending same reply.
I20260709 13:00:13.948560  4279 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:00:14.026786  4278 raft_consensus.cc:2764] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:14.033553  1599 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:14.076324  1599 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:13.931939  4198 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:14.007889  4189 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:13.985040  4045 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:14.008497  3999 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.007828  4299 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:14.008234  4260 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:14.072643  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:14.090875  2271 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:14.031509  4123 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:14.094069  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:14.095907  1627 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:13.985148  4265 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:14.038964  4291 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:14.014992  4203 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:14.035172  4259 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:14.009702  4283 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:14.059875  3849 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:14.055150  4163 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:14.019213  4215 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:14.578593  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.093467  4045 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:14.514487  1709 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.008s	sys 0.007s
W20260709 13:00:14.625890  1709 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.008s	sys 0.011s
I20260709 13:00:14.245000  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 571) took 1231 ms. Trace:
W20260709 13:00:14.528141  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1698) took 1524 ms (client timeout 1947 ms). Trace:
I20260709 13:00:14.153568  2262 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:14.184269  2268 raft_consensus.cc:2368] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6.
I20260709 13:00:14.166780  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:14.629805  1555 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:00:14.190668  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 309737us
W20260709 13:00:14.371481  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 359651us
W20260709 13:00:14.340250  4282 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.325s	user 0.000s	sys 0.000s
W20260709 13:00:14.437942  1526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.603s (SENT) [suppressed 45 similar messages]
I20260709 13:00:14.626951  2269 rpcz_store.cc:276] 0709 13:00:13.013637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.083343 (+ 69706us) service_pool.cc:224] Handling call
0709 13:00:13.083630 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.533902 (+450272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.244707 (+710805us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400566b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:14.244921 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776027008}
I20260709 13:00:14.623822  4259 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:14.631621  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:14.632869  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.627220  1629 rpcz_store.cc:269] 0709 13:00:13.003646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.019539 (+ 15893us) service_pool.cc:224] Handling call
0709 13:00:14.527920 (+1508381us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b5400165dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:14.528074 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1775516544}
I20260709 13:00:14.086902  4279 consensus_queue.cc:1243] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:14.634672  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:14.640165  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:14.644721  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:14.646461  4293 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:14.646770  4268 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:14.250140  4306 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:14.647886  4003 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:14.648772  4267 consensus_meta.cc:287] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.946s	user 0.008s	sys 0.002s
I20260709 13:00:14.701820  1700 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:14.648506  4201 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:14.650720  3849 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:14.198845  4123 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:14.653669  4216 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.719s	user 0.004s	sys 0.003s
W20260709 13:00:14.247591  2267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 773) took 1893 ms (client timeout 1962 ms). Trace:
I20260709 13:00:14.762694  1555 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:14.251190  4091 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:14.199833  4302 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
W20260709 13:00:14.199260  4290 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:00:14.133388  4299 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:14.241025  4278 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.418s
I20260709 13:00:14.324469  4017 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:14.659667  1704 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:00:14.201923  4281 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.406s	user 0.001s	sys 0.001s
W20260709 13:00:14.324095  4284 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 13:00:14.529649  4263 consensus_meta.cc:287] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.968s	user 0.012s	sys 0.000s
W20260709 13:00:14.587525  4063 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.919s	user 0.010s	sys 0.001s
W20260709 13:00:14.592239  4254 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.844s	user 0.001s	sys 0.008s
W20260709 13:00:14.670832  1552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.011s	sys 0.017s
W20260709 13:00:14.822382  1552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.012s	sys 0.018s
I20260709 13:00:14.133272  4250 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:14.244144  4305 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:14.239301  4189 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:14.681058  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.021s	sys 0.017s
W20260709 13:00:14.833011  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.021s	sys 0.017s
I20260709 13:00:14.201396  4285 consensus_queue.cc:237] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:14.687409  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:14.643352  4217 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:14.688544  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:14.856148  2271 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:14.518623  4187 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:14.624719  4203 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:14.869352  1708 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:14.644296  4131 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:14.701609  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.006s	sys 0.020s
I20260709 13:00:14.640164  4110 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:14.103236  3999 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:14.797920  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:14.801832  1555 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:14.807399  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 369583us
I20260709 13:00:14.879518  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 387) took 1095 ms. Trace:
I20260709 13:00:14.788345  4201 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:14.641650  1553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:38648
I20260709 13:00:14.880911  1553 raft_consensus.cc:606] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:14.881372  1553 raft_consensus.cc:614] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:14.762797  4279 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
W20260709 13:00:14.833736  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 757491us
I20260709 13:00:14.672379  2269 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:14.884600  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 674) took 1113 ms. Trace:
I20260709 13:00:14.884701  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:14.885098  2269 rpcz_store.cc:276] 0709 13:00:13.771147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.644334 (+873187us) service_pool.cc:224] Handling call
0709 13:00:14.884518 (+240184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.707727  4267 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:14.837039  4163 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:14.889395  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38648 (request call id 16) took 1002 ms. Trace:
I20260709 13:00:14.822466  4263 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4.
I20260709 13:00:14.837136  4291 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:14.842386  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1859) took 2275 ms. Trace:
I20260709 13:00:14.843456  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1794) took 1311 ms. Trace:
I20260709 13:00:14.822975  4215 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.828047  4254 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:14.816303  4265 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:14.789317  4216 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:14.859010  1551 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.889s	user 0.011s	sys 0.000s
I20260709 13:00:14.865298  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 676) took 1093 ms. Trace:
I20260709 13:00:14.871837  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:14.909633  1551 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:14.909904  2262 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:14.868196  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 388) took 1075 ms. Trace:
W20260709 13:00:14.873274  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.006s	sys 0.020s
W20260709 13:00:14.841606  4288 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.006s	user 0.007s	sys 0.009s
W20260709 13:00:14.763347  2267 rpcz_store.cc:269] 0709 13:00:12.354076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.363350 (+  9274us) service_pool.cc:224] Handling call
0709 13:00:14.247403 (+1884053us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54005933d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:14.247532 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2512265472}
I20260709 13:00:14.874444  4187 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:14.879854  1526 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.756s (SENT)
I20260709 13:00:14.894122  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:14.923792  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 43981.5us
I20260709 13:00:14.924015  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 778) took 1063 ms. Trace:
I20260709 13:00:14.924567  2269 rpcz_store.cc:276] 0709 13:00:13.860916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.893806 (+1032890us) service_pool.cc:224] Handling call
0709 13:00:14.923934 (+ 30128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.902252  4215 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:14.935635  2262 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:14.936252  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 783) took 1041 ms. Trace:
I20260709 13:00:14.936558  2262 rpcz_store.cc:276] 0709 13:00:13.895225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.871505 (+976280us) service_pool.cc:224] Handling call
0709 13:00:14.936188 (+ 64683us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.828528  4063 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:14.847577  4189 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:14.897980  1706 rpcz_store.cc:276] 0709 13:00:13.532076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.533115 (+  1039us) service_pool.cc:224] Handling call
0709 13:00:13.545945 (+ 12830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.554343 (+  8398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.554376 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.554844 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.693811 (+138967us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:13.693870 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.693973 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.843256 (+1149283us) raft_consensus.cc:1685] finished
0709 13:00:14.843276 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.843396 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22904,"raft.queue_time_us":16388,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":107050,"threads_started":1,"wal-append.queue_time_us":249638}
I20260709 13:00:14.875762  4110 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:14.905580  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 389) took 1109 ms. Trace:
I20260709 13:00:14.896507  1702 rpcz_store.cc:276] 0709 13:00:12.567175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.668315 (+101140us) service_pool.cc:224] Handling call
0709 13:00:12.668655 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.001300 (+332645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.001348 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.020532 (+ 19184us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.615615 (+595083us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:13.615675 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.615793 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.842100 (+1226307us) raft_consensus.cc:1685] finished
0709 13:00:14.842122 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.842303 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":150642,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":787556,"threads_started":2,"wal-append.queue_time_us":674077}
I20260709 13:00:14.907765  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:14.910203  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 391) took 1047 ms. Trace:
W20260709 13:00:14.910645  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 832040us
I20260709 13:00:14.910434  1560 rpcz_store.cc:276] 0709 13:00:13.792748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.867218 (+1074470us) service_pool.cc:224] Handling call
0709 13:00:14.867564 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.867882 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.867910 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.867950 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:14.867977 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.868033 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.868144 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":21073}
I20260709 13:00:14.942745  1551 rpcz_store.cc:276] 0709 13:00:13.862377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.866887 (+  4510us) service_pool.cc:224] Handling call
0709 13:00:14.910145 (+1043258us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:14.894793  4252 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.104s	user 0.011s	sys 0.000s
I20260709 13:00:14.879851  1555 rpcz_store.cc:276] 0709 13:00:13.784446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.793293 (+1008847us) service_pool.cc:224] Handling call
0709 13:00:14.793669 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.879244 (+ 85575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.879462 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.944697  1599 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:14.925625  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:14.946488  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:14.889891  1553 rpcz_store.cc:276] 0709 13:00:13.886829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.641381 (+754552us) service_pool.cc:224] Handling call
0709 13:00:14.881800 (+240419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.906867  4163 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:14.909662  2271 rpcz_store.cc:276] 0709 13:00:13.771722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.645010 (+873288us) service_pool.cc:224] Handling call
0709 13:00:14.865232 (+220222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.941213  1554 rpcz_store.cc:276] 0709 13:00:13.796641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.888590 (+1091949us) service_pool.cc:224] Handling call
0709 13:00:14.904927 (+ 16337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.905148 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.905185 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.905240 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:14.905284 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.905353 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.905506 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.942164  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:14.946758  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 782) took 1063 ms. Trace:
I20260709 13:00:14.950237  2269 rpcz_store.cc:276] 0709 13:00:13.883374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.925387 (+1042013us) service_pool.cc:224] Handling call
0709 13:00:14.946681 (+ 21294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.947594  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 675) took 1176 ms. Trace:
I20260709 13:00:14.953019  2262 rpcz_store.cc:276] 0709 13:00:13.771438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.946192 (+1174754us) service_pool.cc:224] Handling call
0709 13:00:14.947524 (+  1332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.955178  1702 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:14.960011  1526 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.166s (SENT)
I20260709 13:00:14.960770  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:14.972569  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:14.973575  1553 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:14.939881  4156 consensus_meta.cc:287] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.174s	user 0.011s	sys 0.000s
I20260709 13:00:14.976112  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:14.976490  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:14.978366  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:14.951908  1704 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
W20260709 13:00:14.980788  1526 leader_election.cc:336] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.167s (SENT)
I20260709 13:00:14.940459  4003 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:15.010214  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:14.945076  4263 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.010941  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 785) took 1081 ms. Trace:
I20260709 13:00:14.954285  4265 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:15.012765  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.015034  2271 rpcz_store.cc:276] 0709 13:00:13.929391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.948518 (+1019127us) service_pool.cc:224] Handling call
0709 13:00:15.010146 (+ 61628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.010426 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.010457 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.010544 (+    87us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:15.010580 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.010676 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.010869 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.008455  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.011247  1599 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:15.010978  1704 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 13:00:15.019907  1702 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:15.008868  4156 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:15.023666  4216 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.010500  4163 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:15.025233  4156 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.025183  4163 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.028239  1704 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:15.006886  4303 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.981724  4324 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:15.007630  4262 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:15.044397  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:15.007633  4313 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
W20260709 13:00:15.051170  4325 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:00:15.052940  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 385) took 1295 ms. Trace:
I20260709 13:00:15.078680  1552 rpcz_store.cc:276] 0709 13:00:13.757667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.771082 (+ 13415us) service_pool.cc:224] Handling call
0709 13:00:13.771558 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.863424 (+ 91866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.863462 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.863891 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.822901 (+959010us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:14.822957 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.823047 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.052720 (+229673us) raft_consensus.cc:1685] finished
0709 13:00:15.052737 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.052881 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107178,"raft.queue_time_us":111294,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":46350,"thread_start_us":891121,"threads_started":1,"wal-append.queue_time_us":1022060}
I20260709 13:00:15.053462  4283 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:15.054247  4320 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:00:15.054436  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1793) took 1522 ms. Trace:
I20260709 13:00:14.966353  4252 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.056267  4119 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.057410  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1624) took 1335 ms. Trace:
I20260709 13:00:15.087652  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:15.088376  1704 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:15.060628  4317 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.062112  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:15.092902  2265 raft_consensus.cc:2368] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7.
I20260709 13:00:15.068585  4254 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.069337  4216 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.086707  1556 rpcz_store.cc:276] 0709 13:00:13.722056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.722618 (+   562us) service_pool.cc:224] Handling call
0709 13:00:13.723097 (+   479us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:13.732778 (+  9681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.732812 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:13.733381 (+   569us) log.cc:844] Serialized 52 byte log entry
0709 13:00:14.342650 (+609269us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b1800416f80. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:00:14.802122 (+459472us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:14.802193 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.802288 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.057106 (+254818us) raft_consensus.cc:1685] finished
0709 13:00:15.057129 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.057346 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2590,"raft.queue_time_us":2915,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7274,"spinlock_wait_cycles":11614592,"thread_start_us":459201,"threads_started":1,"wal-append.queue_time_us":1242659}
W20260709 13:00:15.070222  4304 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.990s	user 0.007s	sys 0.006s
I20260709 13:00:15.070325  4063 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:15.070506  4261 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:15.077133  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:15.077486  4306 raft_consensus.cc:2764] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:15.081209  1709 rpcz_store.cc:276] 0709 13:00:13.531775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.533271 (+  1496us) service_pool.cc:224] Handling call
0709 13:00:13.533618 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:13.555066 (+ 21448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.555099 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:13.555642 (+   543us) log.cc:844] Serialized 52 byte log entry
0709 13:00:13.688395 (+132753us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:14.626290 (+937895us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.633368 (+  7078us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.634259 (+   891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.634333 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.840619 (+206286us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:15.054204 (+213585us) raft_consensus.cc:1685] finished
0709 13:00:15.054234 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.054380 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37207,"prepare.queue_time_us":353666,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":18807,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":14717,"spinlock_wait_cycles":70918016,"thread_start_us":997090,"threads_started":2,"wal-append.queue_time_us":200708}
W20260709 13:00:15.098449  1673 leader_election.cc:336] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.522s (SENT)
I20260709 13:00:15.110822  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:15.112182  1673 leader_election.cc:336] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.629s (SENT)
W20260709 13:00:15.112942  1673 leader_election.cc:336] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.646s (SENT)
W20260709 13:00:15.113641  1673 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.659s (SENT)
I20260709 13:00:15.113993  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:15.101588  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 687) took 1308 ms. Trace:
I20260709 13:00:15.114632  2265 rpcz_store.cc:276] 0709 13:00:13.793482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.061830 (+1268348us) service_pool.cc:224] Handling call
0709 13:00:15.101506 (+ 39676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.007061  4250 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:00:15.117107  4331 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:15.117772  4331 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:15.118999  1673 leader_election.cc:336] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.662s (SENT)
W20260709 13:00:15.120069  1673 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.694s (SENT)
I20260709 13:00:15.095681  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.120813  1704 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:15.122012  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:15.072829  4324 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:00:15.084722  4315 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:00:15.109354  1557 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:15.054425  1706 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 4.
I20260709 13:00:15.026829  4263 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:15.103474  1630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.014s	sys 0.031s
W20260709 13:00:15.131021  1630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.015s	sys 0.031s
I20260709 13:00:15.123433  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.126457  1556 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:15.132423  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1629) took 1147 ms. Trace:
I20260709 13:00:15.132755  1556 rpcz_store.cc:276] 0709 13:00:13.985095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.103333 (+1118238us) service_pool.cc:224] Handling call
0709 13:00:15.126236 (+ 22903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.132179 (+  5943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.132370 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.086342  4299 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.133960  1556 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:00:15.135251  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1631) took 1149 ms. Trace:
I20260709 13:00:15.135658  1556 rpcz_store.cc:276] 0709 13:00:13.985810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.133465 (+1147655us) service_pool.cc:224] Handling call
0709 13:00:15.133756 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:15.135007 (+  1251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.135202 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.137182  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1632) took 1151 ms. Trace:
I20260709 13:00:15.137555  1556 rpcz_store.cc:276] 0709 13:00:13.986129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.136485 (+1150356us) service_pool.cc:224] Handling call
0709 13:00:15.136744 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.136901 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.136923 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.136960 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:15.136987 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.137038 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.137131 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.133924  1700 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:15.128895  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:15.139209  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:15.139654  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1633) took 1153 ms. Trace:
I20260709 13:00:15.140097  1556 rpcz_store.cc:276] 0709 13:00:13.986441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.138911 (+1152470us) service_pool.cc:224] Handling call
0709 13:00:15.139152 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.139319 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.139397 (+    78us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.139434 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:15.139465 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.139512 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.139602 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.142050  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1634) took 1155 ms. Trace:
I20260709 13:00:15.142773  1629 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:00:15.134773  4003 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:15.072165  4303 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:15.125743  4119 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:15.136474  4286 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.117s	user 0.012s	sys 0.000s
I20260709 13:00:15.147977  1553 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:15.149271  1629 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:15.151273  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.154094  1709 raft_consensus.cc:2376] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5. Re-sending same reply.
I20260709 13:00:15.155190  3603 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.155676  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.177317  1706 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:15.162374  3938 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:15.163839  4198 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:15.103330  4317 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.140671  4187 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.169176  1633 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:15.219743  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.170110  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:15.220742  1627 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:15.165190  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.135462  4324 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:15.191515  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 70521.7us
I20260709 13:00:15.221311  1707 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:15.191428  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:15.222445  1673 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Timed out: RequestConsensusVote RPC to 127.0.107.194:39441 timed out after 1.947s (SENT)
I20260709 13:00:15.222851  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:15.223315  1673 leader_election.cc:336] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.970s (SENT)
I20260709 13:00:15.223549  1553 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:15.223721  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:15.224351  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:15.142477  1556 rpcz_store.cc:276] 0709 13:00:13.986742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.141274 (+1154532us) service_pool.cc:224] Handling call
0709 13:00:15.141518 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.141743 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:15.141765 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.141815 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:15.141845 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.141897 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.141987 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:15.211447  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 60909.6us
I20260709 13:00:15.227535  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.109942  4216 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:15.228176  1706 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:15.228400  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1796) took 1630 ms. Trace:
I20260709 13:00:15.229061  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.225561  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:15.230746  1556 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:15.227970  1601 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:15.232378  1601 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:15.234097  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:15.175225  4252 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:15.235412  1556 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:15.237884  1629 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
W20260709 13:00:15.219169  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.228850  1703 rpcz_store.cc:276] 0709 13:00:13.598478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.598610 (+   132us) service_pool.cc:224] Handling call
0709 13:00:13.647215 (+ 48605us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:13.747569 (+100354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.747597 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:13.763541 (+ 15944us) log.cc:844] Serialized 52 byte log entry
0709 13:00:14.268072 (+504531us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:14.268130 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.268233 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.228192 (+959959us) raft_consensus.cc:1685] finished
0709 13:00:15.228213 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.228347 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8858,"raft.queue_time_us":47986,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":16744,"thread_start_us":502600,"threads_started":2,"wal-append.queue_time_us":1094933}
W20260709 13:00:15.236565  1673 leader_election.cc:336] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.087s (SENT)
I20260709 13:00:15.175671  4267 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:15.238902  1558 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:00:15.240622  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:15.093603  4110 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:15.239777  1556 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:15.241446  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:15.240868  1558 pending_rounds.cc:85] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 5
I20260709 13:00:15.242352  1558 pending_rounds.cc:107] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:00:15.242615  1558 raft_consensus.cc:2889] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:15.187888  3938 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:15.244402  1553 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.225387  4292 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.247377  4292 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:15.224397  4286 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:15.191336  4198 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:15.220049  3999 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:15.246070  1706 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:00:15.246510  4327 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:00:15.246433  4110 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:15.239424  4063 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:15.236276  4313 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:15.254117  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:15.253326  1673 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.111s (SENT)
I20260709 13:00:15.237382  4250 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:15.254298  1553 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:15.218662  3603 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.259155  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:15.259193  4198 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:15.282596  4198 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.255266  4267 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:15.285369  1626 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.264999  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1625) took 1541 ms. Trace:
W20260709 13:00:15.287038  4323 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.444s	user 0.003s	sys 0.000s
I20260709 13:00:15.286269  1559 rpcz_store.cc:276] 0709 13:00:13.723845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.733484 (+  9639us) service_pool.cc:224] Handling call
0709 13:00:13.739472 (+  5988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.764301 (+ 24829us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:00:13.764343 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.790188 (+ 25845us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.630911 (+840723us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b18004172e0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:00:14.908664 (+277753us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:14.908727 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.908820 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.264737 (+355917us) raft_consensus.cc:1685] finished
0709 13:00:15.264754 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.264946 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12518,"raft.queue_time_us":40545,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":40111,"spinlock_wait_cycles":5937024,"thread_start_us":277519,"threads_started":1,"wal-append.queue_time_us":1252849}
I20260709 13:00:15.288424  1559 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:15.289467  1559 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:15.265514  4216 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.255687  4189 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.263828  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1704) took 1286 ms. Trace:
I20260709 13:00:15.291172  1630 rpcz_store.cc:276] 0709 13:00:13.977173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.977404 (+   231us) service_pool.cc:224] Handling call
0709 13:00:14.007913 (+ 30509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.123047 (+115134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.123095 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.191456 (+ 68361us) log.cc:844] Serialized 26 byte log entry
0709 13:00:15.131384 (+939928us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:15.131421 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.131488 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.263600 (+132112us) raft_consensus.cc:1685] finished
0709 13:00:15.263621 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.263762 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36574,"raft.queue_time_us":87737,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":61257,"thread_start_us":944470,"threads_started":2,"wal-append.queue_time_us":888732}
I20260709 13:00:15.266160  1552 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:15.254348  4215 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:15.267805  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.251827  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:15.258402  4292 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.274353  4313 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.282567  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:15.275957  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:15.299980  2235 connection.cc:256] RPC call timeout handler was delayed by -1.1394969739999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 13:00:15.294126  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.306237  1626 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:15.311724  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:15.296520  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 390) took 1495 ms. Trace:
W20260709 13:00:15.334373  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 81070us
I20260709 13:00:15.334939  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:15.334748  1552 rpcz_store.cc:276] 0709 13:00:13.801149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.090900 (+1289751us) service_pool.cc:224] Handling call
0709 13:00:15.091167 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.294250 (+203083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.296275 (+  2025us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54001d38d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:15.296455 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":402015616}
W20260709 13:00:15.336035  1673 leader_election.cc:336] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.156s (SENT)
I20260709 13:00:15.336601  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:15.336705  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:15.336876  1600 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:15.333374  2235 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:15.326083  1556 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:15.308626  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 670) took 1539 ms. Trace:
I20260709 13:00:15.304894  1551 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:15.305224  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.342221  2264 rpcz_store.cc:276] 0709 13:00:13.768854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.768980 (+   126us) service_pool.cc:224] Handling call
0709 13:00:13.769268 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.805046 (+ 35778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.308406 (+1503360us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b5400030cd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:15.308570 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42390400}
I20260709 13:00:15.331290  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 539) took 1569 ms. Trace:
I20260709 13:00:15.347891  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:15.349399  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:15.350666  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:15.299386  4045 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.001s
I20260709 13:00:15.355648  1552 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:15.280184  4250 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:15.326620  4286 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.370571  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.346917  1631 rpcz_store.cc:276] 0709 13:00:13.761545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.761702 (+   157us) service_pool.cc:224] Handling call
0709 13:00:13.785246 (+ 23544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.971123 (+185877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.971172 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.971855 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.071310 (+ 99455us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:14.071365 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.303495 (+1232130us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b540007f3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:15.303536 (+    41us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.303580 (+    44us) raft_consensus.cc:1685] finished
0709 13:00:15.303592 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.331219 (+ 27627us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25039,"raft.queue_time_us":48610,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":8869,"spinlock_wait_cycles":195348864,"thread_start_us":151598,"threads_started":2,"wal-append.queue_time_us":838124}
I20260709 13:00:15.378839  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.308315  4317 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:15.326928  4252 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:15.391377  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.378873  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:15.392088  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.396639  1628 raft_consensus.cc:2410] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:15.398432  1702 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:15.334390  4313 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.397807  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:15.351939  4108 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.346498  4279 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.400403  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:15.401377  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.415424  1630 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:15.352860  4131 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:15.370692  4187 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:15.346529  4215 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:15.354604  4201 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:15.404861  1632 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:15.412231  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:15.352192  4291 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:15.412600  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.378543  4189 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.371464  4338 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:15.419407  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:15.433176  2266 raft_consensus.cc:2376] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5. Re-sending same reply.
W20260709 13:00:15.433964  2266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 685) took 1643 ms (client timeout 2087 ms). Trace:
W20260709 13:00:15.434496  2266 rpcz_store.cc:269] 0709 13:00:13.790201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.419057 (+1628856us) service_pool.cc:224] Handling call
0709 13:00:15.433892 (+ 14835us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.420279  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:15.387930  4250 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:15.416399  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.441891  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.446384  1634 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:15.447861  1634 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:15.449023  1634 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:15.372084  4324 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:15.451978  4324 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.422163  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:15.441732  4189 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.452891  2263 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
W20260709 13:00:15.453375  2263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 779) took 1591 ms (client timeout 2062 ms). Trace:
I20260709 13:00:15.453428  4123 consensus_queue.cc:1059] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:15.390465  4254 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:15.455785  4123 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:15.454666  4189 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:15.456225  4123 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:15.455013  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.457477  1627 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:15.457177  4123 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:15.459226  4123 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.441205  1631 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:15.453732  2263 rpcz_store.cc:269] 0709 13:00:13.863418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.421836 (+1558418us) service_pool.cc:224] Handling call
0709 13:00:15.453318 (+ 31482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:15.454595  4063 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:00:15.461087  4063 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:15.461462  4063 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:15.462342  4063 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:15.463538  4063 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.462819  4250 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:15.440359  1554 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:15.454810  4316 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:00:15.465799  4250 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.437218  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 383) took 1680 ms. Trace:
I20260709 13:00:15.475126  1557 rpcz_store.cc:276] 0709 13:00:13.757106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.759374 (+  2268us) service_pool.cc:224] Handling call
0709 13:00:15.436970 (+1677596us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400181d54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:15.437144 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2975669632}
I20260709 13:00:15.470800  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:15.476195  1635 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:15.476368  1559 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:15.469908  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 384) took 1712 ms. Trace:
I20260709 13:00:15.390349  4292 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:00:15.417418  4131 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.386907  4045 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:15.477444  1558 rpcz_store.cc:276] 0709 13:00:13.757435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.784519 (+ 27084us) service_pool.cc:224] Handling call
0709 13:00:13.811071 (+ 26552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.243234 (+1432163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.469704 (+226470us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003124d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:15.469857 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3283250432}
I20260709 13:00:15.492208  1709 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:15.492111  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 112778us
I20260709 13:00:15.493758  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.496915  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.499818  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.402907  4252 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:15.439174  4187 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:15.394060  4286 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.468179  4338 raft_consensus.cc:697] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:15.400117  4343 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:00:15.503111  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:15.430087  4279 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:15.491174  4131 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:15.516635  1705 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:15.519405  3999 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:15.519949  3999 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.520355  3999 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:15.522221  4236 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:15.524154  4236 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:15.479245  4254 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:15.526335  4324 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.526821  4324 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:15.527860  4324 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:15.529299  4324 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.528777  4254 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:15.537588  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:15.549448  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 143878us
W20260709 13:00:15.563426  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 43852.2us
I20260709 13:00:15.566183  4201 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:15.567664  4201 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.574049  1557 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:15.578233  1558 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:15.580260  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.581064  1706 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:15.590273  1628 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:15.596134  1558 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:15.617158  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:15.618876  1558 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:15.573752  4259 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:15.678795  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:15.679517  1558 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:15.642578  4262 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.620985  3999 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:15.678210  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 781) took 1801 ms. Trace:
I20260709 13:00:15.694343  4303 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:15.701336  4345 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:00:15.702004  4279 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.704921  4286 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:15.705363  3999 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:15.706616  4341 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:00:15.707060  4313 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.709013  4313 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:15.711565  1630 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 13:00:15.716959  1634 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:15.720196  1558 raft_consensus.cc:2410] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:15.721009  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:15.730370  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:15.644784  4187 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.731714  1558 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:15.738394  4045 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:15.730849  4286 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.739568  4286 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.739852  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:15.741451  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.747356  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:15.743980  4344 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:00:15.727460  4279 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 13:00:15.744791  4346 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:00:15.741801  4286 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:15.695734  4262 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.759599  4262 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:15.759953  1703 raft_consensus.cc:2410] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:15.760519  4252 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:15.743255  4301 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:15.673197  4338 consensus_queue.cc:237] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:15.738435  3603 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:15.763274  1706 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:15.691850  2267 rpcz_store.cc:276] 0709 13:00:13.877145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.939663 (+1062518us) service_pool.cc:224] Handling call
0709 13:00:15.017596 (+ 77933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.066704 (+ 49108us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:15.210421 (+143717us) log.cc:844] Serialized 14 byte log entry
0709 13:00:15.608145 (+397724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:15.613171 (+  5026us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:15.618904 (+  5733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.670048 (+ 51144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.678144 (+  8096us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63720,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":64937,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"thread_start_us":414226,"threads_started":3,"wal-append.queue_time_us":274427}
I20260709 13:00:15.776432  1706 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
W20260709 13:00:15.776436  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.779783  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:15.781656  1557 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:15.780635  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:15.784938  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:15.786765  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:15.788949  4108 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:15.763656  4301 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:15.794117  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.796803  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:15.803303  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:15.805061  4242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.002s	sys 0.013s
I20260709 13:00:15.815933  4351 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.804522  4262 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.814942  4260 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:15.823853  4242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.002s	sys 0.013s
I20260709 13:00:15.831493  1557 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:15.921468  1558 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:15.921834  1556 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:15.856325  4300 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:15.928052  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.822781  4351 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.947723  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1801) took 1283 ms. Trace:
I20260709 13:00:15.948160  1705 rpcz_store.cc:276] 0709 13:00:14.666044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.680199 (+ 14155us) service_pool.cc:224] Handling call
0709 13:00:14.704512 (+ 24313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.518804 (+814292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.947473 (+428669us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b540005da54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:15.947659 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867406720}
I20260709 13:00:15.952024  4351 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:15.929709  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.930899  4123 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:15.953359  4123 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:15.953557  4369 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:00:15.953804  4123 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:15.954821  4123 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.956056  4123 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:15.937073  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.924968  4260 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:15.941308  4368 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:15.835060  4131 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:15.962101  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:15.926928  4300 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:15.826530  4301 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:15.967409  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.967819  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:15.964708  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.959697  1709 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:15.960294  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:15.962618  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:15.962648  1551 raft_consensus.cc:2393] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:15.970019  1674 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:15.964493  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.964732  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.962805  1705 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:15.970815  1632 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:15.966478  4260 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:15.923141  4198 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.963531  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:15.970989  1630 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:15.966603  4131 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:15.974264  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.974587  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:15.982599  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:15.975011  1526 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:15.973814  4267 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.968106  4300 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:15.976419  2268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 686) took 2183 ms (client timeout 2111 ms). Trace:
I20260709 13:00:15.977376  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:15.987768  1700 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:15.988251  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:15.989370  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:15.991685  4267 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:15.976986  4108 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:15.994123  4187 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:15.994295  4300 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.994803  4108 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:15.995803  4108 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:15.996475  4338 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:15.996817  4108 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:15.997524  4108 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:15.987828  4189 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:15.987660  2268 rpcz_store.cc:269] 0709 13:00:13.793094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.976220 (+2183126us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:15.976337 (+   117us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:16.000916  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:16.001554  1709 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.963202  4351 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.004482  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:15.996925  4338 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:00:16.009553  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.927580  4262 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:16.016891  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:16.018393  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:16.014163  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:15.993934  4267 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:16.026628  4108 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:16.027828  4131 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:16.016361  4338 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:16.029285  4349 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:16.029915  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:16.030711  4236 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:16.031307  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:16.015508  4313 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:00:16.020967  4227 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:15.988070  4198 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:16.033509  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:16.071935  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:16.072925  1628 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:16.073104  1635 raft_consensus.cc:2410] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:16.011121  4110 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:16.038154  1526 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:16.011588  4187 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:16.076220  1634 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:00:16.054273  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 75862.9us
I20260709 13:00:15.998085  3603 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:00:16.072033  4246 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:00:16.032807  4252 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:16.083666  4252 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:16.084152  4252 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:16.055552  1553 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:16.056784  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:16.059450  1557 raft_consensus.cc:2410] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:16.058292  1709 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:16.086328  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:16.036219  1559 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:16.089864  1553 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:16.015419  4351 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:16.076193  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:16.054845  4268 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:16.057807  4108 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:16.055904  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.091192  1553 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:16.104997  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.092212  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:16.107277  4262 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:16.107709  4110 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:16.107905  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:16.108194  4110 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.108608  4110 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.084973  4324 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:16.102336  4198 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:16.111320  4300 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.118357  4300 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:16.120644  4300 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:16.095453  4268 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.134779  4268 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.135669  1552 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:00:16.111868  4278 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:00:16.153456  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 470) took 1126 ms. Trace:
I20260709 13:00:16.153918  1702 rpcz_store.cc:276] 0709 13:00:15.026908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.027796 (+   888us) service_pool.cc:224] Handling call
0709 13:00:15.041124 (+ 13328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.401630 (+360506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.153209 (+751579us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b540012a554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:16.153392 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821250432}
I20260709 13:00:16.113072  4324 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.156646  4324 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:16.157991  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 1800) took 1512 ms (client timeout 2013 ms). Trace:
W20260709 13:00:16.158420  1708 rpcz_store.cc:269] 0709 13:00:14.645457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.645582 (+   125us) service_pool.cc:224] Handling call
0709 13:00:16.157813 (+1512231us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b54001c3ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:16.157939 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30382336}
I20260709 13:00:16.159584  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:16.173835  1704 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:16.195116  4227 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:16.202711  4227 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:16.206259  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.166863  4123 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:16.173076  4189 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:00:16.207934  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 112616us
I20260709 13:00:16.203588  4227 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:16.213990  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 127367us
I20260709 13:00:16.208657  4375 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:16.214529  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.209544  4123 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:16.223097  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 189676us
I20260709 13:00:16.211246  4262 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:16.234390  1600 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:16.244472  1673 leader_election.cc:336] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.047s (SENT)
I20260709 13:00:16.247972  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:16.249017  4300 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:16.249648  4300 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:16.251174  4300 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:16.257959  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:16.261478  4003 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:16.265271  4003 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:16.266636  4003 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:16.269819  4278 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:16.270432  4278 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:16.220753  4063 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:16.236815  4123 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.274534  4286 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.284186  4278 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:16.274761  4379 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:00:16.220887  4170 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:00:16.278169  4342 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:16.330762  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:16.331259  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:16.331523  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:16.329632  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2007) took 1100 ms. Trace:
I20260709 13:00:16.332850  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:16.340888  1626 rpcz_store.cc:276] 0709 13:00:15.229196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.230091 (+   895us) service_pool.cc:224] Handling call
0709 13:00:16.314400 (+1084309us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b5400079c54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:16.329407 (+ 15007us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116534144}
I20260709 13:00:16.341800  1552 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:16.332060  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:16.344628  1554 raft_consensus.cc:2376] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6. Re-sending same reply.
W20260709 13:00:16.346439  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 118430us
I20260709 13:00:16.337296  1526 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:16.332880  1551 pending_rounds.cc:85] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 6
I20260709 13:00:16.278939  4351 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:16.241603  4262 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:16.238747  4110 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:16.430734  1551 pending_rounds.cc:107] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:16.438894  1551 raft_consensus.cc:2889] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:16.332116  1560 raft_consensus.cc:2376] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7. Re-sending same reply.
W20260709 13:00:16.432235  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 95354.2us
I20260709 13:00:16.237110  4375 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:16.447809  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:16.451153  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 230629us
W20260709 13:00:16.456477  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 201750us
I20260709 13:00:16.289991  4063 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:16.466348  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 118619us
I20260709 13:00:16.328236  4306 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:00:16.440703  4351 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.470988  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:16.435662  4198 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:16.327807  4286 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:16.473344  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:16.480711  2270 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:16.483144  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:16.483836  2270 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.487498  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:16.490113  1626 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:16.493861  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:16.327306  4189 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:16.503499  2268 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:16.506299  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:16.505379  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:16.507030  1633 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:16.474541  4170 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:16.528841  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 70863.6us
I20260709 13:00:16.505690  4387 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:16.531167  2235 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:16.540266  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 68935us
I20260709 13:00:16.545125  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:16.546073  4338 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:16.523957  4198 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.482004  4351 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:16.550894  2270 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:16.552703  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:16.498585  4252 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:16.543159  4385 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:16.524191  4170 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:16.570005  1552 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:16.570796  4385 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:16.571715  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:16.660588  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 173208us
I20260709 13:00:16.669624  1554 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:16.669982  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:16.543953  4389 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.130s
W20260709 13:00:16.704546  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.540901  4379 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:00:16.592638  4110 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:16.558780  4198 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:16.665073  4388 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:16.714392  1560 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:16.598496  4395 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:16.548883  4387 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:16.770605  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:16.771456  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 467) took 1827 ms. Trace:
I20260709 13:00:16.771809  1701 rpcz_store.cc:276] 0709 13:00:14.944416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.770343 (+1825927us) service_pool.cc:224] Handling call
0709 13:00:16.771391 (+  1048us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:16.711330  4260 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:16.780264  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:16.760283  4110 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.759214  4395 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.759323  4388 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:16.792690  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:16.793435  1560 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:16.797657  4110 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:16.799038  4394 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:00:16.800172  4110 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:16.692812  4400 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 13:00:16.804536  1555 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:16.778244  4396 log.cc:927] Time spent T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:00:16.790645  4379 consensus_queue.cc:1243] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:16.808929  4388 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:16.791981  4395 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:16.837615  4400 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:16.858886  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 147339us
I20260709 13:00:16.863641  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:16.844805  4352 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.273s	user 0.001s	sys 0.002s
I20260709 13:00:16.789832  4260 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:16.869892  1701 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:16.838871  4375 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:16.871253  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 198597us
I20260709 13:00:16.843539  4110 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.847141  4155 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.849675  4379 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:16.888705  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:16.907730  4198 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:16.911316  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:16.935639  4405 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:16.936103  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:16.936269  4405 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:16.914726  4338 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:16.915022  4413 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:16.915659  4383 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 13:00:16.918113  4382 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 13:00:16.937383  4405 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:16.914840  4377 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
W20260709 13:00:16.921350  4384 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
W20260709 13:00:16.922425  4393 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:00:16.923071  4387 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:16.905066  4110 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:16.924424  4385 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:16.926425  4170 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:16.932714  4268 consensus_meta.cc:287] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.797s	user 0.006s	sys 0.005s
I20260709 13:00:16.934266  3938 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:16.934140  4155 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:16.861784  4400 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:16.959147  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.877456  4263 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:17.065531  1673 leader_election.cc:336] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.715s (SENT)
I20260709 13:00:17.284037  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:17.169996  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 617372us
I20260709 13:00:17.289402  2236 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:17.106539  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.007s	sys 0.029s
W20260709 13:00:17.290875  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.008s	sys 0.038s
W20260709 13:00:17.043578  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 131356us
I20260709 13:00:17.300431  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.305610  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.307482  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:17.310012  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.312876  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:17.319504  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.319900  1629 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:17.320413  2270 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:17.320495  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:16.955622  4413 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:17.325801  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:17.326229  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:17.326620  1635 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:17.326210  4413 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.326924  2270 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.327533  4413 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.327667  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:17.328547  1635 raft_consensus.cc:2410] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:17.329366  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:17.330555  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.330786  2268 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:17.331542  4155 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:17.325350  1632 raft_consensus.cc:2410] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:17.331881  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:17.332453  1627 raft_consensus.cc:2376] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6. Re-sending same reply.
I20260709 13:00:17.332677  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:17.333216  1626 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.333140  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:17.333768  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.333725  2270 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:17.335477  1524 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:17.336377  4252 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:17.336545  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.337037  4252 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:17.337369  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:17.338110  1633 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:17.340822  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1912) took 1591 ms. Trace:
I20260709 13:00:17.340989  4216 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.341249  1557 rpcz_store.cc:276] 0709 13:00:15.749178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.087340 (+338162us) service_pool.cc:224] Handling call
0709 13:00:16.087643 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.087978 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.088003 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:16.088463 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:00:16.211926 (+123463us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:16.211964 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.212026 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:17.340605 (+1128579us) raft_consensus.cc:1685] finished
0709 13:00:17.340632 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.340763 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1013,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":123034,"threads_started":1,"wal-append.queue_time_us":187473}
I20260709 13:00:17.342706  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:17.333814  1634 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:17.341440  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:17.355863  1626 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
W20260709 13:00:17.116657  4227 consensus_meta.cc:287] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.888s	user 0.008s	sys 0.004s
W20260709 13:00:17.395882  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 75524.9us
I20260709 13:00:17.357369  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:17.399935  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:17.409714  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 68329.7us
W20260709 13:00:17.317823  4123 consensus_meta.cc:287] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.988s	user 0.012s	sys 0.000s
I20260709 13:00:17.313222  4400 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:16.960863  4351 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:17.400385  1631 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
W20260709 13:00:17.426429  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 360950us
I20260709 13:00:17.430182  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:17.430343  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:17.325394  4391 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.327s	user 0.001s	sys 0.001s
I20260709 13:00:17.317785  4170 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.343863  3938 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:17.425197  4381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.000s	sys 0.012s
I20260709 13:00:17.424511  4376 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:17.424443  4416 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:17.429174  4252 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:17.438968  4254 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:00:17.439172  4377 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.318158  4268 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:17.455715  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:17.461227  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:17.495185  1635 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:17.435382  4398 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:00:17.434514  4123 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:17.469409  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:17.447866  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.508934  4410 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
W20260709 13:00:17.453307  4189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.045s	sys 0.098s
W20260709 13:00:17.510385  4408 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:00:17.512280  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.547935  2263 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:17.548645  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 789) took 1072 ms. Trace:
I20260709 13:00:17.549062  2263 rpcz_store.cc:276] 0709 13:00:16.478707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.479010 (+   303us) service_pool.cc:224] Handling call
0709 13:00:17.512073 (+1033063us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:00:17.548557 (+ 36484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12885760}
I20260709 13:00:17.453637  4216 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:17.487210  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:17.551118  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:17.555106  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 85801.4us
W20260709 13:00:17.501500  4324 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.337s	user 0.008s	sys 0.004s
W20260709 13:00:17.468329  4381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.000s	sys 0.013s
I20260709 13:00:17.582866  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 395) took 1252 ms. Trace:
I20260709 13:00:17.589289  1551 rpcz_store.cc:276] 0709 13:00:16.330623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.332356 (+  1733us) service_pool.cc:224] Handling call
0709 13:00:16.332695 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.464746 (+132051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.464778 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:16.465247 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:00:16.764071 (+298824us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:16.764108 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.764175 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:17.582559 (+818384us) raft_consensus.cc:1685] finished
0709 13:00:17.582583 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.582782 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":248390,"threads_started":1,"wal-append.queue_time_us":468493}
I20260709 13:00:17.590137  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:17.545342  4189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.047s	sys 0.101s
I20260709 13:00:17.597113  1701 raft_consensus.cc:2368] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7.
I20260709 13:00:17.598264  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:17.485663  4252 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:17.601012  1631 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:17.478010  4419 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.485445  4260 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:17.556411  4108 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.447s	user 0.004s	sys 0.009s
I20260709 13:00:17.546017  4156 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.563529  4410 consensus_queue.cc:1243] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:17.616304  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:17.583336  4411 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:00:17.614364  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.617690  2265 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:17.458418  4170 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.563781  4377 raft_consensus.cc:2764] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:17.619285  2269 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:17.481851  4416 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:17.621512  1709 raft_consensus.cc:2410] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:17.614921  1635 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:00:17.622881  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 179490us
I20260709 13:00:17.623242  1631 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:17.467609  4387 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 13:00:17.438629  4263 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:17.633038  2271 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:17.587715  4216 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 8 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:17.646409  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:17.647367  2269 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:17.609560  4252 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:17.545698  4404 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:00:17.638976  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:17.631349  4108 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.604789  4389 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:00:17.624439  4260 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.438265  4227 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:17.662586  1633 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 2.
I20260709 13:00:17.665611  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:17.604089  4324 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:17.641292  4416 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:17.668723  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.051s	sys 0.088s
W20260709 13:00:17.682621  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.051s	sys 0.088s
I20260709 13:00:17.625502  4156 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.691768  2269 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:17.696584  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.702149  4424 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.702646  4425 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:17.663429  4108 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.719213  4246 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:17.720742  4108 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:17.722092  4110 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
W20260709 13:00:17.703497  4412 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 13:00:17.723145  4424 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.713747  1599 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:17.704190  4301 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:17.706090  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 404) took 1107 ms. Trace:
I20260709 13:00:17.707734  2269 raft_consensus.cc:2376] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6. Re-sending same reply.
I20260709 13:00:17.673211  4389 consensus_queue.cc:1243] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:17.650897  4263 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:17.711621  2236 connection.cc:256] RPC call timeout handler was delayed by -1.3461438840000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2922s for a response
I20260709 13:00:17.668843  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:17.675298  4260 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:17.725816  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.704660  4268 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:17.743251  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 153398us
I20260709 13:00:17.730753  1552 rpcz_store.cc:276] 0709 13:00:16.598548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.661071 (+ 62523us) service_pool.cc:224] Handling call
0709 13:00:16.661382 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.661729 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.661757 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:16.669410 (+  7653us) log.cc:844] Serialized 26 byte log entry
0709 13:00:16.871929 (+202519us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:17.105882 (+233953us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.106270 (+   388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.106376 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:17.705781 (+599405us) raft_consensus.cc:1685] finished
0709 13:00:17.705812 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.705997 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6219,"prepare.queue_time_us":697835,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":3450,"raft.queue_time_us":130823,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":78811,"thread_start_us":295497,"threads_started":2,"wal-append.queue_time_us":583215}
I20260709 13:00:17.737905  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:17.744946  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 1820) took 2420 ms. Trace:
I20260709 13:00:17.745477  1703 rpcz_store.cc:276] 0709 13:00:15.324078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.366554 (+ 42476us) service_pool.cc:224] Handling call
0709 13:00:17.744715 (+2378161us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54001c4dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:17.744878 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835471104}
I20260709 13:00:17.751449  4422 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:17.751976  2267 raft_consensus.cc:2376] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7. Re-sending same reply.
I20260709 13:00:17.752630  4263 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:17.752156  4422 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.743177  4261 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:17.753127  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:17.754539  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.755313  2267 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:17.757071  4389 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.757609  4389 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.761759  4389 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:17.767627  4324 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:17.721555  4246 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:00:17.775583  4156 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:17.672422  4216 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.785996  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1904) took 2198 ms. Trace:
I20260709 13:00:17.786449  1558 rpcz_store.cc:276] 0709 13:00:15.587258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.815391 (+228133us) service_pool.cc:224] Handling call
0709 13:00:15.901512 (+ 86121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.924383 (+ 22871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.785778 (+1861395us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b540020add0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:17.785930 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158872448}
I20260709 13:00:17.801676  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 1903) took 2218 ms. Trace:
I20260709 13:00:17.802176  1559 rpcz_store.cc:276] 0709 13:00:15.586086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.805700 (+219614us) service_pool.cc:224] Handling call
0709 13:00:16.034122 (+228422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.090233 (+ 56111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.801487 (+1711254us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540031ef50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:17.801619 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524616960}
I20260709 13:00:17.735140  4404 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.725845  4424 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:17.812188  4123 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:17.799793  4428 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:17.801131  4170 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:17.818552  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:17.819330  4260 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:17.856459  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 405) took 1184 ms. Trace:
I20260709 13:00:17.857817  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.819517  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:17.857676  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 98952.7us
I20260709 13:00:17.859637  1560 rpcz_store.cc:276] 0709 13:00:16.672217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.878686 (+206469us) service_pool.cc:224] Handling call
0709 13:00:16.956809 (+ 78123us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.957100 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.957137 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:17.007119 (+ 49982us) log.cc:844] Serialized 26 byte log entry
0709 13:00:17.491660 (+484541us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:17.491699 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.491791 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:17.770930 (+279139us) raft_consensus.cc:1685] finished
0709 13:00:17.770955 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:17.856377 (+ 85422us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":404987,"threads_started":1,"wal-append.queue_time_us":624273}
I20260709 13:00:17.860826  1708 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:17.861418  1673 leader_election.cc:336] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.067s (SENT)
W20260709 13:00:17.859149  1709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1883) took 1773 ms (client timeout 1668 ms). Trace:
W20260709 13:00:17.804112  4395 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.932s	user 0.009s	sys 0.001s
I20260709 13:00:17.864468  2234 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:17.867594  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.862440  1709 rpcz_store.cc:269] 0709 13:00:16.085372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.086093 (+   721us) service_pool.cc:224] Handling call
0709 13:00:17.827407 (+1741314us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54000b8454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:17.859085 (+ 31678us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3520012544}
W20260709 13:00:17.871321  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 1833) took 1909 ms (client timeout 2013 ms). Trace:
W20260709 13:00:17.871481  1703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1894) took 1675 ms (client timeout 1773 ms). Trace:
W20260709 13:00:17.873375  1703 rpcz_store.cc:269] 0709 13:00:16.196277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.797848 (+1601571us) service_pool.cc:224] Handling call
0709 13:00:17.871418 (+ 73570us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:17.873106  1708 rpcz_store.cc:269] 0709 13:00:15.961729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.819161 (+1857432us) service_pool.cc:224] Handling call
0709 13:00:17.871262 (+ 52101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.874771  2236 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:17.876926  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.861855  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:17.829077  4413 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.000s
I20260709 13:00:17.887548  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.888300  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:17.888978  1709 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
W20260709 13:00:17.889464  1709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1891) took 1779 ms (client timeout 1905 ms). Trace:
W20260709 13:00:17.889832  1709 rpcz_store.cc:269] 0709 13:00:16.110439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.875371 (+1764932us) service_pool.cc:224] Handling call
0709 13:00:17.889413 (+ 14042us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.870949  4278 raft_consensus.cc:3055] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:17.870777  4242 raft_consensus.cc:3055] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:17.830606  4227 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:17.873845  4404 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:17.890902  4170 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:17.824958  4416 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.883574  4377 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.876425  3847 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.899734  4278 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:17.903512  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:17.904049  4420 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:17.904577  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:17.882871  4261 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:17.884220  4428 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.885557  4260 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:17.920434  4260 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:17.907094  1601 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:17.923400  3938 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:17.924022  3938 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:17.885183  4389 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:00:17.926414  1707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1892) took 1754 ms (client timeout 2028 ms). Trace:
W20260709 13:00:17.926915  1707 rpcz_store.cc:269] 0709 13:00:16.172592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.904319 (+1731727us) service_pool.cc:224] Handling call
0709 13:00:17.926358 (+ 22039us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.928051  2262 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:17.901185  4424 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:17.910604  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 49222.9us
I20260709 13:00:17.908797  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:17.913990  3847 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:17.908383  4267 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:17.911100  4263 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:17.913446  4110 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.878309  4383 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:00:17.919737  4428 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.901443  4242 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:17.908372  4374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.839s	user 0.003s	sys 0.037s
I20260709 13:00:17.890964  4123 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:17.907775  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:17.935374  1601 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:17.891647  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:17.925181  3938 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:17.907639  4170 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:17.954267  1708 raft_consensus.cc:2410] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:00:17.884385  4395 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.916415  4422 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:17.929078  4420 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.953076  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.954193  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:17.939868  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:17.944487  4374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.875s	user 0.003s	sys 0.037s
I20260709 13:00:17.964360  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:17.935497  1673 leader_election.cc:336] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.242s (SENT)
W20260709 13:00:17.957636  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1898) took 1625 ms (client timeout 1714 ms). Trace:
I20260709 13:00:17.960727  1707 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:17.966637  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:17.967103  1707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1888) took 1858 ms (client timeout 2220 ms). Trace:
I20260709 13:00:17.961977  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:17.966933  1708 rpcz_store.cc:269] 0709 13:00:16.332666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.875495 (+1542829us) service_pool.cc:224] Handling call
0709 13:00:17.957577 (+ 82082us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:17.967819  1707 rpcz_store.cc:269] 0709 13:00:16.108626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.927716 (+1819090us) service_pool.cc:224] Handling call
0709 13:00:17.967050 (+ 39334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:17.951217  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.949373  3847 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:17.969904  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.971675  2264 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:17.951102  4404 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:17.973286  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:17.994905  2265 raft_consensus.cc:2393] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:17.938915  4424 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.976771  2268 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:17.999153  4286 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:17.978410  4260 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:18.000295  2268 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:17.980553  2267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8129c29801c142749490f0df95b71485"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:00:18.000735  4424 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:18.001032  2267 raft_consensus.cc:606] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:17.942430  4267 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:17.975736  4422 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:17.982121  4293 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:17.962177  4420 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:17.946295  4388 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.084s	user 0.000s	sys 0.017s
I20260709 13:00:17.997113  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:17.998797  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:17.962455  4236 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:18.001631  2268 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:17.944367  4263 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:18.002925  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 400) took 1670 ms. Trace:
I20260709 13:00:18.033931  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:18.034345  1555 rpcz_store.cc:276] 0709 13:00:16.331997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.332258 (+   261us) service_pool.cc:224] Handling call
0709 13:00:16.804342 (+472084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.804934 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.002684 (+1197750us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54001ff4d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:18.002850 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085104896}
I20260709 13:00:18.035007  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1882) took 1956 ms. Trace:
I20260709 13:00:18.001405  2267 raft_consensus.cc:614] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:18.035511  1706 rpcz_store.cc:276] 0709 13:00:16.078690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.033612 (+1954922us) service_pool.cc:224] Handling call
0709 13:00:18.034935 (+  1323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:18.007023  2265 raft_consensus.cc:1217] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[3.5-6.6]   Dedup: 3.5->[6.6-6.6]
I20260709 13:00:17.954897  4123 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.941777  4400 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.028621  1708 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:18.029829  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:18.042204  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 1842) took 1874 ms (client timeout 2288 ms). Trace:
W20260709 13:00:18.042562  1708 rpcz_store.cc:269] 0709 13:00:16.167702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.996392 (+1828690us) service_pool.cc:224] Handling call
0709 13:00:18.042150 (+ 45758us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:18.036635  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:18.040328  2265 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: [3.5-6.6]
I20260709 13:00:18.000757  4260 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:18.041489  1709 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:17.958076  4278 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:17.966298  4261 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.043824  1706 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:17.994278  4242 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:18.008630  4422 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:18.045743  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:18.053972  2268 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:18.057384  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:18.064649  1706 raft_consensus.cc:2410] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:18.065311  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1895) took 1868 ms. Trace:
I20260709 13:00:18.065819  1706 rpcz_store.cc:276] 0709 13:00:16.196573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.057084 (+1860511us) service_pool.cc:224] Handling call
0709 13:00:18.065235 (+  8151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:18.069866  2268 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:18.069950  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:18.045739  4380 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:18.070482  2268 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:18.040566  4338 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:18.077061  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:18.077631  1708 raft_consensus.cc:2376] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6. Re-sending same reply.
I20260709 13:00:18.068068  4422 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:18.077381  2268 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.069686  4236 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:18.084345  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 101233us
I20260709 13:00:18.085803  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:18.087150  1708 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:18.077242  4242 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.094365  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:18.095773  1673 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:18.039327  4388 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.067898  4342 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:18.091549  4441 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.110138  4442 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:18.110664  4442 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:18.111641  4442 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:18.113240  4442 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:18.115162  4123 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:18.124477  1708 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:18.128767  4425 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:18.132112  4400 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:18.134091  4123 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:18.129113  4390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.452s	user 0.001s	sys 0.003s
W20260709 13:00:18.135079  4390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.462s	user 0.001s	sys 0.003s
I20260709 13:00:18.092873  4236 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:18.194097  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:18.234046  1708 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
W20260709 13:00:18.238193  4439 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:00:18.238548  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:18.242098  1708 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.133581  4252 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.130224  4395 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:18.136734  4170 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:18.256006  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:18.241843  4388 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:18.232097  4425 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.267565  1708 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:18.272477  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:18.273825  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:18.274493  1708 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:18.126948  4441 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.172474  4444 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.141s
W20260709 13:00:18.282004  4301 consensus_meta.cc:287] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.001s
I20260709 13:00:18.275458  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:18.284075  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:18.284772  1708 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:18.288373  4400 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.294128  4349 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.294755  4447 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.295567  4236 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:18.269531  4263 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:18.298671  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:18.303966  1708 raft_consensus.cc:2410] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:18.305584  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:18.309247  1708 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:18.303912  4349 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.304179  4447 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.313145  4447 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:18.309855  4441 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:18.303793  4400 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.314713  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:18.317533  1708 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.267300  4425 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:18.315510  4400 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:18.301535  4405 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:00:18.330675  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:18.331439  2266 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:18.335187  1708 raft_consensus.cc:2410] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:18.335439  4425 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:18.346589  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1826) took 2386 ms. Trace:
I20260709 13:00:18.348704  1708 rpcz_store.cc:276] 0709 13:00:15.959800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.335911 (+2376111us) service_pool.cc:224] Handling call
0709 13:00:18.336214 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.336394 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:18.346194 (+  9800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:18.346256 (+    62us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:18.346314 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.346387 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.346525 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:18.351686  4378 log.cc:927] Time spent T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 2.006s	user 0.010s	sys 0.015s
I20260709 13:00:18.352963  1708 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:18.353595  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1827) took 2393 ms. Trace:
W20260709 13:00:18.358311  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.353899  1708 rpcz_store.cc:276] 0709 13:00:15.960043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.352284 (+2392241us) service_pool.cc:224] Handling call
0709 13:00:18.352611 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.353342 (+   731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.353543 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:18.360105  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1831) took 2399 ms. Trace:
I20260709 13:00:18.360567  1708 rpcz_store.cc:276] 0709 13:00:15.961045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.359173 (+2398128us) service_pool.cc:224] Handling call
0709 13:00:18.359500 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.359705 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:18.359741 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:18.359796 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:18.359834 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.359904 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.360041 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:18.361642  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1652) took 2662 ms. Trace:
W20260709 13:00:18.359059  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.362516  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1889) took 2253 ms (client timeout 1775 ms). Trace:
I20260709 13:00:18.367260  1556 rpcz_store.cc:276] 0709 13:00:15.699456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.963551 (+264095us) service_pool.cc:224] Handling call
0709 13:00:15.986409 (+ 22858us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:16.000942 (+ 14533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:16.000980 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:16.001459 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:00:16.161353 (+159894us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:16.161412 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.161510 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:18.350933 (+2189423us) spinlock_profiling.cc:243] Waited 82 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:18.361271 (+ 10338us) raft_consensus.cc:1685] finished
0709 13:00:18.361294 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.361541 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22363,"raft.queue_time_us":15148,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":13433,"spinlock_wait_cycles":188506368,"thread_start_us":159119,"threads_started":1,"wal-append.queue_time_us":229268}
W20260709 13:00:18.375852  1701 rpcz_store.cc:269] 0709 13:00:16.108881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.935861 (+826980us) service_pool.cc:224] Handling call
0709 13:00:18.362226 (+1426365us) spinlock_profiling.cc:243] Waited 660 ms on lock 0x7b54001ad6d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:18.362414 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518427904}
I20260709 13:00:18.377951  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1832) took 2416 ms. Trace:
I20260709 13:00:18.378435  1701 rpcz_store.cc:276] 0709 13:00:15.961299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.377102 (+2415803us) service_pool.cc:224] Handling call
0709 13:00:18.377432 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.377617 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:18.377646 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:18.377688 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:18.377720 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.377779 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.377896 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:18.380183  1701 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:00:18.380899  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1834) took 2414 ms. Trace:
I20260709 13:00:18.381263  1701 rpcz_store.cc:276] 0709 13:00:15.966700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.379531 (+2412831us) service_pool.cc:224] Handling call
0709 13:00:18.379962 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.380654 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.380849 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:18.382777  1701 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:18.384464  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:18.387643  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1835) took 2420 ms. Trace:
I20260709 13:00:18.389333  1701 rpcz_store.cc:276] 0709 13:00:15.967170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.382136 (+2414966us) service_pool.cc:224] Handling call
0709 13:00:18.382473 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.387392 (+  4919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.387589 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:18.396173  2266 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
W20260709 13:00:18.398644  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 302932us
I20260709 13:00:18.334539  4267 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:18.345876  4428 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.406867  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:18.407871  2262 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 13:00:18.412071  1673 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:18.413450  2266 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:18.420547  2266 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:18.421468  4425 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:18.422966  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:18.423951  2269 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:18.424996  2269 raft_consensus.cc:3055] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:18.425360  2269 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:18.415138  4267 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:18.414810  4252 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:18.428869  2269 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.455514  4425 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.456179  4425 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:18.458591  4425 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:18.459215  4063 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:18.459940  4262 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:18.466151  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:18.437729  4445 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:00:18.468679  2269 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.496346  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.497495  1631 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 5: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:18.501647  4063 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.501827  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.502508  1634 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:18.502333  4063 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:18.503517  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.504721  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.506270  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.507480  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.508687  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.505911  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.520522  2269 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:00:18.534369  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.539516  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:18.540330  1702 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:18.540572  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:18.543797  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:18.544565  2269 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:18.545591  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:18.545920  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.545658  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.546794  1627 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:18.549454  1628 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:18.551185  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:18.554688  4428 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:18.554919  2269 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:18.555848  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:18.544745  4403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.630s	user 0.020s	sys 0.039s
W20260709 13:00:18.556802  4403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.642s	user 0.020s	sys 0.039s
I20260709 13:00:18.556401  2269 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:18.558745  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:18.559844  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:18.560885  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:18.561581  2269 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:18.562258  4403 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:18.562294  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:18.563020  4403 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:18.563751  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:18.564643  2269 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:18.564208  4403 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.565582  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:18.566231  2269 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:18.571170  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:18.571529  4406 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.657s	user 0.000s	sys 0.028s
I20260709 13:00:18.574282  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1875) took 3207 ms. Trace:
I20260709 13:00:18.574971  4278 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.576598  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:18.577574  4400 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:18.577973  4400 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:18.578336  4400 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:18.574734  1704 rpcz_store.cc:276] 0709 13:00:15.367094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:15.767966 (+400872us) service_pool.cc:224] Handling call
0709 13:00:16.160368 (+392402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.174346 (+ 13978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.574093 (+2399747us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54001c3ed0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:18.574222 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901676416}
W20260709 13:00:18.580191  1703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1899) took 2247 ms (client timeout 1710 ms). Trace:
W20260709 13:00:18.580632  1703 rpcz_store.cc:269] 0709 13:00:16.333049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.576595 (+2243546us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:18.580104 (+  3509us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:18.581409  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:18.522241  4063 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:18.582604  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:18.498847  4422 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:18.587194  1703 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:00:18.589517  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.583473  4420 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.001s
I20260709 13:00:18.587771  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1885) took 2480 ms. Trace:
I20260709 13:00:18.590947  1703 rpcz_store.cc:276] 0709 13:00:16.107863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.581222 (+2473359us) service_pool.cc:224] Handling call
0709 13:00:18.586883 (+  5661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.587543 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.587711 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:18.565770  4403 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:18.589531  2269 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:18.597823  1704 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:18.585057  4405 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:18.590804  4419 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:18.604166  2269 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:18.604904  2269 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:18.594013  4420 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.613296  2269 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.616513  2269 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.628023  4422 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:18.630647  4420 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:18.669134  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.675180  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1838) took 2582 ms. Trace:
I20260709 13:00:18.675359  4242 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:18.669225  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.677242  4242 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.678947  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1836) took 2622 ms. Trace:
I20260709 13:00:18.679426  1708 rpcz_store.cc:276] 0709 13:00:16.055940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.384194 (+2328254us) service_pool.cc:224] Handling call
0709 13:00:18.384505 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.384746 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:18.384773 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:18.385258 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:00:18.540449 (+155191us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:18.540509 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.540613 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:18.678263 (+137650us) raft_consensus.cc:1685] finished
0709 13:00:18.678363 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.678723 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":134508,"threads_started":1,"wal-append.queue_time_us":197084}
I20260709 13:00:18.683359  4242 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:18.688558  4400 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.689596  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.691371  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 799) took 1364 ms. Trace:
I20260709 13:00:18.688613  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.695155  1627 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 2: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:18.695827  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 554) took 1132 ms. Trace:
I20260709 13:00:18.691884  2264 rpcz_store.cc:276] 0709 13:00:17.326802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.331694 (+  4892us) service_pool.cc:224] Handling call
0709 13:00:17.331949 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.976041 (+644092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.690150 (+714109us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b5400590954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:18.690966 (+   816us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470789504}
I20260709 13:00:18.697517  4422 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.698534  4422 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:18.716118  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1841) took 2602 ms. Trace:
I20260709 13:00:18.716668  1703 rpcz_store.cc:276] 0709 13:00:16.113709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.591963 (+2478254us) service_pool.cc:224] Handling call
0709 13:00:18.592319 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.592831 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:18.592860 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:18.599559 (+  6699us) log.cc:844] Serialized 26 byte log entry
0709 13:00:18.712980 (+113421us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:18.713093 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.713247 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:18.715675 (+  2428us) raft_consensus.cc:1685] finished
0709 13:00:18.715691 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.715908 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75,"raft.queue_time_us":389,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":2861,"thread_start_us":103788,"threads_started":1,"wal-append.queue_time_us":108034}
I20260709 13:00:18.718361  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.693807  4400 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:18.676139  1700 rpcz_store.cc:276] 0709 13:00:16.092233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.438470 (+2346237us) service_pool.cc:224] Handling call
0709 13:00:18.438778 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.446391 (+  7613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:18.446421 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:18.446954 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:00:18.579627 (+132673us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:18.579681 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.579772 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:18.674416 (+ 94644us) raft_consensus.cc:1685] finished
0709 13:00:18.674453 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.674845 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7212,"raft.queue_time_us":16129,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"thread_start_us":132310,"threads_started":1,"wal-append.queue_time_us":155286}
I20260709 13:00:18.723842  1703 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:18.725777  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:18.727133  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1839) took 2634 ms. Trace:
I20260709 13:00:18.696288  1635 rpcz_store.cc:276] 0709 13:00:17.563677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.636801 (+ 73124us) service_pool.cc:224] Handling call
0709 13:00:17.637146 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.862433 (+225287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.862477 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:17.862864 (+   387us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:17.862910 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.694520 (+831610us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b18002a9ca0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419
0709 13:00:18.695242 (+   722us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b540034eed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:18.695286 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.695598 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24740,"raft.queue_time_us":135502,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5914,"spinlock_wait_cycles":236202112}
I20260709 13:00:18.727952  4216 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:18.729108  4216 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:18.731159  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.732156  1628 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:18.732451  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:18.734104  4227 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.735122  4227 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:18.735569  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.736871  1629 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:18.727059  4187 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.747323  4216 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:18.727300  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 599) took 1106 ms. Trace:
I20260709 13:00:18.748615  4227 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:18.752269  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.727692  1702 rpcz_store.cc:276] 0709 13:00:16.092488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.541097 (+2448609us) service_pool.cc:224] Handling call
0709 13:00:18.541387 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.541594 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:18.550452 (+  8858us) log.cc:844] Serialized 14 byte log entry
0709 13:00:18.726412 (+175960us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:18.726544 (+   132us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:18.726652 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.726762 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.726975 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8707,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":180,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":269,"thread_start_us":174632,"threads_started":1,"wal-append.queue_time_us":81573}
I20260709 13:00:18.750052  2271 rpcz_store.cc:276] 0709 13:00:17.620694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.655531 (+ 34837us) service_pool.cc:224] Handling call
0709 13:00:18.699853 (+1044322us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:00:18.727191 (+ 27338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3358592}
I20260709 13:00:18.753696  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:18.751520  4187 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:18.751991  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:18.757946  1702 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:00:18.762176  4045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.323s	user 0.016s	sys 0.023s
W20260709 13:00:18.764201  4045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.331s	user 0.016s	sys 0.024s
I20260709 13:00:18.782989  4227 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:18.784052  4227 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:18.786680  4227 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:18.783022  1700 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:18.788378  1705 raft_consensus.cc:2410] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:18.789294  1700 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:18.791358  4422 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:18.792378  1700 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:18.768909  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.796661  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1846) took 1049 ms. Trace:
I20260709 13:00:18.797278  1703 rpcz_store.cc:276] 0709 13:00:17.747553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.752434 (+1004881us) service_pool.cc:224] Handling call
0709 13:00:18.758544 (+  6110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.796157 (+ 37613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:18.796203 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:18.796272 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:18.796341 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.796413 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.796560 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:18.799928  1700 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:18.801162  4349 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:18.801965  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:18.804275  1560 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:18.804426  4374 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:18.805307  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:18.805805  4379 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:18.804546  1700 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:00:18.825520  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:18.807432  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:18.807957  4385 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:00:18.810781  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:18.814718  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:18.815798  2269 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:18.818780  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:18.821063  4416 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:18.823479  1555 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.823789  4187 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:18.824632  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1662) took 2073 ms. Trace:
I20260709 13:00:18.839762  1558 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 8: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:18.840919  1551 raft_consensus.cc:2393] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:18.841275  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:18.841950  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 90238.9us
I20260709 13:00:18.842954  4444 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:18.844803  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1897) took 2625 ms. Trace:
I20260709 13:00:18.849361  1559 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:18.856052  4444 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.872151  4444 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.872282  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:18.872674  1709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1896) took 2661 ms (client timeout 1932 ms). Trace:
W20260709 13:00:18.873157  1709 rpcz_store.cc:269] 0709 13:00:16.210551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.894337 (+1683786us) service_pool.cc:224] Handling call
0709 13:00:18.850734 (+956397us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54003e12d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:18.872350 (+ 21616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243198720}
I20260709 13:00:18.850332  1557 rpcz_store.cc:276] 0709 13:00:16.677427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.395430 (+718003us) service_pool.cc:224] Handling call
0709 13:00:17.395685 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:17.395866 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:17.645220 (+249354us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.736317 (+ 91097us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.981284 (+244967us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b180042aae0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:18.718807 (+737523us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b180042aae0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:00:18.719184 (+   377us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:18.719279 (+    95us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:18.719413 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.722850 (+  3437us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.750911 (+ 28061us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":967703,"prepare.queue_time_us":232376,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":101,"raft.queue_time_us":991147,"raft.run_cpu_time_us":464,"raft.run_wall_time_us":40896,"spinlock_wait_cycles":26541312,"thread_start_us":306521,"threads_started":2,"wal-append.queue_time_us":302301}
I20260709 13:00:18.855819  1708 rpcz_store.cc:276] 0709 13:00:16.219725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.681559 (+2461834us) service_pool.cc:224] Handling call
0709 13:00:18.721731 (+ 40172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.722290 (+   559us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:18.762276 (+ 39986us) log.cc:844] Serialized 14 byte log entry
0709 13:00:18.844423 (+ 82147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:18.844488 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:18.844555 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.844629 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.844743 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17962,"prepare.queue_time_us":45853,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":23805,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":183,"thread_start_us":63480,"threads_started":1}
W20260709 13:00:18.881577  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.882853  4349 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:18.884855  1560 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:18.886312  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:18.861794  4187 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.887514  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:18.887666  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:18.887622  4187 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:18.881562  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1893) took 2707 ms (client timeout 2350 ms). Trace:
I20260709 13:00:18.888590  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:18.886308  4317 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.029250  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1840) took 2936 ms. Trace:
W20260709 13:00:19.170135  1705 rpcz_store.cc:269] 0709 13:00:16.174117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.033490 (+1859373us) service_pool.cc:224] Handling call
0709 13:00:18.881184 (+847694us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54001c48d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:18.881447 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1666334080}
I20260709 13:00:18.935117  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.054183  4395 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:19.024899  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.053747  4444 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:19.026824  2268 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:18.975090  1555 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:18.889181  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:18.888378  1553 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
W20260709 13:00:19.030880  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.169090  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:19.137656  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.202491  1559 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 2: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:19.099781  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 590) took 1500 ms. Trace:
I20260709 13:00:18.888191  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 608) took 1218 ms. Trace:
I20260709 13:00:19.014359  4170 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:19.181159  1704 rpcz_store.cc:276] 0709 13:00:16.092780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.580378 (+2487598us) service_pool.cc:224] Handling call
0709 13:00:18.580778 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.598322 (+ 17544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.028602 (+430280us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b54001fcf54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:19.029015 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38721280}
I20260709 13:00:19.183261  1554 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:19.183707  4317 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:19.199573  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1837) took 3107 ms. Trace:
W20260709 13:00:19.200484  1453 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35578 (request call id 323) took 14592 ms (client timeout 15000 ms). Trace:
I20260709 13:00:19.203532  1558 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:19.203467  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 482) took 1284 ms. Trace:
I20260709 13:00:19.208956  1702 rpcz_store.cc:276] 0709 13:00:17.918641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.768607 (+849966us) service_pool.cc:224] Handling call
0709 13:00:18.776248 (+  7641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.776875 (+   627us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:18.776900 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:18.778690 (+  1790us) log.cc:844] Serialized 26 byte log entry
0709 13:00:18.927816 (+149126us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:18.927861 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.928372 (+   511us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:19.203188 (+274816us) raft_consensus.cc:1685] finished
0709 13:00:19.203220 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.203388 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":148614,"threads_started":1,"wal-append.queue_time_us":394731}
I20260709 13:00:19.204110  2262 rpcz_store.cc:276] 0709 13:00:17.669212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.354191 (+684979us) service_pool.cc:224] Handling call
0709 13:00:18.407489 (+ 53298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:18.410018 (+  2529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.887765 (+477747us) spinlock_profiling.cc:243] Waited 52.8 ms on lock 0x7b5400566b50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:18.887983 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121503104}
I20260709 13:00:19.207289  4170 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:19.214361  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:19.203830  2270 rpcz_store.cc:276] 0709 13:00:17.610570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.622281 (+ 11711us) service_pool.cc:224] Handling call
0709 13:00:17.622647 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:17.650010 (+ 27363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.650082 (+    72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:17.650699 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:00:17.735417 (+ 84718us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:17.954938 (+219521us) log.cc:844] Serialized 14 byte log entry
0709 13:00:17.955227 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.055790 (+1100563us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b540063f954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:19.055878 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:19.055979 (+   101us) raft_consensus.cc:1685] finished
0709 13:00:19.082735 (+ 26756us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.099584 (+ 16849us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4907,"prepare.queue_time_us":264164,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":5322,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":8012,"spinlock_wait_cycles":58835712,"thread_start_us":267753,"threads_started":2,"wal-append.queue_time_us":285777,"wal-append.run_cpu_time_us":2691,"wal-append.run_wall_time_us":1088678}
I20260709 13:00:19.215186  1558 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.214440  4170 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:19.211553  1557 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 13:00:19.214370  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.218091  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:19.218343  1553 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:19.218775  1557 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:19.219312  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:19.220458  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:19.221556  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.208379  1701 rpcz_store.cc:276] 0709 13:00:16.091990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.391852 (+2299862us) service_pool.cc:224] Handling call
0709 13:00:18.872075 (+480223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.872725 (+   650us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:18.873106 (+   381us) log.cc:844] Serialized 14 byte log entry
0709 13:00:19.182515 (+309409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:19.182564 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:19.182602 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.198392 (+ 15790us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.199147 (+   755us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54003e12d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:19.199331 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3906,"prepare.run_cpu_time_us":162,"prepare.run_wall_time_us":163,"raft.queue_time_us":6979,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":3899,"spinlock_wait_cycles":1038362880,"thread_start_us":301976,"threads_started":1,"wal-append.queue_time_us":298990}
I20260709 13:00:19.223065  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.223415  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.224112  1559 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:19.224292  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.225100  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.226116  1553 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
I20260709 13:00:19.228252  4317 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:19.227181  1557 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:19.228832  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:19.230532  4045 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:19.230702  4444 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:00:19.128626  1455 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 6 to 7, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:19.230988  4045 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:19.231485  4045 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.232028  1455 catalog_manager.cc:5697] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.234898  4379 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.225953  1559 raft_consensus.cc:2393] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:19.182628  4395 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:19.236479  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.237149  4379 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:19.238147  4385 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:19.259361  4385 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:19.261669  4385 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:19.241622  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 352612us
I20260709 13:00:19.263918  4379 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:19.264421  1558 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:19.283392  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.240751  1455 catalog_manager.cc:5697] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 4, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:19.291828  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.293998  1557 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:19.300290  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:19.307808  2268 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:19.309305  4261 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:19.309777  4261 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:19.310215  4261 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:19.306384  1552 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:19.299036  4349 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:19.315446  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:19.318092  1558 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.315260  1554 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:19.316538  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 607) took 1671 ms. Trace:
I20260709 13:00:19.316013  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.319846  1557 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:19.319447  2268 rpcz_store.cc:276] 0709 13:00:17.645695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.069476 (+423781us) service_pool.cc:224] Handling call
0709 13:00:18.069757 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:18.506815 (+437058us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b5400710aa0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddf44a1d 00007f06ddf2b1a4 00007f06ddfad447 00007f06ddfc5fe7 00007f06ddfc77de 00007f06ddfd1b49 00007f06ddfd2416 00007f06ddfced8f 00007f06ddfce83e 00007f06e2f93419
0709 13:00:19.025770 (+518955us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b58005909d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddf2b0aa 00007f06ddfad447 00007f06ddfc5fe7 00007f06ddfc77de 00007f06ddfd1b49 00007f06ddfd2416 00007f06ddfced8f 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4
0709 13:00:19.308541 (+282771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.316414 (+  7873us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709284608}
I20260709 13:00:19.321295  1557 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:19.322639  1557 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:19.323894  1557 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:00:19.324739  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.327890  4375 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:00:19.328279  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:19.328042  1455 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 7, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.329128  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:19.208513  1453 rpcz_store.cc:269] 0709 13:00:04.640621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.657426 (+ 16805us) service_pool.cc:224] Handling call
0709 13:00:19.200250 (+14542824us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:15.151916 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:15.152657 (+   741us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:15.152720 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:00:15.152741 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:15.153863 (+  1122us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:15.153990 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:15.176730 (+ 22740us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:00:15.247895 (+ 71165us) tablet.cc:701] Row locks acquired
0709 13:00:15.247945 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:00:15.248115 (+   170us) write_op.cc:270] Start()
0709 13:00:15.248261 (+   146us) write_op.cc:276] Timestamp: P: 1783602015248050 usec, L: 0
0709 13:00:15.248294 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:00:15.250359 (+  2065us) log.cc:844] Serialized 4882 byte log entry
0709 13:00:15.560713 (+310354us) op_driver.cc:464] REPLICATION: finished
0709 13:00:15.570254 (+  9541us) write_op.cc:301] APPLY: starting
0709 13:00:15.570385 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:15.570752 (+   367us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:15.570921 (+   169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:15.572878 (+  1957us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:15.576784 (+  3906us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:00:15.576829 (+    45us) write_op.cc:312] APPLY: finished
0709 13:00:15.601218 (+ 24389us) log.cc:844] Serialized 89 byte log entry
0709 13:00:15.643974 (+ 42756us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:15.674859 (+ 30885us) write_op.cc:454] Released schema lock
0709 13:00:15.684453 (+  9594us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:15.730823 (+ 46370us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:15.745990 (+ 15167us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":61636,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":9201,"apply.run_cpu_time_us":16271,"apply.run_wall_time_us":148325,"num_ops":12,"prepare.queue_time_us":315680,"prepare.run_cpu_time_us":50294,"prepare.run_wall_time_us":353792,"raft.queue_time_us":34737,"raft.run_cpu_time_us":1640,"raft.run_wall_time_us":16141,"replication_time_us":312260,"thread_start_us":541079,"threads_started":4,"wal-append.queue_time_us":272659,"wal-append.run_cpu_time_us":12802,"wal-append.run_wall_time_us":1217693}]]}
I20260709 13:00:19.331056  4434 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:19.331403  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.332304  1554 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:00:19.329128  1626 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:19.332043  1455 catalog_manager.cc:5697] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 3 to 6, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:00:19.343309  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:19.332353  4170 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:19.344831  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44395.4us
I20260709 13:00:19.349303  1552 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:19.348534  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.350147  1557 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:19.338304  3938 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:00:19.351037  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 90650.2us
I20260709 13:00:19.349157  1635 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:19.349102  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:19.335741  4434 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:19.351333  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:19.351949  1702 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:00:19.353073  4131 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:19.348857  4278 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.356063  1702 pending_rounds.cc:85] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 4
W20260709 13:00:19.353930  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.361334  4468 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:00:19.356523  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.361976  1552 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:19.366575  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:19.367154  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:19.368368  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:19.368782  1552 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:19.369017  1553 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:19.370289  4317 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:19.370821  4317 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.371254  4317 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.372195  4313 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:19.373437  1553 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:19.374508  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:19.374958  1674 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:19.375303  1632 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:19.377139  4278 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:19.368955  4187 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:19.379498  4278 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:19.380306  4278 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:19.380751  4278 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.381086  4278 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:19.359150  1526 connection.cc:256] RPC call timeout handler was delayed by -1.6185097210000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 13:00:19.382409  1526 connection.cc:256] RPC call timeout handler was delayed by -1.6104097209999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260709 13:00:19.382731  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5771097209999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 13:00:19.383065  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5690097209999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 13:00:19.383584  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5672097209999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 13:00:19.382951  4349 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:19.383874  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:19.375532  3938 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:19.385021  1705 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:19.386615  3938 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:19.388536  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:19.388839  4349 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:19.389632  4349 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:19.360453  1702 pending_rounds.cc:107] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:00:19.368003  4434 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:19.391722  1701 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:00:19.393079  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:19.393354  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:19.393610  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:19.358199  4444 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.395223  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:19.403033  1631 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.392470  4045 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:19.395953  4375 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:19.396590  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:19.397533  4242 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:19.398734  1554 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:19.401340  1702 raft_consensus.cc:2889] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:19.403719  1557 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:19.406805  1455 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 4 to 7, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.410573  1558 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:19.402177  1701 pending_rounds.cc:85] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 4
I20260709 13:00:19.412184  1701 pending_rounds.cc:107] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:00:19.412468  1701 raft_consensus.cc:2889] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:19.413138  4242 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:19.413630  4242 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:19.413350  1455 catalog_manager.cc:5697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.414466  1629 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.414671  4242 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:19.415678  4464 consensus_queue.cc:1059] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:19.416184  4242 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.415258  1455 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 4 to 6, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:19.416862  4131 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:19.417235  4131 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:19.422937  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:19.425503  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.423825  1704 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:19.434396  4261 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:19.437081  4261 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:19.437793  4131 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:19.440814  4131 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.423704  4349 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:19.424306  4395 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:19.454887  1629 raft_consensus.cc:2410] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:00:19.425232  4444 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:19.453830  1524 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39441 timed out after 1.604s (SENT) [suppressed 39 similar messages]
I20260709 13:00:19.456312  4261 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:19.483389  1631 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
W20260709 13:00:19.496187  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46646.1us
W20260709 13:00:19.499325  4466 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:19.500207  3938 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:19.502861  4170 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:19.503808  4317 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:19.506103  4317 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:19.506379  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 49128.5us
I20260709 13:00:19.448668  4349 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:19.555999  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 181678us
W20260709 13:00:19.570518  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 61213.9us
I20260709 13:00:19.541285  4317 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:00:19.575861  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:19.577076  1455 catalog_manager.cc:5697] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 5, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:19.571851  4045 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:19.570914  4313 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:19.592279  4292 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:00:19.604614  4045 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.604477  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:19.621018  4261 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:19.621569  4261 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.621966  4261 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.604360  4131 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
W20260709 13:00:19.708276  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.720209  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 109349us
I20260709 13:00:19.719316  1455 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:19.725263  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 277555us
I20260709 13:00:19.611858  4045 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:19.738560  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 146940us
W20260709 13:00:19.730684  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 346574us
W20260709 13:00:19.740764  1526 connection.cc:256] RPC call timeout handler was delayed by -1.4502097210000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 13:00:19.721573  4242 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:00:19.742374  1526 connection.cc:256] RPC call timeout handler was delayed by -1.4259097209999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 13:00:19.742815  1526 connection.cc:256] RPC call timeout handler was delayed by -1.3711263430000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:00:19.737591  1455 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:00:19.743189  1526 connection.cc:256] RPC call timeout handler was delayed by -1.3675263430000086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
W20260709 13:00:19.743566  1526 connection.cc:256] RPC call timeout handler was delayed by -1.3395097210000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
I20260709 13:00:19.727669  4444 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:19.744189  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1667097210000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
W20260709 13:00:19.745357  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0497097209999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23500000000000001s for a response
I20260709 13:00:19.738274  4497 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:19.749459  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 374646us
W20260709 13:00:19.738255  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 146525us
I20260709 13:00:19.747382  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:19.753345  1673 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:19.750986  1455 catalog_manager.cc:5697] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 3 to 6, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.757061  4478 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:19.757781  4478 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:19.758605  4242 raft_consensus.cc:3055] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:19.758841  4375 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.759109  4242 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:19.759469  4375 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:19.760313  4478 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:19.761224  4478 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:19.763655  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 380007us
I20260709 13:00:19.761890  4375 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:19.766470  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:19.774837  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.774492  1455 catalog_manager.cc:5697] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 2, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.778728  2265 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEARNER]: Advancing to term 6
I20260709 13:00:19.779152  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:19.781114  2267 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:19.782653  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:19.783005  4131 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:19.784425  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:19.785043  2268 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:19.775022  4491 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:19.734769  4484 consensus_queue.cc:1059] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:00:19.760196  4242 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:19.796214  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:19.762965  4485 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:19.767210  4444 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:19.761701  4478 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:19.779229  4250 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:19.804694  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:19.799373  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:19.761588  4497 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:19.810861  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 54674.6us
I20260709 13:00:19.804180  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:19.808318  4250 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:19.813094  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:19.812901  4250 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:19.813699  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.814177  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.801911  4485 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.815847  2262 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:19.802711  4131 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:19.823621  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.818527  2270 raft_consensus.cc:2376] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7. Re-sending same reply.
I20260709 13:00:19.804956  4444 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.825587  1526 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:19.827207  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.832095  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:19.833187  4484 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:19.833624  4484 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:19.813825  2267 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:19.835048  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:19.834693  4484 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:19.814221  4250 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:19.789968  4278 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:19.842716  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:19.838814  2236 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:19.848490  2271 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 6 LEARNER]: Advancing to term 7
I20260709 13:00:19.850474  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:19.846628  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:19.853670  4464 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:19.855670  4261 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:19.845788  4131 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:19.856210  4317 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:19.821501  4485 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.827313  4444 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:19.836110  2267 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:19.886927  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 151024us
I20260709 13:00:19.858992  2262 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
W20260709 13:00:19.895061  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44855.2us
W20260709 13:00:19.861482  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.849113  2268 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:19.867344  2265 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:00:19.876145  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 49855.1us
W20260709 13:00:19.847555  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 59396.9us
I20260709 13:00:19.836587  4242 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:19.895774  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 88492.5us
W20260709 13:00:19.858915  4482 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.237s	user 0.003s	sys 0.000s
I20260709 13:00:19.909631  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:19.881253  4385 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:19.878842  4464 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:19.912643  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:19.916999  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 78269.9us
I20260709 13:00:19.918650  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:19.912967  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:19.836854  4495 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:00:19.927835  1556 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:19.928211  4465 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:19.928006  4292 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:19.915519  2268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:37992
W20260709 13:00:19.928967  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 92380.5us
I20260709 13:00:19.929270  4395 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:19.915151  4385 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:19.955327  2270 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:19.952961  2268 raft_consensus.cc:606] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Received request to transfer leadership to TS 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:19.959744  1627 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.912178  4496 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:19.957962  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52500.9us
I20260709 13:00:19.961544  4385 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.195662  1674 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:19.982997  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.199028  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.046294  4506 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:20.200373  4506 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:20.200964  4506 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:20.202106  4488 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.202718  4488 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:20.027633  4502 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:00:19.989332  4131 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:20.030372  2269 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:19.987720  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:20.038642  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 125486us
I20260709 13:00:20.034950  4261 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:20.035701  4464 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:20.209865  4493 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:20.210712  4464 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.210491  4493 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.212745  4493 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:19.936183  4490 consensus_queue.cc:1059] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:00:20.214521  4490 raft_consensus.cc:3055] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:20.214951  4490 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:19.983254  4170 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:20.216161  4490 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:20.217295  4170 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:20.217372  4490 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:20.217736  4170 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.218158  4170 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.955224  4484 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:20.029685  4478 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:19.990242  4486 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:00:20.044466  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:19.989864  4499 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:00:20.010784  2267 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:20.227504  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 183125us
I20260709 13:00:19.998730  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:20.228721  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 309789us
I20260709 13:00:20.229027  4507 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:20.229463  4507 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.015508  4501 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:20.230453  4488 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:20.230582  4465 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:20.230969  4465 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:20.231377  4465 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.232084  4261 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:19.981531  4375 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:20.233845  4261 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:20.012985  4278 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:20.101267  1627 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:20.228721  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:20.238247  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 250630us
I20260709 13:00:20.238977  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:20.240072  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:20.241062  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:20.241436  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:20.241086  1704 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:20.162380  4485 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:20.163566  4489 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.406s	user 0.002s	sys 0.000s
I20260709 13:00:20.164075  1634 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:20.163331  4496 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.014288  4045 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:20.166148  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:20.166515  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:20.166922  2264 raft_consensus.cc:2410] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:00:20.165787  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 255852us
I20260709 13:00:20.170274  2271 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 7 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:20.118542  4444 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:20.035645  1631 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:20.175968  4508 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:20.177605  4515 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:20.165096  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 262927us
I20260709 13:00:20.261391  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:20.041097  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:20.201807  4506 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:20.209313  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:20.229803  4507 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.242004  1702 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
W20260709 13:00:20.246654  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.250268  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 54755.7us
I20260709 13:00:20.250579  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:20.207535  4395 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.262091  1705 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:20.266856  4506 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:20.267567  4395 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.268564  2270 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:20.269109  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:20.270469  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:20.271229  1707 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.270678  1709 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:00:20.279592  4496 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:20.280274  4480 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:20.247536  4278 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:20.288993  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:20.290694  1701 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
W20260709 13:00:20.293356  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.293532  1705 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:20.295343  4523 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:20.295733  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:20.295946  4523 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.297046  1707 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:20.297353  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:20.300997  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:20.302199  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:20.302397  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 338663us
I20260709 13:00:20.302896  1629 raft_consensus.cc:2368] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7.
I20260709 13:00:20.264735  4508 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:20.270498  4045 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:20.289304  4486 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:20.289971  4515 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:20.308251  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:20.314687  1629 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.306694  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:20.312211  2234 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:20.297734  4523 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:20.299119  4444 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:20.317361  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 66881.6us
I20260709 13:00:20.319092  4375 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:20.330224  4131 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:00:20.334543  4385 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.309859  4045 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:20.336346  4045 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.336784  4385 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:20.309341  4434 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:20.307500  3938 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:00:20.337961  4434 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:20.338497  4434 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.338938  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:20.327925  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 86958.4us
W20260709 13:00:20.331543  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.317239  1634 raft_consensus.cc:2376] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4. Re-sending same reply.
I20260709 13:00:20.329325  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:20.341014  2265 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:20.341320  1628 raft_consensus.cc:2410] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:20.330341  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:20.328107  4523 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:20.328353  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:00:20.346868  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 137616us
I20260709 13:00:20.307622  4496 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:20.352417  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:20.352432  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:20.310845  4486 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:20.355450  1632 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:20.333855  4375 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:20.355939  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:20.358189  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:20.326648  4427 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:20.330461  4278 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:20.366250  1626 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:20.330540  4520 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:20.349051  4480 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.368954  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:20.384665  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:20.369364  4261 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.388171  4395 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:20.389307  4379 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.390098  4497 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:20.390218  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 61979.7us
I20260709 13:00:20.390336  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:20.394243  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:20.395761  1524 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:20.397565  4515 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:20.385079  4525 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:20.359324  4292 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.401314  4170 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:20.332331  4465 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.348320  4523 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:20.369135  4278 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.363551  3938 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:20.402467  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:20.480139  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 113413us
I20260709 13:00:20.480907  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:20.333114  4508 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.367156  4427 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:20.403288  2263 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:20.403787  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:20.404181  1703 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:00:20.483734  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 186483us
I20260709 13:00:20.385281  4375 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.406510  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:20.406859  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:20.368492  2262 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:20.410791  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:20.488651  1631 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.411322  4444 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:20.362427  4486 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:20.414695  1629 raft_consensus.cc:2410] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:20.420779  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:20.369002  1635 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:20.462436  1702 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:20.410614  4500 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:00:20.464550  4527 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:20.458768  4485 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:20.405356  4131 consensus_queue.cc:1059] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:20.485443  1704 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:00:20.422940  4507 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.468816  4464 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:20.492233  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 85797us
I20260709 13:00:20.492889  4313 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:20.496465  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.477373  4523 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.497575  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:20.478679  4278 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.431732  4480 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.501748  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:20.488076  4427 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:20.467322  4261 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:20.483906  4484 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:20.477555  4490 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:00:20.475499  4292 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:20.522531  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:20.626432  1557 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:20.805413  1555 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:20.610736  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.807405  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 326584us
I20260709 13:00:20.674405  1560 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:20.622210  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:20.726262  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.810535  1558 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:20.812526  4292 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:20.522944  4444 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.682230  4536 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:00:20.709940  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.814675  4506 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:20.816489  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:20.622596  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:20.751821  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 357703us
I20260709 13:00:20.622923  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:20.841281  1631 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
W20260709 13:00:20.683133  4529 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:00:20.588121  4521 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:00:20.512835  4508 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.844504  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:20.508828  3938 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:20.850602  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.805711  4313 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.511142  4520 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:20.487375  4379 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.741048  4170 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:20.854136  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 458453us
I20260709 13:00:20.854203  1599 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:20.851104  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 424617us
I20260709 13:00:20.823734  4385 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.861825  1630 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:20.872303  1526 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:20.905689  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.906417  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.815646  4045 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.864864  4313 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.866741  4497 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:20.921005  1555 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:20.588228  4527 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.858410  4520 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:20.929795  4510 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:20.947430  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.910924  4490 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:20.878394  4385 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:20.930945  4465 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:20.958612  4444 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:20.991307  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 174922us
W20260709 13:00:20.992555  1701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.020s	sys 0.084s
W20260709 13:00:20.992934  1701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.020s	sys 0.084s
I20260709 13:00:20.983956  4131 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.929818  4511 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:00:21.007085  1601 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:20.987012  4530 log.cc:927] Time spent T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
W20260709 13:00:21.040967  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 48653.6us
W20260709 13:00:21.045786  4538 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:21.040306  3938 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:21.049234  4131 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:21.059758  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 150530us
I20260709 13:00:21.042520  4465 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.051615  4484 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:21.058863  4547 raft_consensus.cc:3055] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:21.069813  4490 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:21.064985  4497 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:00:21.113982  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 61639.1us
I20260709 13:00:21.080914  4536 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:21.085840  4261 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.107878  4547 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:21.124521  4395 raft_consensus.cc:993] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: : Instructing follower 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 13:00:21.136116  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:21.087847  4465 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.128213  4484 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:21.146232  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 111112us
I20260709 13:00:21.150079  1524 leader_election.cc:400] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7.
I20260709 13:00:21.152897  4379 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.151520  1600 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:21.133535  4261 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:00:21.138044  4045 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:21.171826  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 320801us
I20260709 13:00:21.153987  4493 raft_consensus.cc:1081] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Signalling peer 7e99891af85f4b10aa1cc2da6aa33082 to start an election
I20260709 13:00:21.164649  4490 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:21.196381  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 61864.3us
W20260709 13:00:21.201453  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 58576.7us
I20260709 13:00:21.170616  4527 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.213385  2262 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:21.214123  4549 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.214689  4549 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.217489  4549 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:21.217738  4434 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.879s	user 0.009s	sys 0.000s
I20260709 13:00:21.191315  4385 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.175469  4539 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:21.222011  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:21.177721  4484 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:21.220548  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:21.222980  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.195442  4546 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:21.156577  4497 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.235695  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.219447  4551 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:21.246496  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49019.1us
I20260709 13:00:21.236567  1559 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:21.240906  4567 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:21.241084  4540 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:00:21.241842  4563 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:00:21.244841  1526 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:21.227519  4550 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.208148  4553 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:00:21.256198  2265 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:21.231019  4131 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.259294  4541 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:21.259807  4541 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:21.260190  4541 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:21.259287  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:21.261819  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:21.263414  4543 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:21.263929  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:21.264138  4546 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:21.269745  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:21.227061  4434 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.259321  4552 raft_consensus.cc:2764] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:21.278247  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:21.279237  4568 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:21.280469  4568 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:21.281967  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.284840  4488 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:21.285943  4488 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:21.288297  4545 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:00:21.208671  4547 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:21.285866  4542 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:00:21.302668  1556 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:21.287045  4531 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.601s	user 0.001s	sys 0.000s
I20260709 13:00:21.219666  4536 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:21.230252  4539 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:21.305850  4537 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.241s	user 0.001s	sys 0.001s
I20260709 13:00:21.259354  4549 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:00:21.245790  4551 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.255714  4550 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.306828  4547 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.289162  4488 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.301465  4131 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:21.300865  4546 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:21.323910  4486 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.733s	user 0.008s	sys 0.005s
W20260709 13:00:21.332333  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 180883us
W20260709 13:00:21.335991  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.331293  4570 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.342908  4570 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:21.345283  4570 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.333978  4131 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.346272  4131 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:21.350836  4465 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.350636  4546 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:21.352378  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.341928  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:21.289371  4313 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 13:00:21.380923  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 117134us
I20260709 13:00:21.386360  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1867) took 1146 ms. Trace:
I20260709 13:00:21.387552  4539 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:21.387698  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 45848.2us
I20260709 13:00:21.362450  4465 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:21.388649  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:21.389176  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.388545  4465 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:21.321084  4278 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:21.390941  4544 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.219s	user 0.002s	sys 0.001s
I20260709 13:00:21.389921  4465 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.392776  4313 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.386853  1708 rpcz_store.cc:276] 0709 13:00:20.239832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.248765 (+  8933us) service_pool.cc:224] Handling call
0709 13:00:20.289929 (+ 41164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.412754 (+122825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.412786 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:20.422801 (+ 10015us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.508996 (+ 86195us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:20.509053 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.345991 (+836938us) spinlock_profiling.cc:243] Waited 80.7 ms on lock 0x7b54000a82d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:21.346057 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.385952 (+ 39895us) raft_consensus.cc:1685] finished
0709 13:00:21.385972 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.386271 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":829,"raft.queue_time_us":9439,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8619,"spinlock_wait_cycles":185708288,"thread_start_us":33071,"threads_started":1,"wal-append.queue_time_us":412185}
I20260709 13:00:21.389792  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:21.395287  4550 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.395514  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 627) took 1051 ms. Trace:
I20260709 13:00:21.396961  4567 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:21.308141  4520 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.397495  4567 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:21.310472  4427 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.397617  4558 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:21.398180  4558 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.398857  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1870) took 1116 ms. Trace:
I20260709 13:00:21.398500  4567 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.399528  4427 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.400206  4427 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:21.400265  4552 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:21.398536  4558 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:21.401943  4541 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:21.406472  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 916817us
I20260709 13:00:21.395925  2264 rpcz_store.cc:276] 0709 13:00:20.344028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.344200 (+   172us) service_pool.cc:224] Handling call
0709 13:00:20.352332 (+  8132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.412689 (+ 60357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.412734 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:20.434217 (+ 21483us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.904478 (+470261us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:20.910754 (+  6276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.910829 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.285089 (+374260us) spinlock_profiling.cc:243] Waited 8.9 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:21.395226 (+110137us) raft_consensus.cc:1685] finished
0709 13:00:21.395254 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.395455 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52796,"raft.queue_time_us":53286,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3078,"spinlock_wait_cycles":20458752,"thread_start_us":427367,"threads_started":1,"wal-append.queue_time_us":578472}
I20260709 13:00:21.407696  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:21.413848  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 70743.8us
I20260709 13:00:21.414846  1600 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:21.417088  1526 leader_election.cc:400] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7.
I20260709 13:00:21.417148  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1871) took 1114 ms. Trace:
I20260709 13:00:21.342206  4572 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.419437  4170 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.419709  4572 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.420859  4444 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:21.421227  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:21.421808  1705 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.420002  4170 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:21.417668  1707 rpcz_store.cc:276] 0709 13:00:20.303053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.303436 (+   383us) service_pool.cc:224] Handling call
0709 13:00:20.303700 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.303898 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:20.433593 (+129695us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.416758 (+983165us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:21.416825 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:21.416882 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.416968 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.417093 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":541541,"prepare.queue_time_us":15599,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":547859,"threads_started":2,"wal-append.queue_time_us":539757}
I20260709 13:00:21.420925  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:21.424485  1702 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:21.428851  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:21.429559  1631 raft_consensus.cc:2376] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8. Re-sending same reply.
I20260709 13:00:21.433874  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:21.421461  4444 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:21.429909  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:21.399217  1709 rpcz_store.cc:276] 0709 13:00:20.282701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.286139 (+  3438us) service_pool.cc:224] Handling call
0709 13:00:20.300098 (+ 13959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.302188 (+  2090us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:20.313685 (+ 11497us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.475723 (+162038us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.813098 (+337375us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b18003e8b40. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:21.284233 (+471135us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b18003e8b40. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2557 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:21.394914 (+110681us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18003e8b40. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2522 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:21.398369 (+  3455us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b18003e8b40. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:00:21.398507 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:21.398562 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:21.398607 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.398675 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.398798 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4396,"prepare.queue_time_us":13107,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":116,"raft.queue_time_us":936947,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":5952,"spinlock_wait_cycles":34787840,"thread_start_us":166675,"threads_started":2,"wal-append.queue_time_us":168714}
I20260709 13:00:21.438723  1707 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:21.399816  4278 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.322917  4484 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:21.451406  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:21.456038  1628 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:00:21.455257  1635 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:21.454804  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:21.455793  1627 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:21.468081  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:21.468722  1702 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:21.465819  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:21.470165  1554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:38648
I20260709 13:00:21.435910  4045 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:21.472057  1554 raft_consensus.cc:606] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:21.472343  4292 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:21.472793  4292 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:21.435818  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:21.355302  4486 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.436699  4574 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:21.447453  4170 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:21.482926  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:21.483733  1707 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:21.467696  4480 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 13:00:21.423120  4539 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 13:00:21.480922  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.486284  1705 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
W20260709 13:00:21.488127  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 71180.1us
I20260709 13:00:21.454840  4434 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.455439  4444 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:21.491431  4559 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:21.449489  4313 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:21.448402  4536 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:00:21.475903  4563 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:21.497926  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1873) took 1151 ms. Trace:
I20260709 13:00:21.503676  1701 rpcz_store.cc:276] 0709 13:00:20.346792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.350744 (+  3952us) service_pool.cc:224] Handling call
0709 13:00:20.366431 (+ 15687us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.366785 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.366814 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:20.384449 (+ 17635us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.993351 (+608902us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:20.993405 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.993496 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.355163 (+361667us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:21.489051 (+133888us) raft_consensus.cc:1685] finished
0709 13:00:21.489081 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.497837 (+  8756us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":282,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":28400,"spinlock_wait_cycles":7789824,"thread_start_us":571193,"threads_started":1,"wal-append.queue_time_us":709202}
I20260709 13:00:21.468604  4131 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.477095  4541 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.506760  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:21.494350  4508 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.001s
I20260709 13:00:21.551682  1705 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
W20260709 13:00:21.551934  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 45027.3us
I20260709 13:00:21.559914  1707 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
W20260709 13:00:21.550513  4523 consensus_meta.cc:287] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.000s
I20260709 13:00:21.485914  4292 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.498135  4480 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:21.544418  4539 raft_consensus.cc:3055] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:21.587916  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 118852us
I20260709 13:00:21.496637  4427 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:21.589687  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.590576  1554 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:21.589563  4539 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:21.592046  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.594476  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:21.595202  1551 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.508663  4563 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.592697  1554 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:21.500588  2267 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:21.594509  4539 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:21.608326  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 155294us
I20260709 13:00:21.611769  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:21.584293  4486 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.636936  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:21.613894  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1694) took 1117 ms. Trace:
I20260709 13:00:21.567823  4572 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.589447  4553 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.621646  4578 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.602002  4563 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:21.646126  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 139261us
I20260709 13:00:21.649845  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:21.651515  4595 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:21.652060  4595 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.652495  4595 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.637935  1553 rpcz_store.cc:276] 0709 13:00:20.496929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.499046 (+  2117us) service_pool.cc:224] Handling call
0709 13:00:20.589569 (+ 90523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.843376 (+253807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.843405 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:20.845280 (+  1875us) log.cc:844] Serialized 26 byte log entry
0709 13:00:21.107902 (+262622us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:21.107941 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.108005 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.613615 (+505610us) raft_consensus.cc:1685] finished
0709 13:00:21.613660 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.613823 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21174,"raft.queue_time_us":372050,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":15117,"thread_start_us":425588,"threads_started":2,"wal-append.queue_time_us":443239}
I20260709 13:00:21.583448  4523 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:21.663342  4578 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.614177  4427 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:21.679837  1703 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:21.664700  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:21.682440  4589 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:21.662552  2267 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
W20260709 13:00:21.688269  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 51431.8us
I20260709 13:00:21.689184  1524 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:21.690284  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:21.690416  4573 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:21.690985  4573 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:21.691481  4573 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.692164  4536 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:21.692039  4558 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.693815  4536 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:21.663559  4539 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.694622  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:21.696103  4591 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:21.696805  4591 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:21.697465  4591 consensus_queue.cc:1243] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:21.699105  4536 consensus_queue.cc:1059] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:21.700161  4541 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:21.700536  4541 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:21.701328  4541 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:21.702768  4541 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:21.702600  4427 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:21.687227  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:21.724485  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.728068  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 166549us
I20260709 13:00:21.733017  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:21.734870  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 51819us
I20260709 13:00:21.685074  4313 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:21.740607  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:21.729470  4567 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:21.740363  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.742225  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:21.743321  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:21.714866  4261 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.710498  4523 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:21.683302  4484 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:00:21.715166  4558 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.778774  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:21.740841  4313 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.784070  4131 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.683245  4553 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:21.784148  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:21.818652  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.822058  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 70703.7us
I20260709 13:00:21.741569  4608 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.845070  1553 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.810680  4510 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:21.847052  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:21.842242   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:21.851397  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:21.823346  4313 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:21.865670  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:21.849442  4558 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.866466  2268 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:21.868512  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.811863  4261 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:21.778398  4465 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.857733  4510 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:21.862588  4434 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:21.864156  4480 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.874892  4558 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:21.895964  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:21.897289  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:21.898494  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:21.898582  4615 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:21.899055  2266 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:21.899132  4615 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.900564  1551 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
W20260709 13:00:21.901926  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.902525  4601 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.902662  4553 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.903213  4601 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:21.906430  4610 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:00:21.908305  4584 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.436s	user 0.003s	sys 0.000s
I20260709 13:00:21.911160  2268 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
W20260709 13:00:21.913473  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 1.50674e+06us
I20260709 13:00:21.914460  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:21.912282  1526 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.350s (SENT)
I20260709 13:00:21.883028  4434 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:21.915884  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:21.916435  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1905502459999866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 13:00:21.916846  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0573502459999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
I20260709 13:00:21.917608  4261 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.917980  4464 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.918565  4464 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.920578  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.921214  4558 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.920581  4464 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.922907  1551 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:21.923549  4465 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.924376  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.925453  1551 raft_consensus.cc:2410] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:21.926383  4515 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:21.926860  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.927155  4515 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:21.929152  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.930287  1551 raft_consensus.cc:2410] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:21.932250  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:21.932632  4547 consensus_meta.cc:287] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.001s
I20260709 13:00:21.934125  1557 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: [5.6-7.7]
W20260709 13:00:21.934880  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 568) took 1594 ms (client timeout 1587 ms). Trace:
W20260709 13:00:21.935281  1630 rpcz_store.cc:269] 0709 13:00:20.340341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.363717 (+ 23376us) service_pool.cc:224] Handling call
0709 13:00:21.934658 (+1570941us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b540019a5d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:21.934788 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":964556544}
I20260709 13:00:21.936038  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:21.856137  4608 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:21.942499  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 534890us
I20260709 13:00:21.943252  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:21.943877  4608 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.944666  1674 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:21.946595  4543 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:21.947037  4543 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:21.949998  4602 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:00:21.950505  1557 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:21.950996  1627 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:21.939985  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.951243  4510 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.953197  4507 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:21.955780  4581 log.cc:927] Time spent T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.477s	user 0.001s	sys 0.000s
I20260709 13:00:21.959393  4520 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.965305  4278 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:21.965868  4278 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:21.966342  4278 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:21.915968  4434 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:21.876101  4578 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:21.985644  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:21.985883  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:21.986692  1635 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:21.986593  1633 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:21.989491  1553 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:21.905718  4601 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:21.998857  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.999416  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.999948  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:22.000515  1551 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:22.001772  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 57210.7us
I20260709 13:00:21.948011  4543 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:21.994644  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:21.995857  1552 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:21.983736  1600 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:22.000185  1553 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:22.059271  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:22.061340  2262 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
W20260709 13:00:22.062750  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 79272.5us
I20260709 13:00:22.059860  1559 raft_consensus.cc:2410] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:00:21.992827  4045 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.005s
I20260709 13:00:22.064260  4045 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:22.065193  1700 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 2.
I20260709 13:00:21.987222  4170 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:21.990610  4578 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.993891  4615 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:22.077049  1630 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:00:22.059437  4584 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.150s	user 0.002s	sys 0.000s
I20260709 13:00:22.075384  1600 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:22.082183  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 345399us
I20260709 13:00:22.079126  2266 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:22.084052  4543 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:21.980434  4595 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:22.162161  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.125026  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:22.531539  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 1880) took 1127 ms. Trace:
W20260709 13:00:22.539184  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.539925  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.538512  1700 rpcz_store.cc:276] 0709 13:00:21.404168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.416485 (+ 12317us) service_pool.cc:224] Handling call
0709 13:00:22.531322 (+1114837us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54001fe354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:22.531451 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1430780288}
W20260709 13:00:22.347740  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.008s	sys 0.010s
I20260709 13:00:22.206578  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:22.561365  2268 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:22.541368  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 625596us
I20260709 13:00:22.231359  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1878) took 1827 ms. Trace:
I20260709 13:00:22.108151  2264 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:22.122365  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:22.552835  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 446058us
I20260709 13:00:22.224327  1706 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:22.565099  2266 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:22.468760  1708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.006s	sys 0.013s
I20260709 13:00:22.142009  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:22.566092  1708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.007s	sys 0.014s
I20260709 13:00:22.566265  1701 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.257771  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:22.562851  1703 rpcz_store.cc:276] 0709 13:00:20.403707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.491024 (+ 87317us) service_pool.cc:224] Handling call
0709 13:00:20.522628 (+ 31604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.686959 (+1164331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.231105 (+544146us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540005d054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:22.231288 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2661156096}
I20260709 13:00:22.403218  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1875) took 2017 ms. Trace:
I20260709 13:00:22.571414  1704 rpcz_store.cc:276] 0709 13:00:20.385903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.405977 (+ 20074us) service_pool.cc:224] Handling call
0709 13:00:20.406363 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:20.818116 (+411753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.402839 (+1584723us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b54000b7a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:22.403138 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181050624}
I20260709 13:00:22.248550   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:22.074623  4170 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:22.565411  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:22.192732  4612 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:00:22.567473  1553 raft_consensus.cc:2376] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8. Re-sending same reply.
I20260709 13:00:22.074110  4601 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:22.347831  1629 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.003s	sys 0.011s
W20260709 13:00:22.592896  1629 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.004s	sys 0.016s
W20260709 13:00:22.560712  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.011s	sys 0.013s
I20260709 13:00:22.147550  4480 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:22.541953  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.086927  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:22.211412  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:22.240136  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:22.529117  4490 raft_consensus.cc:1064] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 13:00:22.126058  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:22.601953  1554 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:22.582657  1558 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:22.304004  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:22.528594  4586 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 1.044s	user 0.003s	sys 0.000s
I20260709 13:00:22.220099  4551 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:22.162595  4618 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:00:22.584115  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 51761.3us
I20260709 13:00:22.584685  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:22.365923  4506 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.488s	user 0.003s	sys 0.007s
W20260709 13:00:22.241962  4587 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.769s	user 0.003s	sys 0.000s
W20260709 13:00:22.626837  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.078609  4515 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.223775  4563 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.000s
I20260709 13:00:22.638114  4515 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.638724  4563 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.640488  4515 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:22.641052  4515 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.641466  4563 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:22.225613  4573 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.001s
W20260709 13:00:22.634548  4506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.754s	user 0.006s	sys 0.007s
I20260709 13:00:22.588044  1553 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:22.642297  4573 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.644425  4573 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:22.645550  4434 consensus_meta.cc:287] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.643s	user 0.012s	sys 0.000s
W20260709 13:00:22.242935  1556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1685) took 1748 ms (client timeout 1795 ms). Trace:
W20260709 13:00:22.646188  1556 rpcz_store.cc:269] 0709 13:00:20.494429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.507896 (+ 13467us) service_pool.cc:224] Handling call
0709 13:00:22.242691 (+1734795us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54000c8fd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:22.242847 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082657664}
I20260709 13:00:22.583946  1630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
 from {username='slave'} at 127.0.0.1:59260
I20260709 13:00:22.079293  4525 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:22.654234  1630 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:22.591668  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:22.654644  1630 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.654834  1700 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:22.655885  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:22.160722  4605 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:00:22.656497  4523 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:22.091512  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.657146  4523 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:22.658303  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 639) took 1229 ms. Trace:
I20260709 13:00:22.658246  4523 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.659271  4480 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:22.658767  2269 rpcz_store.cc:276] 0709 13:00:21.428860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.664746 (+235886us) service_pool.cc:224] Handling call
0709 13:00:21.683781 (+ 19035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.684214 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:21.684251 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.684703 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:00:21.779169 (+ 94466us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:21.779216 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.779276 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.658106 (+878830us) raft_consensus.cc:1685] finished
0709 13:00:22.658124 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.658244 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1139,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":94084,"threads_started":1,"wal-append.queue_time_us":203260}
I20260709 13:00:22.594586  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:22.660342  4480 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:22.661237  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 73961us
I20260709 13:00:22.662009  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:22.662217  4507 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:22.662622  4507 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.662961  4507 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.663167  4601 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:22.664203  4601 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:22.665998  4500 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:22.666508  4500 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:22.666672  1601 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:22.667603  4486 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.667475  4500 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.669029  4620 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:22.669457  4620 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.669799  4620 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:22.670341  4525 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:22.670761  4525 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:22.671128  4525 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.671329  4615 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:22.672676  4548 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:22.673111  4548 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:22.161336  2267 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEARNER]: Advancing to term 8
I20260709 13:00:22.606667  1558 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:22.620303  1704 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:22.674063  4548 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.675040  1704 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:22.675504  4548 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.676326  1704 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:22.666821  4292 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.680399  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:22.681418  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1888) took 1257 ms. Trace:
I20260709 13:00:22.681834  1709 rpcz_store.cc:276] 0709 13:00:21.424462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.443348 (+ 18886us) service_pool.cc:224] Handling call
0709 13:00:21.458998 (+ 15650us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:21.968586 (+509588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.968623 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:21.991991 (+ 23368us) log.cc:844] Serialized 52 byte log entry
0709 13:00:22.520867 (+528876us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b48001e0258. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:00:22.578380 (+ 57513us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:22.578412 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.578503 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.681139 (+102636us) raft_consensus.cc:1685] finished
0709 13:00:22.681158 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.681361 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":493232,"raft.queue_time_us":504247,"raft.run_cpu_time_us":3645,"raft.run_wall_time_us":534061,"spinlock_wait_cycles":12854528,"thread_start_us":495549,"threads_started":1,"wal-append.queue_time_us":666672}
I20260709 13:00:22.685096  1630 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.586687  4170 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:22.085338  4578 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.584450  4444 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:22.702972  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.704083  2266 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:22.634389  2268 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:22.636896  4595 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:22.212908  4313 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:22.658818  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 532886us
I20260709 13:00:22.193013  4278 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.700911  4591 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.706225  4567 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:22.621354  1555 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:22.686141  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:22.711941  1630 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:22.712087  1702 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.645957  4434 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.650880  4592 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.691601  4484 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.691923  4395 raft_consensus.cc:670] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } [suppressed 3 similar messages]
I20260709 13:00:22.694089  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:22.694610  1558 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.719099  1558 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.720005  1552 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:22.720090  4551 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:22.695209  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:22.648471  1701 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:22.696213  1631 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:22.721814  1635 raft_consensus.cc:2410] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:22.641554  4515 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.697131  1626 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:22.698231  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:22.699337  1627 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:22.598088  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:22.710199  4278 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:22.686233  1706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48128
I20260709 13:00:22.728039  1706 raft_consensus.cc:606] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:00:22.728619  1557 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:22.703204  4548 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:22.730423  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:22.688498  1709 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:22.728404  1706 raft_consensus.cc:614] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:22.710216  4313 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:22.717060  1704 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:22.702754  4507 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.710816  4591 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.732334  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:22.732697  1558 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:22.735795  1704 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:22.718470  4592 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.733703  4395 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:00:22.738909  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:22.731564  4578 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:22.741359  4554 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:00:22.745404  4570 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:22.745817  4570 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.746178  4570 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.744055  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:22.744127  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:22.722539  4484 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.751803  4591 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:22.752157  4617 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:22.736119  4539 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:22.736564  4567 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:22.751158  1599 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:22.729907  4493 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:00:22.742399  4573 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:22.763674  4444 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:22.764367  4595 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:22.765518  4621 raft_consensus.cc:1064] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 13:00:22.762151  2235 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:22.738448  4548 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.783463  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:22.784128  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.738690  4510 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 13:00:22.781703  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.782310  2236 leader_election.cc:336] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.601s (SENT)
I20260709 13:00:22.778403  4444 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.784088  2263 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.757743  4578 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:22.774209  1702 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
W20260709 13:00:22.786230  4621 raft_consensus.cc:1068] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Unable to promote non-voter 6923294c847b48ebb577e0935d316aa3: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:22.757813  4549 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:00:22.786746  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:22.786238  4629 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:22.787894  2264 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:22.759636  4500 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.790904  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:22.805884  2265 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:22.775103  4539 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:22.827622  4539 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.807864  2265 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:22.830135  2265 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.831230  2265 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:22.812115  4628 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:00:22.785006  4550 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:22.770639  4560 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:00:22.819432  4434 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:22.815516  4484 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:22.816179  4551 consensus_queue.cc:1059] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:22.817230  4170 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.817553  4395 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:22.818681  4623 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:00:22.823945  4592 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:22.826381  4493 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:22.814680  4515 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:22.836711  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.800733  4578 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.838486  4620 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.785630  4573 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:22.781164  4595 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:22.840222  2263 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:22.840569  2268 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:22.844996  2265 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
W20260709 13:00:22.845477  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 62469.6us
W20260709 13:00:22.856417  2236 leader_election.cc:336] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.587s (SENT)
I20260709 13:00:22.858112  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1879) took 1454 ms. Trace:
I20260709 13:00:22.866843  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:22.836107  2267 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:00:22.860632  4595 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.855697  4578 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:22.861503  4573 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.862943  4507 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:22.859763  4549 consensus_queue.cc:1243] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:22.863916  1455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 231) took 8028 ms. Trace:
I20260709 13:00:22.865702  4620 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:22.869269  1707 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:22.867082  1708 rpcz_store.cc:276] 0709 13:00:21.403833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.417595 (+ 13762us) service_pool.cc:224] Handling call
0709 13:00:21.438382 (+ 20787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.964089 (+525707us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:21.964545 (+   456us) log.cc:844] Serialized 14 byte log entry
0709 13:00:22.566881 (+602336us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:22.567603 (+   722us) log.cc:844] Serialized 26 byte log entry
0709 13:00:22.578013 (+ 10410us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:22.578088 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.578192 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.667195 (+ 89003us) spinlock_profiling.cc:243] Waited 7.64 ms on lock 0x7b18003e2660. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:22.840187 (+172992us) raft_consensus.cc:1685] finished
0709 13:00:22.857641 (+ 17454us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.858055 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":529901,"prepare.queue_time_us":4151,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":5120,"raft.queue_time_us":530738,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":10202,"spinlock_wait_cycles":19553792,"thread_start_us":601772,"threads_started":1,"wal-append.queue_time_us":752601}
W20260709 13:00:22.870170  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.874966  4616 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:22.873646  2267 pending_rounds.cc:85] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 3
W20260709 13:00:22.914373  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47484us
W20260709 13:00:22.918299  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 352974us
I20260709 13:00:22.903492  4493 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:22.909986  2267 pending_rounds.cc:107] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:00:22.905076  4616 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:22.924149  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.922926  2267 raft_consensus.cc:2889] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:22.929674  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:22.920540  4549 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.936458  4637 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:22.937029  4637 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:22.937858  4637 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.962707  1632 raft_consensus.cc:1217] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Deduplicated request from leader. Original: 2.2->[3.3-5.4]   Dedup: 5.4->[]
I20260709 13:00:22.963557  1632 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:00:22.964469  4622 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:22.964722  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:22.965469  1635 raft_consensus.cc:2368] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:22.965083  4622 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.962791  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:22.966848  2265 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:22.966102  1456 catalog_manager.cc:5697] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 3 to 5, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:22.967330  4622 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:22.962941  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:22.890836  1455 rpcz_store.cc:276] 0709 13:00:14.835273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.837746 (+  2473us) service_pool.cc:224] Handling call
0709 13:00:22.863831 (+8026085us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:20.182772 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:20.183473 (+   701us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:20.183522 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:00:20.183544 (+    22us) tablet.cc:662] Decoding operations
0709 13:00:20.184679 (+  1135us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:20.184771 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:20.184796 (+    25us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:00:20.185989 (+  1193us) tablet.cc:701] Row locks acquired
0709 13:00:20.194072 (+  8083us) write_op.cc:260] PREPARE: finished
0709 13:00:20.194273 (+   201us) write_op.cc:270] Start()
0709 13:00:20.194430 (+   157us) write_op.cc:276] Timestamp: P: 1783602020194190 usec, L: 0
0709 13:00:20.194454 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:00:20.246680 (+ 52226us) log.cc:844] Serialized 5196 byte log entry
0709 13:00:21.289891 (+1043211us) op_driver.cc:464] REPLICATION: finished
0709 13:00:21.472207 (+182316us) write_op.cc:301] APPLY: starting
0709 13:00:21.472308 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:21.472605 (+   297us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:21.472753 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:21.683718 (+210965us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:21.684005 (+   287us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:00:21.684054 (+    49us) write_op.cc:312] APPLY: finished
0709 13:00:21.684432 (+   378us) log.cc:844] Serialized 95 byte log entry
0709 13:00:21.684611 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:21.684762 (+   151us) write_op.cc:454] Released schema lock
0709 13:00:21.684839 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:21.685291 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:21.685320 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1391,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":182016,"apply.run_cpu_time_us":9166,"apply.run_wall_time_us":213070,"num_ops":13,"prepare.queue_time_us":190571,"prepare.run_cpu_time_us":57150,"prepare.run_wall_time_us":291482,"raft.queue_time_us":243050,"raft.run_cpu_time_us":35133,"raft.run_wall_time_us":93148,"replication_time_us":1095265,"thread_start_us":494382,"threads_started":4,"wal-append.queue_time_us":199638,"wal-append.run_cpu_time_us":25954,"wal-append.run_wall_time_us":2202337}]]}
I20260709 13:00:22.924052  4525 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.979205  4564 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:22.979939  4564 consensus_queue.cc:1243] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:22.980489  4525 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:22.981269  1709 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:22.982276  4621 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:22.984267  4486 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:22.987462  4630 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:22.988018  4630 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:22.988129  4490 consensus_queue.cc:237] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.988993  4630 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.990329  4550 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:22.990747  4550 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:00:22.990804  4638 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:00:22.991997  4550 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.993239  4170 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:22.994419  4548 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:22.995404  4616 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:22.982698  4621 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:22.998266  4621 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:22.999516  4621 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:23.001088  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:23.001685  1558 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.968678  4549 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:23.003284  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:23.003888  1555 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:23.004956  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:23.006022  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:23.006155  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:23.004300  4570 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:23.007231  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:23.007889  1551 raft_consensus.cc:2368] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8.
I20260709 13:00:23.008694  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:23.009260  1552 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:23.009596  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:23.010741  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:23.011541  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:23.012239  1557 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:23.012465  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:23.014165  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:23.014331  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.030292  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:23.034360  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:23.036242  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.027637  1456 catalog_manager.cc:5697] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 5 to 6, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.046376  2265 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:23.066180  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:23.067307  1555 raft_consensus.cc:2410] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:00:23.066268  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 103436us
I20260709 13:00:23.068203  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:23.066311  1456 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 2 to 6, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.060222  1558 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:23.068032  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:23.095001  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:23.095351  1556 raft_consensus.cc:2410] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:23.095775  1560 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:23.102461  1557 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:23.027273  4616 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:23.105679  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:23.009703  4444 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:23.114256  1551 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:23.117172  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:23.124629  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 209204us
W20260709 13:00:23.125154  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.125900  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 377685us
I20260709 13:00:23.105810  4620 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:23.126911  1456 catalog_manager.cc:5697] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 3 to 6, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.106103  4427 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:23.065795  4170 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:23.185148  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 57475us
W20260709 13:00:23.196306  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 56186us
I20260709 13:00:23.199642  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:23.265611  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:23.267478  1708 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:23.110181  4525 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:23.273989  1706 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:23.276341  1706 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:23.278163  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:23.109836  4548 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:23.195824  4480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.019s
W20260709 13:00:23.290938  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.006s	sys 0.019s
W20260709 13:00:23.291373  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.006s	sys 0.019s
W20260709 13:00:23.291800  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.111029  4630 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:23.271981  1601 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:23.269274  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:23.282699  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 61368.6us
I20260709 13:00:23.116905  4486 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:00:23.287076  2270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.010s	sys 0.030s
I20260709 13:00:23.285799  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:23.121464  4608 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:23.149335  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:23.130465  4484 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
W20260709 13:00:23.294039  1628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.006s	sys 0.019s
I20260709 13:00:23.302383  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:23.302764  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.014s	sys 0.042s
W20260709 13:00:23.328439  1628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.006s	sys 0.019s
W20260709 13:00:23.328765  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.014s	sys 0.042s
W20260709 13:00:23.303953  2270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.011s	sys 0.030s
I20260709 13:00:23.207041  4554 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.313050  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:23.324409  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:23.329456  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 667569us
W20260709 13:00:23.291010  4480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.015s	sys 0.031s
I20260709 13:00:23.305785  1456 catalog_manager.cc:5697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.196309  4500 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.113s
W20260709 13:00:23.386963  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 237761us
I20260709 13:00:23.390470  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:23.395282  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.333042  2236 leader_election.cc:336] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.122s (SENT)
W20260709 13:00:23.395812  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.129081  4596 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.177s
I20260709 13:00:23.281023  3938 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:00:23.284622  4427 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:23.301522  4546 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:23.400307  2235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.018s	sys 0.037s
W20260709 13:00:23.430749  2235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.018s	sys 0.037s
W20260709 13:00:23.431130  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 648686us
W20260709 13:00:23.394037  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.014s	sys 0.040s
W20260709 13:00:23.432200  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.014s	sys 0.040s
W20260709 13:00:23.432495  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 640336us
W20260709 13:00:23.434894  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.305608  4571 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:23.294621  4620 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:23.305433  4536 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.331110  4563 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:00:23.396041  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:23.304975  4589 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:23.412338  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 110051us
I20260709 13:00:23.420537  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:23.427678  4567 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:23.334748  4486 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:23.425731  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:23.495839  1704 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:23.305251  4543 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:23.357270  1559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.024s	sys 0.024s
W20260709 13:00:23.496799  1559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.026s	sys 0.024s
I20260709 13:00:23.289820  4170 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:23.293671  4548 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:23.446337  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.328518  4511 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:00:23.394809  4292 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:23.469907  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.473413  1709 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:23.471163  4506 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:23.473834  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1895) took 1384 ms. Trace:
I20260709 13:00:23.293457  4525 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:23.488919  1706 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.418102  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:23.474476  1456 catalog_manager.cc:5697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 5, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.499114  2235 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:23.507956  1524 leader_election.cc:400] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
W20260709 13:00:23.507809  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 257336us
I20260709 13:00:23.473768  1553 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.523065  1524 leader_election.cc:403] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:00:23.514150  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 181162us
I20260709 13:00:23.517855  1705 rpcz_store.cc:276] 0709 13:00:22.089377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.089500 (+   123us) service_pool.cc:224] Handling call
0709 13:00:22.581720 (+492220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:22.582137 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:23.082303 (+500166us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.472852 (+390549us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:23.472914 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:23.472970 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.473107 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.473778 (+   671us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38535,"prepare.queue_time_us":709297,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":20272,"raft.queue_time_us":38653,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":9197,"thread_start_us":832932,"threads_started":2}
W20260709 13:00:23.530424  4641 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:00:23.495154  4567 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.532228  4567 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:23.531970  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:23.473002  4549 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:23.386049  4554 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:23.536702  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.537195  4620 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:23.538547  4444 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:23.539574  4486 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:23.521037  4588 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:23.540871  4643 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:23.541236  4525 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:23.541945  1708 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:23.542312  4500 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:23.542742  4500 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:23.543825  4649 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:23.543617  4500 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:23.544350  4649 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:23.544864  4500 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:23.546038  4574 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:23.546200  4292 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:23.546463  4574 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:23.547119  4292 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:23.547297  4574 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:23.547986  4651 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:00:23.548168  4642 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:00:23.548532  4574 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.537719  4655 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:23.549324  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1898) took 1457 ms. Trace:
I20260709 13:00:23.549433  4655 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:23.547580  4631 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:23.473950  4653 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:23.551573  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.551909  1705 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:23.553056  1553 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
W20260709 13:00:23.553596  1552 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.000s
I20260709 13:00:23.612054  1552 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
W20260709 13:00:23.560427  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.562583  1707 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:23.474252  4546 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:23.549768  1703 rpcz_store.cc:276] 0709 13:00:22.091642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.579980 (+488338us) service_pool.cc:224] Handling call
0709 13:00:22.611684 (+ 31704us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:22.646324 (+ 34640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:22.646374 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:22.647095 (+   721us) log.cc:844] Serialized 52 byte log entry
0709 13:00:22.916428 (+269333us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:22.916475 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.916539 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:23.549103 (+632564us) raft_consensus.cc:1685] finished
0709 13:00:23.549124 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.549260 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8253,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":268850,"threads_started":1,"wal-append.queue_time_us":480268}
W20260709 13:00:23.617146  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.667260  1704 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:23.672166  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:23.673341  1632 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:23.668349  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 71389.2us
I20260709 13:00:23.683701  1630 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:23.512964  4571 raft_consensus.cc:697] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:23.516597  4506 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:23.705951  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 288011us
I20260709 13:00:23.708768  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:23.711573  1705 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:23.492820  4536 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:23.713469  1635 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:00:23.568701  4595 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.000s
I20260709 13:00:23.566051  4525 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:23.511912  4541 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.171s
I20260709 13:00:23.511557  4543 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:23.716945  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:23.512214  4434 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.171s
I20260709 13:00:23.719465  1626 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:23.737558  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:23.706852  4616 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.000s
I20260709 13:00:23.740080  4486 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:23.740198  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:23.742280  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:23.731526  4595 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:23.743628  4543 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:23.742060  4525 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:23.744361  4444 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:23.744911  4444 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:23.745291  4444 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:23.746416  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:23.714466  4507 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:23.747599  4645 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.201s	user 0.003s	sys 0.003s
I20260709 13:00:23.747697  4507 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:23.750875  4647 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:23.751513  4647 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:23.752480  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:23.753000  1631 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:23.754395  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:23.667783  4560 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.757476  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:23.746711  4654 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:00:23.717893  1456 catalog_manager.cc:5697] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 5, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.770262  1706 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 3.
I20260709 13:00:23.753710  4647 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:23.771351   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:23.738855  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:23.792686  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 293666us
W20260709 13:00:23.794597  2267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.006s	sys 0.002s
W20260709 13:00:23.795190  2267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.007s	sys 0.003s
W20260709 13:00:23.796722  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 504334us
W20260709 13:00:23.797854  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.798380  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.802098  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:23.505977  4589 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:23.806881  1631 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:23.809201  1707 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:23.820148  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 648) took 1053 ms. Trace:
I20260709 13:00:23.734786  4631 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:23.823197  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:23.827298  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:23.820662  2266 rpcz_store.cc:276] 0709 13:00:22.766604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.770964 (+  4360us) service_pool.cc:224] Handling call
0709 13:00:22.787999 (+ 17035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:22.788287 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:23.392220 (+603933us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.781510 (+389290us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.819503 (+ 37993us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.819698 (+   195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:23.819746 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:23.819816 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.819917 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.820091 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52726,"prepare.queue_time_us":81642,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":7701,"thread_start_us":881668,"threads_started":2}
W20260709 13:00:23.834491  1673 connection.cc:256] RPC call timeout handler was delayed by -2.0395652530000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 13:00:23.834936  1673 connection.cc:256] RPC call timeout handler was delayed by -1.8037652530000514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2364s for a response
W20260709 13:00:23.835273  1673 connection.cc:256] RPC call timeout handler was delayed by -1.57336525300002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.262s for a response
W20260709 13:00:23.835667  1673 connection.cc:256] RPC call timeout handler was delayed by -1.0477652530000228s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3204s for a response
I20260709 13:00:23.668422  4653 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:23.897075  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:23.893559  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36038 (request call id 14) took 1067 ms. Trace:
I20260709 13:00:23.839586  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:23.868064  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:23.934471  1706 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
W20260709 13:00:23.865978  1700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 1901) took 1276 ms (client timeout 1610 ms). Trace:
I20260709 13:00:23.836927  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:23.935997  1700 rpcz_store.cc:269] 0709 13:00:22.589689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.655642 (+ 65953us) service_pool.cc:224] Handling call
0709 13:00:23.865787 (+1210145us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54001fcf54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:23.865917 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1069044992}
W20260709 13:00:23.902173  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.951174  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:23.933626  1702 rpcz_store.cc:276] 0709 13:00:22.826576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.836508 (+  9932us) service_pool.cc:224] Handling call
0709 13:00:23.893276 (+1056768us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54000b7f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd5735 00007f06e2f95d29 00007f06dc5141d4 00007f06dc514162 00007f06dc514091 00007f06dc51400c 00007f06dc5132c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:23.893459 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809206144}
W20260709 13:00:23.953286  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 113799us
I20260709 13:00:23.954242  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:23.837772  1456 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.957536  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:23.964432  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.965036  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:23.966675  1706 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
W20260709 13:00:23.967521  1526 leader_election.cc:336] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.668s (SENT)
I20260709 13:00:23.969542  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:23.970350  4649 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:23.965039  1601 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:23.827328  4608 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:23.971824  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 265711us
I20260709 13:00:23.972049  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:23.979619  4665 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:23.980206  4546 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:23.981813  4646 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 13:00:23.982263  1506 auto_rebalancer.cc:893] Removing replace marker failed: Replica 4f1725fe36e349ac85405627f9c93d95 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:00:23.985697  4616 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:23.950735  4548 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:23.986208  4480 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:23.986901  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:23.987037  4668 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:23.988096  4567 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:23.988837  4589 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:23.989378  4608 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:23.889925  4591 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:00:23.977036  1456 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.987360  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:23.990981  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:24.029843  1705 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:23.992681  2270 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
W20260709 13:00:23.996402  1506 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:00:23.963791  4525 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:23.978291  4278 raft_consensus.cc:2764] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:00:24.037957  4591 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:00:24.024236  1526 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.710s (SENT)
I20260709 13:00:24.038527  4591 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:24.039067  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:24.040629  4589 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.041178  4589 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.040282  1456 catalog_manager.cc:5697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 3 to 5, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:24.043272  4589 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.043788  4589 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:24.044250  4589 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:23.965428  4292 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:00:24.047981  4589 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.048537  4589 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:24.049085  4589 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.051537  4589 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:24.055014  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64115.5us
I20260709 13:00:23.994864  4665 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.045876  1705 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:23.999940  4592 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:23.804842  4560 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.009917  4170 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:23.998229  4541 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:00:23.826561  4655 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:23.978065  4571 consensus_queue.cc:237] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:24.032637  1506 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:00:24.015621  4643 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
W20260709 13:00:24.133809  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.147795  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:24.134629  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 78787.4us
I20260709 13:00:24.089815  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:23.998514  4573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.011s	sys 0.024s
I20260709 13:00:23.865324  4506 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:24.029038  4649 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.174327  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.174993  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.175861  1705 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:24.082820  4493 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:24.178668  4649 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.181005  4649 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:24.178586  4493 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:24.115478  4578 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.211s	user 0.009s	sys 0.003s
I20260709 13:00:24.063829  4536 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:24.137373  4500 consensus_meta.cc:287] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.000s
W20260709 13:00:24.192327  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.131210  4549 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:24.189916  1630 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:24.088260  4484 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:24.136102  4589 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:24.186324  1524 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:24.199355  4484 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:24.172456  4573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.012s	sys 0.024s
I20260709 13:00:24.201280  1456 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:24.067960  4665 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:24.196915  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1717) took 1493 ms. Trace:
I20260709 13:00:24.088505  4278 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:24.086498  4567 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.088020  4525 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:24.023267  4552 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.149s
I20260709 13:00:24.199455  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.215359  4511 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:24.168219  4630 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:00:24.220340  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.219615  4500 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:00:24.228492  4493 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:24.218227  4484 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:24.231753  4653 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:24.234974  4648 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.714s	user 0.003s	sys 0.000s
I20260709 13:00:24.237452  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:24.238305  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:24.238390  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:24.237761  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:24.245503  4589 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:24.191888  4592 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:24.200049  4680 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.199645  4506 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:24.284560  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:24.285271  4278 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.246917  1559 rpcz_store.cc:276] 0709 13:00:22.703974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.704142 (+   168us) service_pool.cc:224] Handling call
0709 13:00:22.715856 (+ 11714us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:22.718676 (+  2820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:22.718709 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:22.726873 (+  8164us) log.cc:844] Serialized 52 byte log entry
0709 13:00:23.497277 (+770404us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:23.497332 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.497434 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.196617 (+699183us) raft_consensus.cc:1685] finished
0709 13:00:24.196648 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.196835 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2496,"raft.queue_time_us":2627,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":9285,"thread_start_us":743040,"threads_started":1,"wal-append.queue_time_us":769057}
I20260709 13:00:24.288971  4570 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:24.198740  4549 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:24.316942  4292 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.298548  1673 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:24.284596  4672 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.191712  4578 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:24.301335  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.305805  1701 raft_consensus.cc:2410] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:00:24.267266  4621 consensus_meta.cc:287] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.267s	user 0.017s	sys 0.000s
I20260709 13:00:24.308311  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 1962) took 1246 ms. Trace:
I20260709 13:00:24.308307  1705 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:24.327610  4589 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:24.323783  1634 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:24.393123  1553 rpcz_store.cc:276] 0709 13:00:23.061680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.069130 (+  7450us) service_pool.cc:224] Handling call
0709 13:00:24.308115 (+1238985us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b5400178254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:24.308241 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":813608832}
I20260709 13:00:24.345537  1552 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:24.394954  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:24.346625  1557 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:24.366624  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:24.395686  1553 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:24.293239  4574 consensus_meta.cc:287] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.001s
I20260709 13:00:24.367219  4681 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.375217  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 76739.7us
I20260709 13:00:24.486127  1635 raft_consensus.cc:2410] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:24.375842  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:24.379863  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.382300  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:24.328384  4687 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.329028  4617 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.303781  1456 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 2 to 5, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:24.398939  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.374056  1555 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:24.459246  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.481788  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:24.489382  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.489337  1556 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:24.490051  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:24.316480  4511 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:24.499830  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 304585us
I20260709 13:00:24.502235  1631 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:24.503399  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:24.500162  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:24.505049  1705 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:24.506198  1559 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:24.393676  4653 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:24.508340  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:24.509829  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.511723  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.516736  1701 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
W20260709 13:00:24.517091  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.517609  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.515420  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.520673  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:24.521322  1634 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
W20260709 13:00:24.521919  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.518823  1456 catalog_manager.cc:5697] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 4 to 5, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:24.523593  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:24.524204  1557 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:24.524353  1553 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:24.485637  4589 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.519912  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.482534  4567 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.533357  1705 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:24.533448  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:24.534343  1559 raft_consensus.cc:2410] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:24.534400  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:24.532655  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:24.535543  1555 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:24.493216  4493 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.538018  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.538415  1553 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:24.526242  1456 catalog_manager.cc:5697] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:24.540395  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.541535  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:24.542378  2234 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:24.515372  4170 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:24.540997  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:24.393415  4292 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:24.542630  1552 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:24.370620  4680 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.549945  4670 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:24.551201  4685 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:00:24.556834  1556 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:24.570643  4278 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.570940  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:24.572341  2265 raft_consensus.cc:1217] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[3.5-8.7]   Dedup: 3.5->[6.6-8.7]
I20260709 13:00:24.572693  4560 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.496304  4681 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.501315  4687 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.394012  4672 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.635790  2271 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEARNER]: Advancing to term 8
I20260709 13:00:24.636803  4672 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:24.638435  2264 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:24.579530  1633 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:24.482934  4525 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:24.549121  4170 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:24.642704  4170 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:24.642814  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:24.584581  4444 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.839s	user 0.010s	sys 0.003s
I20260709 13:00:24.518061  4617 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:24.644940  4444 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.579766  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:24.580168  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.582417  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:24.646978  4444 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.539832  4549 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:24.586145  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:24.537626  4653 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:24.583998  2265 pending_rounds.cc:85] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 5
I20260709 13:00:24.656553  2265 pending_rounds.cc:107] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:24.656839  2265 raft_consensus.cc:2889] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:24.611322  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:24.658600  2263 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
W20260709 13:00:24.658866  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 69524us
I20260709 13:00:24.543919  4563 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.633278  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:24.634264  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:24.660597  2269 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
W20260709 13:00:24.660739  2236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.504s (SENT) [suppressed 26 similar messages]
I20260709 13:00:24.646453  4617 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:24.647612  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:24.646999  1702 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:24.648437  1556 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:24.646517  1634 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:24.533687  4666 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:24.652309  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:24.663755  1456 catalog_manager.cc:5697] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 5, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:24.494297  4592 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:24.581611  4670 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:24.671355  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:24.672148  1704 raft_consensus.cc:2368] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:24.677976  1456 catalog_manager.cc:5697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 3 to 4, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:24.682926  1554 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:24.685204  1633 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:24.686281  1674 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:24.545063  4567 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.687968  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:24.691325  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.694177  2271 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:24.544214  4493 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.597270  4292 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:24.698938  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:24.707634  4591 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:24.710081  4657 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.167s	user 0.002s	sys 0.019s
I20260709 13:00:24.687219  4486 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:24.729871  1456 catalog_manager.cc:5697] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 3, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:24.742487  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:24.743184  1705 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:24.744378  4170 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.677074  4670 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:24.725601  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:24.702219  4687 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.670833  4563 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:24.734553  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:24.735842  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.740084  4486 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.740334  4591 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:24.694794  4444 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:24.719260  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:24.757809  1705 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:24.759842  1634 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:24.746487  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2064) took 3025 ms. Trace:
I20260709 13:00:24.743350  1456 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 3 to 4, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:24.747517  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1923) took 1079 ms. Trace:
I20260709 13:00:24.762007  1558 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:24.689299  4666 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.761108  1629 rpcz_store.cc:276] 0709 13:00:21.720811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.720927 (+   116us) service_pool.cc:224] Handling call
0709 13:00:21.734940 (+ 14013us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:22.593432 (+858492us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:22.923504 (+330072us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.428273 (+504769us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.490494 (+ 62221us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.514317 (+ 23823us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.514511 (+   194us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:23.514569 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.514687 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.709236 (+1194549us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:24.746226 (+ 36990us) raft_consensus.cc:1685] finished
0709 13:00:24.746255 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.746422 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144463,"prepare.queue_time_us":94521,"prepare.run_cpu_time_us":4502,"prepare.run_wall_time_us":33034,"raft.queue_time_us":264421,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":13132,"spinlock_wait_cycles":34256768,"thread_start_us":1602884,"threads_started":3,"wal-append.queue_time_us":613174}
I20260709 13:00:24.772022  4666 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.772264  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:24.773393  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:24.775496  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.776095  1705 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
W20260709 13:00:24.750669  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 89974.4us
W20260709 13:00:24.777246  2236 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.590s (SENT)
I20260709 13:00:24.777613  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:24.755393  1554 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:24.758998  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:24.762090  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.779340  1704 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:24.762312  4653 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:24.766361  4680 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.770066  4681 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.761222  1706 rpcz_store.cc:276] 0709 13:00:23.667818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.991181 (+323363us) service_pool.cc:224] Handling call
0709 13:00:23.991481 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.038408 (+ 46927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.038454 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.038500 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:24.038533 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.747297 (+708764us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b5400129b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:24.747338 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.747462 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":98514304}
I20260709 13:00:24.780654  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.749835  4278 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:24.795981  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:24.796676  2271 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:24.781996  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.785074  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:24.783826  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.798750  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:24.799340  1555 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:24.799235  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.801445  1704 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:24.801571  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:24.802234  1554 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:24.755364  4511 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.760365  4427 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:24.807018  2263 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:24.815495  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:24.807436  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:24.809830  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 123639us
W20260709 13:00:24.811206  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.812529  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:24.819113  2271 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:24.819314  1674 leader_election.cc:400] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8.
I20260709 13:00:24.813659  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:24.818508  1629 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:24.819974  1706 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:24.820415  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:24.821053  1629 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:24.820777  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:24.817359  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:24.827021  2263 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:24.827064  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.827941  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:24.828248  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.828737  2271 raft_consensus.cc:2368] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9.
I20260709 13:00:24.830521  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.834259  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.781270  4444 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:24.831197  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:24.801033  4649 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.800125  4694 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:24.807958  4672 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:24.837649  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:24.853576  1555 raft_consensus.cc:2410] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:24.841300  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.842429  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:24.844610  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.854883  1705 raft_consensus.cc:2410] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:24.825569  1674 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:24.858777  1704 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:24.846704  1633 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:24.859004  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:24.859783  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.860507  1704 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:24.861200  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.869992  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:24.883108  4652 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.341s	user 0.004s	sys 0.015s
W20260709 13:00:24.848510  4484 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.001s
I20260709 13:00:24.864568  4278 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:24.895776  4427 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.899202  4689 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 13:00:24.941085  4484 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:24.858197  4694 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.948521  4484 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:24.899555  1634 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:24.949273  1628 raft_consensus.cc:2368] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8.
W20260709 13:00:24.901819  4693 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:00:24.904908  4563 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:24.906445  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:24.900447  4493 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:24.907007  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:24.906870  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:24.951386  2271 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:24.923110  1632 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:24.923853  4570 raft_consensus.cc:1064] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
W20260709 13:00:24.923717  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.932808  4692 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:00:24.930275  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.954149  4570 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.930691  4567 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.961185  4706 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.961192  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:24.962093  1703 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:24.961838  4706 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:24.930990  4444 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.964231  4706 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:24.933238  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 74311.3us
I20260709 13:00:24.967422  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:24.934489  1704 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:24.969422  1703 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:24.969892  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.970495  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.971261  1703 raft_consensus.cc:2368] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:24.945557  1706 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:24.972172  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.946056  4427 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.975134  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1922) took 1620 ms. Trace:
I20260709 13:00:24.975672  4427 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.955292  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:24.975632  1702 rpcz_store.cc:276] 0709 13:00:23.354600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.969874 (+615274us) service_pool.cc:224] Handling call
0709 13:00:23.970216 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.662290 (+692074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.974868 (+312578us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54001bdad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:24.975063 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556201216}
I20260709 13:00:24.955518  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:24.977530  2263 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:24.956036  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:24.979105  4656 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.440s	user 0.000s	sys 0.003s
I20260709 13:00:24.897570  4670 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.987926  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:24.956579  4660 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.404s	user 0.000s	sys 0.014s
W20260709 13:00:24.934545  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.971101  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:24.985669  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:24.857790  4649 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:24.997380  1704 raft_consensus.cc:2368] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:24.941537  4698 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:24.831668  4525 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:25.008641  1703 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:25.009462  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1931) took 1046 ms. Trace:
I20260709 13:00:25.009855  1703 rpcz_store.cc:276] 0709 13:00:23.963574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.984794 (+1021220us) service_pool.cc:224] Handling call
0709 13:00:25.008427 (+ 23633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.009192 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.009404 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.012800  4649 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:25.015539  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:25.016225  2265 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:25.017027  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:25.017581  2263 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.027436  4170 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:24.926126  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:25.051607  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 1914) took 1737 ms (client timeout 1906 ms). Trace:
W20260709 13:00:25.052695  1708 rpcz_store.cc:269] 0709 13:00:23.314520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.324037 (+  9517us) service_pool.cc:224] Handling call
0709 13:00:25.051391 (+1727354us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400220454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:25.051533 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360432512}
I20260709 13:00:25.053856  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:25.054656  2268 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:00:25.035691  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.054651  2270 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 5: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:00:25.062270  4665 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.761s	user 0.008s	sys 0.004s
W20260709 13:00:25.029765  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.062914  4665 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:24.996183  4706 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:25.063546  4698 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:25.066323  1708 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:00:25.063043  4658 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 1.173s	user 0.006s	sys 0.006s
I20260709 13:00:25.068229  1705 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:25.070060  1552 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:25.071487  1633 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:25.067533  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 53197.9us
I20260709 13:00:25.055177  4703 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.075366  1552 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:25.075301  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:25.078210  2271 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:25.078482  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:25.080492  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.080289  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:25.084268  1551 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:25.084883  1558 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:24.990583  4500 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 13:00:25.087319  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.088760  2236 leader_election.cc:336] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.633s (SENT)
I20260709 13:00:25.095394  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.089442  2263 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:25.086628  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:25.090984  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:25.096899  1552 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:25.097788  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:25.099911  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:25.100510  2236 leader_election.cc:336] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.663s (SENT)
I20260709 13:00:25.101050  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:25.101545  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1009535350000306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2332s for a response
I20260709 13:00:25.102154  4702 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:25.068637  4550 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:25.103068  1526 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.620s (SENT)
I20260709 13:00:25.110180  1673 leader_election.cc:400] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9.
W20260709 13:00:25.110585  1526 leader_election.cc:336] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.768s (SENT)
I20260709 13:00:25.110630  1673 leader_election.cc:403] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:25.111213  1526 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.111924  4525 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:25.112320  4525 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.112649  4525 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.112829  4698 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.113559  4278 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.114315  4278 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:25.114670  4644 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.115403  4278 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:25.102402  4507 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:25.117105  1705 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:25.119923  4278 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:25.120412  4278 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.123191  4665 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:25.123394  4670 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:25.124229  4670 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.140347  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.098810  4484 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:25.147810  4620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.607s	user 0.015s	sys 0.015s
I20260709 13:00:25.168848  1673 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.169525  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.172338  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:25.170389  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 201899us
I20260709 13:00:25.178610  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:25.093786  4703 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.183032  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.176434  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:25.194384  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:25.165190  4484 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:25.167778  4620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.627s	user 0.016s	sys 0.015s
I20260709 13:00:25.202122  4507 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:25.203971  4564 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:25.136044  4649 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:00:25.180158  4668 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:25.215235  1600 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.191582  3938 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:25.192368  4444 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9.
I20260709 13:00:25.207024  4665 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:25.206166  4710 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:25.210750  4484 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.210853  4500 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:25.216775  4702 raft_consensus.cc:3055] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:25.220891  3938 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.225180  4620 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.227437  4710 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:25.243153  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 485) took 2115 ms. Trace:
I20260709 13:00:25.243775  1709 rpcz_store.cc:276] 0709 13:00:23.125614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.125751 (+   137us) service_pool.cc:224] Handling call
0709 13:00:23.473236 (+347485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.510770 (+ 37534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.239294 (+1728524us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54000b7550. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:25.240484 (+  1190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798534016}
W20260709 13:00:25.229137  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 128168us
I20260709 13:00:25.233317  4665 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:25.235078  4702 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:25.232198  4500 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:25.251771  4703 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:25.253628  1707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 486) took 2127 ms (client timeout 2122 ms). Trace:
I20260709 13:00:25.258663  4710 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:25.259641  4589 consensus_meta.cc:287] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.715s	user 0.011s	sys 0.000s
I20260709 13:00:25.238981  3938 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:25.261250  1703 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:25.245146  1709 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:25.230764  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 130268us
W20260709 13:00:25.279601  2236 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.987s (SENT)
I20260709 13:00:25.280167  2236 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.227613  4706 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:25.228919  4708 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:25.269335  1707 rpcz_store.cc:269] 0709 13:00:23.125951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.126090 (+   139us) service_pool.cc:224] Handling call
0709 13:00:25.253408 (+2127318us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54003a0554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:25.253531 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609363712}
I20260709 13:00:25.231109  4653 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.244463  4709 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.264029  4671 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.268509  4500 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:25.290632  2236 leader_election.cc:336] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.175s (SENT)
I20260709 13:00:25.291214  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:25.287039  4591 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.003s
I20260709 13:00:25.293642  1709 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:00:25.309446  1709 pending_rounds.cc:85] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 5
I20260709 13:00:25.309777  1709 pending_rounds.cc:107] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:25.310051  1709 raft_consensus.cc:2889] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.261729  4636 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:25.324383  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:25.324478  4670 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:25.324658  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 1916) took 2007 ms. Trace:
I20260709 13:00:25.325142  4670 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:25.325402  1700 rpcz_store.cc:276] 0709 13:00:23.317206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.957081 (+639875us) service_pool.cc:224] Handling call
0709 13:00:25.315107 (+1358026us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54001c3ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:25.324603 (+  9496us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749202304}
I20260709 13:00:25.276525  4550 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:00:25.324643  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:25.327415  1558 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:25.328863  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:25.331229  1555 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:25.332592  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:25.333958  1600 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:25.329422  1552 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:25.329941  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:25.337850  2267 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:25.289856  4715 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.298524  4395 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.339978  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:25.346800  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:25.281657  4589 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.345578  1558 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:25.287722  4703 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:00:25.351797  2236 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.336777  4712 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:25.323450  4710 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.293090  4671 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.282284  4278 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:25.402771  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 61663.8us
I20260709 13:00:25.326609  4444 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:25.359758  1557 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:25.360778  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:25.352272  1551 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:25.342206  4570 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:25.405449  1554 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:25.394615  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.399838  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 264866us
I20260709 13:00:25.402741  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:25.406409  1559 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.355048  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:25.339082  4665 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:25.401445  4715 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.333142  1555 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:25.404994  2236 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.412513  1552 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:25.413465  4714 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:00:25.424499  2262 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
W20260709 13:00:25.425288  1526 leader_election.cc:336] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.246s (SENT)
W20260709 13:00:25.421660  2236 leader_election.cc:336] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.110s (SENT)
I20260709 13:00:25.423046  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:25.426872  4716 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:00:25.427103  4550 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:25.427604  4550 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.427958  4550 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:25.428658  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.428905  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1930) took 1574 ms. Trace:
I20260709 13:00:25.431298  1708 raft_consensus.cc:1217] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-5.4]   Dedup: 5.4->[]
I20260709 13:00:25.432034  1708 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:00:25.429492  1702 rpcz_store.cc:276] 0709 13:00:23.855048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.977075 (+1122027us) service_pool.cc:224] Handling call
0709 13:00:24.977545 (+   470us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:25.051553 (+ 74008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.051597 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:25.071279 (+ 19682us) log.cc:844] Serialized 78 byte log entry
0709 13:00:25.229295 (+158016us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:25.229338 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.229405 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.428588 (+199183us) raft_consensus.cc:1685] finished
0709 13:00:25.428620 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.428827 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119623,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":189996,"threads_started":2,"wal-append.queue_time_us":177150}
I20260709 13:00:25.326081  4702 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.425896  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.403671  4712 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:25.437327  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:25.438371  1557 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:25.405774  4570 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.400044  4649 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:00:25.422699  4395 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:25.441749  4715 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.434204  4507 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:00:25.442301  4570 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.454001  1557 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:25.437471  4591 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.410887  4444 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.407581  4706 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:25.455660  1552 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:25.472163  4644 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:25.474244  4721 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:25.475080  4721 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:25.478470  4719 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:00:25.478978  1557 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:25.479187  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:25.480175  4506 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:25.481078  4511 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:25.481760  4511 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:25.482848  4595 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:25.482903  4511 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:25.487908  4549 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:25.491377  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1907) took 1249 ms. Trace:
I20260709 13:00:25.491787  1703 rpcz_store.cc:276] 0709 13:00:24.241641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.013444 (+771803us) service_pool.cc:224] Handling call
0709 13:00:25.261061 (+247617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.278531 (+ 17470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.491149 (+212618us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54003a0550. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:25.491317 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568788736}
I20260709 13:00:25.493323  4554 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:25.493821  3938 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:25.502666  3938 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:25.498692  1559 raft_consensus.cc:2410] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:25.498406  4712 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:25.500097  4507 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:25.541707  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 365954us
I20260709 13:00:25.405205  4670 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.512450  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:25.545358  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:25.458914  1526 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.537s (SENT)
I20260709 13:00:25.547152  1703 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:25.547020  1526 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.547240  1560 raft_consensus.cc:2410] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:00:25.547988  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 89127.7us
I20260709 13:00:25.515143  4278 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:25.503726  4591 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:25.551239  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:25.552007  1700 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:25.524281  4705 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.514s	user 0.002s	sys 0.000s
I20260709 13:00:25.524500  4525 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.496887  4721 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:25.514240  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 92607us
W20260709 13:00:25.548751  1526 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.559s (SENT)
I20260709 13:00:25.571393  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.546097  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:25.572602  1559 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:25.515759  4589 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:25.555044  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:25.559835  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:25.561390  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:25.571519  2236 leader_election.cc:336] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.114s (SENT)
I20260709 13:00:25.575310  1702 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:25.575372  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.553650  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:25.584168  2236 leader_election.cc:336] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.245s (SENT)
I20260709 13:00:25.584816  2236 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.556602  4541 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.540805  4484 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:25.590651  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.590907  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:25.596807  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.591598  1700 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:25.601900  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:25.601992  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 76918us
I20260709 13:00:25.578451  4427 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.602097  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:25.602842  2267 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:25.605757  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:25.605891  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:25.606428  1560 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:25.607481  4591 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:25.605150  1559 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:25.610672  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:25.610430  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.588860  4715 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.589564  4727 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.617383  4636 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:25.621857  4525 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:25.623543  1557 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:25.613896  4510 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:25.612406  4721 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:25.625336  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.620925  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:25.628320  1700 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:25.618129  4636 raft_consensus.cc:2764] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:00:25.624642  4578 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:25.630561  4721 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:25.635382  4721 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:25.643532  4551 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:25.644044  4551 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:25.644955  4694 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:25.645017  4551 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.646551  4551 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.647220  4500 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.647778  4563 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:25.648200  4563 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:25.648859  1703 raft_consensus.cc:2410] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:25.649384  4500 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:25.649020  4563 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.650730  4563 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.650969  4484 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:25.651240  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:25.629400  4444 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:25.659627  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.666857  1703 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:25.630827  4510 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:25.631497  4525 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.652216  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:25.674423  1700 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:25.676071  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:25.676684  1703 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.627715  4550 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.680083  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:25.681321  4510 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:25.684511  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:25.684511  1703 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:25.685949  1700 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.688421  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1923) took 1442 ms. Trace:
I20260709 13:00:25.688812  1708 rpcz_store.cc:276] 0709 13:00:24.247601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.072015 (+824414us) service_pool.cc:224] Handling call
0709 13:00:25.431074 (+359059us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:25.432546 (+  1472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.688225 (+255679us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54001c57d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:25.688362 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825079040}
W20260709 13:00:25.690097  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.691721  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:25.692257  1558 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.692591  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.693625  4717 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.694139  4717 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:25.694859  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1747) took 1950 ms (client timeout 1603 ms). Trace:
W20260709 13:00:25.695227  1630 rpcz_store.cc:269] 0709 13:00:23.744050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.746120 (+  2070us) service_pool.cc:224] Handling call
0709 13:00:25.694706 (+1948586us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54001662d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:25.694800 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018047232}
I20260709 13:00:25.696201  4717 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:25.692258  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:25.696800  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:25.697448  4444 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:25.697772  1673 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.698113  4444 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:25.698776  1555 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:25.698851  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.699249  4444 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.699970  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.701496  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:25.696916  1700 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:25.645880  4570 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:25.709282  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.711158  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.715415  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.715972  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.717444  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.709282  1635 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:25.718237  1632 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
W20260709 13:00:25.720054  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 109690us
I20260709 13:00:25.720940  1558 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:25.723271  1673 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.711208  1674 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.725610  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:25.730746  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.734668  4486 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:25.740672  1628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1752) took 1503 ms (client timeout 1940 ms). Trace:
W20260709 13:00:25.741155  1628 rpcz_store.cc:269] 0709 13:00:24.237036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.237167 (+   131us) service_pool.cc:224] Handling call
0709 13:00:25.740463 (+1503296us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b540034dfd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:25.740601 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439403904}
I20260709 13:00:25.744263  1526 leader_election.cc:400] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:25.745515  4541 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:00:25.746706  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1915) took 1502 ms (client timeout 1668 ms). Trace:
I20260709 13:00:25.747413  4541 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:25.747294  1701 rpcz_store.cc:269] 0709 13:00:24.243890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.517425 (+273535us) service_pool.cc:224] Handling call
0709 13:00:25.746441 (+1229016us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54000b8454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:25.746625 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584683392}
I20260709 13:00:25.748863  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:25.750905  1705 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:25.752242  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:25.726846  1600 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:25.753930  1634 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:25.682097  4525 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:25.755825  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44701.1us
I20260709 13:00:25.723351  4721 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:25.766700  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:25.765328  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.725234  4710 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.751693  4729 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:25.753885  4278 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.767396  4698 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:25.787153  4550 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:25.764973  4708 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:25.768965  4712 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:25.758906  4549 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:25.788461  4712 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:25.788669  4549 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:25.789075  4712 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.789610  4570 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:25.768389  1674 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.769385  4444 raft_consensus.cc:2764] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:25.790354  4729 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:25.791594  4729 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:25.793313  1701 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:25.764642  4723 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:25.794598  4723 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:25.795780  4723 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:25.769378  4655 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:25.776147  4732 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:00:25.799479  4525 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:25.798658  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:25.801054  1701 raft_consensus.cc:2368] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:25.753436  4653 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:00:25.801883  4653 consensus_queue.cc:1243] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:25.802439  4653 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:25.802781  4653 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:25.803561  4653 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:25.804716  4653 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:25.807462  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.809234  4444 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:25.789610  4549 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:25.808391  4170 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:25.811477  4170 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.784446  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:25.801882  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:25.811950  4170 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:25.819649  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:25.821969  1556 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:25.823767  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.823589  1554 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.824992  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.826218  1560 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:25.827734  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:25.828223  1558 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:25.839988  1558 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:25.812321  4486 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:00:25.855453  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:25.855981  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.808928  4710 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.855343  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:25.875864  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:25.878238  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:25.872606  4721 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:25.882953  1626 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:25.877907  4550 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:25.856191  4551 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:25.887022  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:25.888631  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 123442us
I20260709 13:00:25.889546  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.892967  1554 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:25.872911  4708 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:25.896095  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.899117  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:25.900314  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:25.900890  2271 raft_consensus.cc:2368] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9.
I20260709 13:00:25.881625  4703 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:25.906631  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:25.906991  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.854342  4525 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:00:25.856549  1701 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:25.907478  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.909370  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.909852  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.910645  1629 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:25.910669  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:25.911103  1630 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:25.911540  1703 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:25.912351  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:25.874688  4698 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:00:25.916272  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:25.881772  4741 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:25.885735  4550 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.919642  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.915627  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:25.919872  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.920562  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:25.926882  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.921114  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.927559  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:25.927842  1630 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:25.928206  1701 raft_consensus.cc:2376] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5. Re-sending same reply.
I20260709 13:00:25.921242  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:25.924808  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.929795  1703 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:25.930498  1629 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:25.906317  4710 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:25.930932  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:25.929109  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:25.929840  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1763) took 1633 ms. Trace:
W20260709 13:00:25.931734  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 185191us
I20260709 13:00:25.906981  4703 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.937909  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.939608  1703 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:25.951581  1701 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:25.939438  1633 rpcz_store.cc:276] 0709 13:00:24.296140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.859627 (+563487us) service_pool.cc:224] Handling call
0709 13:00:24.859929 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.074049 (+214120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.929599 (+855550us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400355f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:25.929769 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486190336}
I20260709 13:00:25.952847  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:25.886413  4721 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:25.928158  4550 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:25.966467  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.974619  1526 leader_election.cc:400] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:25.953753  4703 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:25.976512  1526 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:25.952221  4653 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.979570  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:25.980880  1633 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:00:25.981609  1634 raft_consensus.cc:2410] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:00:25.991824  4744 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:00:25.912137  4708 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.011930  4708 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:26.011549  4170 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:26.030831  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:26.032132  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.035353  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.029986  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:25.980904  4549 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.049633  1526 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:25.984113  4591 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.058445  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.055835  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:26.041766  4752 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:00:26.056525  4686 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:26.056160  4444 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:26.062153  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:25.997757  4712 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.039238  4170 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:26.071229  1627 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:26.070701  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:26.066546  4554 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:26.068560  4741 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:26.088466  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.061177  4710 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:26.071367  4686 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:26.062489  4549 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:26.086815  4554 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.092113  4741 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.106467  1599 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:26.104768  4690 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.106333  4480 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:00:26.118351  4690 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:26.120772  4549 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:26.121037  1634 raft_consensus.cc:2410] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:26.143698  4710 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.098652  4554 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:26.147481  1599 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:26.149580  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:26.150856  1555 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:26.146373  4686 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.159698  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:26.160717  1557 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.164081  4702 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.166452  4563 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:26.166940  4563 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.167320  4563 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.168141  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:26.169219  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:26.130415  4550 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.172039  4550 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:26.172232  1557 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:26.155200  4551 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.178762  4551 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.180806  4551 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:26.181896  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:26.182322  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:26.154633  4484 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:26.183146  4484 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:26.183516  4484 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.186517  4550 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:26.187058  4550 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:26.188256  2263 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:26.188503  4717 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.188812  4670 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.189018  4717 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.191009  4717 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:26.191798  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:26.192356  2267 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.193001  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.193578  2264 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:26.106994  4741 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.195832  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:26.198171  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:26.207015  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 47609.4us
I20260709 13:00:26.198197  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:26.199434  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:26.208204  2271 raft_consensus.cc:2376] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6. Re-sending same reply.
I20260709 13:00:26.201172  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:26.206154  4722 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.771s	user 0.006s	sys 0.000s
I20260709 13:00:26.188073  4550 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.211019  2267 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:26.211732  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:26.216137  2264 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:26.213440  1701 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:26.212651  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.217706  2263 raft_consensus.cc:2410] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:26.219182  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:26.219990  1701 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.228821  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.231783  2269 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 7 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:26.231930  2263 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:00:26.233146  2263 pending_rounds.cc:85] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 6
I20260709 13:00:26.233464  2263 pending_rounds.cc:107] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:26.233745  2263 raft_consensus.cc:2889] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:26.237627  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.238428  2265 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:26.238857  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:26.240550  1599 leader_election.cc:400] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9.
W20260709 13:00:26.241475  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.240929  1599 leader_election.cc:403] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:26.233796  1701 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:26.247308  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.247974  1701 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:26.253255  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.254684  1601 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:26.255620  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.256129  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:26.258234  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:26.267372  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.267668  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.269258  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.270756  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:26.275635  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:26.205564  4703 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.205754  4554 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:26.281198  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.277396  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:26.278369  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.277161  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:26.283493  1630 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:26.284265  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:26.281703  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:26.284660  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:26.285632  1630 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:26.287919  4703 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:26.288005  4649 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:26.185200  4563 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.214196  4620 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:00:26.288694  4649 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.290879  4563 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:26.294333  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:26.231382  4589 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.299679  1632 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:26.299927  1701 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:26.282521  4427 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.306257  4620 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:26.306704  4620 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.307066  4620 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.276428  4591 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:26.268803  4721 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:26.304332  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.310344  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:26.316888  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:26.317503  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:26.279016  4747 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:26.310856  1553 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:26.279265  4665 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.295138  4655 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.301460  4698 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:26.276391  4480 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:00:26.300854  4757 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:26.323846  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.301811  4444 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.310359  4510 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.320209  4591 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:26.297047  4729 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:00:26.334568  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1929) took 2512 ms. Trace:
I20260709 13:00:26.335026  1706 rpcz_store.cc:276] 0709 13:00:23.822219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.973015 (+1150796us) service_pool.cc:224] Handling call
0709 13:00:24.973379 (+   364us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:25.207857 (+234478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.207905 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:25.208801 (+   896us) log.cc:844] Serialized 78 byte log entry
0709 13:00:25.292986 (+ 84185us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:25.293048 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.293317 (+   269us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:26.187333 (+894016us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:26.330964 (+143631us) raft_consensus.cc:1685] finished
0709 13:00:26.330989 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.334510 (+  3521us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101188,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":19326,"spinlock_wait_cycles":5623552,"thread_start_us":317594,"threads_started":2,"wal-append.queue_time_us":150427}
I20260709 13:00:26.310005  4484 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.310721  4589 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:26.326519  4747 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:26.326702  4712 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:26.337658  4591 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.357704  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:26.386926  1704 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:00:26.333930  4444 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:26.389422  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 107810us
I20260709 13:00:26.358439  1706 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:26.402773  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:26.414820  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 160203us
I20260709 13:00:26.409387  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:26.416828  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:26.420588  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:26.421408  1635 raft_consensus.cc:2376] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6. Re-sending same reply.
I20260709 13:00:26.418394  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:26.424295  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:26.427794  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.426414  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.428568  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:26.428835  1708 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:26.431226  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:26.433661  4765 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:00:26.432663  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.413723  4480 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.435763  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:26.420246  4427 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.443414  1706 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:26.439466  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:26.440567  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.430990  4170 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:26.429991  4510 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:26.461882  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:26.462532  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:26.447957  4665 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:26.476977  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.478960  1700 raft_consensus.cc:2410] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:00:26.423686  4686 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:00:26.481760  4767 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:26.488399  4767 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.488859  4767 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.490718  4671 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:26.493666  4766 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:26.506778  4427 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.491479  4671 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:26.508008  4671 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:26.508371  4686 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:26.495544  4702 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:26.509423  4702 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.474799  4578 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:26.510632  4578 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:26.512360  4762 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.404s	user 0.000s	sys 0.003s
I20260709 13:00:26.512457  4702 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:26.501726  4771 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:26.432355  4747 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:26.506065  2270 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:26.514919  4665 raft_consensus.cc:697] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:26.515929  4665 consensus_queue.cc:237] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:26.500072  4768 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:00:26.517257  4655 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9.
I20260709 13:00:26.508045  4484 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:26.521047  4427 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:26.521522  4427 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:26.522480  4427 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:26.483875  4510 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:26.525339  4510 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:26.497064  4444 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:26.508481  4671 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.508919  4686 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:26.511720  4578 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:26.530172  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 101675us
I20260709 13:00:26.535660  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:26.539973  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:26.544488  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.546626  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:00:26.545894  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 110236us
I20260709 13:00:26.550534  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:26.551265  2264 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:26.551393  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:26.551932  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:26.554124  2269 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:26.554392  2265 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:26.538401  4686 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.533959  4427 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.557001  1630 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:26.579612  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:26.580967  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.582942  4784 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.583781  4784 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.584692  4784 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:26.585485  4784 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:26.585992  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:26.587253  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.596863  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.585817  4784 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:26.541882  4550 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:26.549948  4761 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:26.625072  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.626418  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:26.653710  2264 raft_consensus.cc:2410] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:00:26.547336  4444 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:00:26.657657  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.659384  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.674974  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.688795  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.690968  4761 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:26.691566  4761 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:26.581892  4620 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:26.652299  4788 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:26.653136  4550 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:26.693857  4761 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:26.718549  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1941) took 2142 ms. Trace:
I20260709 13:00:26.718634  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.719022  1709 rpcz_store.cc:276] 0709 13:00:24.576103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.280704 (+704601us) service_pool.cc:224] Handling call
0709 13:00:25.282347 (+  1643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.323689 (+ 41342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.718325 (+1394636us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b54000b7054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:26.718491 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25061248}
I20260709 13:00:26.719043  4655 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.720232  4655 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.722510  4655 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:26.720767  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:26.724501  4774 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:00:26.724421  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.725919  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.727043  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:26.727957  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.728452  1702 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:26.729705  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:26.730875  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.731949  4741 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.734261  2266 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:26.736220  2262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 729) took 1781 ms (client timeout 1931 ms). Trace:
I20260709 13:00:26.702509  4788 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.737473  4788 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:26.736882  2262 rpcz_store.cc:269] 0709 13:00:24.954547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.955005 (+   458us) service_pool.cc:224] Handling call
0709 13:00:26.735963 (+1780958us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b5400598dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:26.736131 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983154944}
I20260709 13:00:26.737872  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1932) took 2773 ms. Trace:
I20260709 13:00:26.738282  1704 rpcz_store.cc:276] 0709 13:00:23.964744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.005225 (+1040481us) service_pool.cc:224] Handling call
0709 13:00:25.005588 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.389184 (+1383596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.737631 (+348447us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54001c4dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:26.737817 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3173697792}
I20260709 13:00:26.739390  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:26.704217  4757 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:26.714834  4777 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:00:26.743966  4507 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:26.720235  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:26.736897  4767 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.747185  1600 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:26.747694  4741 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:26.765353  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:26.766266  1559 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:26.747931  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:26.749557  1704 raft_consensus.cc:2368] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10.
I20260709 13:00:26.751384  1552 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:00:26.761940  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:26.717275  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 137761us
I20260709 13:00:26.768174  1709 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:26.762980  1560 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:00:26.768307  1558 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:26.770496  1560 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:00:26.769879  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:26.771639  2262 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.769064  1524 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:26.772114  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.773458  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.773778  1558 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:26.775044  1704 raft_consensus.cc:2393] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:26.775251  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:26.777875  4665 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:26.778551  4687 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:26.780144  4665 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:26.780881  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:26.777959  4708 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:26.783629  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.785653  2262 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 13:00:26.787024  1560 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:26.812669  1600 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:26.716423  4630 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.716687  4550 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.788012  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:26.785837  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.802167  1702 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:26.826674  1552 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:26.829372  4620 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:26.831728  4630 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.787159  4708 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:26.837577  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:26.838235  1704 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.702162  4784 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:26.813978  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:26.812320  4690 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:26.807819  4767 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:26.824676  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.769670  4757 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:26.853761  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:26.833914  4630 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:26.834769  4507 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.781139  4665 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:26.864778  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:26.866338  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:26.866374  1674 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:26.868284  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:26.878854  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:26.880829  4709 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:26.880666  4775 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:26.883635  1709 raft_consensus.cc:2410] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:26.856220  4690 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:26.831751  4788 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:26.860822  4747 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.841084  4686 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:26.893278  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:26.902891  4792 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:00:26.905536  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.885198  4444 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:26.858865  4563 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:00:26.909101  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.937741  1703 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
W20260709 13:00:26.909603  4591 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.551s	user 0.002s	sys 0.007s
I20260709 13:00:26.938755  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:26.856644  4620 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:00:26.882296  4767 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:00:26.882817  4490 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:26.912036  2264 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:26.970927  1560 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.912866  4788 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:26.887392  4708 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:26.919845  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:26.989950  1630 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:26.920753  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:26.922712  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:26.900678  4541 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:26.931857  1704 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:26.882076  4757 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:26.940873  1632 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:00:26.891728  4690 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.973176  1628 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:26.967780  4671 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:27.009704  4686 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:27.066804  2271 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:27.143950  1630 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:27.439632  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1788) took 1237 ms. Trace:
I20260709 13:00:27.012382  1634 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:27.105304  1700 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:27.039076  1560 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:27.441903  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1784) took 1245 ms. Trace:
I20260709 13:00:27.442057  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1789) took 1233 ms. Trace:
I20260709 13:00:27.442498  1628 rpcz_store.cc:276] 0709 13:00:26.209111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.936891 (+727780us) service_pool.cc:224] Handling call
0709 13:00:26.972846 (+ 35955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.441805 (+468959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.441972 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.216601  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1783) took 1020 ms. Trace:
I20260709 13:00:27.444097  1635 rpcz_store.cc:276] 0709 13:00:26.196571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.449112 (+252541us) service_pool.cc:224] Handling call
0709 13:00:27.211380 (+762268us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540034dfd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:27.216510 (+  5130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693948288}
I20260709 13:00:26.395030   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:27.108779  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1945) took 1405 ms. Trace:
I20260709 13:00:27.465370  1709 rpcz_store.cc:276] 0709 13:00:25.703313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.783288 (+1079975us) service_pool.cc:224] Handling call
0709 13:00:27.108529 (+325241us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x7b54001ab8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:27.108700 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227041536}
I20260709 13:00:27.440879  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1790) took 1231 ms. Trace:
I20260709 13:00:27.439994  1630 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:27.105511  2268 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:27.474624  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1937) took 1876 ms. Trace:
I20260709 13:00:27.475381  1700 rpcz_store.cc:276] 0709 13:00:25.598266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.104810 (+1506544us) service_pool.cc:224] Handling call
0709 13:00:27.105119 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.441462 (+336343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.474519 (+ 33057us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:27.076759  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 218902us
I20260709 13:00:27.489267  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:27.112869  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1935) took 2620 ms. Trace:
I20260709 13:00:27.491671  1705 rpcz_store.cc:276] 0709 13:00:24.497799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.117888 (+620089us) service_pool.cc:224] Handling call
0709 13:00:25.750640 (+632752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.751446 (+   806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.112592 (+1361146us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54000b8450. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:27.112787 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454370176}
I20260709 13:00:27.440068  1632 rpcz_store.cc:276] 0709 13:00:26.202403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.936831 (+734428us) service_pool.cc:224] Handling call
0709 13:00:26.937144 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.439325 (+502181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.439579 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.967960  4444 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:27.467144  1634 rpcz_store.cc:276] 0709 13:00:26.209388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.011588 (+802200us) service_pool.cc:224] Handling call
0709 13:00:27.011972 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.440653 (+428681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.440829 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.507261  1709 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:27.508316  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1940) took 1903 ms. Trace:
I20260709 13:00:27.510433  2267 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:00:27.510496  1709 rpcz_store.cc:276] 0709 13:00:25.605218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.506661 (+1901443us) service_pool.cc:224] Handling call
0709 13:00:27.507048 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.507979 (+   931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.508247 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.509815  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1943) took 1884 ms. Trace:
I20260709 13:00:27.442391  1626 rpcz_store.cc:276] 0709 13:00:26.196776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.675875 (+479099us) service_pool.cc:224] Handling call
0709 13:00:26.676339 (+   464us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:26.676884 (+   545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.676929 (+    45us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:26.682251 (+  5322us) log.cc:844] Serialized 78 byte log entry
0709 13:00:26.852743 (+170492us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:26.852801 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.852897 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:27.084666 (+231769us) raft_consensus.cc:1685] finished
0709 13:00:27.084691 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.441847 (+357156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2022,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":9050,"thread_start_us":148257,"threads_started":1,"wal-append.queue_time_us":270335}
I20260709 13:00:27.531893  1635 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:27.525343  1700 rpcz_store.cc:276] 0709 13:00:25.625636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.508794 (+1883158us) service_pool.cc:224] Handling call
0709 13:00:27.509181 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.509413 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.509448 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.509505 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:27.509549 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.509622 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.509748 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:27.537300  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.538262  1700 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:26.973830  4490 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:27.084506  4754 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.101s	user 0.001s	sys 0.002s
I20260709 13:00:27.436507  4551 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.093417  4525 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:26.948134  4591 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:27.010504  4709 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.588s
I20260709 13:00:27.101779  4550 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:27.550715  2269 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:27.955564  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1944) took 2327 ms. Trace:
I20260709 13:00:27.955943  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 856) took 1130 ms. Trace:
I20260709 13:00:27.955603  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1948) took 2301 ms. Trace:
W20260709 13:00:27.924032  1557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.011s	sys 0.032s
W20260709 13:00:27.905881  1555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.006s	sys 0.008s
W20260709 13:00:27.970877  1557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.014s	sys 0.034s
W20260709 13:00:27.971323  1555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.008s	sys 0.008s
I20260709 13:00:27.956107  1630 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:27.967206  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1939) took 2364 ms. Trace:
I20260709 13:00:27.971076  1700 rpcz_store.cc:276] 0709 13:00:25.654595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.537227 (+1882632us) service_pool.cc:224] Handling call
0709 13:00:27.537651 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.538837 (+  1186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.955559 (+416722us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.970180  1705 rpcz_store.cc:276] 0709 13:00:25.628615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.525776 (+1897161us) service_pool.cc:224] Handling call
0709 13:00:27.552735 (+ 26959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.553181 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.553251 (+    70us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.553337 (+    86us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:27.553410 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.553578 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.955507 (+401929us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.449836  4292 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.450974  4549 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.483632  4690 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:27.954973  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.450019  4649 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:27.652981  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 163849us
I20260709 13:00:27.973052  1704 rpcz_store.cc:276] 0709 13:00:25.603327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.506236 (+1902909us) service_pool.cc:224] Handling call
0709 13:00:27.966546 (+460310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.966791 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.966830 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.966887 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:27.966929 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.967010 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.967146 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.970314  2271 rpcz_store.cc:276] 0709 13:00:26.825755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.505582 (+679827us) service_pool.cc:224] Handling call
0709 13:00:27.955367 (+449785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.955620 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.955653 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.955691 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:27.955725 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.955779 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.955885 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.983826  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:27.991379  1526 connection.cc:256] RPC call timeout handler was delayed by -1.5083583560000307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 13:00:27.991992  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.753921  4655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.009s	sys 0.018s
W20260709 13:00:27.682613  4570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.022s	sys 0.012s
W20260709 13:00:27.877664  4723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.008s	sys 0.032s
I20260709 13:00:27.995301  2262 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:27.738525  4764 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.592s	user 0.008s	sys 0.003s
I20260709 13:00:27.644721  4427 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:27.999897  1601 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:27.903479  4671 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.000569  1701 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:00:28.001060  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.707942  4773 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.056s	user 0.003s	sys 0.000s
I20260709 13:00:28.004576  1706 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:27.707334  4541 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.007462  1705 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:27.972971  4490 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.006871  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 526) took 2151 ms. Trace:
I20260709 13:00:28.005985  1704 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:28.001508  4570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.022s	sys 0.029s
I20260709 13:00:28.023392  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1957) took 1841 ms. Trace:
W20260709 13:00:27.996733  4655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.015s	sys 0.025s
I20260709 13:00:28.027379  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1949) took 2358 ms. Trace:
I20260709 13:00:28.030562  1706 rpcz_store.cc:276] 0709 13:00:26.181538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.999411 (+1817873us) service_pool.cc:224] Handling call
0709 13:00:27.999691 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.023111 (+ 23420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.023326 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.030753  1704 rpcz_store.cc:276] 0709 13:00:25.669307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.005321 (+2336014us) service_pool.cc:224] Handling call
0709 13:00:28.005819 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.027117 (+ 21298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.027322 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:27.970271  4525 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:27.997210  4649 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.026701  1707 rpcz_store.cc:276] 0709 13:00:25.855929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.993349 (+2137420us) service_pool.cc:224] Handling call
0709 13:00:28.006408 (+ 13059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.006579 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.006602 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.006640 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:28.006667 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.006717 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.006819 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.029119  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1943) took 2326 ms. Trace:
I20260709 13:00:28.033563  1705 rpcz_store.cc:276] 0709 13:00:25.702787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.988077 (+2285290us) service_pool.cc:224] Handling call
0709 13:00:28.007299 (+ 19222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.028799 (+ 21500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.029048 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.047475  1707 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260709 13:00:28.048250  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1967) took 1788 ms. Trace:
I20260709 13:00:28.048664  1707 rpcz_store.cc:276] 0709 13:00:26.259746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.033753 (+1774007us) service_pool.cc:224] Handling call
0709 13:00:28.047225 (+ 13472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:28.047984 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.048192 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.052042  1707 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:00:28.005115  4723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.011s	sys 0.037s
I20260709 13:00:28.053040  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1961) took 1597 ms. Trace:
I20260709 13:00:28.053495  1707 rpcz_store.cc:276] 0709 13:00:26.455906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.051368 (+1595462us) service_pool.cc:224] Handling call
0709 13:00:28.051715 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.052453 (+   738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.052980 (+   527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.051770  4655 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:28.054189  1706 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:28.054774  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1955) took 1873 ms. Trace:
I20260709 13:00:27.982735  4551 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:27.994457  4292 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.022694  4665 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:27.993886  4549 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.070653  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2086) took 2114 ms. Trace:
I20260709 13:00:28.071477  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1968) took 1811 ms. Trace:
I20260709 13:00:28.071134  1629 rpcz_store.cc:276] 0709 13:00:25.956046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.956324 (+   278us) service_pool.cc:224] Handling call
0709 13:00:25.956785 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:25.957548 (+   763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.957649 (+   101us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:25.974565 (+ 16916us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.096190 (+121625us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:26.096216 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.096296 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:27.432764 (+1336468us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:28.070355 (+637591us) raft_consensus.cc:1685] finished
0709 13:00:28.070376 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.070580 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5359,"raft.queue_time_us":370,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":17974,"spinlock_wait_cycles":4840320,"thread_start_us":45023,"threads_started":1,"wal-append.queue_time_us":121084}
I20260709 13:00:28.072877  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1958) took 1891 ms. Trace:
I20260709 13:00:28.048491  4761 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.075294  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.000s	sys 0.042s
I20260709 13:00:28.048300  4484 raft_consensus.cc:476] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:28.073422  1706 rpcz_store.cc:276] 0709 13:00:26.181773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.031735 (+1849962us) service_pool.cc:224] Handling call
0709 13:00:28.053573 (+ 21838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.059077 (+  5504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.072816 (+ 13739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.075150  1701 rpcz_store.cc:276] 0709 13:00:26.180994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.000013 (+1819019us) service_pool.cc:224] Handling call
0709 13:00:28.000269 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.054525 (+ 54256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.054719 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.071946  1705 rpcz_store.cc:276] 0709 13:00:26.260032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.034587 (+1774555us) service_pool.cc:224] Handling call
0709 13:00:28.070978 (+ 36391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.071157 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.071184 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.071229 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:28.071260 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.071313 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.071424 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.047950  4591 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:28.048396  4763 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.707659  4444 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.025606  4620 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 13:00:28.078095  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.001s	sys 0.042s
I20260709 13:00:28.052605  4671 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:28.055301  4653 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:28.025895  4563 consensus_queue.cc:1059] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:00:28.031599  4541 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.075886  4723 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:28.241981  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2074) took 4564 ms (client timeout 2110 ms). Trace:
I20260709 13:00:28.244225  4821 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:28.333061  1627 rpcz_store.cc:269] 0709 13:00:23.674966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.675072 (+   106us) service_pool.cc:224] Handling call
0709 13:00:28.239130 (+4564058us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54000893d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:28.239274 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5340435200}
I20260709 13:00:28.245409  1703 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:28.262770  4278 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.267518  4814 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
W20260709 13:00:28.270370  4818 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:00:28.058059  4649 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.228716  4799 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.081794  4761 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:28.280568  4551 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.282429  4292 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:28.244843  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 529) took 1969 ms. Trace:
I20260709 13:00:28.355365  1702 rpcz_store.cc:276] 0709 13:00:26.275868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.730575 (+454707us) service_pool.cc:224] Handling call
0709 13:00:28.244615 (+1514040us) spinlock_profiling.cc:243] Waited 68.9 ms on lock 0x7b54001fe854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:28.244781 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158554880}
I20260709 13:00:28.336450  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 689) took 1785 ms. Trace:
I20260709 13:00:28.344835  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:28.357281  1627 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:28.329986  4653 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:28.350723  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:28.358634  1629 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:28.361769  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1967) took 1590 ms. Trace:
I20260709 13:00:28.362200  1702 rpcz_store.cc:276] 0709 13:00:26.771764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.356652 (+1584888us) service_pool.cc:224] Handling call
0709 13:00:28.361286 (+  4634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.361454 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.361479 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.361518 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:28.361546 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.361597 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.361717 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.357007  2265 rpcz_store.cc:276] 0709 13:00:26.550709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.575587 (+ 24878us) service_pool.cc:224] Handling call
0709 13:00:26.575925 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:26.755043 (+179118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.755073 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:26.755639 (+   566us) log.cc:844] Serialized 52 byte log entry
0709 13:00:26.935470 (+179831us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:26.974088 (+ 38618us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.995095 (+ 21007us) log.cc:844] Serialized 14 byte log entry
0709 13:00:27.003368 (+  8273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.003482 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.336130 (+1332648us) raft_consensus.cc:1685] finished
0709 13:00:28.336163 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.336364 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164147,"prepare.queue_time_us":650011,"prepare.run_cpu_time_us":202,"prepare.run_wall_time_us":7784,"raft.queue_time_us":89219,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":125506,"spinlock_wait_cycles":204932352,"thread_start_us":272515,"threads_started":2,"wal-append.queue_time_us":1369103}
I20260709 13:00:28.325670  4763 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.332149  4671 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.359802  4551 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:28.343259  4278 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.521665  4292 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.525586  4563 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:00:28.536947  1700 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.002s	sys 0.002s
I20260709 13:00:28.337666  4723 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.528086  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:28.556545  1700 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.003s	sys 0.003s
W20260709 13:00:28.554648  1709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.006s
W20260709 13:00:28.557451  1709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.000s	sys 0.006s
I20260709 13:00:28.337355  4821 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.353502  4799 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:28.491999  4815 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 13:00:28.543561  1558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.004s	sys 0.001s
W20260709 13:00:28.543169  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.001s	sys 0.004s
W20260709 13:00:28.537611  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.005s
W20260709 13:00:28.559017  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.491009  4550 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:28.563447  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.000s	sys 0.006s
W20260709 13:00:28.563381  1558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.004s	sys 0.001s
W20260709 13:00:28.563282  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.001s	sys 0.005s
I20260709 13:00:28.527907  4822 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.570906  1702 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:00:28.574244  1673 leader_election.cc:336] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.532s (SENT)
I20260709 13:00:28.574532  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1798) took 1474 ms. Trace:
I20260709 13:00:28.575702  1630 rpcz_store.cc:276] 0709 13:00:27.099915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.468484 (+368569us) service_pool.cc:224] Handling call
0709 13:00:27.505860 (+ 37376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.973080 (+467220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.574219 (+601139us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b5400088ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:28.574445 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035001728}
W20260709 13:00:28.577064  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.004s	sys 0.004s
W20260709 13:00:28.577420  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.004s	sys 0.004s
W20260709 13:00:28.577716  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 555168us
W20260709 13:00:28.580389  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.002s	sys 0.005s
W20260709 13:00:28.584791  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.003s	sys 0.005s
I20260709 13:00:28.549569  4665 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:28.534332  4551 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:28.586912  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 528985us
I20260709 13:00:28.607379  1630 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:00:28.608762  4821 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.609330  4821 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.610744  4840 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:28.611311  4838 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:28.611800  4541 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.550187  4653 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.611999  4838 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.612852  4653 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:28.614964  4838 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.615620  4838 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:28.616186  4816 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.535s	user 0.003s	sys 0.008s
I20260709 13:00:28.609055  4832 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:28.554382  4563 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.539914  4292 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.589946  4831 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:28.621811  4551 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:28.621186  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 43818.8us
W20260709 13:00:28.657135  1673 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Timed out: RequestConsensusVote RPC to 127.0.107.194:39441 timed out after 1.603s (SENT)
W20260709 13:00:28.624375  1704 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.011s	sys 0.003s
W20260709 13:00:28.628505  2236 connection.cc:256] RPC call timeout handler was delayed by -1.0891822510000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 13:00:28.660029  1704 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.011s	sys 0.004s
W20260709 13:00:28.628897  1674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.003s	sys 0.010s
I20260709 13:00:28.617415  4589 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.593149  4834 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.609082  4784 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:28.664249  4839 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:28.664819  4839 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.666358  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1786) took 1737 ms. Trace:
I20260709 13:00:28.666929  4839 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.630362  4578 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:28.667758  4578 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:28.666776  1558 rpcz_store.cc:276] 0709 13:00:26.928766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.928941 (+   175us) service_pool.cc:224] Handling call
0709 13:00:26.929405 (+   464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:27.441694 (+512289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.441728 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:27.968805 (+527077us) log.cc:844] Serialized 52 byte log entry
0709 13:00:28.564782 (+595977us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:28.564820 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.564884 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.666106 (+101222us) raft_consensus.cc:1685] finished
0709 13:00:28.666128 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.666288 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99783,"raft.queue_time_us":576663,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6549,"thread_start_us":557053,"threads_started":1,"wal-append.queue_time_us":654420}
I20260709 13:00:28.630589  4761 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:28.669641  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1945) took 3037 ms. Trace:
I20260709 13:00:28.670013  1709 rpcz_store.cc:276] 0709 13:00:25.632679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.514619 (+1881940us) service_pool.cc:224] Handling call
0709 13:00:27.515109 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.515423 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.515465 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:27.968470 (+453005us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.557851 (+589381us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:28.557885 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.557947 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.669430 (+111483us) raft_consensus.cc:1685] finished
0709 13:00:28.669458 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.669586 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":535441,"threads_started":1,"wal-append.queue_time_us":669525}
I20260709 13:00:28.671665  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:28.630771  1702 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:28.672271  1709 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:28.672458  1702 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:28.673640  1709 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:28.635075  4723 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:28.616205  4838 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.670055  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 750) took 2118 ms. Trace:
I20260709 13:00:28.674461  2269 rpcz_store.cc:276] 0709 13:00:26.551238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.579881 (+ 28643us) service_pool.cc:224] Handling call
0709 13:00:26.630526 (+ 50645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.971932 (+1341406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.669801 (+697869us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b5400671e54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:28.669959 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2115222400}
I20260709 13:00:28.675663  4838 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.676360  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1770) took 1924 ms. Trace:
W20260709 13:00:28.677240  4690 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.675s	user 0.002s	sys 0.008s
I20260709 13:00:28.579933  4822 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:28.678097  4490 consensus_meta.cc:287] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.000s
I20260709 13:00:28.678534  4490 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.679867  4822 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:28.658690  4831 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.680625  4690 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:28.681926  1635 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:28.640218  4278 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:28.682300  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1782) took 1887 ms. Trace:
I20260709 13:00:28.640475  4763 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:28.609761  4821 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.683229  1709 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:28.684046  4554 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:28.684368  4821 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.593945  4550 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:28.684674  4799 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:28.685201  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 594) took 4296 ms. Trace:
W20260709 13:00:28.687314  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 703617us
I20260709 13:00:28.611317  4840 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.682698  1555 rpcz_store.cc:276] 0709 13:00:26.795172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.795323 (+   151us) service_pool.cc:224] Handling call
0709 13:00:26.824476 (+ 29153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.824776 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:27.326418 (+501642us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.681941 (+1355523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.681991 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:28.682065 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.682136 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.682243 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":708477,"prepare.queue_time_us":1047912,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":711467,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47,"thread_start_us":1131341,"threads_started":2,"wal-append.queue_time_us":739651}
I20260709 13:00:28.660496  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:28.663291  4834 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.673302  1702 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.590564  4570 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:00:28.676792  4665 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.683153  4757 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:28.688107  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:28.633227  4653 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:28.658864  1673 leader_election.cc:336] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Timed out: RequestConsensusVote RPC to 127.0.107.194:39441 timed out after 1.857s (SENT)
I20260709 13:00:28.702713  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:28.688845  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:28.638631  4649 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:28.661235  1674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.003s	sys 0.010s
I20260709 13:00:28.685639  1631 rpcz_store.cc:276] 0709 13:00:24.388338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.931174 (+542836us) service_pool.cc:224] Handling call
0709 13:00:24.931542 (+   368us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:24.931979 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.932014 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:26.085201 (+1153187us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b1800268780. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a
0709 13:00:26.085612 (+   411us) log.cc:844] Serialized 78 byte log entry
0709 13:00:26.326884 (+241272us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:26.338216 (+ 11332us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.338474 (+   258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.338560 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.677630 (+2339070us) spinlock_profiling.cc:243] Waited 925 us on lock 0x7b1800268780. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1
0709 13:00:28.678183 (+   553us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b1800268780. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:28.684978 (+  6795us) raft_consensus.cc:1685] finished
0709 13:00:28.685000 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.685144 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10389,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":1986,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":8382,"spinlock_wait_cycles":14594304,"thread_start_us":229415,"threads_started":1,"wal-append.queue_time_us":248892}
I20260709 13:00:28.635134  4833 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:28.696447  1702 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:28.696561  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 165882us
I20260709 13:00:28.697834  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:28.710441  1552 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:00:28.715512  1559 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:00:28.715570  1552 pending_rounds.cc:85] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 4
I20260709 13:00:28.715958  1559 pending_rounds.cc:85] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 3
I20260709 13:00:28.716153  1552 pending_rounds.cc:107] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:28.716663  1552 raft_consensus.cc:2889] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:28.718456  2267 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:28.720624  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:28.721354  2267 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.716264  1559 pending_rounds.cc:107] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:00:28.722316  1559 raft_consensus.cc:2889] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:28.730757  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 71925.6us
I20260709 13:00:28.731433  4834 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:28.731806  1673 leader_election.cc:336] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Timed out: RequestConsensusVote RPC to 127.0.107.194:39441 timed out after 1.870s (SENT)
I20260709 13:00:28.732220  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:28.733217  1673 leader_election.cc:336] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Timed out: RequestConsensusVote RPC to 127.0.107.194:39441 timed out after 1.940s (SENT)
I20260709 13:00:28.733645  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:28.735189  2265 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:28.699079  4811 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:28.699577  4821 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:28.741559  1558 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:28.737668  1553 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:28.742877  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:28.743870  2269 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.745187  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 682) took 2197 ms. Trace:
I20260709 13:00:28.701043  4836 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.745530  2266 rpcz_store.cc:276] 0709 13:00:26.548088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.548205 (+   117us) service_pool.cc:224] Handling call
0709 13:00:26.579079 (+ 30874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.734653 (+155574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.744981 (+2010328us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540064c8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:28.745134 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356481280}
I20260709 13:00:28.685145  4550 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.701412  4427 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.750245  1556 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:00:28.750880  1556 pending_rounds.cc:85] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 1
W20260709 13:00:28.751161  2270 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 674) took 2843 ms (client timeout 2081 ms). Trace:
I20260709 13:00:28.751322  1556 pending_rounds.cc:107] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:28.751704  1556 raft_consensus.cc:2889] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:28.749135  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 61137.9us
I20260709 13:00:28.702203  4846 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.753417  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:28.740005  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:28.751565  2270 rpcz_store.cc:269] 0709 13:00:25.896454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.898141 (+  1687us) service_pool.cc:224] Handling call
0709 13:00:28.739323 (+2841182us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400269154. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:28.739461 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333315968}
I20260709 13:00:28.745915  2267 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:28.754805  2265 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
W20260709 13:00:28.757205  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 68438.1us
I20260709 13:00:28.758227  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:28.791844  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 58660.8us
I20260709 13:00:28.738999  4649 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:28.800252  2269 raft_consensus.cc:2410] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:28.748620  4799 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:28.807528  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 92383.1us
I20260709 13:00:28.740545  4698 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:28.718452  4653 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.710108  4757 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.734853  4833 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.740903  4821 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:28.848814  4644 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:28.849445  4821 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.785323  4541 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:28.760044  4563 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:28.853087  4563 consensus_queue.cc:1059] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:28.773738  4836 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.863898  4836 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:28.737255  4850 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:00:28.868463  4840 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.785044  4846 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.870990  4846 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:28.871487  4846 raft_consensus.cc:3055] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:28.871805  4846 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:28.873724  1702 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:00:28.874419  1702 pending_rounds.cc:85] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 4
I20260709 13:00:28.874678  1702 pending_rounds.cc:107] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:00:28.874909  1702 raft_consensus.cc:2889] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:28.875391  4653 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:28.794520  4278 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:28.835042  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 847) took 2246 ms. Trace:
I20260709 13:00:28.789496  4591 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:28.771811  4822 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:28.784803  4427 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.788957  4589 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:28.825052  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:28.785703  4554 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.809122  4649 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.796315  4811 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.834882  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:28.826172  4444 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:00:28.902860  2266 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:00:28.849735  4644 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:28.880699  2262 rpcz_store.cc:276] 0709 13:00:26.588431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.878316 (+289885us) service_pool.cc:224] Handling call
0709 13:00:26.886266 (+  7950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.003743 (+1117477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.834727 (+830984us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400566b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:28.834957 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2550328576}
I20260709 13:00:28.889228  2269 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:28.872552  4846 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:28.935442  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 237955us
I20260709 13:00:28.940510  4852 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:28.903431  4649 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:28.949049  4833 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.908653  4554 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.945536  4690 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.894397  4589 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.889815  4822 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.953277  4554 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.902370  4811 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:28.953845  4589 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.946173  4427 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:28.947064  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.948592  4550 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:28.962531  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 160228us
I20260709 13:00:28.965232  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:28.966425  4846 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:28.968398  4708 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:28.959679  4822 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.971297  4811 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.975594  4578 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.976162  4649 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:28.976704  4578 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:28.982658  4170 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:28.984367  4170 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:28.980090  4822 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:29.002082  4671 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.991557  4490 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:28.982200  4649 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:29.000766  4757 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:29.013015  4831 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:29.053146  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 299584us
I20260709 13:00:29.055881  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:29.059705  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:29.086364  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 276665us
I20260709 13:00:29.087545  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.089073  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:29.089419  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:29.091711  1560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1785) took 2223 ms (client timeout 1783 ms). Trace:
I20260709 13:00:29.092469  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.094833  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:28.676748  1557 rpcz_store.cc:276] 0709 13:00:26.752222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.752382 (+   160us) service_pool.cc:224] Handling call
0709 13:00:26.779924 (+ 27542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.780172 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:26.972128 (+191956us) log.cc:844] Serialized 14 byte log entry
0709 13:00:27.972713 (+1000585us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.675732 (+703019us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b180042a600. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:00:28.676006 (+   274us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:28.676070 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:28.676115 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.676183 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.676308 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":689305,"prepare.queue_time_us":1100582,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":721787,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":19350,"spinlock_wait_cycles":11022592,"thread_start_us":1189910,"threads_started":2,"wal-append.queue_time_us":1053298}
W20260709 13:00:29.068269  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 310037us
I20260709 13:00:29.068760  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:29.070202  1552 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:29.091744  1626 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:29.070813  1554 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:00:29.081073  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.081394  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:29.094905  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.096068  1632 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:29.067446  1556 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:29.098590  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:29.099031  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1799) took 1092 ms. Trace:
W20260709 13:00:29.099675  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 305812us
I20260709 13:00:29.100710  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1936) took 3509 ms. Trace:
I20260709 13:00:29.103634  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.105124  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:29.063907  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:28.979679  2234 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:29.127202  1634 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:29.128512  1633 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:29.129417  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 149698us
I20260709 13:00:29.130650  4821 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:29.132725  1553 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 3.
I20260709 13:00:29.132833  4819 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:29.134531  4665 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:29.134974  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:29.136807  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:29.138573  4690 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:29.139199  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:28.993368  4170 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.139873  4831 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:29.151335  4831 consensus_queue.cc:1243] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:00:29.151893  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 63132.3us
I20260709 13:00:29.151655  4525 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:29.152994  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:29.153199  4170 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:29.153414  4525 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.154479  4846 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.155071  4846 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:29.141396  4570 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.155599  4846 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.156003  4570 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.158394  4831 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.141263  4837 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:00:29.092259  1560 rpcz_store.cc:269] 0709 13:00:26.867871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.868007 (+   136us) service_pool.cc:224] Handling call
0709 13:00:29.091276 (+2223269us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540031ef54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:29.091482 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234657536}
I20260709 13:00:29.163434  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.164903  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1951) took 3458 ms. Trace:
I20260709 13:00:29.112684  1703 rpcz_store.cc:276] 0709 13:00:25.591383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.969318 (+1377935us) service_pool.cc:224] Handling call
0709 13:00:28.245225 (+1275907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.334578 (+ 89353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.099992 (+765414us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001fe850. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:29.100352 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2933513984}
I20260709 13:00:29.165443  1700 rpcz_store.cc:276] 0709 13:00:25.706694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.996237 (+2289543us) service_pool.cc:224] Handling call
0709 13:00:27.996643 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.996917 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:28.561653 (+564736us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.793642 (+231989us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.793888 (+   246us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.014511 (+220623us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b18000372a0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:29.105332 (+ 90821us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b18000372a0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:00:29.164095 (+ 58763us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.164215 (+   120us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:29.164361 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.164470 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.164668 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78791,"prepare.queue_time_us":629907,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":6302,"raft.queue_time_us":79206,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":91,"spinlock_wait_cycles":22882048,"thread_start_us":744715,"threads_started":2,"wal-append.queue_time_us":317263}
I20260709 13:00:29.167925  4549 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:29.168179  1599 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:29.169445  4811 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:29.170535  4553 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:29.170465  4811 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:29.171195  4553 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:29.173066  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.173321  2234 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:29.174180  4857 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:29.174537  4859 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:29.175238  4857 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.175980  4821 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:29.177294  1553 raft_consensus.cc:2410] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:00:29.172693  4553 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.178490  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:29.179466  1628 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:28.981807  2264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 848) took 2357 ms (client timeout 1972 ms). Trace:
W20260709 13:00:29.180377  2264 rpcz_store.cc:269] 0709 13:00:26.625038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.688489 (+ 63451us) service_pool.cc:224] Handling call
0709 13:00:28.981592 (+2293103us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b540005ee54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:28.981723 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511215360}
I20260709 13:00:29.173413  4811 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:29.182883  4278 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:29.186374  4427 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:29.186651  4779 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:29.187211  4779 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:29.137748  4665 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:00:29.189412  4490 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:29.092510  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.190052  4444 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.190665  1629 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:29.190810  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:29.192657  4649 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:29.193447  4649 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:29.165436  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.112291  1635 rpcz_store.cc:276] 0709 13:00:28.006430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.006566 (+   136us) service_pool.cc:224] Handling call
0709 13:00:28.006811 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.682349 (+675538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.098511 (+416162us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b540018e7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:29.098832 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552301312}
I20260709 13:00:29.159026  4831 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:29.219329  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:29.221007  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 60701.5us
I20260709 13:00:29.189944  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:29.231564  4570 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:29.223870  4831 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.237265  1559 raft_consensus.cc:2410] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:29.189980  4490 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:29.177922  4857 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:29.247503  4427 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:00:29.252046  4649 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.252997  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:29.253813  2270 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:29.255355  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:29.256738  4811 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:29.258261  2266 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEARNER]: Advancing to term 9
W20260709 13:00:29.258999  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 69359.2us
I20260709 13:00:29.260051  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:29.249330  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:29.272064  1634 raft_consensus.cc:2410] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:29.272101  1633 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:29.190701  4444 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.266665  4819 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:29.280403  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:29.281121  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:29.223587  4779 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:29.282778  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:29.291553  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:29.302064  1456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35568 (request call id 320) took 12219 ms (client timeout 15000 ms). Trace:
I20260709 13:00:29.306304  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:29.308159  4444 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:29.283586  4570 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:29.327539  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:29.329459  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.331004  1559 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:29.331143  1705 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:00:29.331640  4671 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:00:29.334632  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.335500  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:29.335609  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:29.335775  4620 raft_consensus.cc:3055] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:29.336200  4553 consensus_queue.cc:1059] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:29.347470  1705 pending_rounds.cc:85] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 3
I20260709 13:00:29.337493  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:29.337642  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 239436us
I20260709 13:00:29.338140  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.338274  4828 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.339035  4877 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.359674  2271 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.340961  4292 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:29.344774  1554 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:29.323297  1526 leader_election.cc:400] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10.
I20260709 13:00:29.337047  1702 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:29.361627  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:29.322291  4570 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.369252  2266 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:29.359253  1705 pending_rounds.cc:107] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 8.4
W20260709 13:00:29.375108  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 112321us
I20260709 13:00:29.358960  4620 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:29.375963  1705 raft_consensus.cc:2889] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:29.372972  4570 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:29.383966  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 74680.4us
I20260709 13:00:29.385027  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:29.383637  1700 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.389711  1524 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:29.392272  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.401088  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1966) took 3062 ms. Trace:
I20260709 13:00:29.399519  1703 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.389585  4490 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.394644  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:29.406612  1554 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:00:29.387724  4828 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:29.406131  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 142446us
I20260709 13:00:29.410588  4655 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.411170  4822 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:29.411746  4822 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:29.411341  4655 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.412281  4822 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:29.409813  4811 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:29.414467  4427 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.415022  4811 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:29.415308  4427 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:29.416422  4779 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:29.418184  4792 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.418661  4792 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:29.393599  4877 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:29.425403  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 45333.8us
I20260709 13:00:29.426671  4877 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:29.427872  4620 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.428395  4589 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:29.429239  4620 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.407331  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.409686  2265 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
W20260709 13:00:29.438452  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.438896  2234 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:29.429514  4589 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:29.428946  4846 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.434355  4554 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:29.417850  4427 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:29.446743  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1964) took 2846 ms. Trace:
I20260709 13:00:29.450820  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:29.452469  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.401598  1704 rpcz_store.cc:276] 0709 13:00:26.259473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.031815 (+1772342us) service_pool.cc:224] Handling call
0709 13:00:28.032135 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.660535 (+628400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.660565 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.694211 (+ 33646us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.845004 (+150793us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:28.884122 (+ 39118us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.281297 (+397175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.297764 (+ 16467us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.321343 (+ 23579us) raft_consensus.cc:1685] finished
0709 13:00:29.321361 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.321495 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":243309,"prepare.queue_time_us":38926,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":360753,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":141494,"thread_start_us":792591,"threads_started":3,"wal-append.queue_time_us":181427}
I20260709 13:00:29.441850  4708 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.466617  4550 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:29.467218  4550 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.467649  4550 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:29.470399  4860 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:29.475282  1627 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
W20260709 13:00:29.478309  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.478773  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:29.479473  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.480528  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.482247  4708 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.482995  4655 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:29.483649  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.484520  1630 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 13:00:29.484881  4846 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:29.416406  4811 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.465230  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.485494  4831 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.485847  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.486845  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.487389  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.487701  4831 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:29.488297  1630 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:29.488592  2234 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:29.487388  1702 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
W20260709 13:00:29.311022  1456 rpcz_store.cc:269] 0709 13:00:17.082824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.155794 (+ 72970us) service_pool.cc:224] Handling call
0709 13:00:29.301719 (+12145925us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:25.344525 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:25.416652 (+ 72127us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:25.416689 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:00:25.416708 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:25.451015 (+ 34307us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:25.455206 (+  4191us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:25.456340 (+  1134us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:00:25.517061 (+ 60721us) tablet.cc:701] Row locks acquired
0709 13:00:25.517082 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:00:25.517240 (+   158us) write_op.cc:270] Start()
0709 13:00:25.517362 (+   122us) write_op.cc:276] Timestamp: P: 1783602025517191 usec, L: 0
0709 13:00:25.517383 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:25.518114 (+   731us) log.cc:844] Serialized 7083 byte log entry
0709 13:00:25.729167 (+211053us) op_driver.cc:464] REPLICATION: finished
0709 13:00:26.058377 (+329210us) write_op.cc:301] APPLY: starting
0709 13:00:26.058470 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:26.058806 (+   336us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:26.081511 (+ 22705us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:26.116356 (+ 34845us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:26.116656 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:00:26.116705 (+    49us) write_op.cc:312] APPLY: finished
0709 13:00:26.117205 (+   500us) log.cc:844] Serialized 125 byte log entry
0709 13:00:26.122772 (+  5567us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:26.122947 (+   175us) write_op.cc:454] Released schema lock
0709 13:00:26.123013 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:26.123443 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:26.123474 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":637333,"reported_tablets":39,"spinlock_wait_cycles":9088,"child_traces":[["op",{"apply.queue_time_us":305475,"apply.run_cpu_time_us":5649,"apply.run_wall_time_us":70786,"num_ops":18,"prepare.queue_time_us":219266,"prepare.run_cpu_time_us":28261,"prepare.run_wall_time_us":259266,"raft.queue_time_us":104031,"raft.run_cpu_time_us":36027,"raft.run_wall_time_us":181576,"replication_time_us":211582,"thread_start_us":411226,"threads_started":4,"wal-append.queue_time_us":100196,"wal-append.run_cpu_time_us":16323,"wal-append.run_wall_time_us":1522963}]]}
I20260709 13:00:29.482553  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.475415  4828 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:29.481889  1703 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:29.505923  2271 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:29.510326  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.451500  4554 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:29.446210  4787 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:29.516324  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:29.501943  4877 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:29.520195  4877 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:29.518603  4444 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:29.521867  4444 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.524703  4444 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:29.525144  2267 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:29.519464  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.506165  4671 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:29.518649  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:29.450408  1701 rpcz_store.cc:276] 0709 13:00:26.528573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.082116 (+1553543us) service_pool.cc:224] Handling call
0709 13:00:28.083159 (+  1043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.083379 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:28.366613 (+283234us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.686771 (+320158us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.772542 (+ 85771us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.987815 (+215273us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b180017f4a0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2522 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:29.298217 (+310402us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.320235 (+ 22018us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:29.325100 (+  4865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.358538 (+ 33438us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.375373 (+ 16835us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":992604,"prepare.queue_time_us":545718,"prepare.run_cpu_time_us":141,"prepare.run_wall_time_us":2661,"raft.queue_time_us":651299,"raft.run_cpu_time_us":493,"raft.run_wall_time_us":16013,"spinlock_wait_cycles":65157888,"thread_start_us":577704,"threads_started":4,"wal-append.queue_time_us":272223}
I20260709 13:00:29.534528  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.536096  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:29.500561  4427 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:29.529336  4490 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:29.567813  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.787128  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:29.808959  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:29.555339  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.530305  4671 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:29.807140  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 220903us
I20260709 13:00:29.807767  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:29.590164  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1962) took 3133 ms. Trace:
I20260709 13:00:29.811072  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:29.797654  1700 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:29.590430  1703 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:29.635213  1599 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.254:36797, user_credentials={real_user=slave}} blocked reactor thread for 51363us
I20260709 13:00:29.686343  4787 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:29.543040  1524 connection.cc:256] RPC call timeout handler was delayed by -2.19945564599999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
I20260709 13:00:29.830354  2265 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:00:29.831257  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 366964us
I20260709 13:00:29.836165  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.600229  4715 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:29.599421  4665 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:29.585369  4649 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:29.794593  4708 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:29.656344  4881 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:00:29.556646  4444 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.596648  4877 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:29.604035  4828 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:29.847288  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:29.827384  4671 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.585922  4427 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:29.854355  1631 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:29.855232  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.855196  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.602205  4856 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:29.861351  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.861838  4578 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.856560  4859 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:29.862919  2235 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.579s (SENT) [suppressed 36 similar messages]
I20260709 13:00:29.870447  2264 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:29.840794  4589 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:29.844518  4821 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.838191  4715 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:29.884955  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:29.841512  4665 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:29.887689  1526 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:29.890940  1701 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:29.886577  4578 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.891446  4589 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.856688  4860 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.889887  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:29.818612  1707 rpcz_store.cc:276] 0709 13:00:26.456155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.054500 (+1598345us) service_pool.cc:224] Handling call
0709 13:00:28.060197 (+  5697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.882557 (+822360us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:29.102153 (+219596us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.338018 (+235865us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.338141 (+   123us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:29.338286 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.589733 (+251447us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54001df954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:29.589789 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.589969 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43076,"prepare.queue_time_us":26330,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":7049,"raft.queue_time_us":50006,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":160,"spinlock_wait_cycles":1890721024,"thread_start_us":370327,"threads_started":2,"wal-append.queue_time_us":235590}
I20260709 13:00:29.897677  1700 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:29.898181  4859 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:29.596475  4554 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.899778  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:29.901605  1601 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:29.903159  4821 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:29.894654  4525 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.741s	user 0.010s	sys 0.006s
W20260709 13:00:29.909601  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.853474  4570 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.915660  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.917665  2268 raft_consensus.cc:2393] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:00:29.919320  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 43961.9us
I20260709 13:00:29.917318  1630 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:29.920282  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:29.911054  4857 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:29.920281  2234 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:29.932089  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.934154  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:29.936167  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:29.936352  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:29.936800  1560 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.937160  2264 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:29.938215  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:29.939097  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:29.911453  4829 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:00:29.939143  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1965) took 3177 ms. Trace:
I20260709 13:00:29.931843  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:29.910851  4860 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:29.886212  4649 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:29.951530  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80236.8us
I20260709 13:00:29.920593  4828 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:29.889315  4877 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:00:29.945631  1560 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:29.941540  1705 rpcz_store.cc:276] 0709 13:00:26.762217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.082816 (+1320599us) service_pool.cc:224] Handling call
0709 13:00:28.249783 (+166967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.405201 (+1155418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.938872 (+533671us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001c3ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:29.939088 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485657472}
I20260709 13:00:29.906486  4708 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:00:29.927632  4861 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:29.951633  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:29.960136  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:29.961330  4828 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:29.962018  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:29.910226  4444 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:29.962839  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.973482  1703 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:29.963590  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:29.920132  4888 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:00:29.967970  1551 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:29.969007  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 67537.2us
I20260709 13:00:29.971222  1701 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:29.973625  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.975430  1704 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.977090  4761 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:00:29.978188  4444 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:29.978895  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:29.983247  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.986402  1703 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:29.978997  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:29.979544  2262 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:29.972743  4779 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.556s	user 0.003s	sys 0.010s
W20260709 13:00:29.982340  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.989020  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:29.969731  4861 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.993568  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:29.994542  2268 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:29.996959  1634 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:29.997447  4840 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:30.001272  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.979729  4828 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:00:30.019328  1633 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:00:30.031188  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:30.019182  1526 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:30.022390  2262 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:30.026130  1628 raft_consensus.cc:2368] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7.
I20260709 13:00:30.002213  1706 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:00:30.033618  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:30.034909  1706 pending_rounds.cc:85] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 6
I20260709 13:00:30.035096  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:30.035300  1706 pending_rounds.cc:107] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:00:30.036850  4859 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:30.037037  4860 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:30.037629  4787 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:30.038125  4578 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:30.038348  1701 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:30.038693  2268 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:30.039608  4821 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:30.039822  1701 pending_rounds.cc:85] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 3
I20260709 13:00:30.040001  2268 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:30.040148  1701 pending_rounds.cc:107] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:00:30.040535  1701 raft_consensus.cc:2889] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:30.008327  4620 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:30.035743  1706 raft_consensus.cc:2889] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:30.027374  1707 raft_consensus.cc:2368] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:30.049436  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1963) took 3546 ms. Trace:
I20260709 13:00:30.050098  1706 rpcz_store.cc:276] 0709 13:00:26.502881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.079914 (+1577033us) service_pool.cc:224] Handling call
0709 13:00:28.328538 (+248624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.046122 (+1717584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.047174 (+  1052us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54001fcf54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:30.049368 (+  2194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3712428928}
I20260709 13:00:30.050916  4444 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:30.030365  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.054495  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:30.070165  1551 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:30.022567  4861 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.076618  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:30.069801  4822 consensus_meta.cc:287] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.001s
I20260709 13:00:30.075594  1631 raft_consensus.cc:2376] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9. Re-sending same reply.
I20260709 13:00:30.051903  4578 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:30.097919  4578 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:30.097355  1700 raft_consensus.cc:2410] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:30.034403  4889 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:30.052074  4620 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:30.106307  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:30.071210  4840 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:30.083896  4828 consensus_queue.cc:1243] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:30.114822  1551 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:30.118395  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 142985us
W20260709 13:00:30.121336  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 142465us
I20260709 13:00:30.104708  4787 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:30.133302  1700 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:30.113252  4877 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.136943  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.142616  1557 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 5.
I20260709 13:00:30.111411  4889 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:30.156605  1703 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:30.154971  4889 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.034564  4715 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:30.135485  4427 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:30.099783  4822 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:30.073633  4665 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:30.164083  1601 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:30.140926  4888 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:30.175387  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.158154  4779 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:00:30.166796  4828 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:30.207602  1705 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:30.168907  4570 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:30.205730  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:30.211702  1700 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:30.205401  4665 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.176057  4888 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:30.221282  1556 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:00:30.221694  1556 pending_rounds.cc:85] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 4
I20260709 13:00:30.221951  1556 pending_rounds.cc:107] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:30.222240  1556 raft_consensus.cc:2889] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:30.219081  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.219482  4649 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:30.182857  4715 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.220124  4427 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:00:30.234247  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 50628.5us
I20260709 13:00:30.241056  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:30.245899  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 111013us
I20260709 13:00:30.247406  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:30.248864  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.250136  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.251178  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.251427  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.252254  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.255681  4278 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:30.256249  4278 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:30.258258  1552 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:30.258256  4549 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:30.263470  4832 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:30.265338  4832 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:30.240228  4620 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:30.210084  4589 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:30.180457  4877 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:30.270622  1553 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:30.230314  4888 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:30.239166  4550 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.771s	user 0.002s	sys 0.016s
I20260709 13:00:30.277252  1551 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:30.280297  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.240415  4819 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:30.301795  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.305325  1559 raft_consensus.cc:2410] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:30.306447  1700 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:30.320443  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.321823  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:30.299887  4819 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:30.327168  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 337626us
I20260709 13:00:30.238056  4828 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:30.330619  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.336077  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 88764.8us
I20260709 13:00:30.338138  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:30.339417  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.341833  1558 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:30.342197  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:30.215874  4840 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:30.345005  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.327775  4761 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:30.349502  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.350791  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:30.352535  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 90096.9us
I20260709 13:00:30.337177  4819 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.303504  4550 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:30.360865  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:30.363060  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:30.361869  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 333612us
I20260709 13:00:30.359725  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.363037  1554 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:30.363209  1556 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.364655  1552 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:30.375980  1631 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:30.378666  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:30.378995  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.381708  4792 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:00:30.382694  1558 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:30.354657  4278 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:30.382850  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:30.388415  2264 raft_consensus.cc:2368] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8.
I20260709 13:00:30.389496  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.365752  4893 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.371376  4444 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:30.396767  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 368805us
I20260709 13:00:30.398257  1552 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:30.374421  4578 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:30.398550  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1985) took 1056 ms. Trace:
W20260709 13:00:30.399673  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45266.8us
I20260709 13:00:30.408013  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:30.408303  4550 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:30.382776  4822 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:30.410230  4671 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.006s
W20260709 13:00:30.410964  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.411047  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:30.411772  1555 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:30.393991  4877 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:30.386361  4761 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:30.428110  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.417564  4589 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:00:30.423791  4859 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:00:30.424543  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.415472  1708 rpcz_store.cc:276] 0709 13:00:29.353978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.519289 (+165311us) service_pool.cc:224] Handling call
0709 13:00:29.544852 (+ 25563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.787331 (+242479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.787361 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.877300 (+ 89939us) log.cc:844] Serialized 564 byte log entry
0709 13:00:30.170443 (+293143us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:30.170483 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.170618 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.398365 (+227747us) raft_consensus.cc:1685] finished
0709 13:00:30.398382 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.398498 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50560,"thread_start_us":251592,"threads_started":1,"wal-append.queue_time_us":423288}
I20260709 13:00:30.429721  1556 raft_consensus.cc:2410] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:30.430696  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:30.441709  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 71222.5us
I20260709 13:00:30.442806  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:30.415759  4278 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.451241  2266 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:30.452260  2265 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:00:30.447878  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:30.448387  4829 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:30.449409  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 119098us
I20260709 13:00:30.443632  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:30.451222  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.456123  1704 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:30.428282  4761 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:30.469180  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:30.443625  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:30.467451  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.467337  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:30.432898  4822 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:30.450681  4490 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.640s	user 0.012s	sys 0.000s
I20260709 13:00:30.470908  1632 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:30.419432  4549 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:00:30.462106  4857 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:30.473711  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:30.483024  1628 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:30.462245  4899 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:30.484216  1626 raft_consensus.cc:2410] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:30.460772  4829 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.485509  1627 raft_consensus.cc:2410] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:30.465602  4525 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:30.466322  4893 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:30.488240  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 61374.6us
I20260709 13:00:30.429315  4671 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:30.428473  4889 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:30.495816  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:30.479182  4444 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:30.505553  2234 leader_election.cc:400] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7.
I20260709 13:00:30.506017  2234 leader_election.cc:403] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:00:30.493192  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 50580us
W20260709 13:00:30.479010  4895 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:00:30.474859  4761 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.518359  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:30.519292  4828 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:30.519631  1558 raft_consensus.cc:2410] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:30.482194  4857 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:30.462459  4427 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:30.522384  4427 consensus_queue.cc:1243] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:30.522750  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1984) took 1180 ms. Trace:
I20260709 13:00:30.523173  1702 rpcz_store.cc:276] 0709 13:00:29.341827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.492591 (+150764us) service_pool.cc:224] Handling call
0709 13:00:29.512994 (+ 20403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.650347 (+137353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.650393 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.838824 (+188431us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.309631 (+470807us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:30.309651 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.309687 (+    36us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.522547 (+212860us) raft_consensus.cc:1685] finished
0709 13:00:30.522566 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.522694 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18201,"raft.queue_time_us":67693,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":120,"thread_start_us":416506,"threads_started":1,"wal-append.queue_time_us":668389}
I20260709 13:00:30.524273  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:30.525606  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:30.526185  4822 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:30.529148  4861 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:30.482321  4901 raft_consensus.cc:2764] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:30.530514  1557 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 5: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:30.531479  4889 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:30.532235  2270 raft_consensus.cc:2368] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10.
I20260709 13:00:30.532701  4671 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:30.534402  4861 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:30.535334  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.536453  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:30.538374  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.538795  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.539354  1557 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:30.539438  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.540199  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:30.540426  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.541144  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:30.541689  1557 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.543365  4857 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:30.544934  4857 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.467718  4278 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:30.545766  2234 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:30.547888  4278 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:30.493407  4525 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:30.549072  4525 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:30.550578  4525 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:30.550755  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.552315  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:30.558130  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:30.558555  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:30.559062  2266 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:00:30.559340  4894 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.146s	user 0.003s	sys 0.001s
I20260709 13:00:30.493675  4829 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.563095  2270 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:30.563524  4578 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:30.565198  4901 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7.
I20260709 13:00:30.566238  4901 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:30.566754  4901 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:30.567198  4901 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:30.567860  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:30.582506  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:30.583344  1628 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.586772  4889 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:30.593022  4829 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:30.598626  2271 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:30.618760  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:30.619881  1558 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:30.621094  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:30.558013  4893 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:30.634526  1631 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:30.585669  4787 consensus_queue.cc:1059] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:00:30.649295  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 123756us
W20260709 13:00:30.647526  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 48726.7us
W20260709 13:00:30.668906  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 183931us
I20260709 13:00:30.667289  1601 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:30.555274  4819 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:30.634433  4877 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:30.679931  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:00:30.680946  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 96176us
I20260709 13:00:30.674263  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:30.683678  1633 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.645800  4859 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:30.685307  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:30.603936  4888 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:30.689379  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 55889.5us
I20260709 13:00:30.700313  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:30.638170  4427 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:00:30.717159  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 157417us
I20260709 13:00:30.719132  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:30.719770  1632 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:00:30.719496  4828 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:30.717303  4671 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:30.698941  4859 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:30.733632  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46914.6us
I20260709 13:00:30.734315  4278 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:30.785048  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 72392.1us
W20260709 13:00:30.783376  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 49179.6us
I20260709 13:00:30.725684  4917 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:30.718639  4761 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:30.803202  4490 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:30.801828  1633 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:30.745229  4671 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:30.742390  4828 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:30.854578  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 114735us
I20260709 13:00:30.804036  4278 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:30.726568  4649 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:00:30.847707  1632 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:30.852447  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1990) took 1323 ms. Trace:
I20260709 13:00:30.853927  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 1991) took 1268 ms. Trace:
I20260709 13:00:30.845867  4911 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:00:30.738775  4620 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:00:30.864904  1707 rpcz_store.cc:276] 0709 13:00:29.530257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.048334 (+518077us) service_pool.cc:224] Handling call
0709 13:00:30.048827 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.096204 (+ 47377us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:30.340825 (+244621us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.675865 (+335040us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.687365 (+ 11500us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.687511 (+   146us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:30.687556 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.687647 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.852183 (+164536us) raft_consensus.cc:1685] finished
0709 13:00:30.852204 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.852364 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41457,"prepare.queue_time_us":17845,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":50949,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":36640,"thread_start_us":523492,"threads_started":2,"wal-append.queue_time_us":420529}
I20260709 13:00:30.742093  1454 catalog_manager.cc:5697] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 5 to 6, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:30.857349  4828 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.855545  4671 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.897719  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:00:30.896802  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 110859us
I20260709 13:00:30.865042  1706 rpcz_store.cc:276] 0709 13:00:29.611911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.051491 (+439580us) service_pool.cc:224] Handling call
0709 13:00:30.168001 (+116510us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b58001b3398. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 13:00:30.168237 (+   236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.238545 (+ 70308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.238592 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.441254 (+202662us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b2c00057cb8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2
0709 13:00:30.470916 (+ 29662us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.653271 (+182355us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:30.653321 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.653418 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.853690 (+200272us) raft_consensus.cc:1685] finished
0709 13:00:30.853715 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.853860 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25615,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":96,"spinlock_wait_cycles":104629760,"thread_start_us":160855,"threads_started":1,"wal-append.queue_time_us":232983}
I20260709 13:00:30.862623  4550 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.799306  4792 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
W20260709 13:00:30.907819  1526 connection.cc:256] RPC call timeout handler was delayed by -1.1489107389999731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
I20260709 13:00:30.867919  4913 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:30.938411  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 75737.4us
W20260709 13:00:30.941814  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0634107389999485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 13:00:30.900754  4829 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:30.955564  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 156378us
I20260709 13:00:30.958312  1627 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:30.952042  4792 consensus_queue.cc:1243] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:30.959846  1454 catalog_manager.cc:5697] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 5 to 6, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:30.949107  4715 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:30.990098  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44808.7us
I20260709 13:00:30.985472  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:30.991442  1634 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.987139  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:30.994477  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:30.994735  1557 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:30.943181  4550 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.048182  1627 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:31.050215  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:31.051615  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.057108  1632 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:31.059577  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:31.064445  1630 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:31.070297  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:30.985078  4787 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:00:31.050130  4819 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:30.954885  4913 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:30.993480  4917 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:31.086019  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:31.125515  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:31.158767  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 96921.8us
I20260709 13:00:31.120730  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:31.169922  1634 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:31.125912  1633 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:00:31.066334  4931 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:31.181428  1634 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:00:31.148644  1454 catalog_manager.cc:5697] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 2 to 6, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
W20260709 13:00:31.184685  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 260900us
W20260709 13:00:31.130765  4934 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:31.186343  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:31.070202  4649 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.178364  1626 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
W20260709 13:00:31.150487  4919 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.311s	user 0.001s	sys 0.001s
I20260709 13:00:31.191159  4943 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:31.061105  4278 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.142941  4715 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:00:31.126117  4918 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
W20260709 13:00:31.205207  1628 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.621s	user 0.003s	sys 0.006s
I20260709 13:00:31.212383  1628 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
W20260709 13:00:31.127045  4936 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:31.083588  4888 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:31.206550  4649 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.213775  4943 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:31.150228  4939 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.236s
I20260709 13:00:31.216051  4942 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:31.216717  4927 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.220626  1454 catalog_manager.cc:5697] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 2 to 6, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:31.221773  4550 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:31.192499  4665 consensus_meta.cc:287] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.965s	user 0.010s	sys 0.002s
I20260709 13:00:31.221995  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:31.229666  4784 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.232249  1628 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:31.183682  4931 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:31.234261  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 449834us
W20260709 13:00:31.237274  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 178184us
I20260709 13:00:31.150602  4922 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.289s
W20260709 13:00:31.222222  4923 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:00:31.210659  4761 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:31.445060  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:31.445700  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 261540us
W20260709 13:00:31.352123  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50810.5us
I20260709 13:00:31.249946  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:31.249383  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:31.331805  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.263891  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:31.449434  1704 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:31.393644  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:31.405637  4857 consensus_meta.cc:287] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.860s	user 0.015s	sys 0.001s
I20260709 13:00:31.462399  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:31.266047  4921 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
W20260709 13:00:31.270675  4525 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.000s
I20260709 13:00:31.475515  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:31.389741  4936 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:00:31.502359  1626 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:31.268678  4943 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:31.461916  4784 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.483657  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:31.486148  4951 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:31.488373  4902 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:31.490706  4856 raft_consensus.cc:3055] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:31.491505  4665 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:31.493372  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:31.481197  1701 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:31.548691  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2004) took 1036 ms. Trace:
W20260709 13:00:31.516577  4923 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:31.481849  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:31.503860  2264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 707) took 1562 ms (client timeout 1538 ms). Trace:
I20260709 13:00:31.498879  1704 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:31.509230  2263 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:31.551728  2264 rpcz_store.cc:269] 0709 13:00:29.935078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.937936 (+  2858us) service_pool.cc:224] Handling call
0709 13:00:31.493773 (+1555837us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b5400269154. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:31.493925 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026766720}
I20260709 13:00:31.514395  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:31.515323  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:31.502862  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:31.519984  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:31.513852  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:31.533715  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.554019  2265 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:31.555289  1630 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:31.553166  2268 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:31.548791  4784 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:31.504899  2269 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:31.262722  4715 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.554126  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:31.519918  4856 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:31.564630  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 71324.2us
I20260709 13:00:31.569259  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:31.257874  4942 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.561522  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:31.390462  4917 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.573119  2268 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:31.549284  1709 rpcz_store.cc:276] 0709 13:00:30.511984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.516439 (+  4455us) service_pool.cc:224] Handling call
0709 13:00:30.516764 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:30.734004 (+217240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.734055 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:30.736207 (+  2152us) log.cc:844] Serialized 52 byte log entry
0709 13:00:30.809210 (+ 73003us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:30.841618 (+ 32408us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.856743 (+ 15125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.856844 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.887522 (+ 30678us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b48001e0258. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:00:31.275556 (+388034us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b1800018280. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:31.548469 (+272913us) raft_consensus.cc:1685] finished
0709 13:00:31.548490 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.548633 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86667,"prepare.queue_time_us":48368,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":91443,"raft.run_cpu_time_us":2921,"raft.run_wall_time_us":269882,"spinlock_wait_cycles":18634752,"thread_start_us":202181,"threads_started":2,"wal-append.queue_time_us":253297}
I20260709 13:00:31.515897  4832 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:00:31.577612  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:31.550418  4550 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:31.501235  4927 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:31.557801  4649 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:31.581211  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:31.558235  4913 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:31.545928  4949 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:00:31.544729  4902 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.597005  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2000) took 1496 ms. Trace:
W20260709 13:00:31.598713  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 86909.5us
I20260709 13:00:31.598409  1700 rpcz_store.cc:276] 0709 13:00:30.100676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.240640 (+139964us) service_pool.cc:224] Handling call
0709 13:00:30.277689 (+ 37049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.306800 (+ 29111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.596667 (+1289867us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b54000b7a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:31.596926 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65406208}
W20260709 13:00:31.597735  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 114148us
I20260709 13:00:31.583063  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:31.602530  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:31.601981  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:31.577688  4901 consensus_meta.cc:287] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.010s	user 0.011s	sys 0.002s
I20260709 13:00:31.585630  1600 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:00:31.582417  4828 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.000s
W20260709 13:00:31.618350  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 131968us
I20260709 13:00:31.596403  4956 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:31.746382  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 160849us
I20260709 13:00:31.751938  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:31.754964  2267 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:00:31.746042  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 116231us
W20260709 13:00:31.760008  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 294949us
I20260709 13:00:31.627790  4927 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:31.767875  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 167862us
I20260709 13:00:31.565316  4931 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.583607  4550 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.755656  4913 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:31.755084  4649 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:31.756585  4525 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:31.779064  2235 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:31.627671  4828 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.618048  4901 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.802331  1601 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:31.818236  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 66374.9us
I20260709 13:00:31.781457  4913 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.627561  4856 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:31.829856  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50901.2us
W20260709 13:00:31.836575  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.837158  2266 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:31.842909  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:31.853046  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:31.823702  4850 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:31.800714  4961 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:31.853785  1557 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:31.825852  4913 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.793452  4525 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:31.827316  4811 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:31.794366  4649 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:31.848431  4856 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:31.880304  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 60933.5us
I20260709 13:00:31.854004  4832 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:31.857125  4850 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.825974  4949 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:00:31.860773  4954 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:31.882416  4917 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:00:31.887578  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 85312.1us
I20260709 13:00:32.004347  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:32.041572  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:31.954632  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:31.936707  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 59291.4us
I20260709 13:00:31.960175  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:31.973203  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:31.999047  2271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 697) took 2156 ms (client timeout 2708 ms). Trace:
I20260709 13:00:31.975078  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:31.955430  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.967641  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.984398  4901 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:31.941658  4902 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:32.066622  4940 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:31.924772  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:32.062609  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 58354us
I20260709 13:00:31.924561  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:31.921861  1551 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:31.933308  1555 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:32.001641  1705 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:31.932456  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:32.071929  1556 raft_consensus.cc:2376] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8. Re-sending same reply.
I20260709 13:00:32.074394  1557 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
W20260709 13:00:32.065270  2271 rpcz_store.cc:269] 0709 13:00:29.842625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.054245 (+211620us) service_pool.cc:224] Handling call
0709 13:00:31.998863 (+1944618us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54005d6e54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:31.998972 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215814912}
W20260709 13:00:31.960722  1600 connection.cc:256] RPC call timeout handler was delayed by -1.8314719819999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 13:00:32.077073  1600 connection.cc:256] RPC call timeout handler was delayed by -1.826971981999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 13:00:31.999720  1554 raft_consensus.cc:2376] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8. Re-sending same reply.
W20260709 13:00:32.035919  4969 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 13:00:32.085706  1554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 469) took 1706 ms (client timeout 1547 ms). Trace:
I20260709 13:00:32.086615  2235 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:32.088414  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.088359  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:32.007598  4968 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.122s	user 0.002s	sys 0.000s
W20260709 13:00:32.009004  4972 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:00:32.032224  4933 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:32.090404  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:32.099556  1701 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:31.923458  4942 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:32.087531  1554 rpcz_store.cc:269] 0709 13:00:30.372597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.389161 (+ 16564us) service_pool.cc:224] Handling call
0709 13:00:31.999540 (+1610379us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b54002da928. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3dac924 00007f06e2f95227 00007f06e2f94ab8 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:32.078893 (+ 79353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8875904}
I20260709 13:00:32.053285  4784 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:31.918479  4956 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:31.887619  4961 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:32.050185  4821 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:31.923473  4671 consensus_meta.cc:287] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.980s	user 0.008s	sys 0.008s
I20260709 13:00:31.892694  4850 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:32.013536  4974 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:32.067622  4570 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:00:32.010093  4943 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:31.984812  4828 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:32.009229  4860 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:32.062199  4278 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:32.106129  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:32.196269  1700 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:32.017594  4550 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:31.939747  4525 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:32.000892  4944 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:32.130424  4821 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:32.117969  4911 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:32.120963  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:32.077574  4902 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:31.903808  4832 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:32.098460  4901 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:32.132181  1633 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:32.049903  4926 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:32.148912  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 60626.2us
I20260709 13:00:32.223658  2235 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:32.203707  4968 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:32.099426  4933 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:31.888899  4811 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:32.220225  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 99341.4us
I20260709 13:00:32.129873  4951 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:00:32.097532  4954 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:32.159341  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:32.150923  4671 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.241305  2234 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:32.159420  4995 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:32.246058  4888 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:32.233418  4550 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:32.212713  4278 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.203457  4784 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.255018  4821 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:32.261998  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 102825us
I20260709 13:00:32.262462  4821 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.262780  4784 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:32.243934  4901 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:32.264040  4901 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.264957  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:32.255843  4949 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.266366  4859 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:32.251096  4911 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:32.266240  4961 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:32.267277  4911 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.268500  4949 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.269511  4671 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:32.232168  4902 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:32.220335  4944 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.223160  4860 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:32.275022  1552 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:32.265794  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:32.219756  4525 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:00:32.259639  1553 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:32.277093  2270 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:32.256837  4959 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:32.216404  4943 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:32.294102  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 90699.2us
I20260709 13:00:32.266295  4888 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:32.274271  4944 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:32.273500  4278 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:32.271795  4902 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:32.269951  4911 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:32.272311  4981 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:00:32.313606  4525 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:32.314148  4525 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.271229  4949 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:32.314549  4525 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:32.315392  4987 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:00:32.318092  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 52370.5us
I20260709 13:00:32.239408  4926 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.301793  4959 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:32.347681  4278 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:32.352245  4278 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:32.358950  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.360587  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:32.361392  1554 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:32.362972  4278 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:32.365249  2235 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:32.365193  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:32.296619  4952 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:32.367970  4889 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:32.368474  4889 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.368893  4889 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:32.328372  4832 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:32.371356  4991 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.371742  4952 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:32.371917  4991 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.372799  4952 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:32.374243  4988 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:32.374854  4988 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:32.375854  4988 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.297500  4828 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:00:32.371598  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:32.378888  1558 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:32.276427  4995 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:32.380568  1554 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
W20260709 13:00:32.389495  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 138273us
I20260709 13:00:32.297335  4996 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:00:32.398531  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:32.403373  4998 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:00:32.404433  4998 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:32.404786  4998 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:32.399262  1554 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:32.408213  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:32.412187  1632 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:32.405076  5005 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.414597  4860 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:32.414752  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:32.425815  1554 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:32.425863  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:32.415751  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:32.378434  4902 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:00:32.417339  4991 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:32.419373  4811 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:32.412669  4888 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:32.423207  4913 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 13:00:32.399437  4828 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:32.407006  2234 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:32.433094  5005 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.441039  4991 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.441638  1701 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
W20260709 13:00:32.444965  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.366972  4933 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.490341  1555 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:32.616860  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.453428  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46538.5us
W20260709 13:00:32.723764  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.702976  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.535230  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1824) took 1316 ms. Trace:
I20260709 13:00:32.728942  2234 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:32.730269  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.535624  4939 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:32.692979  4973 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.815s	user 0.000s	sys 0.003s
I20260709 13:00:32.733316  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:32.537432  4877 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:32.452109  4828 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:32.740629  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:32.495091  4940 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:32.454005  4901 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:32.744985  4901 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.702975  4995 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:32.745406  4901 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:32.746732  1555 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:32.747015  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:32.719998  4554 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:32.743443  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 299279us
I20260709 13:00:32.749782  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:32.472157  4998 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:32.755745  2266 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:00:32.456257  4913 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.757763  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:32.758536  4913 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:32.740849  4877 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:32.759469  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:32.760141  4877 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.758608  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:32.761514  2265 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:32.520057  4959 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.494134  4999 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:32.762840  4828 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.763253  5009 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.784176  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:32.492905  4649 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:32.787102  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:32.761315  4877 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.728082  1627 rpcz_store.cc:276] 0709 13:00:31.218877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.219000 (+   123us) service_pool.cc:224] Handling call
0709 13:00:31.219307 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.219563 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:31.219881 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 13:00:31.795651 (+575770us) log.cc:844] Serialized 14 byte log entry
0709 13:00:31.798579 (+  2928us) log.cc:844] Serialized 14 byte log entry
0709 13:00:31.973340 (+174761us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b1800305da0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2522 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:32.534644 (+561304us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b1800305da0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddb774bc 00007f06daec548b 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287
0709 13:00:32.534772 (+   128us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.534832 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:32.534901 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.534990 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.535153 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194459,"prepare.queue_time_us":63752,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":100,"raft.queue_time_us":147681,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":7605,"spinlock_wait_cycles":20393472,"thread_start_us":473170,"threads_started":3,"wal-append.queue_time_us":327776}
I20260709 13:00:32.776661  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:32.788722  1631 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:32.741197  4821 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:32.543558  4525 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.535240  4926 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:32.743247  4715 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:32.764261  4965 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.939s	user 0.002s	sys 0.002s
I20260709 13:00:32.738600  4979 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:00:32.799636  5002 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:32.797757  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:32.804325  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.815572  4949 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.886443  4949 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.888883  4949 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:32.816850  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.889788  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.782822  4933 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:32.850167  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 118573us
I20260709 13:00:32.778481  4922 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:00:32.851006  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:32.748600  4991 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:32.892354  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 2.46932e+06us
I20260709 13:00:32.795519  4954 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:32.900127  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:32.900869  1627 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:32.904628  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:32.906351  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:32.906905  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 766) took 1427 ms. Trace:
W20260709 13:00:32.907527  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.908411  4988 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:32.908182  1674 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:32.854396  4828 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.851778  4821 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:32.907253  2262 rpcz_store.cc:276] 0709 13:00:31.479397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.479551 (+   154us) service_pool.cc:224] Handling call
0709 13:00:31.484522 (+  4971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.492768 (+  8246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.492801 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.493252 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.646245 (+152993us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:31.646304 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.646397 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.719785 (+1073388us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:32.906570 (+186785us) raft_consensus.cc:1685] finished
0709 13:00:32.906597 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.906823 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18917,"raft.queue_time_us":16675,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":14216,"spinlock_wait_cycles":243636608,"thread_start_us":152500,"threads_started":1,"wal-append.queue_time_us":265900}
I20260709 13:00:32.915508  1555 raft_consensus.cc:2368] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8.
I20260709 13:00:32.878481  5002 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.904542  4979 consensus_queue.cc:1243] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:32.797312  5009 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:32.991393  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 83328.8us
I20260709 13:00:32.858982  4715 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:32.993880  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:32.994833  1555 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:32.995713  2235 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:32.926429  4988 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.001452  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:33.002171  1555 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:33.008091  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 277318us
I20260709 13:00:32.932230  4525 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:32.938097  5002 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:33.026887  4995 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:33.027822  1555 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:33.032785  4979 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.033563  4979 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.038978  4979 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:33.041128  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:33.009481  4943 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:33.058647  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:33.023109  4954 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:33.069860  1629 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:33.070629  1674 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:33.067392  4821 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.116806  5009 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:33.117945  5010 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
W20260709 13:00:33.122900  5019 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:00:33.130041  4922 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.130630  4922 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.133260  4922 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:33.034516  4988 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:00:33.057772  4525 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:33.168099  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:33.166541  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:33.174814  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:33.181530  4985 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.065s	user 0.002s	sys 0.000s
I20260709 13:00:33.189822  4939 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:33.190431  4939 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.196200  4902 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:33.167083  4988 consensus_queue.cc:1243] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:33.166457  5017 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.173126  4525 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:33.208212  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:33.170101  4888 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:33.186486  5005 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:33.218988  1630 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:33.209357  4525 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.211709  4902 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:33.222812  1629 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:33.153597  4954 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.224658  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:33.214793  4888 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:33.211372  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 423424us
I20260709 13:00:33.226205  1629 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:33.240636  1554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.020s	sys 0.033s
I20260709 13:00:33.244479  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:33.244745  1554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.021s	sys 0.033s
I20260709 13:00:33.228331  4902 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.245726  4902 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:33.246430  5020 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:00:33.250180  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1822) took 1274 ms. Trace:
I20260709 13:00:33.254926  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.254701  1629 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.256187  1629 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:33.257375  1632 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:33.242120  4649 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:33.251379  4850 consensus_meta.cc:287] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.045s	user 0.009s	sys 0.005s
I20260709 13:00:33.248692  4888 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.239845  4840 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:33.291579  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:33.252581  1554 rpcz_store.cc:276] 0709 13:00:31.975643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.434589 (+458946us) service_pool.cc:224] Handling call
0709 13:00:32.520167 (+ 85578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.520468 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:32.602240 (+ 81772us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.249834 (+647594us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:33.249886 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:33.249936 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.250001 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.250126 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":77732,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":4694,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":149,"thread_start_us":642659,"threads_started":1}
W20260709 13:00:33.272882  4904 raft_consensus.cc:670] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } [suppressed 3 similar messages]
I20260709 13:00:33.262382  4991 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:33.321447  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.324903  2267 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:33.322332  2269 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:33.327750  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:33.328713  5028 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.329258  5028 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.331379  5028 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:33.332717  4490 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.333170  4490 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.335213  4490 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:33.351285  1629 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:33.287529  4649 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.369995  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.372469  2267 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:33.370904  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.288379  4850 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:33.374835  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 410276us
W20260709 13:00:33.359738  4945 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:00:33.299373  4840 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.393301  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:33.396412  2267 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.401818  2266 raft_consensus.cc:2376] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7. Re-sending same reply.
W20260709 13:00:33.407698  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 413327us
I20260709 13:00:33.409898  2262 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.390218  4904 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:33.423333  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.425143  2264 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:33.430723  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.400771  5009 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 13:00:33.450783  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.437584  4943 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.440172  4954 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:33.472170  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.426991  4904 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:33.473690  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.494189  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:33.496434  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:33.461310  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 321566us
I20260709 13:00:33.498777  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.499614  2264 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:33.506326  2262 raft_consensus.cc:2410] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:00:33.518771  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 305661us
W20260709 13:00:33.492878  4889 consensus_meta.cc:287] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.123s	user 0.015s	sys 0.000s
I20260709 13:00:33.524850  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:33.526557  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:33.527215  1629 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.476418  4943 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.531903  1630 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:33.531924  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:33.520859  4901 consensus_meta.cc:287] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.775s	user 0.008s	sys 0.006s
I20260709 13:00:33.541844  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:33.544636  5030 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:00:33.545426  5032 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:33.545580  4943 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:33.528611  4889 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:33.553869  1599 leader_election.cc:336] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.538s (SENT)
I20260709 13:00:33.557338  1627 raft_consensus.cc:2410] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:33.567226  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.554239  4649 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:33.568195  2264 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:33.571429  4850 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:33.582399  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 57770.4us
W20260709 13:00:33.583822  1526 leader_election.cc:336] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.555s (SENT)
I20260709 13:00:33.584240  1526 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:33.585035  2265 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:33.586150  4943 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:33.586282  4988 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:33.587230  4988 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:33.590087  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:33.593247  1674 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:33.594755  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:33.594951  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:33.595583  2264 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.598670  1629 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
W20260709 13:00:33.608103  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.605654  4988 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.583720  4840 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:33.617287  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 131348us
I20260709 13:00:33.559880  4901 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:33.613026  4933 consensus_meta.cc:287] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.722s	user 0.008s	sys 0.004s
I20260709 13:00:33.631078  4902 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.634729  4939 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:33.636896  4939 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:33.631253  5042 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.639308  4779 raft_consensus.cc:2955] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:00:33.644862  4877 consensus_meta.cc:287] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.846s	user 0.011s	sys 0.000s
W20260709 13:00:33.647387  4964 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.828s	user 0.001s	sys 0.003s
W20260709 13:00:33.626736  5002 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.583s	user 0.003s	sys 0.008s
I20260709 13:00:33.652945  2263 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:00:33.627861  4554 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.850s	user 0.012s	sys 0.001s
I20260709 13:00:33.659510  2267 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
W20260709 13:00:33.674553  5036 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:00:33.671447  5035 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:00:33.631570  4988 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.708019  1560 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
W20260709 13:00:33.686990  1526 leader_election.cc:336] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.650s (SENT)
I20260709 13:00:33.708457  1560 pending_rounds.cc:85] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 8
I20260709 13:00:33.708752  1560 pending_rounds.cc:107] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:33.708727  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:33.709295  1560 raft_consensus.cc:2889] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:33.712481  1599 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:33.714768  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.715374  2267 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
W20260709 13:00:33.718555  5046 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:33.721189  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:33.721590  1626 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:33.721822  1555 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:33.722545  4901 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:33.722911  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:33.723507  1555 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:33.723876  4889 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:33.724301  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:33.724800  1555 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.726835  4902 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:33.731451  1555 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:33.729533  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:33.732340  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:33.732645  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.733016  1555 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:33.733968  4525 consensus_meta.cc:287] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
I20260709 13:00:33.734102  4959 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:33.737927  4525 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.738507  4959 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.739045  4959 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.740144  4525 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:33.710616  4861 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.740933  4861 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.742944  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 874) took 1001 ms. Trace:
W20260709 13:00:33.743556  4828 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.000s
I20260709 13:00:33.744279  4933 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:33.745716  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.746809  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.747864  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.750174  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:33.750759  1556 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.751199  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:33.754391  2234 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:33.691207  5002 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:33.755712  4649 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:33.756089  4649 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:33.756495  4649 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.757037  5002 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:33.757395  1556 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:33.757994  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2024) took 1350 ms. Trace:
I20260709 13:00:33.758709  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:33.758599  4991 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:33.759430  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:33.743307  2271 rpcz_store.cc:276] 0709 13:00:32.742008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.742160 (+   152us) service_pool.cc:224] Handling call
0709 13:00:32.776554 (+ 34394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.787879 (+ 11325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.787913 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.850526 (+ 62613us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.359848 (+509322us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:33.359892 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.359959 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.742732 (+382773us) raft_consensus.cc:1685] finished
0709 13:00:33.742752 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.742887 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6243,"raft.queue_time_us":6350,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":12568,"thread_start_us":431731,"threads_started":1,"wal-append.queue_time_us":579592}
I20260709 13:00:33.748762  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:33.758369  1709 rpcz_store.cc:276] 0709 13:00:32.407284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.407410 (+   126us) service_pool.cc:224] Handling call
0709 13:00:32.422511 (+ 15101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.797739 (+375228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.797776 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.797819 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:32.797849 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.757684 (+959835us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400129b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:33.757729 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.757849 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862469376}
I20260709 13:00:33.749825  4888 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.761601  2264 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
W20260709 13:00:33.761977  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 142812us
I20260709 13:00:33.762795  2235 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:33.764068  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 51659.5us
I20260709 13:00:33.767709  2267 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:33.769066  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:33.713925  4904 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:33.776298  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:33.765499  4570 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:33.778295  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:33.778787  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:33.780962  1526 leader_election.cc:336] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.532s (SENT)
I20260709 13:00:33.778003  4991 raft_consensus.cc:3055] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:33.782526  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:33.782881  1555 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:33.785109  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:33.785578  4998 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.781481  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:33.789120  2267 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:33.789899  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:33.786453  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:33.791461  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:33.792013  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:33.770699  4901 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:00:33.795387  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:33.796167  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:33.797011  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:33.779906  5009 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:33.801862  1555 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
W20260709 13:00:33.807623  1552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1812) took 1893 ms (client timeout 1726 ms). Trace:
I20260709 13:00:33.781630  4991 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:00:33.808773  1552 rpcz_store.cc:269] 0709 13:00:31.913862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.914058 (+   196us) service_pool.cc:224] Handling call
0709 13:00:33.807417 (+1893359us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54002dc3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:33.807556 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":472690048}
I20260709 13:00:33.788655  4570 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:33.800045  5042 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.804140  4939 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:33.787278  5051 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:33.776854  4999 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:00:33.798658  4490 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:00:33.828858  1599 leader_election.cc:336] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.824s (SENT)
I20260709 13:00:33.780818  5052 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:00:33.830793  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.832427  4988 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.799625  4828 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:00:33.809552  5029 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:33.824717  5041 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:33.825058  4939 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.816669  5009 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:33.824100  4570 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.820240  4840 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:33.823403  4554 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:00:33.839097  4888 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:33.840767  5051 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:33.842993  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1825) took 1109 ms. Trace:
I20260709 13:00:33.845358  2264 raft_consensus.cc:2955] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:33.853204  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:33.857609  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.866079  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:33.866140  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.866889  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.878468  1701 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:00:33.881588  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:33.884538  1701 pending_rounds.cc:85] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 7
I20260709 13:00:33.884654  1709 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:33.884989  1701 pending_rounds.cc:107] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:00:33.885500  1701 raft_consensus.cc:2889] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:33.882452  1554 rpcz_store.cc:276] 0709 13:00:32.733357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.324830 (+591473us) service_pool.cc:224] Handling call
0709 13:00:33.345420 (+ 20590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.362362 (+ 16942us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:33.606010 (+243648us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.760213 (+154203us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.766392 (+  6179us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.766517 (+   125us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:33.766677 (+   160us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.766794 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.766842 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.842736 (+ 75894us) raft_consensus.cc:1685] finished
0709 13:00:33.842764 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.842923 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8029,"prepare.queue_time_us":301022,"prepare.run_cpu_time_us":212,"prepare.run_wall_time_us":15425,"raft.queue_time_us":6500,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":34901,"spinlock_wait_cycles":14288640,"thread_start_us":339477,"threads_started":2,"wal-append.queue_time_us":193821}
I20260709 13:00:33.887214  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:33.887943  1701 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:33.883703  1702 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:33.884565  1708 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:33.899484  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.900085  1702 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
W20260709 13:00:33.900594  1526 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.627s (SENT)
I20260709 13:00:33.864161  4939 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:33.899941  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 92236.6us
I20260709 13:00:33.855446  5041 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:33.904844  1707 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:33.868037  4570 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.907529  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:33.910535  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.944520  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1828) took 1203 ms. Trace:
W20260709 13:00:33.947160  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 89684.8us
I20260709 13:00:33.897807  1701 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
W20260709 13:00:33.918654  1526 leader_election.cc:336] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.892s (SENT)
I20260709 13:00:33.954329  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:33.855232  4988 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:33.954982  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.906463  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:33.955569  1708 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:33.914148  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.946252  1556 rpcz_store.cc:276] 0709 13:00:32.741523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.789446 (+1047923us) service_pool.cc:224] Handling call
0709 13:00:33.789734 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.790093 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.790122 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.795656 (+  5534us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.907068 (+111412us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:33.907123 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.907213 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.943723 (+ 36510us) raft_consensus.cc:1685] finished
0709 13:00:33.943742 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.944376 (+   634us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9746,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":6706,"thread_start_us":111026,"threads_started":1,"wal-append.queue_time_us":145776}
I20260709 13:00:33.957053  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:33.957537  1556 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:33.958257  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:33.959326  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:33.959429  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:33.959796  1556 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:33.956651  1709 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:33.963202  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:33.963773  1706 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:33.964499  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:33.912711  5041 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.967104  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:33.967742  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2029) took 1551 ms. Trace:
I20260709 13:00:33.967832  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.968672  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:33.968672  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:33.971095  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 64715.5us
I20260709 13:00:33.972146  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.973763  1600 leader_election.cc:400] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8.
I20260709 13:00:33.974100  1600 leader_election.cc:403] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:00:33.977054  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.979259  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:33.982286  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 200879us
I20260709 13:00:33.978559  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.983103  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:33.984189  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.985154  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:33.985291  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 66684.1us
W20260709 13:00:33.986274  1526 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.638s (SENT)
I20260709 13:00:33.986270  1709 raft_consensus.cc:2368] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:33.986739  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:33.986853  1703 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:33.987802  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.988453  1703 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:33.962345  4940 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:33.965346  4902 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:33.991498  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.970098  1705 rpcz_store.cc:276] 0709 13:00:32.416033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.416304 (+   271us) service_pool.cc:224] Handling call
0709 13:00:32.416658 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.416841 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:33.799692 (+1382851us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.962662 (+162970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:33.962710 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:33.962761 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.962823 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.967695 (+  4872us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1382613,"prepare.queue_time_us":1398649,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":3184,"spinlock_wait_cycles":88064,"thread_start_us":162667,"threads_started":1}
W20260709 13:00:33.982947  5054 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:00:33.996281  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:34.007861  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.997272  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.997490  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.998826  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:33.999598  5029 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8.
I20260709 13:00:33.999938  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.000586  4821 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.000697  4949 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:33.978175  4779 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:34.005826  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1811) took 2093 ms. Trace:
I20260709 13:00:34.020017  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.020465  1558 rpcz_store.cc:276] 0709 13:00:31.912924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.913130 (+   206us) service_pool.cc:224] Handling call
0709 13:00:34.005582 (+2092452us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54003124d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:34.005750 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713798016}
I20260709 13:00:34.009394  1700 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:34.010461  1702 raft_consensus.cc:2410] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:00:33.998320  1600 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:34.015517  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:34.017083  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:34.017287  2267 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEARNER]: Advancing to term 10
I20260709 13:00:34.018335  1556 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.019078  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.026372  1706 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
I20260709 13:00:34.033367  4988 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:34.033681  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:34.034014  4988 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:34.034509  1558 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:34.035635  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:34.036389  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2021) took 1959 ms. Trace:
I20260709 13:00:34.016783  4525 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:34.036948  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:34.037457  4525 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:34.038751  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 476) took 3504 ms. Trace:
I20260709 13:00:34.038487  4525 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:34.039112  1560 rpcz_store.cc:276] 0709 13:00:30.534695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.584197 (+ 49502us) service_pool.cc:224] Handling call
0709 13:00:30.620504 (+ 36307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.709760 (+3089256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.038512 (+328752us) spinlock_profiling.cc:243] Waited 3.09 s on lock 0x7b540030be54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:34.038675 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7097350912}
I20260709 13:00:34.040238  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:34.040740  1560 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.041262  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:34.020153  4949 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:34.042794  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.042699  4949 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:34.043606  1700 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:34.044019  4949 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.044798  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.045351  1700 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:34.046180  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 768) took 2566 ms. Trace:
I20260709 13:00:34.028082  4821 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:34.046653  2270 rpcz_store.cc:276] 0709 13:00:31.498867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.504013 (+  5146us) service_pool.cc:224] Handling call
0709 13:00:34.045966 (+2541953us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54005f0354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:34.046102 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660512000}
I20260709 13:00:34.057263  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:34.066280  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.046123  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.047317  1555 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:34.037755  1558 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:34.052599  2268 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:33.992208  5058 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.036787  1704 rpcz_store.cc:276] 0709 13:00:32.076801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.082191 (+  5390us) service_pool.cc:224] Handling call
0709 13:00:32.100810 (+ 18619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.101081 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:32.161660 (+ 60579us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.177576 (+1015916us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b180038ce60. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2557 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:34.035897 (+858321us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b180038ce60. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddb774bc 00007f06daec548b 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287
0709 13:00:34.036070 (+   173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.036118 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:34.036163 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.036244 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.036341 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":667726,"prepare.queue_time_us":110494,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":71051,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":6739,"spinlock_wait_cycles":12524160,"thread_start_us":96977,"threads_started":1,"wal-append.queue_time_us":33460,"wal-append.run_cpu_time_us":1018,"wal-append.run_wall_time_us":1063328}
I20260709 13:00:34.076900  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.077625  1704 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:34.078897  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.079746  1704 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:34.080575  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.081784  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.085393  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.086467  1674 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:34.056886  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:34.088202  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:34.088969  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.089169  1629 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:34.089774  1708 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 4: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:34.006649  4999 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.092878  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:34.099902  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:34.105502  1628 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:34.058100  1706 raft_consensus.cc:2376] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6. Re-sending same reply.
I20260709 13:00:34.075450  1700 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:34.108536  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:34.108660  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:34.101260  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.102643  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:34.109097  1556 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:34.109787  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:34.113147  1524 connection.cc:256] RPC call timeout handler was delayed by -1.5442143579999765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:00:34.109195  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:34.114372  1627 raft_consensus.cc:2410] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:34.114360  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:34.029927  4554 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:34.119630  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 121383us
I20260709 13:00:34.127274  1630 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10.
I20260709 13:00:34.127437  1600 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:34.121315  1560 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:34.121491  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:34.123030  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:34.123221  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:34.133049  1555 raft_consensus.cc:2410] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:00:34.124583  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.125226  1707 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:34.125993  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.133714  1704 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:34.134469  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.134696  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.135406  1700 raft_consensus.cc:2410] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:34.136948  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.137836  1700 raft_consensus.cc:2410] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:00:34.126775  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:34.138396  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.130141  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:34.113972  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 127731us
I20260709 13:00:34.139189  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.139940  1560 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:34.140084  1704 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:34.141297  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:34.141077  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.143573  1704 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:34.144062  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.144848  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:34.145466  1704 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:34.142798  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 134072us
I20260709 13:00:34.147526  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.147663  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:34.144810  1703 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:34.150956  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.151580  1700 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:34.152403  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.153088  1700 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
W20260709 13:00:34.140542  1526 leader_election.cc:336] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.657s (SENT)
I20260709 13:00:34.154387  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:34.150661  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.154469  1706 raft_consensus.cc:2410] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:00:34.158437  1708 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:34.160686  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:34.167352  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.168453  1707 raft_consensus.cc:2410] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:00:34.169600  1707 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:33.996542  5009 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:34.172782  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:34.177961  2267 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:00:34.179595  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.180331  1703 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:34.197284  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:34.201551  2267 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:34.111456  4840 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:00:34.159078  5058 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:34.210945  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 70434.3us
W20260709 13:00:34.251200  1526 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.678s (SENT)
I20260709 13:00:34.254515  2235 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:34.212126  1708 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:34.213739  1707 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:00:34.214143  1704 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:34.114733  4888 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:00:34.047056  4649 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:34.152966  4999 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:34.217898  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:34.218564  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:34.276711  1703 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:34.222839  5057 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:00:34.291976  4956 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:34.292781  4956 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:00:34.225106  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.225960  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 873) took 1486 ms. Trace:
I20260709 13:00:34.293977  4956 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:34.294549  2268 rpcz_store.cc:276] 0709 13:00:32.739251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.739377 (+   126us) service_pool.cc:224] Handling call
0709 13:00:34.050244 (+1310867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.076201 (+ 25957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.225735 (+149534us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54005f0350. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:34.225893 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3014298880}
I20260709 13:00:34.209640  5052 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:00:34.306687  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:34.307875  1555 raft_consensus.cc:2410] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:00:34.309193  4940 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:34.312352  5014 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.580s	user 0.007s	sys 0.003s
I20260709 13:00:34.228525  4979 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:34.230314  4924 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:34.175130  4906 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:34.160475  4997 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:34.234826  4877 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:34.006827  5051 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:34.153374  5056 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.171331  4554 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:34.275213  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:34.363673  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 88557.8us
I20260709 13:00:34.364725  1526 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:34.282461  5060 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:00:34.329707  1629 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:34.350008  1701 raft_consensus.cc:2410] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:34.225589  4570 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:34.330246  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 182502us
W20260709 13:00:34.361514  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 220312us
I20260709 13:00:34.374110  1674 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:34.374320  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:34.375929  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:34.368912  2263 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:34.389015  1708 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:34.316342  4999 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.397768  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:34.356106  4959 consensus_meta.cc:287] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.617s	user 0.007s	sys 0.005s
I20260709 13:00:34.399183  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:34.401059  1674 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:34.400748  1560 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:34.402171  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1830) took 1634 ms. Trace:
I20260709 13:00:34.402611  1560 rpcz_store.cc:276] 0709 13:00:32.768166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.359665 (+1591499us) service_pool.cc:224] Handling call
0709 13:00:34.400603 (+ 40938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.401860 (+  1257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.402089 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:34.350344  4958 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:34.356331  4997 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.359783  4877 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:34.366159  5056 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:34.421841  1631 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:34.405922  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:34.409512  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:34.409727  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:34.424139  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:34.449266  1629 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:34.392699  4940 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.357214  4889 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:00:34.398343  4988 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:34.398263  4999 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.391036  5052 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:34.397554  4906 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:34.400692  5058 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:34.438715  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 258267us
I20260709 13:00:34.477137  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:34.477954  1629 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:34.419649  4997 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.423090  4877 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.392035  4554 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:34.493762  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 93295.7us
I20260709 13:00:34.444061  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1831) took 1664 ms. Trace:
I20260709 13:00:34.426167  5056 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.408268  4959 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:34.449930  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 288744us
W20260709 13:00:34.463737  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 54075.8us
I20260709 13:00:34.494508  1560 rpcz_store.cc:276] 0709 13:00:32.780179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.424908 (+1644729us) service_pool.cc:224] Handling call
0709 13:00:34.438728 (+ 13820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.438912 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.438937 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.443703 (+  4766us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:34.443767 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.443841 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.443992 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:34.495254  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:34.465093  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 59239.8us
I20260709 13:00:34.420620  4958 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:34.478684  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:34.466529  4840 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.479751  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:34.482113  5065 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:34.481704  5067 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.484480  4902 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.485659  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 489) took 2259 ms. Trace:
I20260709 13:00:34.505712  1557 rpcz_store.cc:276] 0709 13:00:32.225896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.428742 (+202846us) service_pool.cc:224] Handling call
0709 13:00:33.808111 (+1379369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.808298 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.808321 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:33.808361 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:33.808388 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.808436 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.485405 (+676969us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002dc3d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:34.485555 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3117546368}
I20260709 13:00:34.486971  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:34.488339  5073 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:34.491616  5068 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:00:34.469400  4924 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:34.466337  4931 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.497640  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:34.499809  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:34.512586  2271 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:34.481856  4906 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:34.473145  5070 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.503075  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:34.518496  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:34.520265  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:34.500664  4939 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.003s
I20260709 13:00:34.507433  1635 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 6.
W20260709 13:00:34.494241  5042 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.665s	user 0.002s	sys 0.009s
I20260709 13:00:34.510957  2262 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:34.523844  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:34.524025  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:34.524482  1627 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.474462  5052 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:34.491786  4991 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:34.539443  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1832) took 1754 ms. Trace:
I20260709 13:00:34.539935  1560 rpcz_store.cc:276] 0709 13:00:32.784599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.513410 (+1728811us) service_pool.cc:224] Handling call
0709 13:00:34.538780 (+ 25370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.539009 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.539051 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.539108 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:34.539152 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.539223 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.539366 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:34.541201  1634 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:34.544155  1629 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:34.512010  4924 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:34.534538  5041 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.554s	user 0.005s	sys 0.007s
I20260709 13:00:34.525699  5067 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.534422  5065 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.527654  5085 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:34.508204  4840 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:34.537954  5042 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:34.566422  4570 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:34.566824  5077 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:00:34.567749  5072 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:34.568318  5072 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:34.568754  5072 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:34.569617  5075 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:34.570195  5075 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.570572  5075 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:34.597277  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 97558.8us
W20260709 13:00:34.676247  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:34.685889  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 165708us
I20260709 13:00:34.690155  1524 leader_election.cc:400] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10.
I20260709 13:00:34.549970  4924 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.694248  1705 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:34.528306  4939 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:34.715255  1524 leader_election.cc:403] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:34.551307  5067 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:34.555914  5065 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:34.802894  5042 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:34.822718  5042 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:34.823458  4649 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:34.823905  4927 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:00:34.824728  5081 log.cc:927] Time spent T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 13:00:34.822122  5071 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:34.575223  5085 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:34.836597  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.848248  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:34.825006  5042 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:34.829090  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:34.883240  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:34.821018  5067 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.535018  5070 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:34.552590  5041 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:34.881057  5068 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:00:34.899092  2267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.016s	sys 0.011s
W20260709 13:00:34.917230  2267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.016s	sys 0.011s
I20260709 13:00:34.828393  5065 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:34.906291  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2015) took 1100 ms. Trace:
W20260709 13:00:34.906682  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 77686.9us
I20260709 13:00:34.918326  1556 rpcz_store.cc:276] 0709 13:00:33.793190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.966899 (+173709us) service_pool.cc:224] Handling call
0709 13:00:34.893540 (+926641us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b5400182c54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:34.893670 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111337856}
I20260709 13:00:34.919262  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:34.884107  1702 raft_consensus.cc:2376] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7. Re-sending same reply.
I20260709 13:00:34.920655  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:34.920987  5078 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.373s	user 0.000s	sys 0.000s
I20260709 13:00:34.921234  1702 raft_consensus.cc:2376] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7. Re-sending same reply.
W20260709 13:00:34.922716  5080 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.397s	user 0.000s	sys 0.000s
I20260709 13:00:34.923178  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1836) took 1577 ms. Trace:
I20260709 13:00:34.923555  1556 rpcz_store.cc:276] 0709 13:00:33.343012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.919203 (+1576191us) service_pool.cc:224] Handling call
0709 13:00:34.919521 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.919682 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.919711 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.919748 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:34.919776 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.919826 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.919917 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:34.926244  5066 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.479s	user 0.001s	sys 0.000s
I20260709 13:00:34.928213  4939 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:34.926359  1556 raft_consensus.cc:2955] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:34.929507  5052 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:34.930757  5056 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:34.932917  5056 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:34.937238  4959 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:34.939785  5082 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.940047  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:34.872750  4554 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:34.948454  1704 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:34.872823  5085 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:34.959658  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 269729us
I20260709 13:00:34.960096  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:34.960222  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:34.962433  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:34.901012  4708 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:34.965277  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:34.990658  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.988211  5052 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:34.940399  5082 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:35.002599  5086 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:34.940385  4981 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:34.996134  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:34.948207  5041 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:34.940820  4958 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:34.946712  5042 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.966364  4963 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:34.941437  5071 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:34.963379  4949 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.919s	user 0.011s	sys 0.000s
I20260709 13:00:35.012466  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1992) took 1117 ms. Trace:
I20260709 13:00:34.962811  5079 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.017343  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:35.017136  1707 rpcz_store.cc:276] 0709 13:00:33.894788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.280755 (+385967us) service_pool.cc:224] Handling call
0709 13:00:34.281002 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.312741 (+ 31739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.312778 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.312821 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:34.312851 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.012250 (+699399us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b54000a78d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:35.012291 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.012411 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72570240}
I20260709 13:00:34.966507  4554 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.941588  5065 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.014058  5071 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:35.033787  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.010933  5074 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:35.007313  4939 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:35.006865  5082 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:35.002933  4620 consensus_queue.cc:1059] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:00:35.035995  1707 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
W20260709 13:00:35.060542  1627 consensus_meta.cc:287] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.000s
I20260709 13:00:35.015893  4981 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:35.014081  5088 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.001892  5072 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:35.083272  4997 consensus_meta.cc:287] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.000s
I20260709 13:00:35.083707  1702 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:35.084980  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.086192  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:35.087170  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.087826  1707 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:35.088471  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:35.077194  1627 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:35.090440  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.091676  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:35.078807  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 464540us
I20260709 13:00:35.092933  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 561) took 1205 ms. Trace:
I20260709 13:00:35.093300  1709 rpcz_store.cc:276] 0709 13:00:33.887554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.999711 (+112157us) service_pool.cc:224] Handling call
0709 13:00:35.092733 (+1093022us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54000b6b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:35.092848 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2101390592}
I20260709 13:00:35.093677  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.094424  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.095436  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.098161  1709 raft_consensus.cc:2376] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8. Re-sending same reply.
I20260709 13:00:35.033362  4708 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.100327  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:35.101016  1554 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:35.100592  4708 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.010234  5086 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.101965  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:35.102954  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:35.103679  5086 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:35.090946  5088 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.104043  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:35.050836  4939 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:35.104614  4939 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.104463  5088 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.107216  5088 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:35.109040  5088 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:35.110425  2266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 722) took 1839 ms (client timeout 1824 ms). Trace:
I20260709 13:00:35.110505  5088 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:35.110860  2266 rpcz_store.cc:269] 0709 13:00:33.272100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.272252 (+   152us) service_pool.cc:224] Handling call
0709 13:00:35.110239 (+1837987us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400442d54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:35.110352 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251608320}
I20260709 13:00:35.111855  4708 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:35.112205  2269 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:35.080461  5079 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:35.113061  5079 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:35.080930  4981 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.013880  5042 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:35.116358  5042 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:35.096771  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1994) took 1201 ms. Trace:
I20260709 13:00:35.112615  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2116) took 2381 ms. Trace:
I20260709 13:00:35.117197  1704 rpcz_store.cc:276] 0709 13:00:33.895269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.280341 (+385072us) service_pool.cc:224] Handling call
0709 13:00:34.280610 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.950243 (+669633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.096519 (+146276us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b540005d554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:35.096702 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535635840}
I20260709 13:00:35.117245  1632 rpcz_store.cc:276] 0709 13:00:32.730873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.731237 (+   364us) service_pool.cc:224] Handling call
0709 13:00:32.738140 (+  6903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.258113 (+519973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.112373 (+1854260us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54003381d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:35.112534 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193686400}
I20260709 13:00:35.121048  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:35.122470  1709 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:35.105085  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:35.124018  1709 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:35.111266  5088 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.137706  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:35.138901  1554 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
W20260709 13:00:35.120112  5075 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.000s
I20260709 13:00:35.023964  4554 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.118173  5089 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.143368  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:35.143358  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:35.151644  1554 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:35.154798  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:35.156070  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:35.160915  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:35.162559  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1837) took 1801 ms. Trace:
I20260709 13:00:35.083715  4997 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.170660  1554 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:35.147562  5095 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:35.157552  5042 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:35.173913  1556 rpcz_store.cc:276] 0709 13:00:33.360998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.925666 (+1564668us) service_pool.cc:224] Handling call
0709 13:00:34.925933 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.926197 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:34.948802 (+ 22605us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.162125 (+213323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.162193 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:35.162250 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.162337 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.162490 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13939,"thread_start_us":212822,"threads_started":1}
I20260709 13:00:35.176973  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 497) took 1728 ms. Trace:
I20260709 13:00:35.186627  1554 rpcz_store.cc:276] 0709 13:00:33.445404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.168699 (+1723295us) service_pool.cc:224] Handling call
0709 13:00:35.170242 (+  1543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.173070 (+  2828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.173271 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:35.159694  4828 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:35.188546  1554 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:00:35.175061  4931 consensus_meta.cc:287] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.651s	user 0.006s	sys 0.003s
I20260709 13:00:35.197726  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 500) took 1743 ms. Trace:
I20260709 13:00:35.198338  1554 rpcz_store.cc:276] 0709 13:00:33.446329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.187800 (+1741471us) service_pool.cc:224] Handling call
0709 13:00:35.188176 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.189203 (+  1027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.189456 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:35.200182  1554 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:35.147203  5075 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.169639  5079 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.200888  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 501) took 1754 ms. Trace:
I20260709 13:00:35.204370  4943 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:35.269773  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.194191  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 498) took 1740 ms. Trace:
I20260709 13:00:35.266469  1706 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:35.272029  1556 rpcz_store.cc:276] 0709 13:00:33.445731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.185095 (+1739364us) service_pool.cc:224] Handling call
0709 13:00:35.185470 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.185681 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.185718 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.185772 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:35.185817 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.185899 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.186050 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:35.267340  1553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1821) took 3295 ms (client timeout 1548 ms). Trace:
I20260709 13:00:35.175716  5095 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:35.187638  5042 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:35.285866  1601 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.924s (SENT) [suppressed 53 similar messages]
I20260709 13:00:35.191766  4828 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.191100  5052 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:35.268337  1554 rpcz_store.cc:276] 0709 13:00:33.446604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.199344 (+1752740us) service_pool.cc:224] Handling call
0709 13:00:35.199721 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.200595 (+   874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.200827 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:35.274143  1553 rpcz_store.cc:269] 0709 13:00:31.971803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.041292 (+ 69489us) service_pool.cc:224] Handling call
0709 13:00:35.267154 (+3225862us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54003d95d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:35.267269 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454792448}
I20260709 13:00:35.297536  5051 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.154364  5071 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:35.358724  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 355773us
W20260709 13:00:35.363476  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 346213us
I20260709 13:00:35.366948  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:35.367301  1554 raft_consensus.cc:1217] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-5.4]   Dedup: 2.2->[3.3-5.4]
I20260709 13:00:35.291208  5042 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.300371  4828 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.372622  1554 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: [2.2-5.4]
I20260709 13:00:35.290448  5095 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.286695  5070 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:35.376398  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2023) took 1563 ms. Trace:
I20260709 13:00:35.379782  1554 rpcz_store.cc:276] 0709 13:00:33.812526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.301341 (+1488815us) service_pool.cc:224] Handling call
0709 13:00:35.367115 (+ 65774us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:35.376068 (+  8953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.376338 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:35.377168  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:35.297778  4931 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:35.383304  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 291722us
I20260709 13:00:35.388481  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:35.269583  4943 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.372532  5093 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:35.380177  5079 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:35.420707  5096 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:35.394917  5065 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:35.432178  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:35.431043  1554 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
W20260709 13:00:35.430919  5091 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
I20260709 13:00:35.372030  5051 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.404388  5070 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.397114  4931 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.483575  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 661) took 1150 ms. Trace:
I20260709 13:00:35.484171  1634 rpcz_store.cc:276] 0709 13:00:34.332885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.542152 (+209267us) service_pool.cc:224] Handling call
0709 13:00:34.550720 (+  8568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.556227 (+  5507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.556272 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.556847 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:00:35.006978 (+450131us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:35.007040 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.007135 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.483255 (+476120us) raft_consensus.cc:1685] finished
0709 13:00:35.483283 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.483494 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":281700,"raft.queue_time_us":1496,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":21896,"thread_start_us":130331,"threads_started":1,"wal-append.queue_time_us":372306}
I20260709 13:00:35.470741  5105 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:35.489725  5117 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:35.503914  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 71976.8us
I20260709 13:00:35.464663  4939 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.505292  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:35.496347  5103 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:00:35.511204  5075 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:35.491394  4554 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:35.520744  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 798) took 1135 ms. Trace:
I20260709 13:00:35.473548  5093 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:00:35.511633  5099 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:00:35.476797  5065 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:35.468842  5052 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.521370  2267 rpcz_store.cc:276] 0709 13:00:34.385313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.387344 (+  2031us) service_pool.cc:224] Handling call
0709 13:00:34.387712 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.917635 (+529923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.917698 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.920694 (+  2996us) log.cc:844] Serialized 26 byte log entry
0709 13:00:35.201516 (+280822us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:35.201564 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.201645 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.520447 (+318802us) raft_consensus.cc:1685] finished
0709 13:00:35.520476 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.520662 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22753,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6458,"thread_start_us":807841,"threads_started":2,"wal-append.queue_time_us":564887}
I20260709 13:00:35.526254  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:35.528072  4999 consensus_meta.cc:287] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.054s	user 0.007s	sys 0.003s
W20260709 13:00:35.529006  4877 consensus_meta.cc:287] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.027s	user 0.009s	sys 0.002s
W20260709 13:00:35.532039  4924 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.711s	user 0.007s	sys 0.001s
I20260709 13:00:35.533672  4997 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:35.540645  1526 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:35.529829  5093 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:35.525046  5105 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.551120  1526 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:35.542356  5075 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:35.568722  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2024) took 1715 ms. Trace:
I20260709 13:00:35.546720  5093 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:35.547223  5065 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.566169  5075 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:35.568835  1526 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:35.567423  5092 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:35.577925  5108 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:00:35.579968  5095 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:35.584995  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2002) took 1687 ms (client timeout 1627 ms). Trace:
W20260709 13:00:35.566183  5098 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:00:35.588443  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 1974) took 1698 ms (client timeout 1861 ms). Trace:
I20260709 13:00:35.590160  1703 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:00:35.592377  1703 pending_rounds.cc:85] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 3
W20260709 13:00:35.592195  1705 rpcz_store.cc:269] 0709 13:00:33.889952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.993993 (+104041us) service_pool.cc:224] Handling call
0709 13:00:35.588300 (+1594307us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54001c52d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:35.588379 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235190528}
I20260709 13:00:35.592772  1703 pending_rounds.cc:107] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:00:35.593077  1703 raft_consensus.cc:2889] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:35.545908  4877 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.585599  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:35.592020  1701 rpcz_store.cc:269] 0709 13:00:33.897097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.959190 (+ 62093us) service_pool.cc:224] Handling call
0709 13:00:35.584770 (+1625580us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54001accd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:35.584918 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896249600}
I20260709 13:00:35.543017  4999 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.595171  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.597491  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:35.598556  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.599080  1701 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:35.599757  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.600021  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:35.600540  1705 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:00:35.600539  1701 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.545750  4924 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.589861  5075 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.593479  5051 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:35.603004  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:35.603463  5110 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:35.604187  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.593288  5117 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:35.605043  5117 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:35.605423  5117 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.605557  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:35.605855  1704 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:35.607812  4821 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:35.591396  5092 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:35.608491  5092 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.612727  5070 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:35.614259  1701 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:35.616842  1707 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:35.592623  4931 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:35.619294  1700 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:35.622594  1701 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:35.625243  1709 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:35.618095  5067 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.000s
I20260709 13:00:35.626379  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:35.628125  1701 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.629379  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1833) took 2832 ms. Trace:
I20260709 13:00:35.630445  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:35.629681  1560 rpcz_store.cc:276] 0709 13:00:32.796954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.549941 (+1752987us) service_pool.cc:224] Handling call
0709 13:00:34.567488 (+ 17547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.885850 (+318362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.885878 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.886511 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 13:00:35.188335 (+301824us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:35.474409 (+286074us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.480662 (+  6253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.480735 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.629240 (+148505us) raft_consensus.cc:1685] finished
0709 13:00:35.629252 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.629333 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9114,"prepare.queue_time_us":373856,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":1478,"raft.queue_time_us":266089,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":2351,"thread_start_us":767763,"threads_started":3,"wal-append.queue_time_us":487741}
I20260709 13:00:35.634899  4933 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:35.635988  4933 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:35.636057  4999 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:35.636421  4933 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:35.634027  5070 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.637240  4933 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.638751  4933 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:35.641834  5085 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.000s
I20260709 13:00:35.618402  5093 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.643517  4939 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:35.649183  5100 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.229s	user 0.000s	sys 0.002s
I20260709 13:00:35.629462  5067 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.628684  5065 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:00:35.646240  4924 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:35.661616  5067 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:35.629560  5105 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:00:35.632882  5119 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:35.644821  2263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 882) took 1594 ms (client timeout 2081 ms). Trace:
I20260709 13:00:35.662467  5085 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.663053  5119 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:35.663107  2263 rpcz_store.cc:269] 0709 13:00:34.050300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.050704 (+   404us) service_pool.cc:224] Handling call
0709 13:00:35.644633 (+1593929us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54007b0f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:35.644768 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644004736}
I20260709 13:00:35.663584  5119 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:35.648629  4927 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.824s	user 0.012s	sys 0.000s
I20260709 13:00:35.664390  4927 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10.
I20260709 13:00:35.663682  1556 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 13:00:35.628335  4963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.012s	sys 0.014s
W20260709 13:00:35.665643  4963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.012s	sys 0.015s
I20260709 13:00:35.666075  5093 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.666491  4927 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:35.666874  4927 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:35.652153  5092 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.667637  4927 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.668586  4927 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.669010  5092 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:35.665957  4963 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:35.643244  4828 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:35.671247  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 569) took 1781 ms. Trace:
I20260709 13:00:35.671764  4828 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:35.671615  1706 rpcz_store.cc:276] 0709 13:00:33.889497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.166595 (+277098us) service_pool.cc:224] Handling call
0709 13:00:34.213031 (+ 46436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.284810 (+1071779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.671010 (+386200us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400126454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:35.671187 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2318425984}
I20260709 13:00:35.673485  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:35.663908  5088 consensus_meta.cc:287] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.003s
I20260709 13:00:35.680663  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:35.682315  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:35.683491  4931 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.683640  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:35.685652  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:35.686203  2267 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.674839  5088 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.684121  4931 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.645008  5095 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:35.684614  4821 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:35.693216  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:35.693518  4821 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.694482  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:35.695114  1555 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:35.695645  4821 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:35.696846  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.697460  1702 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:35.698520  1702 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:35.699298  1704 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:35.702474  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.703330  1706 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:00:35.705550  1706 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:35.670856  4963 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.714638  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 719) took 2472 ms. Trace:
I20260709 13:00:35.715476  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:35.715798  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:35.716100  1558 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:35.716434  2263 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:35.715620  2265 rpcz_store.cc:276] 0709 13:00:33.241789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.241911 (+   122us) service_pool.cc:224] Handling call
0709 13:00:33.246621 (+  4710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.585470 (+338849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.714372 (+2128902us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400583254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:35.714554 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777660288}
I20260709 13:00:35.689503  5092 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:00:35.714589  5075 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.718365  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:35.718410  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:35.718828  5085 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:35.719090  2266 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:35.719275  5075 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:35.720562  4821 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:35.720772  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1842) took 1936 ms. Trace:
I20260709 13:00:35.721160  1631 rpcz_store.cc:276] 0709 13:00:33.784005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.784456 (+   451us) service_pool.cc:224] Handling call
0709 13:00:33.795792 (+ 11336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.422448 (+626656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.720576 (+1298128us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540006bdd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:35.720722 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435683200}
I20260709 13:00:35.648173  5042 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.721977  2267 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:35.726081  1524 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:35.726889  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:35.728152  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:35.742260  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:35.742161  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:35.743208  1554 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.745922  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:35.746994  1558 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:35.689313  5105 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.749436  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:35.750435  1555 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.749245  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:35.713930  4943 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:35.786769  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:35.722649  5117 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.740440  5075 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:35.791042  1558 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.794777  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:35.740918  5093 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:35.740729  4715 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:35.740898  4927 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:35.799710  1702 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:35.739883  4995 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
W20260709 13:00:35.812318  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 88886.8us
I20260709 13:00:35.721174  4821 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.742841  5095 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:00:35.803040  5075 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.815156  4927 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.816365  5042 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:35.822118  5093 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:35.830664  4995 consensus_queue.cc:1243] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:35.851745  1555 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:35.843921  5075 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.853269  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:35.823588  4715 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:00:35.849515  4927 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:35.831878  4889 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:00:35.863780  5095 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:35.874374  5095 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:35.875696  5095 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.879995  4931 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:35.858403  5122 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:00:35.868918  4861 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:35.869233  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:35.897174  1704 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:35.898335  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:35.899657  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.900382  1704 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:35.901382  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.871094  4821 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:35.886469  1554 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:00:35.895602  5119 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.889458  1558 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:00:35.866514  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:35.828673  5126 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:00:35.906602  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 179782us
W20260709 13:00:35.907299  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 83357.5us
I20260709 13:00:35.905285  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:35.905998  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:35.891096  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1834) took 2739 ms. Trace:
I20260709 13:00:35.902848  1704 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:35.909719  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.907852  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 491) took 3681 ms. Trace:
I20260709 13:00:35.910287  1704 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:35.910888  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:35.911105  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.911681  1704 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:35.912532  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:35.912600  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.914263  1558 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.915385  1558 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.916559  1558 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:35.917559  1558 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:35.908562  1626 rpcz_store.cc:276] 0709 13:00:33.152194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.152367 (+   173us) service_pool.cc:224] Handling call
0709 13:00:33.721290 (+568923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.722154 (+   864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.890844 (+2168690us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b540006c2d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:35.891023 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252782336}
I20260709 13:00:35.908917  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:35.918813  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:35.919661  1554 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 8: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:35.920545  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 95754.3us
I20260709 13:00:35.910336  1559 rpcz_store.cc:276] 0709 13:00:32.226478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.494201 (+267723us) service_pool.cc:224] Handling call
0709 13:00:34.006507 (+1512306us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:34.027691 (+ 21184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.027734 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:34.032672 (+  4938us) log.cc:844] Serialized 78 byte log entry
0709 13:00:34.136967 (+104295us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:34.182915 (+ 45948us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.526260 (+343345us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.527206 (+   946us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.576000 (+ 48794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.576105 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.995575 (+419470us) raft_consensus.cc:1685] finished
0709 13:00:34.995595 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.906489 (+910894us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003124d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:35.907792 (+  1303us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":61065,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":6564,"raft.queue_time_us":722479,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":44080,"spinlock_wait_cycles":2945911552,"thread_start_us":494894,"threads_started":4,"wal-append.queue_time_us":356528}
I20260709 13:00:35.921701  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:35.922428  1559 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:35.922540  2235 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:35.923590  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:35.863565  5093 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.924912  1704 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:35.920814  5067 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:35.926636  5067 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:35.934345  5088 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:35.944366  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.921029  5042 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:35.946406  5042 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:35.947263  5042 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:35.928704  4715 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:35.948578  4715 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.948933  4715 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.949098  5075 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.924468  4963 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:00:35.950451  5105 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.924280  4850 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:00:35.950683  5002 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:35.950935  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:35.951116  5002 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:35.951211  4850 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:35.951593  1704 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:35.952142  5075 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:35.951936  5002 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.952520  5119 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:35.927582  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:35.921332  4821 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:35.953409  5002 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.953339  4821 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.956007  4821 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:35.927506  5067 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:35.925781  4889 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:35.956701  4889 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.957103  4889 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.952540  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:35.958976  5116 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.344s	user 0.001s	sys 0.001s
I20260709 13:00:35.959939  1558 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:35.961190  1558 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:00:35.961498  1558 pending_rounds.cc:85] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 3
I20260709 13:00:35.961697  1558 pending_rounds.cc:107] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:00:35.961920  1558 raft_consensus.cc:2889] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:35.935844  5074 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:35.962378  5128 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:35.962553  5074 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.963217  1558 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:35.945858  1601 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:35.947135  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2011) took 2004 ms. Trace:
I20260709 13:00:35.964139  1703 rpcz_store.cc:276] 0709 13:00:33.943102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.330983 (+387881us) service_pool.cc:224] Handling call
0709 13:00:35.589825 (+1258842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.593447 (+  3622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.946939 (+353492us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001accd0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:35.947076 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2804696448}
I20260709 13:00:35.959914  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:35.966084  1704 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.962936  5128 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:35.976828  5128 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:35.965952  1555 raft_consensus.cc:2368] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10.
I20260709 13:00:35.967154  1558 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:35.968832  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:35.980211  5117 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:35.981308  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:35.981873  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2024) took 1043 ms. Trace:
I20260709 13:00:35.981966  1701 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:35.982424  1707 rpcz_store.cc:276] 0709 13:00:34.938600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.091881 (+153281us) service_pool.cc:224] Handling call
0709 13:00:35.981676 (+889795us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b540005d054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:35.981816 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198746368}
I20260709 13:00:35.983616  4963 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.984273  4963 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:35.925462  5079 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:00:35.986159  1704 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:35.998054  1554 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:35.951694  4850 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:36.002628  1554 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:36.002763  4850 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:36.004436  4850 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.920715  5000 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:00:36.006109  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:36.011971  1560 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:35.985903  4963 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:36.021427  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:36.032600  4877 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:36.033674  5123 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:35.987115  4990 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.007087  5079 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:36.039115  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:36.036571  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:36.034242  5123 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.042002  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:36.046474  1526 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:36.053293  5133 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:36.055930  5133 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:36.056376  5133 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:36.058243  5105 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.060415  5074 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:36.061584  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.062304  5119 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:36.062954  4990 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.065563  5012 consensus_queue.cc:1059] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:36.066272  4779 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:36.067008  4904 consensus_queue.cc:1059] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:36.037283  5079 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:36.053382  5075 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:36.071889  1703 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:36.014621  5011 consensus_queue.cc:1059] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:00:36.069304  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.041059  5117 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.044539  5128 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:36.135973  5128 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:36.135914  4927 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.136530  5128 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.082386  4665 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.139297  4665 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.086596  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:36.140146  1558 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:36.097170  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.053629  4963 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:36.044996  4877 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:36.135402  4931 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:36.142729  1707 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:36.069402  4821 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:00:35.569254  1553 rpcz_store.cc:276] 0709 13:00:33.853019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.358310 (+1505291us) service_pool.cc:224] Handling call
0709 13:00:35.371957 (+ 13647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.372157 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:35.494517 (+122360us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.568405 (+ 73888us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.568460 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:35.568504 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.568563 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.568665 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2588,"prepare.queue_time_us":181268,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":3544,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"thread_start_us":157141,"threads_started":2}
I20260709 13:00:36.096380  5075 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:36.073956  5028 consensus_queue.cc:1059] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:00:36.044834  5134 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:00:36.174326  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:36.183631  5133 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.183996  4665 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.185763  5133 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.196334  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:36.196929  2266 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.198051  1553 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:36.191509  5067 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.200685  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:36.200405  5067 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.193871  5105 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:36.200347  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:36.203317  5123 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.211125  2267 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
W20260709 13:00:36.214573  5137 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:36.216816  5079 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:36.174270  5075 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.221208  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:36.173894  5070 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.222666  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1829) took 3480 ms. Trace:
I20260709 13:00:36.160565  4927 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.226327  1551 rpcz_store.cc:276] 0709 13:00:32.741802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.314846 (+1573044us) service_pool.cc:224] Handling call
0709 13:00:34.315138 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.315309 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:34.315579 (+   270us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.221606 (+1906027us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b1800429760. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddb774bc 00007f06daec548b 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287
0709 13:00:36.221686 (+    80us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:36.221727 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:36.221767 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.221838 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.221974 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21222,"prepare.queue_time_us":1172,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2764,"raft.queue_time_us":23726,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":15582,"spinlock_wait_cycles":16171776,"thread_start_us":191053,"threads_started":2,"wal-append.queue_time_us":212458,"wal-append.run_cpu_time_us":1896,"wal-append.run_wall_time_us":1292168}
I20260709 13:00:36.144050  5117 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.152072  4877 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.153193  4931 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:36.223155  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 155188us
W20260709 13:00:36.238221  2262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 736) took 2501 ms (client timeout 1887 ms). Trace:
W20260709 13:00:36.238651  2262 rpcz_store.cc:269] 0709 13:00:33.736490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.750985 (+ 14495us) service_pool.cc:224] Handling call
0709 13:00:36.237997 (+2487012us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54005d6e54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:36.238158 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745443584}
I20260709 13:00:36.224236  4940 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.244717  4554 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:36.245290  4554 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:36.245399  4877 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.247335  5114 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.247170  4554 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.247900  5114 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.248737  4554 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.250584  5074 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.251573  5134 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:36.252226  4931 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:36.252090  5134 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.231391  5070 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:36.154587  5017 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:00:36.269536  1558 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:36.220395  4715 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.237246  4939 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.241572  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:36.242318  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:36.287669  1628 raft_consensus.cc:2368] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9.
I20260709 13:00:36.291580  2266 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:36.273352  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.293018  1558 raft_consensus.cc:1217] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-5.4]   Dedup: 2.2->[3.3-5.4]
I20260709 13:00:36.239856  4963 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:36.280850  5135 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:36.237469  5011 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.293150  1626 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:36.284364  1704 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:36.293583  1558 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: [2.2-5.4]
I20260709 13:00:36.298247  1558 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:36.308142  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:36.311566  1628 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:36.313313  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.315766  1628 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:36.250020  5114 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.244786  5117 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.318639  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.319216  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:36.319787  1628 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:36.325735  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.327091  2264 raft_consensus.cc:2393] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:36.286334  4931 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.332183  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.343091  1628 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:36.344223  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 125664us
I20260709 13:00:36.344970  2236 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:36.294508  5135 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:36.354408  1628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:00:36.355055  1632 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:36.355206  1628 raft_consensus.cc:606] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:36.358281  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.362979  5067 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.318802  5011 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:36.365873  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.346475  5134 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:36.367622  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:36.297017  4939 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:36.352748  5135 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:36.368235  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 132509us
I20260709 13:00:36.331046  5128 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.371448  1634 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:36.373032  2234 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:36.347687  4931 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:36.376735  4715 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:36.378180  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:36.370114  5151 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.381433  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.388780  5075 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:36.373948  5134 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:36.377297  5011 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:36.390527  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:36.434700  1551 raft_consensus.cc:2393] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:36.377297  4939 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:36.390792  5070 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:36.435730  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:36.436383  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 58281.7us
I20260709 13:00:36.391585  1626 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:00:36.437336  1626 pending_rounds.cc:85] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 7
I20260709 13:00:36.437614  1626 pending_rounds.cc:107] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:00:36.392251  5089 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:36.392882  4961 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:36.394523  4979 raft_consensus.cc:3055] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:36.396898  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 557) took 2512 ms. Trace:
I20260709 13:00:36.440470  1700 rpcz_store.cc:276] 0709 13:00:33.886329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.153817 (+267488us) service_pool.cc:224] Handling call
0709 13:00:34.154910 (+  1093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.624132 (+1469222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.396683 (+772551us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54003a0554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:36.396842 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3365553408}
I20260709 13:00:36.400048  2265 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:36.401165  5128 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:36.402207  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:36.402884  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.403725  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.404189  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:36.404379  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:36.405084  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:36.406800  5104 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:36.407246  4525 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.407866  4840 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:36.411253  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:36.414163  1558 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:36.414479  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.470847  1627 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:36.415652  4877 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:36.415729  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:36.375131  4889 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:36.418097  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.484772  1634 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:00:36.486317  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:36.440145  4961 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:36.435415  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:36.378568  5149 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:36.437451  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:36.461927  4904 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:36.437999  1626 raft_consensus.cc:2889] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:36.441681  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.470209  1554 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.409953  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.477212  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:36.478996  1558 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:36.505679  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:36.505808  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:36.506826  1558 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:36.507838  1558 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:36.483394  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:36.417253  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 731) took 2976 ms. Trace:
I20260709 13:00:36.488394  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:36.489290  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:36.490317  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:36.492087  2234 leader_election.cc:400] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9.
I20260709 13:00:36.492736  5072 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.476310  4877 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:36.493139  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:36.493639  5151 raft_consensus.cc:2764] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:36.494572  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:36.495534  5158 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:36.522611  1554 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:36.496110  4931 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:36.496723  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:36.440316  4979 raft_consensus.cc:740] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:36.440004  5089 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:36.441545  5134 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:36.503512  4904 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.535228  4904 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.437978  2267 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:36.501533  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 65880.4us
I20260709 13:00:36.475963  4525 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.501833  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 1990) took 2607 ms. Trace:
I20260709 13:00:36.509806  1701 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.538079  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:36.510015  2234 leader_election.cc:403] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:36.511094  1551 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:36.509006  2269 rpcz_store.cc:276] 0709 13:00:33.441140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.441407 (+   267us) service_pool.cc:224] Handling call
0709 13:00:35.111882 (+1670475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.112550 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.417008 (+1304458us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400442d50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:36.417185 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3814061312}
I20260709 13:00:36.539036  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:36.512076  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:36.492676  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:36.539587  1706 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:36.520833  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:36.521863  2236 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:36.540462  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:36.523433  1703 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.500686  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:36.506526  5149 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:36.527323  5089 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.528738  5134 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.548046  1706 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:36.548902  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:36.531091  5075 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:36.551501  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 59604.1us
I20260709 13:00:36.552654  2234 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:36.552979  1706 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:00:36.523864  5159 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.541741  1553 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 4.
I20260709 13:00:36.542721  1554 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:36.537379  1708 rpcz_store.cc:276] 0709 13:00:33.894309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.276066 (+381757us) service_pool.cc:224] Handling call
0709 13:00:34.315039 (+ 38973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.396584 (+ 81545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.501604 (+2105020us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b54001ac7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:36.501775 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169710976}
I20260709 13:00:36.544132  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:36.482757  5104 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.532505  4889 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:36.533490  4877 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.550860  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:36.561197  1635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:00:36.561749  1635 raft_consensus.cc:606] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:36.558418  1701 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:36.543260  5150 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:36.535318  4979 consensus_queue.cc:260] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.554318  4998 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:36.559860  5143 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.608875  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:36.609653  1708 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.566402  5117 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:36.615317  5117 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:36.615765  5117 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.587543  4998 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:36.623283  4998 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:36.624600  4998 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.550529  5128 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:00:36.560447  5146 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:00:36.581355  5159 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:36.554620  5151 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:00:36.570385  5089 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.662849  2268 raft_consensus.cc:3055] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:36.663261  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 106070us
I20260709 13:00:36.587363  4877 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.646150  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 502) took 3122 ms. Trace:
I20260709 13:00:36.663992  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:36.664162  1556 rpcz_store.cc:276] 0709 13:00:33.523805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.273303 (+1749498us) service_pool.cc:224] Handling call
0709 13:00:35.273724 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.665279 (+391555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.645880 (+980601us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b5400182254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:36.646093 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896381312}
I20260709 13:00:36.663259  2268 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:36.607527  1703 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:36.598894  4889 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:36.547044  4961 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 13:00:36.669945  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 123614us
I20260709 13:00:36.648729  5158 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:00:36.667361  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:36.669531  2268 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.674896  2268 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:36.676858  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:36.678628  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:36.679368  1554 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:36.679528  1556 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.682318  5000 raft_consensus.cc:3055] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:36.682863  5000 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:36.683075  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.683516  5157 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:00:36.683725  5000 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:36.684777  5000 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.682366  4525 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.672039  5151 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:36.698834  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:36.717427  1556 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:36.715862  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:36.687158  4961 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:36.681541  4889 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.681202  5075 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:36.672185  5161 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:00:36.723147  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:36.724081  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:36.717108  5151 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:36.722594  4931 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:36.720479  5150 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:36.751157  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2033) took 1405 ms. Trace:
I20260709 13:00:36.729189  5093 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:36.751647  1709 rpcz_store.cc:276] 0709 13:00:35.345816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.345952 (+   136us) service_pool.cc:224] Handling call
0709 13:00:35.346276 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.626930 (+280654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.750888 (+1123958us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b540005da54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:36.751099 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641231232}
I20260709 13:00:36.731268  4840 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:00:36.755895  5162 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:36.756175  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:36.756501  5162 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:36.756866  4991 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.756832  1554 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:36.719723  4554 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:00:36.728513  5128 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:00:36.748435  5151 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:36.777115  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.670084  5149 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:36.781672  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.782241  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.788214  2268 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:00:36.788877  2268 pending_rounds.cc:85] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 7
I20260709 13:00:36.789104  2268 pending_rounds.cc:107] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:00:36.789361  2268 raft_consensus.cc:2889] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:36.738240  5165 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:00:36.773696  5104 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.791107  4840 raft_consensus.cc:3055] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:36.817040  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 295251us
W20260709 13:00:36.806473  5126 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 13:00:36.822095  5164 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:00:36.839977  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.846364  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 506) took 1156 ms. Trace:
W20260709 13:00:36.851954  1599 connection.cc:256] RPC call timeout handler was delayed by -1.2281890619999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
I20260709 13:00:36.851920  1560 rpcz_store.cc:276] 0709 13:00:35.689814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.689947 (+   133us) service_pool.cc:224] Handling call
0709 13:00:36.846149 (+1156202us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400182754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:36.846285 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620737920}
I20260709 13:00:36.846988  4779 raft_consensus.cc:3055] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:36.853350  4779 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:36.854461  1628 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:36.854182  4779 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.849915  1554 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:36.856004  5101 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.856132  5002 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.856511  5101 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.833377  5067 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.857731  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1852) took 1115 ms. Trace:
I20260709 13:00:36.867327  1552 rpcz_store.cc:276] 0709 13:00:35.742280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.750438 (+  8158us) service_pool.cc:224] Handling call
0709 13:00:36.857550 (+1107112us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b54000c8fd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:36.857680 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168769280}
I20260709 13:00:36.836409  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2050) took 1351 ms. Trace:
I20260709 13:00:36.868693  1702 rpcz_store.cc:276] 0709 13:00:35.484808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.717693 (+232885us) service_pool.cc:224] Handling call
0709 13:00:35.717960 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.815270 (+ 97310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.836111 (+1020841us) spinlock_profiling.cc:243] Waited 81.5 ms on lock 0x7b54001fe354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:36.836333 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187455232}
I20260709 13:00:36.791435  5162 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.808394  5150 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.856650  5002 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.857549  5067 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.859193  4525 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:36.847910  5071 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.860982  5101 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.860615  5135 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.827255  1627 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:36.833104  4904 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:36.865223  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:36.885435  1552 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:36.887800  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:36.858417  4998 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:36.892006  1708 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
W20260709 13:00:36.892791  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.975047  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.977005  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:36.893276  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.961441  1560 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:36.973044  4981 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:00:36.819160  4840 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:36.981508  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:36.982549  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 117418us
I20260709 13:00:36.992738  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:36.982931  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.979206  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:36.964066  1554 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:36.983369  5165 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:37.023113  4821 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:37.023545  4904 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:37.024295  2236 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:37.025264  5002 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:36.982488  5101 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.996084  4828 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.947152  4525 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.037156  5168 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.045271  1560 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:37.042233  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 131311us
I20260709 13:00:37.038100  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:36.974498  5104 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:00:37.040807  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:36.983645  5028 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:00:36.984318  4939 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:00:36.990906  4998 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.066797  1627 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:37.071420  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.072512  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.076370  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:37.077325  2264 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:37.079233  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:37.081684  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.082506  2264 raft_consensus.cc:2368] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10.
I20260709 13:00:37.041056  5135 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:37.084757  2264 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:37.074066  4828 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:37.092890  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:37.094218  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:37.094898  4904 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:37.095082  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.095356  4904 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:37.095775  4904 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:37.095613  5128 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:37.095780  1627 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:37.100260  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.017969  5117 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.106468  1633 raft_consensus.cc:2393] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:37.125475  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.126781  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.127450  1633 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:37.065466  4931 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:37.041350  5101 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.136432  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.140133  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.140930  2262 raft_consensus.cc:2410] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:37.140933  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.145882  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:37.146066  1552 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:37.102721  5143 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9.
W20260709 13:00:37.152870  5166 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:00:37.153059  5067 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:37.153600  5163 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:00:37.154145  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.154824  4525 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:37.151860  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.063586  4840 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.104465  5165 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:00:37.132419  5070 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.263602  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.265668  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.268106  2266 raft_consensus.cc:2410] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:37.271632  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.272460  1633 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:00:37.272881  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.274434  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:37.183279  5089 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.002s
I20260709 13:00:37.290714  1706 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:37.291718  1633 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:37.293556  2271 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:37.296396  2270 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:37.179656  5067 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:37.268070  4961 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.529s	user 0.004s	sys 0.004s
I20260709 13:00:37.300056  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.301542  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.291751  2268 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:37.304611  1708 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:37.305183  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:37.178314  5093 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:37.296234  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 333912us
I20260709 13:00:37.275697  4525 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.309973  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.311731  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:37.312813  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.313942  1626 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:37.295570  4840 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:37.322973  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.321183  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:37.268338  5158 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:00:37.324967  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:37.326494  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.329210  1635 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 13:00:37.322647  4525 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.334703  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.336360  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.336907  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.337747  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.347277  1600 leader_election.cc:400] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10.
I20260709 13:00:37.347730  1600 leader_election.cc:403] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:37.315989  5067 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:00:37.350343  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 371240us
I20260709 13:00:37.356186  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.316092  5089 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 13:00:37.353401  5151 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
W20260709 13:00:37.353226  5000 consensus_meta.cc:287] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.668s	user 0.003s	sys 0.009s
I20260709 13:00:37.365844  1701 raft_consensus.cc:2410] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:37.285270  5070 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.369961  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.308058  4931 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.354588  4998 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:37.367383  4991 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.599s	user 0.007s	sys 0.003s
I20260709 13:00:37.401679  4991 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:37.402961  4991 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:37.397197  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.405961  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.349522  4961 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:37.358104  5175 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:37.400779  5070 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:37.400429  5000 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:37.400363  5173 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:00:37.365223  5174 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:37.407517  1635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "207df21ae856459f9637b16a0feb2796"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
W20260709 13:00:37.408687  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 416767us
I20260709 13:00:37.409031  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.367249  5168 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:37.405189  5082 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.379848  5056 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.428951  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:37.404960  4991 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:37.427719  1635 raft_consensus.cc:606] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
W20260709 13:00:37.428241  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 145146us
I20260709 13:00:37.431104  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.433434  1635 raft_consensus.cc:614] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:37.385922  5179 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10.
I20260709 13:00:37.406092  4981 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:00:37.367815  5093 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:37.440076  4877 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.000s
I20260709 13:00:37.418778  5117 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:37.422735  5101 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:37.268776  5128 consensus_queue.cc:1175] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7e99891af85f4b10aa1cc2da6aa33082" responder_term: 8 status { last_received { term: 7 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:37.421482  5070 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:37.379246  5151 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:37.443912  5172 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:00:37.444820  5151 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:37.447444  4889 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:37.447842  4889 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:37.448720  4889 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.453053  5082 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.454667  2265 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:37.464324  1705 raft_consensus.cc:2410] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:37.454691  5056 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:37.465366  5134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.001s	sys 0.011s
I20260709 13:00:37.450014  4889 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:37.465847  5134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.002s	sys 0.012s
W20260709 13:00:37.469291  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 119484us
W20260709 13:00:37.465915  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 140819us
W20260709 13:00:37.477974  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 126285us
I20260709 13:00:37.483881  5179 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:37.484397  5179 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:37.486150  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:37.496466  4981 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:37.496996  4981 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:37.497330  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.497489  5160 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.870s	user 0.000s	sys 0.015s
I20260709 13:00:37.428730  4525 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:37.499073  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2036) took 1012 ms. Trace:
I20260709 13:00:37.485293  5179 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.500020  1707 rpcz_store.cc:276] 0709 13:00:36.486260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.500507 (+ 14247us) service_pool.cc:224] Handling call
0709 13:00:36.500812 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.501141 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.501172 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.501573 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.983193 (+481620us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:36.983230 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.983310 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.498850 (+515540us) raft_consensus.cc:1685] finished
0709 13:00:37.498868 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.499011 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2719,"raft.run_cpu_time_us":618,"raft.run_wall_time_us":7157,"thread_start_us":444901,"threads_started":1,"wal-append.queue_time_us":642243}
I20260709 13:00:37.501822  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:37.502454  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 73596us
I20260709 13:00:37.506469  1673 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:37.507010  2266 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:37.511399  1630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:00:37.512269  1630 raft_consensus.cc:606] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:37.504863  4940 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:37.521493  1554 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:00:37.520946  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44774.7us
I20260709 13:00:37.530417  1599 leader_election.cc:400] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10.
I20260709 13:00:37.533430  1707 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:37.534343  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.534631  1703 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:37.538316  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:37.505242  5102 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:37.519613  5065 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:37.556772  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:37.497808  4981 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.519879  5089 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:37.561285  1700 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:37.555039  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.555437  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:37.562613  1554 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:37.562704  5200 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:00:37.563024  5185 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:37.565208  5071 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:37.566684  5071 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:37.567055  5071 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:37.567418  5071 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:37.556752  4904 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.569365  5089 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.536317  4821 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:00:37.570271  2267 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:37.537726  4525 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:37.555747  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:37.571951  4525 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.572803  5102 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:37.560586  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:37.435616  5067 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.559715  4991 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:37.548400  5179 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:37.558054  1560 raft_consensus.cc:2393] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:37.546393  4927 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.573535  5102 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.548764  5187 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:00:37.573983  4525 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:37.574348  5180 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:37.576085  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:37.634367  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 58348.6us
I20260709 13:00:37.635349  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:37.577083  5089 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:37.639380  4779 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.578490  4940 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:37.643261  4940 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:37.644433  4940 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.646646  5159 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:37.647202  5159 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:37.648196  5159 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.649750  5159 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.579675  5070 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.655516  5070 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.658403  5185 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:37.587603  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:37.583750  5071 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.659397  5185 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:37.660270  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:37.660846  1700 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:37.661070  5071 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:37.594731  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 64418.5us
W20260709 13:00:37.591305  5177 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:37.663131  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:37.664122  5002 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:37.664536  1600 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:37.664783  5002 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:37.596196  4927 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:37.599879  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 68617.5us
W20260709 13:00:37.598389  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.666265  4963 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:37.666847  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:37.667395  4963 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:37.667790  4963 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:37.598299  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2034) took 2252 ms. Trace:
I20260709 13:00:37.661520  5194 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:37.668480  5181 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:37.668541  4963 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.606448  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:37.665705  5002 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.671922  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:37.608232  5079 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:37.674363  4963 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.602999  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.612720  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:37.676149  1707 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:37.616323  1556 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:37.601158  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.679344  1704 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:37.601063  5075 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:37.626446  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.604748  5056 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:37.603564  2264 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:37.680964  5135 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:37.681372  5135 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:37.596938  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.680083  5075 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:37.682873  5075 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.603847  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.628106  4981 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:37.658218  5180 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:37.683722  2264 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEARNER]: Advancing to term 11
I20260709 13:00:37.589740  4904 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:37.581807  1630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:00:37.595511  5202 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:00:37.686208  1630 raft_consensus.cc:606] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:37.686880  5202 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:37.595934  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.687279  5202 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:37.687628  2270 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:37.600411  5052 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:37.688071  5202 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.688781  5052 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.689289  5202 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:37.600009  4939 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:00:37.668705  5194 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.605227  5104 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:37.691984  5104 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:37.692474  5070 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:37.692952  5167 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:37.692763  5104 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.693336  5167 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:37.604245  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.694317  5167 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.610316  5072 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:37.695348  5167 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:37.695540  5072 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.698350  2262 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:37.619450  1632 raft_consensus.cc:2393] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:37.693830  5104 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:37.700001  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 678) took 1206 ms. Trace:
I20260709 13:00:37.700356  1632 rpcz_store.cc:276] 0709 13:00:36.493429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.543910 (+ 50481us) service_pool.cc:224] Handling call
0709 13:00:37.618995 (+1075085us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b540034d928. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3dac924 00007f06e2f95227 00007f06e2f94ab8 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:37.699915 (+ 80920us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15498624}
I20260709 13:00:37.683837  5075 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.702625   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:37.703409  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.703999  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.704334  1628 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:37.668260  1705 rpcz_store.cc:276] 0709 13:00:35.346135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.604988 (+258853us) service_pool.cc:224] Handling call
0709 13:00:37.598116 (+1993128us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54001c48d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:37.598246 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4272335104}
I20260709 13:00:37.707484  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.618285  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 902) took 1184 ms. Trace:
I20260709 13:00:37.714412  2263 rpcz_store.cc:276] 0709 13:00:36.433729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.433866 (+   137us) service_pool.cc:224] Handling call
0709 13:00:37.617996 (+1184130us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b5400598dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:37.618204 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2239042816}
I20260709 13:00:37.719745  1630 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:37.724885  2267 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:37.733790  1632 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:37.739449  5197 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.740299  5197 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:37.744508  5135 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:37.746627  5135 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:37.747550  5089 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.748328  5089 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:37.762322  4715 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:37.762818  5142 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:37.763316  4715 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:37.762430  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 82521.6us
W20260709 13:00:37.769584  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.774286  5168 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:37.780055  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.781042  1628 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:37.772964  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.790892  2265 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:37.793133  5089 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:37.796360  1700 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:37.797849  5052 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:37.798766  5072 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:37.800557  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.800798  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.801752  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.802831  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.898010  2271 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
W20260709 13:00:37.803086  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 135103us
W20260709 13:00:37.804265  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 88385.4us
I20260709 13:00:37.804416  5187 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:37.804862  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 140411us
I20260709 13:00:37.805733  5170 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:37.917057  1600 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:37.806319  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 521) took 1084 ms. Trace:
I20260709 13:00:37.806406  5082 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:37.811421  4927 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:37.812937  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.814327  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.815382  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.940359  1634 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:37.815713  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.815761  2264 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:00:37.815968  5205 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.080s	user 0.004s	sys 0.000s
I20260709 13:00:37.817492  4715 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:37.818416  5194 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:37.819015  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 152286us
I20260709 13:00:37.951795  1601 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:37.610347  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:37.822656  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:37.826995  2267 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:37.955193  1554 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:37.828860  1705 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:00:37.827967  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.829617  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.829907  4979 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:37.831177  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:37.831583  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.970238  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:37.832101  1704 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:37.832655  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.837265  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:37.840763  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.972235  1707 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:37.972664  2265 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:37.840425  1456 catalog_manager.cc:5697] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 6 to 8, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:37.974418  1456 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.841602  1633 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:37.914742  5187 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.844751  5197 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:37.860589  1552 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:37.863336  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.866371  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.872709  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 94258.6us
I20260709 13:00:38.003803  1558 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:37.881584  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:37.883946  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.006615  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.896651  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.912493  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:37.924250  1674 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:37.918319  1553 rpcz_store.cc:276] 0709 13:00:36.721550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.721679 (+   129us) service_pool.cc:224] Handling call
0709 13:00:36.735779 (+ 14100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.736030 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:36.736324 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.592122 (+855798us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b1800078a00. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:00:37.805466 (+213344us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.805516 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:37.805562 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.806139 (+   577us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.806265 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":746,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2679,"raft.queue_time_us":41522,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":9110,"spinlock_wait_cycles":7887104,"thread_start_us":213212,"threads_started":1}
I20260709 13:00:38.007788  1701 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:37.932591  1600 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:37.938400  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:38.008790  1709 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:37.599972  5102 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:37.942809  5207 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:37.960784  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:38.021338  1627 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:37.961591  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.953729  1599 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:37.954448  1551 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:37.841920   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:37.959812  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:38.012282  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:38.012795  1632 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:38.014838  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:37.958529  4963 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:37.976701  1456 catalog_manager.cc:5697] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 6 to 7, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194), now has a pending config: VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193), VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194), VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195), VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:37.970779  4927 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.032897  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:37.963068  5174 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:38.029735  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:38.042652  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:37.996950  5187 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:38.030786  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 149328us
I20260709 13:00:38.049333  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:37.978499  4961 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.031958  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:38.035238  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:38.035609  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:38.052834  1701 raft_consensus.cc:2410] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:38.036091  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:38.053527  1557 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:37.940912  5104 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:00:37.970345  5070 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:37.943071  5202 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:00:37.995975  5168 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.018566  5194 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:38.029915  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 105809us
I20260709 13:00:37.995891  5028 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:38.041177  5102 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:38.057861  1454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35556 (request call id 318) took 18819 ms (client timeout 15000 ms). Trace:
W20260709 13:00:38.060263  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.061944  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:38.045373  1456 catalog_manager.cc:5697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:38.038069  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:37.971194  4958 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:00:38.033386  5218 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.126s	user 0.001s	sys 0.002s
I20260709 13:00:38.069250  1709 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:00:38.100171  1709 pending_rounds.cc:85] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 7
I20260709 13:00:38.070833  5128 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:38.027001  4963 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:38.032559  5199 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:38.055545  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:38.075176  5168 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:38.037463  5158 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:38.082587  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:38.141218  1553 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:38.043682  5082 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.030972  5000 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:00:38.025408  5002 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
W20260709 13:00:38.095486  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 57525.3us
W20260709 13:00:38.154712  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 92910.6us
I20260709 13:00:38.047611  4927 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.064350  5152 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:38.100534  1709 pending_rounds.cc:107] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:38.162192  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:38.164048  1709 raft_consensus.cc:2889] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:38.039157  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 85518.7us
I20260709 13:00:38.074374  4850 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:38.069707  4931 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:38.070695  5052 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:38.083683  5194 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:38.114836  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:38.116261  1700 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:38.117180  1707 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:38.119011  1703 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:00:38.088153  4889 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.004s
I20260709 13:00:38.133316  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:38.138819  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:38.142064  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:38.201218  1704 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.139783  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:38.156512  2268 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:38.230319  2268 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:00:38.230404  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 90757.1us
I20260709 13:00:38.231238  1674 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:38.231323  2268 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.188412  5052 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:38.064848  4961 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:38.160871  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.106938  4940 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:38.074884  5070 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:38.152119  5202 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:38.165274  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:38.248498  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 83367.6us
I20260709 13:00:38.109387  4963 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.144093  4578 raft_consensus.cc:3055] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:38.144757  5168 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.030053  5207 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.081982  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:38.084406  1454 rpcz_store.cc:269] 0709 13:00:19.218342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.218655 (+   313us) service_pool.cc:224] Handling call
0709 13:00:38.037909 (+18819254us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:32.090734 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:32.091473 (+   739us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:32.091522 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:00:32.091542 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:32.092239 (+   697us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:32.092333 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:32.092359 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:00:32.092867 (+   508us) tablet.cc:701] Row locks acquired
0709 13:00:32.092918 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:00:32.093082 (+   164us) write_op.cc:270] Start()
0709 13:00:32.093227 (+   145us) write_op.cc:276] Timestamp: P: 1783602032093009 usec, L: 0
0709 13:00:32.093249 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:00:32.105650 (+ 12401us) log.cc:844] Serialized 1692 byte log entry
0709 13:00:32.936879 (+831229us) op_driver.cc:464] REPLICATION: finished
0709 13:00:33.404772 (+467893us) write_op.cc:301] APPLY: starting
0709 13:00:33.404902 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:33.405116 (+   214us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:33.434325 (+ 29209us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:33.582802 (+148477us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:33.652702 (+ 69900us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:00:33.674932 (+ 22230us) write_op.cc:312] APPLY: finished
0709 13:00:33.675341 (+   409us) log.cc:844] Serialized 41 byte log entry
0709 13:00:33.675584 (+   243us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:33.691096 (+ 15512us) write_op.cc:454] Released schema lock
0709 13:00:33.713623 (+ 22527us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:33.743118 (+ 29495us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:33.743149 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":467545,"apply.run_cpu_time_us":4647,"apply.run_wall_time_us":338307,"num_ops":4,"prepare.queue_time_us":116112,"prepare.run_cpu_time_us":49527,"prepare.run_wall_time_us":261404,"raft.queue_time_us":418432,"raft.run_cpu_time_us":83659,"raft.run_wall_time_us":421530,"replication_time_us":803219,"thread_start_us":906286,"threads_started":4,"wal-append.queue_time_us":240685,"wal-append.run_cpu_time_us":16662,"wal-append.run_wall_time_us":2291334}]]}
W20260709 13:00:38.173650  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.271328  1557 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:38.150745  4554 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.150913  5082 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:38.059815  5174 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.170284  5134 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.143325  5067 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:00:38.206444  4889 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:38.209506  1708 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:38.212152  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:38.168243  5197 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:00:38.232712  2268 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.095739  1456 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.226779  5102 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:00:38.228696  5056 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:00:38.177057  4931 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:38.229395  4779 consensus_meta.cc:287] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.004s
I20260709 13:00:38.266530  5135 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.296871  1628 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:38.239336  5180 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:38.240358  4939 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.241335  4940 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.251386  5179 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.233294  1555 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:38.247900  5202 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:38.256812  4578 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:38.287654  1456 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:38.308470  1456 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:38.276473  5082 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.301210  5180 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:38.301199  2268 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:38.304186  1704 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:38.278609  4554 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:38.314339  1456 catalog_manager.cc:5697] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 7, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.302484  4940 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.306322  4981 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:38.320696  1456 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 4 to 7, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:38.330133  1456 catalog_manager.cc:5697] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 5, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:38.342563  1456 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:00:38.286214  5225 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:00:38.306886  4779 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:00:38.344301  5227 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:38.320807  5210 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:00:38.312798  5180 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.304677  5179 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:38.344939  5222 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:00:38.303895  5135 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.321143  5165 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:00:38.351897  5159 consensus_meta.cc:287] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.701s	user 0.012s	sys 0.000s
I20260709 13:00:38.360880  1456 catalog_manager.cc:5697] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 4 to 6, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:00:38.386965  5089 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.309875  4939 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:38.402776  1456 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 6 to 7, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.368404  5102 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:38.320019  5052 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.409823  2263 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:00:38.413219  2263 pending_rounds.cc:85] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 6
I20260709 13:00:38.368250  5197 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:38.392370  5223 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:00:38.358189  5202 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:38.413569  2263 pending_rounds.cc:107] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:38.366183  4578 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:38.408211  1456 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 8, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 8 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:00:38.419334  2263 raft_consensus.cc:2889] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.412905  5102 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:38.413295  5089 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.420976  1456 catalog_manager.cc:5697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 3 to 7, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:00:38.449980  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 218826us
I20260709 13:00:38.451934  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:38.453171  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 202763us
I20260709 13:00:38.453027  1456 catalog_manager.cc:5697] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 1 to 6, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:38.454398  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:38.455209  4981 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:38.454733  1456 catalog_manager.cc:5697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.455680  4981 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:38.456573  4981 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.429069  5181 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:38.406008  5165 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:38.461203  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.456439  1456 catalog_manager.cc:5697] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 3, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:38.469277  1704 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:38.473954  1708 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:38.474206  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:38.475883  1599 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:38.510429  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 52189.4us
I20260709 13:00:38.512519  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:38.515434  1599 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:38.449873  5102 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.448359  5070 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:38.451072  5067 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:38.525743  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 214709us
I20260709 13:00:38.465049  5159 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:38.536154  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:38.456946  4940 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.516647  5202 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.429427  5197 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.541035  2270 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:38.517277  5225 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.519021  4578 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:38.572202  1629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.021s	sys 0.046s
W20260709 13:00:38.572907  1629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.021s	sys 0.047s
I20260709 13:00:38.573506  2265 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:38.510794  5207 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:38.574321  2271 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:38.522992  5196 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:38.575243  2264 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEARNER]: Advancing to term 10
I20260709 13:00:38.520638  5189 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:38.590004  1556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.004s	sys 0.008s
W20260709 13:00:38.590390  1556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.004s	sys 0.008s
I20260709 13:00:38.521725  4931 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:38.528728  5104 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:38.594343  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 382320us
I20260709 13:00:38.520958  5150 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
W20260709 13:00:38.603448  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.603899  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.604877  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.000s	sys 0.014s
I20260709 13:00:38.576133  5225 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.575351  5159 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:38.605329  1524 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:38.524055  5152 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:00:38.607295  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:38.607355  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.000s	sys 0.014s
I20260709 13:00:38.608105  2264 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:00:38.610802  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.615748  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:38.543563  5146 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:00:38.540767  5070 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 13:00:38.614548  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 682062us
I20260709 13:00:38.602510  5196 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:38.608314  5225 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.606423  5002 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:38.633673  5056 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.619931  5159 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.620368  5174 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:38.663594  5067 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:00:38.670756  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 65520.5us
I20260709 13:00:38.679126  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:38.677623  5067 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:38.688453  5174 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:38.688946  5067 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.689826  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:38.690565  5067 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.691145  5174 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:38.692054  5187 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.000s
I20260709 13:00:38.692446  5187 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:38.632470  5189 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:38.632768  5070 consensus_queue.cc:1243] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:38.713380  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:38.703953  5194 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:38.713678  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 174409us
I20260709 13:00:38.645434  5179 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:38.703714  4850 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:38.698720  4979 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.692s	user 0.011s	sys 0.000s
I20260709 13:00:38.717777  1526 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:38.646185  5236 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:38.675318  5072 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.741968  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:38.745842  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:38.754988  2264 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:38.756605  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:38.758708  1704 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:38.759202  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:38.760092  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:38.760429  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:38.761104  1700 raft_consensus.cc:2393] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:38.761909  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:38.762780  1701 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:38.763705  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:38.765105  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:38.765837  1705 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:38.705772  4939 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:38.716253  5075 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:38.774757  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:38.674659  5002 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.774788  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:38.776701  1526 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:38.780344  2271 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 3.
I20260709 13:00:38.776933  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:38.676719  5056 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.783253  1626 raft_consensus.cc:2410] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:38.746729  5236 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:38.769405  5194 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:38.784482  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:38.789964  2264 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:00:38.790359  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:38.782737  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 167093us
I20260709 13:00:38.715641  5174 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:00:38.788937  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:38.776103  4931 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.773175  5150 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:38.796926  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:38.772981  5207 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:38.793918  1524 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:38.772224  5238 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:38.778199  5237 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:38.756069  4850 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:38.784459  5089 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:38.777971  5233 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:38.797617  1627 raft_consensus.cc:2376] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10. Re-sending same reply.
I20260709 13:00:38.802496  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:38.772531  5072 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:38.860742  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:38.791875  5194 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:38.871614  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 77802.1us
I20260709 13:00:38.789829  5236 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.880769  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:00:38.879249  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 86330.7us
I20260709 13:00:38.872426  1629 raft_consensus.cc:2376] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10. Re-sending same reply.
I20260709 13:00:38.796989  4931 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:38.871377  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:38.891402  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:38.884755  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:38.886337  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:38.798097  5052 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:38.892719  2269 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.804844  5104 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:38.892933  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:38.895494  5238 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:38.932613  1708 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:00:38.896997  2271 pending_rounds.cc:85] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 7
I20260709 13:00:38.879042  5233 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:38.939601  2271 pending_rounds.cc:107] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 6.8
W20260709 13:00:38.896163  5258 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:00:38.940546  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:38.882109  5194 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:38.881908  5245 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:38.935724  5180 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
I20260709 13:00:38.801944  5150 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.870826  5247 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:38.799418  5189 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.897506  5128 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.941455  2271 raft_consensus.cc:2889] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.945570  5187 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:38.893456  4931 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.894181  5070 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.939862  5238 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.861599  5207 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:38.870549  5093 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:00:38.887655  5232 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:00:38.896800  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:38.972851  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:38.793319  5196 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:38.975332  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 82442.3us
I20260709 13:00:38.977380  1627 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:38.993731  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:38.994423  1627 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:38.995433  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:38.973901  5244 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:00:38.940892  5233 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.886528  5089 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:38.980885  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 190291us
I20260709 13:00:38.996481  5089 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:38.980618  5070 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:39.070371  5241 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:00:38.974407  5237 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.931553  5052 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:39.099370  5134 consensus_meta.cc:287] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.815s	user 0.007s	sys 0.004s
I20260709 13:00:39.009450  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:38.951069  5247 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:39.100195  1628 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:39.058363  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.101763  1629 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:38.980446  5167 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:39.060389  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:38.984300  5238 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.954066  5180 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:38.992813  4850 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:39.059418  5235 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:00:39.079893  1631 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:39.081338  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2064) took 1079 ms. Trace:
I20260709 13:00:38.951769  5245 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.008764  5159 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.087458  5002 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.099587  5237 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.108354  5245 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.108960  5245 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:39.110460  5240 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:00:39.110646  5167 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.111603  1552 rpcz_store.cc:276] 0709 13:00:38.008941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.082553 (+ 73612us) service_pool.cc:224] Handling call
0709 13:00:38.082883 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.087696 (+  4813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.087728 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:38.088185 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:00:38.584157 (+495972us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:38.584195 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.584255 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.081131 (+496876us) raft_consensus.cc:1685] finished
0709 13:00:39.081154 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.081281 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6129,"raft.queue_time_us":5378,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":17718,"thread_start_us":495670,"threads_started":1,"wal-append.queue_time_us":700562}
I20260709 13:00:39.113511  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:39.115983  4961 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.118443  4554 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.119182  5234 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.119776  5234 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.116084  5207 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.118434  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2063) took 1116 ms. Trace:
I20260709 13:00:38.988812  5128 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:39.124796  5220 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.903s	user 0.002s	sys 0.000s
W20260709 13:00:39.127560  5168 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.844s	user 0.005s	sys 0.005s
I20260709 13:00:39.127998  5168 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.058897  5089 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.005165  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.121663  1558 rpcz_store.cc:276] 0709 13:00:38.001792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.004914 (+  3122us) service_pool.cc:224] Handling call
0709 13:00:38.005352 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.290824 (+285472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.290853 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:38.296667 (+  5814us) log.cc:844] Serialized 26 byte log entry
0709 13:00:38.521562 (+224895us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:38.521606 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.660656 (+139050us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b5400311ad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:38.660707 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.118127 (+457420us) raft_consensus.cc:1685] finished
0709 13:00:39.118148 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.118362 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655972096,"thread_start_us":216786,"threads_started":1,"wal-append.queue_time_us":408408}
I20260709 13:00:39.133982  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:39.120163  5028 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:39.129765  5056 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.016539  1560 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:39.101197  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.137996  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:39.138634  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:39.139092  1628 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:00:39.139209  1705 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:39.139990  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:39.140928  1553 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:00:39.087461  1551 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:39.103161  1629 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:39.132333  1627 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:00:39.138679  1700 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:39.143385  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:39.134784  1558 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:39.145287  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:39.109414  5245 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.147863  1558 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:39.156559  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:39.157933  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:39.100494  5247 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:39.172760  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:39.070456  5259 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:39.173480  1702 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:39.177022  1700 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:39.180392  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:39.099861  5134 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:39.106627  5072 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:00:39.183632  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:39.180655  5102 consensus_meta.cc:287] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.000s
W20260709 13:00:39.176697  5239 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:00:39.147533  5237 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.137512  5028 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:39.148388  5207 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:39.101646  5225 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.143265  5052 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.090518  5070 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:39.182427  5000 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.212296  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:39.186381  5082 consensus_meta.cc:287] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.867s	user 0.012s	sys 0.000s
I20260709 13:00:39.176421  5259 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.217198   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:39.198264  5002 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:39.215011  1552 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:39.182271  5263 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:39.260221  5268 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:39.213454  1632 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:39.269078  5268 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.271178  5245 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.271450  5268 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.219937  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 534) took 1452 ms. Trace:
I20260709 13:00:39.272511  1556 rpcz_store.cc:276] 0709 13:00:37.767622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.767835 (+   213us) service_pool.cc:224] Handling call
0709 13:00:37.768285 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.768759 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.768800 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:37.928190 (+159390us) spinlock_profiling.cc:243] Waited 95 ms on lock 0x7b2c00026568. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2
0709 13:00:37.966303 (+ 38113us) log.cc:844] Serialized 26 byte log entry
0709 13:00:38.590786 (+624483us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:38.590832 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.590900 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.214852 (+623952us) raft_consensus.cc:1685] finished
0709 13:00:39.214882 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.219828 (+  4946us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3346,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":218424576,"thread_start_us":560814,"threads_started":1,"wal-append.queue_time_us":743423}
I20260709 13:00:39.275847  5180 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.277693  5168 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.278510  5168 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:39.279114  5168 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:39.280431  4963 consensus_meta.cc:287] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.004s	user 0.009s	sys 0.001s
I20260709 13:00:39.280957  4963 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.282248  1630 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:39.283720  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 691) took 1426 ms. Trace:
I20260709 13:00:39.284130  1630 rpcz_store.cc:276] 0709 13:00:37.857657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.949029 (+ 91372us) service_pool.cc:224] Handling call
0709 13:00:37.949345 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.282757 (+1333412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.283451 (+   694us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400079c54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:39.283654 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3065177856}
I20260709 13:00:39.199034  5197 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.220340  5259 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.197804  5187 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:00:39.290792  4963 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.212163  5226 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.267815  5263 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.303740  5226 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.303874  5225 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.304323  5226 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.220685  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2059) took 1220 ms. Trace:
I20260709 13:00:39.306522  1554 rpcz_store.cc:276] 0709 13:00:38.000024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.008268 (+  8244us) service_pool.cc:224] Handling call
0709 13:00:38.008632 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.027415 (+ 18783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.027437 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:38.035858 (+  8421us) log.cc:844] Serialized 26 byte log entry
0709 13:00:38.586245 (+550387us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b18000f8e00. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:00:38.794905 (+208660us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:38.794973 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:38.795099 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.210685 (+415586us) raft_consensus.cc:1685] finished
0709 13:00:39.210715 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.220583 (+  9868us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19804,"raft.queue_time_us":23676,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":17435,"spinlock_wait_cycles":10726784,"thread_start_us":208325,"threads_started":1,"wal-append.queue_time_us":1042832}
I20260709 13:00:39.308274  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:39.208015  5202 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.000s
I20260709 13:00:39.308956  1556 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:39.310420  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:39.220800  5000 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.317210  1600 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:39.321164  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:39.324973  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:39.245457  5002 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.339928  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:39.344750  1633 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:39.281746  5168 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.347543  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:39.203375  5102 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.349685  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:39.352607  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:39.207520  5072 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.104s
W20260709 13:00:39.351593  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 291299us
I20260709 13:00:39.354683  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:39.361963  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:39.364670  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:39.365571  1524 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:39.370085  2269 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:39.282253  5150 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.339306  5225 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:39.244738  5082 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.351014  5002 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:39.348546  5197 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.346482  5263 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.392697  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:39.395725  1704 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:39.356498  5207 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:00:39.419623  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 277868us
I20260709 13:00:39.350840  4981 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:39.376113  5072 consensus_queue.cc:1243] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:39.372496  4554 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:39.380167  5170 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:39.376781  4963 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:39.417042  1706 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:39.358834  4850 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:39.350718  5233 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:39.422461  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 428552us
I20260709 13:00:39.386487  5202 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:00:39.422052  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:39.437299  5202 consensus_queue.cc:1243] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:39.438448  5052 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:39.438957  5052 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:39.405296  5261 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:39.358806  5028 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.439432  5052 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:39.421128  5197 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.470762  5197 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.439786  5150 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.440341  5170 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:39.471457  5150 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.471957  5170 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.473476  5150 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.461328  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 817) took 1661 ms. Trace:
I20260709 13:00:39.473731  4940 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.474174  2263 rpcz_store.cc:276] 0709 13:00:37.799771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.822137 (+ 22366us) service_pool.cc:224] Handling call
0709 13:00:37.822522 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.419846 (+597324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.461077 (+1041231us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b540005ee54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:39.461269 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1349995392}
I20260709 13:00:39.463220  5233 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:39.477712  5236 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.000s
I20260709 13:00:39.482292  5236 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.480335  5165 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:39.481132  5272 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:00:39.465106  5259 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.483928  5128 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:39.486486  5194 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 13:00:39.487049  5236 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.487490  5194 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:39.489276  5052 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.486562  5104 raft_consensus.cc:993] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 13:00:39.490491  5104 raft_consensus.cc:1081] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Signalling peer 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 13:00:39.426738  5207 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:39.492173  5238 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.493242  5207 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:39.494441  5254 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.519s	user 0.000s	sys 0.002s
I20260709 13:00:39.494346  5194 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.440205  5234 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.479853  5000 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.426244  4981 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.505957  5089 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.506878  5135 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.508637  5238 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.510227  4927 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:39.510594  4931 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.521s	user 0.005s	sys 0.005s
I20260709 13:00:39.512166  4931 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:39.514914  5067 consensus_meta.cc:287] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.001s
I20260709 13:00:39.514917  4931 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.500581  4889 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.519557  4889 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.521606  5089 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.525178  4981 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.449751  5180 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:00:39.407399  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:39.613504  1709 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:39.607544  1560 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:39.561136  5167 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.646215  4889 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.647974  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:39.649737  1701 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:39.612190  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 694) took 1374 ms. Trace:
W20260709 13:00:39.621258  1673 connection.cc:256] RPC call timeout handler was delayed by -1.0395212820000097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 13:00:39.617695  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.662588  5067 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.663532  5067 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.626044  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:39.614790  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.626926  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.628925  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:39.661607  5089 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:39.666872  5089 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.678998  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.679829  1601 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:39.682868  1705 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:39.682279  4889 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.692492  4889 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.692852  1701 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:39.694561  5238 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.694882  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.695400  5238 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.698336  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.701943  5075 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:39.702515  5075 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:39.702598  5089 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.703397  5238 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.682096  1628 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
W20260709 13:00:39.685632  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1863) took 2646 ms (client timeout 1731 ms). Trace:
I20260709 13:00:39.706784  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.684474  5247 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:39.707432  1631 rpcz_store.cc:269] 0709 13:00:37.039419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.587260 (+547841us) service_pool.cc:224] Handling call
0709 13:00:39.685118 (+2097858us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400165dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:39.685343 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2503633664}
I20260709 13:00:39.721886  5245 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.723186  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.718159  5247 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.727718  5228 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:39.728042  1558 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:39.731696  1705 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:39.732324  1627 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:39.735056  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.653983  1634 rpcz_store.cc:276] 0709 13:00:38.237984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.242524 (+  4540us) service_pool.cc:224] Handling call
0709 13:00:38.242791 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.247732 (+  4941us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:38.669426 (+421694us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b18004210c0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06e19c73c7 00007f06ddfd99a7 00007f06ddfe90bf 00007f06ddfe9038
0709 13:00:38.949258 (+279832us) log.cc:844] Serialized 14 byte log entry
0709 13:00:39.274201 (+324943us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.274680 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.274814 (+   134us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:39.275015 (+   201us) log.cc:844] Serialized 14 byte log entry
0709 13:00:39.275164 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.275239 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.611492 (+336253us) raft_consensus.cc:1685] finished
0709 13:00:39.611555 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.611931 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113719,"prepare.queue_time_us":74465,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":4869,"raft.queue_time_us":134814,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":7706,"spinlock_wait_cycles":8364288,"thread_start_us":534043,"threads_started":2,"wal-append.queue_time_us":474210}
W20260709 13:00:39.737304  5262 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.665s	user 0.002s	sys 0.000s
I20260709 13:00:39.704303  5075 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.740305  5102 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.742154  1629 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:39.743582  5227 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:39.762784  5228 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:39.772019  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.774300  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:39.747004  5259 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.747212  4889 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.747848  5245 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.778647  5245 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.748988  5089 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:39.753512  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.781046  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.783286  4889 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:39.784946  4889 raft_consensus.cc:3055] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:39.785435  4889 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:00:39.755182  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 347809us
I20260709 13:00:39.759438  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:39.759239  5002 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.760121  5079 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.760855  5229 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:39.772406  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.774389  5075 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.800321  5247 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.801218  5247 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.742142  5067 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.745040  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:39.802775  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 57995.9us
I20260709 13:00:39.803854  5247 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.804231  4958 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:39.804450  5089 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:39.804821  4958 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:39.805410  4958 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.765309  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2083) took 1523 ms. Trace:
I20260709 13:00:39.806241  5089 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.807085  4889 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.809513  4889 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.775813  5167 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.811228  5167 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.812136  5227 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:39.794435  5079 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.806319  1706 rpcz_store.cc:276] 0709 13:00:38.241569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.242096 (+   527us) service_pool.cc:224] Handling call
0709 13:00:38.242359 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.435248 (+1192889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.764661 (+329413us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000a7dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:39.765051 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2697504000}
I20260709 13:00:39.798797  1627 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
W20260709 13:00:39.840765  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.846561  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.847520  1632 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:39.834656  5079 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.851277  5028 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.854292  4979 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:39.855041  4979 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.857010  5082 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.857527  4979 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.860268  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:39.867506  5228 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.869377  5052 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.869797  5228 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.871313  5134 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.872524  5134 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.873796  5052 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:39.877338  5134 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:39.813017  5227 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.869602  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:39.867667  5002 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:39.898591  5167 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:39.919397  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 160244us
I20260709 13:00:39.921363  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:39.922314  5067 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:39.923233  5067 consensus_queue.cc:1243] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:39.924712  5067 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:39.927034  5170 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.927711  5170 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.910379  5247 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:39.941613  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:39.960780  5170 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:39.962296  5128 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.963840  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2162) took 1169 ms. Trace:
I20260709 13:00:39.964265  1633 rpcz_store.cc:276] 0709 13:00:38.794468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.112332 (+317864us) service_pool.cc:224] Handling call
0709 13:00:39.112650 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.349754 (+237104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.963396 (+613642us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b540035cd54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:39.963653 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532763008}
I20260709 13:00:39.966225  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:39.968008  1559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:42086
I20260709 13:00:39.969035  1559 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:39.969549  1559 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:39.970932  4958 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.972878  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:39.973901  1709 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:39.974386  5150 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.974578  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:39.973913  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:39.974994  5150 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.979079  5135 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:39.979984  5135 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.986099  4939 consensus_queue.cc:1059] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:00:39.987105  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 65904.4us
I20260709 13:00:39.987512  4939 consensus_queue.cc:1059] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:39.988909  1560 raft_consensus.cc:1217] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-6.5]   Dedup: 2.2->[3.3-6.5]
I20260709 13:00:39.989478  1560 pending_rounds.cc:85] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 2
I20260709 13:00:39.989739  1560 pending_rounds.cc:107] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:00:39.963223  5128 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:39.990656  4981 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:39.991842  4981 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:39.992280  4981 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:39.994225  4979 raft_consensus.cc:3055] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:39.993538  4981 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.994668  4979 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:39.994853  5226 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.690s	user 0.013s	sys 0.011s
I20260709 13:00:39.995381  5226 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.995872  4979 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:39.997128  4979 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:39.998301  5104 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:39.998744  5104 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:39.999282  4981 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:39.999855  5104 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.001452  5104 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.977816  5150 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.005455  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 699) took 1260 ms. Trace:
I20260709 13:00:39.987357  1601 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:40.005323  5135 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:40.007375  5291 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.280s	user 0.000s	sys 0.004s
I20260709 13:00:40.007902  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.010735  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.011533  1702 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:40.012352  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.012858  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.013684  1702 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:40.014294  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.015122  1709 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
W20260709 13:00:40.018087  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 148647us
I20260709 13:00:40.019425  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:40.020352  5170 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:40.020959  5170 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:40.021064  1524 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:40.022450  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:40.022187  5170 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:40.023278  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 68859.7us
I20260709 13:00:40.024052  5247 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.024516  5247 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:40.024923  5247 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.026633  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.027719  1557 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.027871  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:40.028661  1555 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.029275  1556 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:40.015087  1702 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:39.990047  1560 raft_consensus.cc:2889] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.997697  5226 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.035902  1628 raft_consensus.cc:2368] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11.
W20260709 13:00:40.006670  5070 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.762s	user 0.013s	sys 0.011s
I20260709 13:00:40.024529  5199 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.041029  5199 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.041110  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.041409  5284 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.042379  1705 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:40.042410  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:40.054852  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.005964  1635 rpcz_store.cc:276] 0709 13:00:38.745131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.745234 (+   103us) service_pool.cc:224] Handling call
0709 13:00:38.745525 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.795933 (+ 50408us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:38.861532 (+ 65599us) log.cc:844] Serialized 14 byte log entry
0709 13:00:38.925445 (+ 63913us) log.cc:844] Serialized 14 byte log entry
0709 13:00:38.926965 (+  1520us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:38.927033 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:38.927092 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.481519 (+554427us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b1800420a00. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2557 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:39.736345 (+254826us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:39.967329 (+230984us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b1800420a00. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f
0709 13:00:39.967855 (+   526us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b48002610d8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:00:40.004283 (+ 36428us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b1800420a00. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419
0709 13:00:40.004978 (+   695us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b5400355a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:40.005018 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.005280 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":67787,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":7453,"raft.queue_time_us":5091,"raft.run_cpu_time_us":2628,"raft.run_wall_time_us":1075170,"spinlock_wait_cycles":234094976,"thread_start_us":28588,"threads_started":1,"wal-append.queue_time_us":127100}
I20260709 13:00:40.059530  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.060267  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.060714  1704 raft_consensus.cc:2368] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:40.061638  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.062470  1556 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:40.061964  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.063354  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:40.063963  4958 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:40.064064  5232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.036s	sys 0.050s
I20260709 13:00:40.064754  1556 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:40.076893  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 89681.8us
I20260709 13:00:40.069695  1553 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:00:40.064004  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:40.072023  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 84104.8us
I20260709 13:00:40.044745  5199 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.042228  5284 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:40.090335  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 69464.3us
I20260709 13:00:40.035102  5128 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.089071  5002 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.094367  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:40.099071  5089 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.099833  5089 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.049558  5134 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.101788  5134 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.104848  5134 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:40.081878  5232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.037s	sys 0.051s
I20260709 13:00:40.110985  1556 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:40.107658  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.092463  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:40.113803  2264 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 8: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:40.085937  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.116237  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.067305  5274 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:40.119340  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.121658  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:40.155429  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.154909  1709 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:40.153889  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.162483  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.171461  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:40.175436  2263 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:40.049726  5070 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:40.179014  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 88469.1us
I20260709 13:00:40.123785  5274 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:40.181212  5179 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.181793  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.181249  1553 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:40.114109  5079 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.188831  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.189291  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.189625  2268 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:40.189915  1701 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:40.189972  5079 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.190641  5079 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.190922  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.191154  5079 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.192525  5181 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.192586  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:40.192992  4939 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:40.193472  1633 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:40.193269  5181 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.194278  4939 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:40.195591  5181 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.195902  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:40.196213  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.197167  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.195725  4939 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:40.194281  5196 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:00:40.198886  5196 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:40.199255  5196 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:40.199995  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.200255  5196 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.192070  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.202580  1703 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:40.210225  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:40.210330  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:40.201845  5196 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.185752  5274 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.231786  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.240504  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.177968  5227 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:40.242223  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.248376  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.197767  4939 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:40.285414  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.242980  5089 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:40.290277  1701 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:00:40.294008  5303 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:00:40.328163  1704 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:40.294553  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 63671us
W20260709 13:00:40.302156  5301 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:00:40.308091  1558 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:40.310477  1553 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:40.310868  5180 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:40.313299  1526 leader_election.cc:400] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:40.313843  5261 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:00:40.314925  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 151693us
I20260709 13:00:40.344695  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:40.354641  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44291.7us
I20260709 13:00:40.354641  1526 leader_election.cc:403] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:40.355466  1557 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:40.284629  5075 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:40.363845  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.364528  1556 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:40.359650  5181 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:40.368980  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.369424  5181 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.369982  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.369719  4939 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.370620  1709 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.371286  4939 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.372103  5181 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.373206  1524 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:40.374594  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:40.375758  5075 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:40.376219  5075 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.376600  5075 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:40.378265  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 65252.7us
I20260709 13:00:40.378773  5284 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:40.354566  5227 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.380056  5227 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.380357  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:40.382776  5070 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:40.383469  5070 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:00:40.391811  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.369722  1553 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 5.
I20260709 13:00:40.392522  2264 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:40.390230  1709 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:00:40.410735  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.418144  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.418990  1557 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:40.421164  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.421506  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.361339  5167 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.419883  1703 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:40.283524  5179 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.434273  5079 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.434551  5179 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:40.435976  4889 consensus_meta.cc:287] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.598s	user 0.006s	sys 0.002s
I20260709 13:00:40.436827  1673 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:40.437609  4889 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.438174  5234 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:00:40.439145  5234 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:40.439548  5234 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:40.440760  5234 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:40.424365  5180 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:40.451239  5028 consensus_meta.cc:287] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.004s
I20260709 13:00:40.452099  1630 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:40.452739  5180 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:40.426016  5167 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.455814  5167 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.459136  5002 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:40.462222  2268 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:40.424989  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:40.425065  1700 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:40.426914  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.427359  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:40.432483  5284 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:40.438501  5277 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:40.431734  5232 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:40.476039  1558 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:40.457949  5056 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:40.473083  1553 raft_consensus.cc:2410] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:40.474287  1555 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:40.392194  5227 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:40.479503  1705 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
W20260709 13:00:40.424378  5301 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:00:40.473716  1559 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.479667  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.480216  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:40.484651  1704 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:40.484666  1557 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:40.482955  5089 raft_consensus.cc:2764] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:00:40.486603  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.481774  1701 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:00:40.478989  5056 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:00:40.424579  5228 consensus_meta.cc:287] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.545s	user 0.000s	sys 0.012s
I20260709 13:00:40.492414  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:40.489252  1601 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:40.477169  5234 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.427387  5000 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 13:00:40.497645  5000 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:40.498170  5000 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:40.483714  5067 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:40.499045  5000 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.499709  5067 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:40.500342  5000 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.500687  5067 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.502578  2268 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:40.502508  4889 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.503876  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.504645  1555 raft_consensus.cc:2368] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12.
I20260709 13:00:40.504802  4889 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.505518  5228 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.506168  1552 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:40.506112  5228 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.507781  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.508301  5228 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:40.509229  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:40.508986  5056 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.490222  5199 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.510365  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.510537  5056 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.510854  5075 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.511762  5284 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:40.512176  5284 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:40.513017  5075 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.513152  5284 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.513744  1631 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:40.514225  5070 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:40.514534  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.515306  1558 raft_consensus.cc:2393] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 4: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:40.515489  1674 leader_election.cc:400] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12.
I20260709 13:00:40.515782  1674 leader_election.cc:403] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:40.516187  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.516845  5180 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:40.517426  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.518318  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.518404  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.519106  1705 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:40.519243  1703 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:40.520576  1552 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:40.522679  1552 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:40.525635  5199 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:40.526140  1559 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.526734  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.530308  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.530691  1704 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
W20260709 13:00:40.531379  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 111624us
I20260709 13:00:40.477494  5170 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.532015  5170 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.532407  5170 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:40.533653  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 45777.4us
I20260709 13:00:40.534197  5180 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12.
I20260709 13:00:40.534708  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:40.534883  5234 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:40.535559  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:40.535583  5104 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:40.536583  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:40.537134  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.502434  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:40.505553  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.501858  5067 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.528298  1559 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:40.522624  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:40.538581  1558 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:40.537609  5002 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:40.479125  5277 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:40.562144  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:40.537391  5234 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:40.491739  5227 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:40.554908  5002 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:40.571684  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.545174  5028 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:40.569890  1601 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:40.545226  5179 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:40.584398  1556 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:40.585065  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.567562  5227 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.590229  5284 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.590003  5234 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.563191  5277 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:40.595458  5230 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.595928  5230 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.596268  5230 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.598188  5180 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:40.599408  5180 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:40.599761  5180 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:40.600705  5180 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.601281  5227 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:40.602458  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.602633  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:40.588937  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.606251  1556 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:40.607856  2263 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
W20260709 13:00:40.609592  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 120544us
I20260709 13:00:40.565362  5232 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:40.615854  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 408312us
I20260709 13:00:40.601982  5180 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.627641  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.623172  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:40.625491  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:40.565809  4981 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:00:40.566612  5228 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:00:40.615113  4979 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.634758  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:40.563056  5181 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:00:40.640033  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:40.590018  5274 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.617458  5179 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:40.630927  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.581312  5079 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:00:40.615226  5028 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:40.619177  5232 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:40.626569  5247 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.601s	user 0.007s	sys 0.004s
I20260709 13:00:40.647694  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:40.652987  1635 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.650161  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:40.667389  2263 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:40.668041  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.644356  5196 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:40.646481  4889 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.648331  4979 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.688431  2264 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:40.654170  5104 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:40.658176  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.654561  5232 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.646978  5229 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:00:40.697036  5229 raft_consensus.cc:3055] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:00:40.697522  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.698722  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 324290us
I20260709 13:00:40.694754  4979 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.710268  1707 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:40.710135  5165 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:00:40.711622  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:40.713066  1524 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:40.714191  5261 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:40.693970  5134 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.680997  5196 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.687163  5082 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:40.696616  5028 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.695348  5104 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:40.657428  5247 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:40.730425  1708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.022s
W20260709 13:00:40.739095  1708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.006s	sys 0.022s
I20260709 13:00:40.702832  5229 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:40.724329  5196 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.714833  5134 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.743335  2269 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:00:40.743453  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.728740  4979 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.745223  5274 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:40.806955  1635 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:40.745536  2263 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:40.746857  5229 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.810158  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.714854  5261 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:00:40.748476  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.749517  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.731293  4889 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.751037  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.752393  5167 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.825614  5167 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.827090  2268 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:40.827859  2236 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:40.828823  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:40.830351  5249 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.830582  5165 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:40.832753  5179 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:40.833699  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.736941  5104 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.757490  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.758505  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:40.761003  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 380721us
I20260709 13:00:40.843303  1703 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:40.758554  5089 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:00:40.843552  1526 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:40.762108  5228 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.845075  5228 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.846321  5261 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:40.847167  5228 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.762979  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.848160  1708 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:40.763965  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.849071  2271 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 7: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:40.769213  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:40.772445  4939 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:40.774309  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 139674us
W20260709 13:00:40.850360  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 81314.3us
I20260709 13:00:40.809613  1553 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
W20260709 13:00:40.851796  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.850713  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:40.812321  1707 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:00:40.688773  5002 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.820565  4979 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.812961  2265 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:40.821333  5229 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:40.823738  4889 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:40.816675  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:40.829938  2236 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:40.853868  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44306.7us
I20260709 13:00:40.860450  4981 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:40.861474  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:40.867856  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.861994  5274 raft_consensus.cc:2764] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:40.871893  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.872679  1709 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:40.873294  1706 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:00:40.865300  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:40.874357  1700 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:40.849839  4939 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:40.868589  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.864308  5277 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.870645  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.871371  5082 raft_consensus.cc:2764] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:00:40.871160  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:40.872186  5274 consensus_queue.cc:1059] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:40.864081  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:40.881247  1705 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:40.869841  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:40.876971  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 60377us
I20260709 13:00:40.876902  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:40.888293  1703 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:40.891695  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:40.892256  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 62412.6us
I20260709 13:00:40.881023  5167 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:40.858381  5228 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:00:40.880780  4889 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:40.901104  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:00:40.922046  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 63780.8us
I20260709 13:00:40.899012  4981 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:40.935016  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:40.899102  5284 raft_consensus.cc:3055] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:40.938951  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:40.905308  4889 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:40.906919  5322 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:40.945746  5322 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.946169  5322 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.946228  5128 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:40.948522  5323 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:00:40.897863  5230 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.954720  5247 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.918561  5170 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.955758  5230 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:40.956658  1708 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:40.957589  5170 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:40.917654  4939 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:40.953704  5322 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.964735  5277 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:40.970927  5322 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:40.961925  5232 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.973822  4939 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.976332  5232 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:40.977099  5299 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.977592  5299 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.977991  5299 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.921838  5274 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:40.982143  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44560.1us
I20260709 13:00:40.983095  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:40.984844  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:40.985992  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:40.986438  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.987766  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.988633  2269 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
W20260709 13:00:40.990056  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.943616  5284 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:40.991016  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:40.991225  5284 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:40.992482  5284 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.943718  5150 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:40.918150  5167 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:40.935096  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:40.989876  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:41.008359  2271 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:40.926594  5134 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:40.943969  4889 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.959424  5318 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:41.002174  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:41.006198  5150 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:41.006656  5319 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:41.044044  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 59264.7us
I20260709 13:00:41.048079  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:41.018812  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 79969.1us
I20260709 13:00:41.018929  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:41.020345  5318 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:41.074527  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.039918  5229 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:41.037225  4981 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:41.085078  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:41.000389  1705 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:41.094893  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:41.095779  2263 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:41.017673  5104 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:41.102330  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:41.102474  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:41.100440  1526 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:41.017460  5196 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:41.104091  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:41.062171  5150 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:41.066049  5249 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.111430  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:41.111254  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:41.114002  1635 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:41.114462  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 191566us
I20260709 13:00:41.103317  1630 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:41.111147  1601 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:41.113229  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:41.117502  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:41.118439  1702 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.084777  5228 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:41.123515  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.134872  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:41.135658  1705 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:41.133781  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:41.099577  5134 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:41.085285  5318 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.145989  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:41.148880  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46484.4us
I20260709 13:00:41.154418  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:41.155431  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:41.108325  4981 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:41.112386  5322 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:41.159546  1628 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:41.162485  2265 raft_consensus.cc:2368] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:41.146831  2267 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 4.
I20260709 13:00:41.134469  5232 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:41.137136  5089 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:41.170384  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:41.138902  4979 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.143095  5134 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.157140  5234 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:41.177385  1559 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.208956  1635 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
W20260709 13:00:41.214509  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 99282us
I20260709 13:00:41.215482  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:41.159754  5323 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.227546  1599 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:41.217744  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:41.142061  5228 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:41.171679  5232 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.241044  1599 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:41.119189  5167 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:41.217391  5227 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.000s
I20260709 13:00:41.244319  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:41.178161  4850 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.246783  5181 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.163417  5135 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:00:41.201665  5234 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:41.239392  5326 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:00:41.246528  5323 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:41.302618  5234 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.304600  5323 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:41.311055  5135 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:41.311735  5135 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:41.312997  5135 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:41.318117  4850 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:41.318549  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2084) took 1006 ms. Trace:
I20260709 13:00:41.235762  5179 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.319636  5179 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:41.320329  4850 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:41.319062  1557 rpcz_store.cc:276] 0709 13:00:40.311813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.531311 (+219498us) service_pool.cc:224] Handling call
0709 13:00:40.531616 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:40.532089 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.532116 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:40.532844 (+   728us) log.cc:844] Serialized 52 byte log entry
0709 13:00:40.904739 (+371895us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:40.904775 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.904840 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.318253 (+413413us) raft_consensus.cc:1685] finished
0709 13:00:41.318279 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.318476 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":134,"thread_start_us":371454,"threads_started":1,"wal-append.queue_time_us":573456}
I20260709 13:00:41.321762  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:41.322670  1557 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:41.322888  5309 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.508s	user 0.004s	sys 0.000s
I20260709 13:00:41.272651  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:41.324246  2266 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:41.290136  1553 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 12: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:41.314155  5067 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:41.247611  5150 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:41.326550  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 278595us
W20260709 13:00:41.332441  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.347949  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:41.348289  2235 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:41.348564  2267 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:00:41.349852  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:41.351380  1557 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:41.234352  5134 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.244163  5232 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:41.360533  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:41.275723  5325 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:00:41.273113  5328 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:00:41.277782  5327 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:00:41.363396  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:41.291935  5228 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:41.382815  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 165191us
W20260709 13:00:41.383002  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 282027us
I20260709 13:00:41.298818  5196 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:41.373353  1702 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:41.220724  4979 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:41.374361  1706 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:00:41.322907  5104 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:41.321959  5179 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:41.347270  5067 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:41.367949  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:41.410638  1708 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:41.411834  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:41.412752  1708 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:41.299484  5000 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:41.367565  5274 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:41.392397  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:41.421797  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:41.394191  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:41.409722  5067 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:41.398949  1559 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:41.261160  5227 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:41.391656  1705 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:41.417474  1673 leader_election.cc:400] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11.
I20260709 13:00:41.430871  1673 leader_election.cc:403] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:41.178045  4981 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:41.424721  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:41.424521  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:41.425767  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 203130us
I20260709 13:00:41.436404  1706 raft_consensus.cc:2410] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:41.436676  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:41.435034  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1899) took 1336 ms. Trace:
I20260709 13:00:41.439000  1551 rpcz_store.cc:276] 0709 13:00:40.027712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.034745 (+  7033us) service_pool.cc:224] Handling call
0709 13:00:40.181599 (+146854us) spinlock_profiling.cc:243] Waited 900 us on lock 0x7b5800003698. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 13:00:40.181884 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.182159 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:40.546564 (+364405us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.363377 (+816813us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.363428 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:41.363470 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.363528 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.363632 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4639,"prepare.queue_time_us":530255,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":51286,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":2068864,"thread_start_us":1119284,"threads_started":3,"wal-append.queue_time_us":539019}
W20260709 13:00:41.443307  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 202352us
I20260709 13:00:41.447047  5002 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.447782  5002 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:41.450538  5002 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:41.452349  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:41.452585  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:41.453122  1635 raft_consensus.cc:2368] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:41.454017  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:41.454525  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:41.455392  1630 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 5: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:41.456655  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:41.457526  1630 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:41.457319  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:41.458341  1705 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:41.458822  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:41.459482  1630 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:00:41.460779  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:41.461025  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:41.461777  1705 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:41.469965  1630 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:41.472290  1707 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:41.482869  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1901) took 1324 ms. Trace:
I20260709 13:00:41.483321  1554 rpcz_store.cc:276] 0709 13:00:40.028405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.048807 (+ 20402us) service_pool.cc:224] Handling call
0709 13:00:40.066372 (+ 17565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.066705 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:40.476602 (+409897us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.346505 (+869903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.346566 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:41.346626 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.346950 (+   324us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.352989 (+  6039us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108431,"prepare.queue_time_us":601406,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3317,"raft.queue_time_us":46433,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":66,"thread_start_us":1161079,"threads_started":3,"wal-append.queue_time_us":587332}
I20260709 13:00:41.471546  5284 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11.
W20260709 13:00:41.489524  5299 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.001s
W20260709 13:00:41.526841  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 90241.8us
I20260709 13:00:41.529196  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:41.580615  2266 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
W20260709 13:00:41.690126  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.788406  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 779) took 1004 ms. Trace:
I20260709 13:00:41.552278  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:41.664710  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.609728  1626 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:00:41.745436  2263 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:00:41.749936  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.604362  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:41.545946  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:00:41.569080  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.558183  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:41.883204  2265 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:41.602810  1628 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:00:41.598495  5329 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:00:41.517705  5167 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:41.520591  5002 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.886356  1632 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:00:41.872509  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 464335us
W20260709 13:00:41.872078  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 477968us
I20260709 13:00:41.885695  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:41.874502  2268 rpcz_store.cc:276] 0709 13:00:40.744036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.748105 (+  4069us) service_pool.cc:224] Handling call
0709 13:00:41.744868 (+996763us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5400730354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:41.747893 (+  3025us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29641600}
W20260709 13:00:41.817219  5234 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.001s
W20260709 13:00:41.540655  5337 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:00:41.831317  4889 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.769s	user 0.011s	sys 0.000s
W20260709 13:00:41.599210  5356 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:00:41.915447  5357 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
W20260709 13:00:41.915815  5352 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.286s	user 0.001s	sys 0.001s
I20260709 13:00:41.875254  5284 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.910413  5229 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:41.916540  5002 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:41.526641  5299 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:41.897483  4939 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.897624  5104 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:00:41.918707  2235 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:41.872357  5227 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:41.926447  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 380584us
I20260709 13:00:41.636883  5150 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:41.602737  4979 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:41.876000  5353 raft_consensus.cc:2764] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:00:41.926371  5318 consensus_meta.cc:287] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.000s
I20260709 13:00:41.940819  5167 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.926944  5234 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:42.010310  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 777) took 1291 ms. Trace:
I20260709 13:00:41.977432  5229 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:41.990118  4939 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.013299  5299 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:42.036881  2267 consensus_meta.cc:287] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.683s	user 0.015s	sys 0.001s
I20260709 13:00:42.042959  2264 rpcz_store.cc:276] 0709 13:00:40.699096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.699265 (+   169us) service_pool.cc:224] Handling call
0709 13:00:40.773911 (+ 74646us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 13:00:40.806329 (+ 32418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.850350 (+ 44021us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:41.210434 (+360084us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.581340 (+370906us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.984264 (+402924us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.984334 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:41.989990 (+  5656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.990100 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.990241 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65666,"prepare.queue_time_us":436863,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":484741,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":66995584,"thread_start_us":714914,"threads_started":4,"wal-append.queue_time_us":713205}
I20260709 13:00:42.052094  2267 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:41.938338  4889 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:42.030745  5067 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.007s
I20260709 13:00:41.907490  5354 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.150s
I20260709 13:00:42.060591  5362 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:42.060397  5299 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:42.061101  5362 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.061519  5362 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:42.061709  5229 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:41.978971  5284 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.066138  5351 raft_consensus.cc:2764] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:42.068624  4939 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:42.070866  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:42.071520  1630 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:42.085877  1631 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
W20260709 13:00:42.087491  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 176493us
I20260709 13:00:42.045270  5318 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.117285  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:42.118079  1631 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:42.118970  1630 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:42.063109  5067 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:42.084951  5196 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:42.125597  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:42.122627  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:42.125047  2271 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:42.129500  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:42.133725  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:42.136041  1632 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:42.138513  1631 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:42.139622  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:42.146564  5348 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:42.146868  1634 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:42.147372  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:42.147514  5318 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:42.147948  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:42.148232  1633 raft_consensus.cc:2410] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:42.148686  1634 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:42.149065  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:42.149443  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:42.150837  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1676866829999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
I20260709 13:00:42.152000  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:42.152184  5067 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:42.153230  1634 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:42.157460  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2090) took 1843 ms. Trace:
I20260709 13:00:42.157917  1555 rpcz_store.cc:276] 0709 13:00:40.313523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.667567 (+354044us) service_pool.cc:224] Handling call
0709 13:00:40.698445 (+ 30878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.712002 (+ 13557us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:40.763392 (+ 51390us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.142902 (+379510us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.131068 (+988166us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b18003db8e0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:00:42.131366 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.131504 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.131544 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:42.131600 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.131662 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.157388 (+ 25726us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32822,"prepare.queue_time_us":51287,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":15870,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":7643,"spinlock_wait_cycles":48225408,"thread_start_us":353658,"threads_started":1,"wal-append.queue_time_us":1219860}
I20260709 13:00:42.169289  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2087) took 1297 ms. Trace:
I20260709 13:00:42.175669  2265 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:42.174151  5229 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:42.187896  5364 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:00:42.188005  5089 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:42.188781  5089 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:42.150882  5134 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.787s	user 0.011s	sys 0.001s
I20260709 13:00:42.170825  1709 rpcz_store.cc:276] 0709 13:00:40.871881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.893407 (+ 21526us) service_pool.cc:224] Handling call
0709 13:00:40.893776 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.894046 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:40.901289 (+  7243us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.921883 (+ 20594us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.306729 (+384846us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b1800123dc0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:42.130162 (+823433us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b1800123dc0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06e19c73c7 00007f06ddfd99a7 00007f06ddfe90bf 00007f06ddfe9038
0709 13:00:42.130366 (+   204us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.135920 (+  5554us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b1800123dc0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2522 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:42.168890 (+ 32970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.168942 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:42.168992 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.169097 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.169228 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25014,"prepare.queue_time_us":5396,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":20276,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":3639,"spinlock_wait_cycles":15818624,"thread_start_us":38191,"threads_started":1}
I20260709 13:00:42.161283  5067 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.202802  1630 pending_rounds.cc:85] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 3
I20260709 13:00:42.215201  1630 pending_rounds.cc:107] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:00:42.215543  1630 raft_consensus.cc:2889] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:42.215880  1630 pending_rounds.cc:107] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:00:42.216212  1630 raft_consensus.cc:2889] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:42.115011  5167 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:42.187917  5346 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:00:42.228506  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:42.232815  1632 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:42.227684  5334 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:00:42.234193  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 1.05689e+06us
I20260709 13:00:42.241647  5089 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:42.241770  5355 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.194s	user 0.000s	sys 0.002s
I20260709 13:00:42.247326  5170 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:42.214437  5228 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.249090  5373 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:00:42.256598  5375 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:42.257346  5002 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:42.229228  4981 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:42.267692  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:42.274202  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 104179us
I20260709 13:00:42.207068  5134 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.277817  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:42.278219  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2089) took 1965 ms. Trace:
I20260709 13:00:42.282280  1559 raft_consensus.cc:2410] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:00:42.287503  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 558) took 1975 ms. Trace:
I20260709 13:00:42.290416  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:42.291471  1635 raft_consensus.cc:2368] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11.
I20260709 13:00:42.238085  5067 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:42.296267  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 144344us
I20260709 13:00:42.300792  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:42.301470  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:42.303952  1554 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:42.305157  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:42.265002  5354 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.307076  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:42.288194  1558 rpcz_store.cc:276] 0709 13:00:40.312077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.563496 (+251419us) service_pool.cc:224] Handling call
0709 13:00:40.615473 (+ 51977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.635275 (+ 19802us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:41.122203 (+486928us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.286665 (+1164462us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.286904 (+   239us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:42.287139 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.287242 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.287420 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":761418,"prepare.queue_time_us":77546,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"thread_start_us":841382,"threads_started":3,"wal-append.queue_time_us":404104}
I20260709 13:00:42.280395  1556 rpcz_store.cc:276] 0709 13:00:40.313246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.645360 (+332114us) service_pool.cc:224] Handling call
0709 13:00:40.650313 (+  4953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.656132 (+  5819us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:41.073410 (+417278us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.276944 (+1203534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.277010 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:42.277080 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.277979 (+   899us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.278151 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":800583,"prepare.queue_time_us":45105,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"thread_start_us":724881,"threads_started":3,"wal-append.queue_time_us":707238}
I20260709 13:00:42.311619  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:42.272073  5227 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.279760  5075 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:42.318552  2269 raft_consensus.cc:2393] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:42.318146  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:42.329876  1633 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:42.357335  1558 raft_consensus.cc:2410] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:42.333184  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:42.359481  5334 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:42.300688  4889 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:42.360026  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:42.361785  5319 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.312s	user 0.008s	sys 0.005s
I20260709 13:00:42.367419  1629 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:42.383384  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:42.301175  5284 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:42.376915  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:42.271850  5228 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:42.378742  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:42.389139  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:42.383154  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:42.279707  4981 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.389195  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:42.301951  5167 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:42.392696  1558 raft_consensus.cc:2410] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:00:42.395159  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:42.362613  5002 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:42.393110  1635 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:42.394172  1551 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:42.363953  5135 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:42.410040  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.281529  5375 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.378798  5067 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:42.414819  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:42.418871  1551 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:42.363377  5227 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:42.420109  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 128720us
I20260709 13:00:42.391703  5319 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:42.411834  5002 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:42.421634  5232 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.031s	user 0.009s	sys 0.005s
I20260709 13:00:42.430998  5343 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:42.431015  5389 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:42.369823  1556 raft_consensus.cc:2410] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:00:42.421957  5373 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:42.431046  5393 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:42.470433  5393 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:42.471408  5393 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:42.471931  5134 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:42.472570  5393 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:42.437245  5343 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:42.442996  5389 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:42.475198  5343 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:42.428987  5341 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.475791  5389 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:42.430991  5339 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:00:42.444521  1556 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:42.476046  5341 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:42.476722  5335 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.953s	user 0.005s	sys 0.010s
I20260709 13:00:42.445305  5227 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:42.477648  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2122) took 1830 ms. Trace:
I20260709 13:00:42.438072  5385 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:42.440023  5381 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:00:42.431348  5377 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:00:42.478229  1701 rpcz_store.cc:276] 0709 13:00:40.647420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.653152 (+  5732us) service_pool.cc:224] Handling call
0709 13:00:40.653666 (+   514us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:40.679419 (+ 25753us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:40.726618 (+ 47199us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.192829 (+1466211us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.193057 (+   228us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:42.217883 (+ 24826us) log.cc:844] Serialized 590 byte log entry
0709 13:00:42.229636 (+ 11753us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:42.229708 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.229812 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.477407 (+247595us) raft_consensus.cc:1685] finished
0709 13:00:42.477434 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.477587 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":964871,"prepare.queue_time_us":1013955,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":95,"raft.queue_time_us":219605,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":24554,"thread_start_us":397086,"threads_started":2,"wal-append.queue_time_us":639125}
I20260709 13:00:42.486328  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 776) took 1829 ms. Trace:
I20260709 13:00:42.486368  5373 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.486764  2262 rpcz_store.cc:276] 0709 13:00:40.656541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.706054 (+ 49513us) service_pool.cc:224] Handling call
0709 13:00:40.799204 (+ 93150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.819697 (+ 20493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.819726 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.820159 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.141342 (+321183us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:41.527926 (+386584us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.835598 (+307672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.835728 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.476020 (+640292us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:42.485893 (+  9873us) raft_consensus.cc:1685] finished
0709 13:00:42.485994 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.486165 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16175,"prepare.queue_time_us":92882,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":6590,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":5687552,"thread_start_us":866538,"threads_started":3,"wal-append.queue_time_us":598083}
I20260709 13:00:42.489178  5373 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:42.491269  5375 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:42.495323  4981 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:42.415290  5028 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:42.496410  5028 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.499006  5028 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:42.441329  5232 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:42.429831  5067 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:42.330425  5354 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.478710  1558 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:42.435060  5002 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:42.442040  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:42.502370  1703 raft_consensus.cc:2368] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10.
I20260709 13:00:42.508515  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 935) took 1345 ms. Trace:
W20260709 13:00:42.530882  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 88977us
I20260709 13:00:42.547636  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 932) took 1427 ms. Trace:
W20260709 13:00:42.546840  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 628251us
W20260709 13:00:42.518375  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 155705us
I20260709 13:00:42.533347  1551 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:00:42.592130  1551 pending_rounds.cc:85] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 4
I20260709 13:00:42.593441  1551 pending_rounds.cc:107] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 10.5
W20260709 13:00:42.593650  1627 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.003s
I20260709 13:00:42.558305  2263 rpcz_store.cc:276] 0709 13:00:41.163422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.163864 (+   442us) service_pool.cc:224] Handling call
0709 13:00:41.745056 (+581192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.876418 (+131362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.508256 (+631838us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400730350. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:42.508444 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310752512}
I20260709 13:00:42.440079  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:42.690116  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 575832us
I20260709 13:00:42.589846  1632 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
W20260709 13:00:42.692253  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.687743  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:42.705008  5362 consensus_meta.cc:287] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.003s
W20260709 13:00:42.770063  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.685567  2235 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:42.594661  1551 raft_consensus.cc:2889] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:42.501989  5232 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:42.744943  5393 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:42.685820  5370 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.531776  5228 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:42.917714  5392 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:00:42.928696  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 159388us
I20260709 13:00:42.589715  2271 rpcz_store.cc:276] 0709 13:00:41.120487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.135338 (+ 14851us) service_pool.cc:224] Handling call
0709 13:00:41.162549 (+ 27211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.129430 (+966881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.547310 (+417880us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b5400521a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:42.547550 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2213289728}
W20260709 13:00:42.763343  1560 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.036s	sys 0.094s
W20260709 13:00:42.540908  5367 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:00:42.530879  5354 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:42.689826  5369 log.cc:927] Time spent T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.579s	user 0.001s	sys 0.000s
W20260709 13:00:42.850546  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 162879us
W20260709 13:00:42.919550  5135 consensus_meta.cc:287] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.007s
I20260709 13:00:42.860886  5234 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:42.535661  5341 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:42.706845  5323 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:42.913822  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:42.784714  5362 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.536303  5345 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:42.915727  1555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.029s	sys 0.077s
W20260709 13:00:42.967942  1555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.029s	sys 0.077s
I20260709 13:00:42.737282  5343 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:42.686973  5348 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:42.686378  5371 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:42.685145  5363 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:42.685700  5365 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.997882  5365 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.000114  5365 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:42.745497  5028 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.000767  5028 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:42.504092  5384 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:43.002210  2269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 930) took 1933 ms (client timeout 2519 ms). Trace:
I20260709 13:00:43.002369  5384 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:43.002628  2269 rpcz_store.cc:269] 0709 13:00:41.068582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.068727 (+   145us) service_pool.cc:224] Handling call
0709 13:00:43.001987 (+1933260us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400566b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:43.002132 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2790927232}
I20260709 13:00:42.686764  5347 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:42.503567  5391 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:42.696352  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:42.917476  1627 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
W20260709 13:00:42.917665  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 324443us
I20260709 13:00:42.918684  1700 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:42.596093  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 628) took 1121 ms. Trace:
W20260709 13:00:42.925436  1703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2088) took 1962 ms (client timeout 1708 ms). Trace:
I20260709 13:00:42.925122  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:42.923072  1633 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:42.929478  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:00:42.918309  1554 consensus_meta.cc:287] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.530s	user 0.005s	sys 0.009s
W20260709 13:00:42.930999  1560 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.037s	sys 0.095s
I20260709 13:00:42.934823  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 629) took 1458 ms. Trace:
I20260709 13:00:42.533396  5002 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:42.941537  1674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.004s	sys 0.009s
I20260709 13:00:42.538805  5385 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:42.947425  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:42.942832  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:42.948387  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.011s	sys 0.003s
W20260709 13:00:42.930632  1557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.008s	sys 0.004s
I20260709 13:00:42.914891  5070 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:42.953122  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 267681us
I20260709 13:00:42.918814  5375 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:42.958048  1709 raft_consensus.cc:2393] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:42.928536  5370 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.916922  5390 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:42.941277  5228 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.971146  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:42.986642  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:42.994460  5371 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.990844  5234 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:42.955832  5104 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:00:42.996933  5363 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.998211  5075 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:42.534068  5247 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:42.956132  5366 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.931887  5393 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:42.987365  5323 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:43.190708  1557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.009s	sys 0.029s
W20260709 13:00:43.025277  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.190827  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 243523us
I20260709 13:00:43.193151  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:43.191349  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.020s	sys 0.020s
I20260709 13:00:43.191417  1702 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:43.008651  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.025s	sys 0.024s
W20260709 13:00:43.194481  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.028s	sys 0.039s
W20260709 13:00:43.193150  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 263778us
I20260709 13:00:43.191759  1704 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
W20260709 13:00:43.197747  1674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.004s	sys 0.015s
I20260709 13:00:43.199383  1554 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 6.
I20260709 13:00:42.993242  5348 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:43.015264  5261 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.016s	sys 0.023s
W20260709 13:00:43.202574  5261 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.019s	sys 0.043s
I20260709 13:00:43.207530  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1906) took 1051 ms. Trace:
I20260709 13:00:43.208140  1633 rpcz_store.cc:276] 0709 13:00:42.156272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.382227 (+225955us) service_pool.cc:224] Handling call
0709 13:00:43.207451 (+825224us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:43.200670  1703 rpcz_store.cc:269] 0709 13:00:40.955547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.119456 (+163909us) service_pool.cc:224] Handling call
0709 13:00:42.857956 (+1738500us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540005da54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:42.917400 (+ 59444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3098214144}
W20260709 13:00:43.194785  1629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.003s	sys 0.019s
I20260709 13:00:43.232060  1702 raft_consensus.cc:2410] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:43.237859  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:43.225539  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:42.928551  5392 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:43.240638  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44609.1us
I20260709 13:00:43.243373  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:43.210994  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2185) took 1586 ms (client timeout 1708 ms). Trace:
I20260709 13:00:43.223613  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:43.239777  1709 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:43.211463  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:43.245565  1701 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
W20260709 13:00:43.243559  1629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.003s	sys 0.024s
I20260709 13:00:43.247395  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:43.247674  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:43.247536  5229 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:43.248040  1700 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:43.248247  1704 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:43.258982  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 562744us
I20260709 13:00:43.191385  1707 rpcz_store.cc:276] 0709 13:00:41.475071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.475253 (+   182us) service_pool.cc:224] Handling call
0709 13:00:41.493377 (+ 18124us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.493594 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:42.194390 (+700796us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.595493 (+401103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.595567 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:42.595632 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.595749 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.595967 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":640149,"prepare.queue_time_us":749643,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":130,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":385198,"threads_started":2,"wal-append.queue_time_us":747177}
W20260709 13:00:43.244680  1627 rpcz_store.cc:269] 0709 13:00:41.603975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.604095 (+   120us) service_pool.cc:224] Handling call
0709 13:00:43.190814 (+1586719us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:43.246134  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.007817  5354 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.195511  1706 rpcz_store.cc:276] 0709 13:00:41.475940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.476111 (+   171us) service_pool.cc:224] Handling call
0709 13:00:41.476476 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.476746 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:42.461577 (+984831us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b18001710a0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddb774bc 00007f06daec548b 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06e19c73c7 00007f06ddfd99a7 00007f06ddfe90bf
0709 13:00:42.461781 (+   204us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.927885 (+466104us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.931408 (+  3523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.931474 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:42.931533 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.931619 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.934744 (+  3125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":656764,"prepare.queue_time_us":726292,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":10498,"raft.queue_time_us":10752,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":14680,"spinlock_wait_cycles":116688384,"thread_start_us":566523,"threads_started":2}
W20260709 13:00:43.151003  5368 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.084s	user 0.004s	sys 0.005s
W20260709 13:00:43.195007  5322 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.009s	sys 0.014s
I20260709 13:00:43.203557  5347 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:43.143994  5388 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:00:43.260720  2236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.036s	sys 0.076s
W20260709 13:00:43.285451  2236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.037s	sys 0.077s
I20260709 13:00:43.005329  5343 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:43.143208  5395 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 13:00:43.195505  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.210419  4939 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.025238  5391 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.210515  5196 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:43.314450  5196 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.317056  5196 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:43.203541  5075 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.317809  5363 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:43.319435  5343 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:43.320068  5343 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:43.320425  5343 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:43.320779  5343 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.281631  1708 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:43.322496  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:43.205909  5371 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:43.210419  5341 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:43.290459  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44013.9us
I20260709 13:00:43.291947  5393 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:43.295358  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2081) took 2984 ms. Trace:
I20260709 13:00:43.242893  5375 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.222705  5234 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.304865  1704 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:00:43.257278  5232 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:43.306877  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 106385us
W20260709 13:00:43.279495  5322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.014s	sys 0.015s
I20260709 13:00:43.256928  5390 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:43.311779  1599 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:43.210533  5228 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.280853  5384 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:43.325924  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:43.349072  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:43.348894  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:43.336190  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:43.376739  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:43.377236  1632 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:43.377521  2268 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:43.352953  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:43.355288  5341 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:43.299870  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 56636.4us
I20260709 13:00:43.355957  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:43.332919  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:43.356928  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:43.310101  5346 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:43.075264  5345 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.331133  5150 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:43.203446  5385 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.363963  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:43.365406  2269 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:00:43.368650  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 56999.9us
I20260709 13:00:43.342170  5104 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:00:43.370258  2270 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:00:43.330778  4939 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.372023  2262 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:00:43.223104  5070 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:43.378396  1709 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:43.349840  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:43.420948  1627 raft_consensus.cc:2368] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9.
I20260709 13:00:43.379334  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:43.370703  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:43.346439  5351 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:43.352674  1552 rpcz_store.cc:276] 0709 13:00:40.310962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.524557 (+213595us) service_pool.cc:224] Handling call
0709 13:00:40.524825 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.525035 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:40.885718 (+360683us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.492496 (+1606778us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b48000030d8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:00:43.294762 (+802266us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b1800388a80. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddb774bc 00007f06daec548b 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287
0709 13:00:43.294943 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.295050 (+   107us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:43.295101 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.295163 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.295277 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":844627,"prepare.queue_time_us":187587,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":896662,"raft.run_cpu_time_us":1017,"raft.run_wall_time_us":184009,"spinlock_wait_cycles":17024256,"thread_start_us":953749,"threads_started":3,"wal-append.queue_time_us":598353,"wal-append.run_cpu_time_us":1528,"wal-append.run_wall_time_us":1191225}
W20260709 13:00:43.382115  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 59785.4us
I20260709 13:00:43.384624  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:43.424431  2267 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:43.425513  5002 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:43.387002  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:43.385768  1701 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:43.389026  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:43.387313  5398 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.392052  5375 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:43.393591  5323 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:43.394871  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 627) took 1924 ms. Trace:
I20260709 13:00:43.395862  5391 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:43.396477  1526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.708s (SENT) [suppressed 9 similar messages]
I20260709 13:00:43.370779  5322 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:43.306835  5028 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:43.370119  5299 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:43.306088  5359 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.343566  5347 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:43.406327  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:43.403550  2263 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:43.425431  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:43.390055  5392 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:43.426301  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:43.457167  2265 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:43.425855  5366 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:43.409924  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:43.372561  5284 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.433509  2264 raft_consensus.cc:2368] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12.
I20260709 13:00:43.407505  5404 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:43.438830  1705 rpcz_store.cc:276] 0709 13:00:41.470157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.470334 (+   177us) service_pool.cc:224] Handling call
0709 13:00:41.470756 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.505875 (+ 35119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.505922 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.543518 (+ 37596us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.940709 (+397191us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:41.940751 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.940823 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.864065 (+923242us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:43.394472 (+530407us) raft_consensus.cc:1685] finished
0709 13:00:43.394503 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.394794 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24796,"raft.queue_time_us":35287,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5505,"spinlock_wait_cycles":28593024,"thread_start_us":330814,"threads_started":1,"wal-append.queue_time_us":508535}
I20260709 13:00:43.309923  5354 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.409704  5274 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:43.455844  1554 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:43.455912  2267 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 8: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:43.411959  4939 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:43.419091  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1912) took 2678 ms. Trace:
I20260709 13:00:43.446506  2266 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:43.435899  5196 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:43.457206  5229 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:43.476701  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 87777.2us
I20260709 13:00:43.482007  1524 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:43.482191  2265 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:43.483407  1524 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:43.480003  1553 rpcz_store.cc:276] 0709 13:00:40.740373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.369965 (+629592us) service_pool.cc:224] Handling call
0709 13:00:41.397113 (+ 27148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.297246 (+900133us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:42.297311 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.297948 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.379542 (+ 81594us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:42.379650 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.379741 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.418798 (+1039057us) raft_consensus.cc:1685] finished
0709 13:00:43.418827 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.419008 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":853983,"raft.queue_time_us":894850,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":22435,"thread_start_us":179852,"threads_started":2,"wal-append.queue_time_us":486149}
W20260709 13:00:43.527614  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 55430.5us
I20260709 13:00:43.526742  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:43.461864  5362 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:43.462491  5384 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:43.418944  5150 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.470504  5028 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:00:43.596529  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 113238us
I20260709 13:00:43.527760  5261 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:43.484133  5196 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.610672  1524 leader_election.cc:400] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:43.611449  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:00:43.613606  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 133477us
I20260709 13:00:43.435500  5351 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.594322  2263 pending_rounds.cc:85] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 3
I20260709 13:00:43.616214  2263 pending_rounds.cc:107] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 8.4
W20260709 13:00:43.617229  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.386065  5390 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.616557  2263 raft_consensus.cc:2889] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:43.628906  2263 pending_rounds.cc:107] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:00:43.629233  2263 raft_consensus.cc:2889] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:43.526401  5404 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:43.447682  5398 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.670243  5370 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:43.673722  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:43.674724  2262 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:43.613183  5392 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:43.614367  5261 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:43.631282  5323 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:43.614157  5196 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.636222  1673 leader_election.cc:400] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12.
W20260709 13:00:43.689167  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 53154.4us
I20260709 13:00:43.689882  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:43.691130  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:43.683368  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1891) took 3791 ms. Trace:
I20260709 13:00:43.625046  5403 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:43.682968  5387 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:43.694252  5387 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:43.665781  5408 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:00:43.627754  5028 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.699059  5404 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.686705  5384 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:00:43.700065  5028 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:43.700678  5386 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:43.701238  5386 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:00:43.702739  5401 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:00:43.702299  5386 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.557528  5359 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:00:43.717902  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:43.718595  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:43.719327  2266 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:43.688863  5261 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:43.718264  2270 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:43.614454  5341 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.658304  5075 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:43.733108  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:43.733738  2267 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:43.485888  5274 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.744059  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1903) took 1611 ms. Trace:
I20260709 13:00:43.722201  5323 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:43.674858  5322 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:43.752952  1629 rpcz_store.cc:276] 0709 13:00:42.132781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.391366 (+258585us) service_pool.cc:224] Handling call
0709 13:00:42.416397 (+ 25031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.423908 (+  7511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.423952 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.430108 (+  6156us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.246688 (+816580us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:43.743295 (+496607us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.743676 (+   381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.743770 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.743823 (+    53us) raft_consensus.cc:1685] finished
0709 13:00:43.743841 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.743993 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":451498,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":202,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":3753,"thread_start_us":1280903,"threads_started":2,"wal-append.queue_time_us":1018563}
W20260709 13:00:43.760057  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 434253us
I20260709 13:00:43.755734  5274 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.714650  5403 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.690573  5347 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:43.776875  1600 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.011s
W20260709 13:00:43.777472  1600 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.000s	sys 0.011s
I20260709 13:00:43.693455  1560 rpcz_store.cc:276] 0709 13:00:39.907969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.928291 (+ 20322us) service_pool.cc:224] Handling call
0709 13:00:39.988537 (+ 60246us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:00:40.070011 (+ 81474us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:40.484117 (+414106us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.901835 (+417718us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:40.927100 (+ 25265us) log.cc:844] Serialized 78 byte log entry
0709 13:00:40.927262 (+   162us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:40.930386 (+  3124us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.378184 (+447798us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.191018 (+1812834us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.682822 (+491804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.683003 (+   181us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.683051 (+    48us) raft_consensus.cc:1685] finished
0709 13:00:43.683064 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.683293 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":871382,"prepare.queue_time_us":1288898,"prepare.run_cpu_time_us":7570,"prepare.run_wall_time_us":60838,"raft.queue_time_us":934925,"raft.run_cpu_time_us":439,"raft.run_wall_time_us":17544,"thread_start_us":2684838,"threads_started":5,"wal-append.queue_time_us":574264,"wal-append.run_cpu_time_us":5328,"wal-append.run_wall_time_us":1433470}
I20260709 13:00:43.743059  5366 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.757881  5229 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:43.792392  1601 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:43.754638  5228 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:43.771961  5405 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:00:43.801054  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:43.484961  5284 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:43.798116  1524 connection.cc:256] RPC call timeout handler was delayed by -1.3616750120000347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:00:43.789543  5247 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.006s	sys 0.005s
W20260709 13:00:43.805176  1524 connection.cc:256] RPC call timeout handler was delayed by -1.3607750120000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260709 13:00:43.807466  5398 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:43.809576  5351 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:43.810859  5228 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:43.798364  5366 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:43.812256  1524 connection.cc:256] RPC call timeout handler was delayed by -1.2158750120000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 13:00:43.830178  1524 connection.cc:256] RPC call timeout handler was delayed by -1.1249750119999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
W20260709 13:00:43.830583  1524 connection.cc:256] RPC call timeout handler was delayed by -1.0979750120000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
I20260709 13:00:43.831421  1524 leader_election.cc:400] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8.
I20260709 13:00:43.832518  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:43.813998  1601 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:43.814642  5104 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:00:43.842702  1552 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:43.843240  1552 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:43.845716  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:43.846400  1558 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
W20260709 13:00:43.846725  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.827016  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 422138us
W20260709 13:00:43.812192  5247 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.006s	sys 0.005s
I20260709 13:00:43.805119  5232 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:43.856411  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:43.857267  1553 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:43.858913  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:43.818656  5028 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:43.818671  5228 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.862365  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:43.864356  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 50462.2us
I20260709 13:00:43.864691  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:43.865692  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:43.865955  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:43.827946  5354 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:43.864820  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:43.869141  1551 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:43.866955  1552 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:43.868467  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:43.874843  1560 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:00:43.877799  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:43.852800  5089 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:43.878546  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46126.6us
I20260709 13:00:43.879346  1552 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.882269  1524 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:43.870180  5400 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 13:00:43.815028  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 482200us
I20260709 13:00:43.889258  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:43.890112  1633 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.863592  5028 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.891767  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:43.896420  1634 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:43.870587  5228 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:43.866209  5150 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:43.906972  1555 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:43.891258  5299 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:43.898979  5028 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:43.918576  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:43.930647  1560 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.930698  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:43.912853  5348 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.711s	user 0.012s	sys 0.000s
I20260709 13:00:43.932989  1626 raft_consensus.cc:2393] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:43.934757  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 536499us
I20260709 13:00:43.935148  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:43.936259  5247 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.936715  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:43.938154  1524 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:43.938983  5170 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:43.939365  5170 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:43.939960  5170 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.940048  5418 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:43.940658  5418 raft_consensus.cc:697] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:43.941531  5418 consensus_queue.cc:237] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:43.939358  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:43.946635  5384 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:43.951478  5391 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:43.951506  5392 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:43.952776  5389 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:43.953153  5389 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:43.954286  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:43.957000  5391 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:43.957597  5391 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:43.958720  5391 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:43.918548  5089 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:43.877717  5323 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:43.928103  5366 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:43.973012  1524 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:43.993698  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1911) took 3277 ms. Trace:
I20260709 13:00:43.997087  1557 rpcz_store.cc:276] 0709 13:00:40.715929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.357544 (+641615us) service_pool.cc:224] Handling call
0709 13:00:41.357949 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.197814 (+839865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.197861 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.207559 (+  9698us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.483676 (+276117us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b48000030d8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:00:43.192048 (+708372us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:43.192087 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.192149 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.974742 (+782593us) raft_consensus.cc:1685] finished
0709 13:00:43.974770 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.993576 (+ 18806us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":848674,"raft.queue_time_us":874922,"raft.run_cpu_time_us":2197,"raft.run_wall_time_us":234909,"spinlock_wait_cycles":8653184,"thread_start_us":934157,"threads_started":1,"wal-append.queue_time_us":1230894}
I20260709 13:00:44.002774  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:44.004621  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:44.006121  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.006340  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.006757  1709 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:44.005682  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.007540  1633 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:44.006953  1706 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:00:44.007515  1708 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:44.023054  1706 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:44.030664  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.010447  5398 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.965953  5348 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:44.022626  5343 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.701s	user 0.012s	sys 0.001s
I20260709 13:00:43.928982  5232 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:44.043843  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 179234us
I20260709 13:00:44.022744  5075 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:44.039661  5371 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.659s	user 0.009s	sys 0.003s
I20260709 13:00:44.041543  5398 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.051088  5345 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.031612  5417 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:44.055315  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 82990.7us
I20260709 13:00:44.047264  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:44.038173  5299 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.092561  5170 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:44.037667  5420 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:00:44.074699  5413 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:00:44.107889  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.111783  1709 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:44.099191  5299 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:44.090750  5422 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:00:44.056778  5403 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.122311  1552 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:00:44.123214  1552 pending_rounds.cc:85] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 5
I20260709 13:00:44.123872  1552 pending_rounds.cc:107] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:00:44.124326  1552 raft_consensus.cc:2889] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.045604  5343 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.053696  5371 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.184934  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.185880  1709 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:44.195393  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 148339us
I20260709 13:00:44.107370  5417 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.199707  5170 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:44.200726  5436 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.201689  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.204324  1702 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:44.205464  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.119611  5420 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.206530  5075 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:44.179770  5403 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:44.208367  5407 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.877s	user 0.005s	sys 0.000s
I20260709 13:00:44.208750  5089 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:44.245318  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:44.245613  5089 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:44.246320  5089 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:44.246696  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:44.247478  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:44.247359  5089 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:44.248562  5430 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:00:44.248695  5089 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:44.224720  1560 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:44.182145  5432 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.236090  1557 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:44.236613  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.233320  1709 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:44.255098  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.255921  1709 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:44.257067  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:44.239327  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:44.236500  5196 consensus_meta.cc:287] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.003s
I20260709 13:00:44.241550  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:44.241056  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:44.210785  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:44.239727  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:44.263664  1707 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:44.214267  5299 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.212772  5229 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:44.216890  5274 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:44.488271  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 237868us
I20260709 13:00:44.236203  5437 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:44.490150  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.522921  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.263728  5284 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:44.245733  5438 log.cc:927] Time spent T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:44.258808  1553 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
W20260709 13:00:44.248659  5433 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:00:44.489956  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:44.546887  1708 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:44.547701  1700 raft_consensus.cc:2368] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10.
W20260709 13:00:44.503248  5228 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.589s	user 0.012s	sys 0.000s
I20260709 13:00:44.252224  5418 raft_consensus.cc:2764] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:00:44.554951  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 835) took 1214 ms. Trace:
W20260709 13:00:44.556730  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 66850us
W20260709 13:00:44.456272  5406 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.924s	user 0.000s	sys 0.002s
I20260709 13:00:44.242362  5075 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.542709  5284 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.408726  5343 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.505050  5348 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:44.477288  5446 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.562371  2263 rpcz_store.cc:276] 0709 13:00:43.341012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.467195 (+126183us) service_pool.cc:224] Handling call
0709 13:00:43.477688 (+ 10493us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:43.689476 (+211788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.689504 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:43.690199 (+   695us) log.cc:844] Serialized 78 byte log entry
0709 13:00:43.929017 (+238818us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:43.929080 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.929165 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.554656 (+625491us) raft_consensus.cc:1685] finished
0709 13:00:44.554683 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.554879 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2311,"raft.queue_time_us":37755,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":3414,"thread_start_us":234812,"threads_started":1,"wal-append.queue_time_us":346601}
I20260709 13:00:44.457152  5420 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:44.578930  5434 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.397s	user 0.000s	sys 0.001s
I20260709 13:00:44.570374  5229 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:44.582969  5229 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.586381  5229 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:44.551132  5437 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.595044  1701 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:44.596266  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1928) took 1389 ms. Trace:
I20260709 13:00:44.596405  5437 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:44.596639  1554 rpcz_store.cc:276] 0709 13:00:43.206876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.209774 (+  2898us) service_pool.cc:224] Handling call
0709 13:00:43.253398 (+ 43624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.479510 (+226112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.596024 (+1116514us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400234954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:44.596209 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464894336}
I20260709 13:00:44.598719  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 785) took 1265 ms. Trace:
I20260709 13:00:44.599119  2271 rpcz_store.cc:276] 0709 13:00:43.333109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.335678 (+  2569us) service_pool.cc:224] Handling call
0709 13:00:43.366301 (+ 30623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.399186 (+ 32885us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:43.399238 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.447790 (+ 48552us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.870238 (+422448us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:43.870280 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.870349 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.598475 (+728126us) raft_consensus.cc:1685] finished
0709 13:00:44.598523 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.598661 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14493,"raft.queue_time_us":14722,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":5609,"thread_start_us":387093,"threads_started":1,"wal-append.queue_time_us":1056945}
I20260709 13:00:44.606776  5354 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:44.607568  5354 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:44.610195  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 741830us
I20260709 13:00:44.251477  5403 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.545634  5398 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.567937  1526 leader_election.cc:400] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10.
W20260709 13:00:44.617465  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 49619.1us
I20260709 13:00:44.568260  5075 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:44.559682  5341 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:44.242398  5436 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.620028  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.547454  5196 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.350939  5432 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.563935  5447 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.622931  1700 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:44.626783  1705 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:44.631237  1703 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:44.564186  5228 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.617923  5343 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.626631  5421 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:44.621060  5354 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.617689  5417 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.622633  5341 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:44.679921  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.571297  5284 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.627972  5371 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:44.627326  5423 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:44.633397  5441 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:44.693284  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.693476  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.695639  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:44.688391  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 823683us
I20260709 13:00:44.704226  5234 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.705854  5361 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:44.708886  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 655599us
I20260709 13:00:44.724853  1708 raft_consensus.cc:2410] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:44.725052  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:44.688256  5407 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:44.730331  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.732448  1702 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:44.733392  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.734228  1702 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:44.734704  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.735333  1704 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:44.737095  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.737797  1709 raft_consensus.cc:2410] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:44.692531  5341 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:44.744469  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.011s	sys 0.030s
W20260709 13:00:44.745211  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.011s	sys 0.030s
I20260709 13:00:44.622251  5446 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.685407  5343 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.746177  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:44.751019  4939 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:00:44.752736  5448 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:00:44.753782  5450 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:00:44.729803  5361 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:44.766096  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:44.741925  5435 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:44.770452  1704 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:44.749804  5274 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.798661  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:44.800639  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:44.731894  5441 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.813038  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:44.813331  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:44.813576  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:44.813812  1552 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 8: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:44.688310  5421 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.814348  1558 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:44.800084  5104 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:00:44.827464  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:44.829046  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:44.805285  5459 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:44.805672  5463 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.807039  5196 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.807564  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:44.808216  1706 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:44.808609  5426 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:44.809098  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 843) took 1091 ms. Trace:
I20260709 13:00:44.797722  5423 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:44.809742  5453 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:44.810636  5363 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.810725  5228 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:44.811193  5370 raft_consensus.cc:670] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } [suppressed 4 similar messages]
W20260709 13:00:44.812115  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 87281.8us
I20260709 13:00:44.813897  1556 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:44.661911  5447 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.816226  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:44.921692  1560 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:44.922680  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:44.923086  5261 consensus_meta.cc:287] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.190s	user 0.006s	sys 0.006s
I20260709 13:00:44.923300  1560 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:44.923518  5261 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.924369  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:44.818604  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 44748.5us
I20260709 13:00:44.823765  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:44.926090  1557 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:44.926719  5261 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.831462  1554 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:44.927482  5451 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:00:44.834334  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:44.928715  1555 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:44.928576  5458 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:00:44.916209  5463 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.838704  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:44.930840  2267 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:44.930881  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:44.931149  5343 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:44.840610  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:44.931821  5463 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:44.932156  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 91686.1us
I20260709 13:00:44.932292  5459 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:44.932732  5459 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.933060  5459 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:44.933235  1674 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:44.934332  5454 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:44.934410  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:44.934805  5454 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:44.935237  5454 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:44.828106  5028 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.832s	user 0.009s	sys 0.003s
I20260709 13:00:44.833669  5396 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.838379  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:44.893536  1705 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:44.844880  1559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1918) took 2577 ms (client timeout 1547 ms). Trace:
W20260709 13:00:44.839944  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 128534us
W20260709 13:00:44.839391  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 220693us
I20260709 13:00:44.918162  1600 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:44.918941  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:44.848623  5284 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
W20260709 13:00:44.952557  1559 rpcz_store.cc:269] 0709 13:00:42.267828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.283414 (+ 15586us) service_pool.cc:224] Handling call
0709 13:00:44.844628 (+2561214us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54001815d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:44.844767 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4451132800}
I20260709 13:00:44.955601  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:44.892882  2265 rpcz_store.cc:276] 0709 13:00:43.717249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.717357 (+   108us) service_pool.cc:224] Handling call
0709 13:00:43.717686 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.728343 (+ 10657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.728398 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.739271 (+ 10873us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.976936 (+237665us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:44.125296 (+148360us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.808496 (+683200us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18003e0200. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:00:44.808673 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.808738 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.808780 (+    42us) raft_consensus.cc:1685] finished
0709 13:00:44.808884 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.809015 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55409,"prepare.queue_time_us":117642,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":683924,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":5424,"spinlock_wait_cycles":3747584,"thread_start_us":293373,"threads_started":2,"wal-append.queue_time_us":305348}
I20260709 13:00:44.927372  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:44.930058  5456 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.956676  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:44.930282  5453 raft_consensus.cc:697] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:44.856526  5387 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:44.831151  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:44.822151  5385 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.939925  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:44.844825  5104 raft_consensus.cc:3055] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:44.943111  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:44.943399  5432 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:44.940088  5403 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:44.943125  5441 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.944408  5028 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.945909  5446 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:44.945842  5341 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.946620  5436 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.947212  5075 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.838573  5319 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.947480  5423 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.838369  5353 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.948539  5398 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:44.948601  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 121258us
I20260709 13:00:44.838915  5389 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:44.832629  5274 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:44.858098  5384 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.885s	user 0.008s	sys 0.004s
I20260709 13:00:45.270455  5384 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:44.954353  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:45.271531  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 317286us
I20260709 13:00:45.272256  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:45.274389  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:45.274923  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:44.845453  5408 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:44.834882  5421 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:44.840369  5371 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 13:00:45.275573  1558 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:00:45.275625  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:45.276777  2262 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:44.941684  5396 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:45.277460  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:45.219349  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2097) took 1017 ms. Trace:
I20260709 13:00:45.128298  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.132469  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:44.963548  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.278357  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:45.278980  1552 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:45.279423  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:45.279855  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.279976  1552 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:45.280712  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.281345  5441 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.171744  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:45.281685  1555 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:45.275585  5408 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:45.282156  1709 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.283046  5408 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.284153  5408 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:45.222074  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 265489us
I20260709 13:00:45.189772  1702 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:45.286445  5452 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:45.286931  5452 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:45.287323  5452 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.287786  1702 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:45.180678  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2093) took 1124 ms. Trace:
I20260709 13:00:45.289288  1706 rpcz_store.cc:276] 0709 13:00:44.056730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.056938 (+   208us) service_pool.cc:224] Handling call
0709 13:00:44.808025 (+751087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.905535 (+ 97510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.180428 (+274893us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54000a78d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:45.180603 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726694272}
W20260709 13:00:45.222973  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 304896us
I20260709 13:00:45.278195  1701 rpcz_store.cc:276] 0709 13:00:44.201532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.236354 (+ 34822us) service_pool.cc:224] Handling call
0709 13:00:45.219150 (+982796us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b5400387cd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:45.219286 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784297856}
I20260709 13:00:45.291397  1600 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:45.292454  5396 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.293031  5396 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:45.293074  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:45.132702  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:45.294381  1551 raft_consensus.cc:2410] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:00:45.294323  1554 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:45.050272  5347 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:45.225181  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.295269  5347 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.112808  2266 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:45.294979  5465 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:45.296348  5465 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.286479  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:45.220440  5348 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.232280  1704 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:44.916093  5461 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:44.937979  5299 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:45.237805  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 406717us
I20260709 13:00:45.049857  5447 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:44.950903  5070 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.245823  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:45.246088  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.233667  5199 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:45.127377  5228 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.130108  5165 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.021255  5426 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:45.022315  5370 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:45.130458  5458 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.262284  1629 raft_consensus.cc:2368] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8.
I20260709 13:00:45.020396  5453 consensus_queue.cc:237] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.350214  5165 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.977921  5261 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.355876  5261 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.356369  5165 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.356940  1556 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.049728  5322 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:45.127861  5196 raft_consensus.cc:2955] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Committing config change with OpId 7.8: config changed from index 3 to 8, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:45.248466  5425 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:45.258322  5319 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.269011  1557 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:45.275027  2263 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:45.276695  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:44.771014  5435 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.176978  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:45.395763  1559 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:45.281853  5441 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:45.295855  1634 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:45.225617  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:45.299000  1627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.069s	sys 0.117s
I20260709 13:00:45.281853  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:45.396731  1627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.069s	sys 0.117s
I20260709 13:00:45.299582  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:45.397197  1633 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
W20260709 13:00:45.397647  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 98160.6us
I20260709 13:00:45.398093  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:45.231534  1705 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:44.959520  5232 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.277s
I20260709 13:00:45.221714  5459 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.938278  5363 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.312356  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1902) took 3168 ms. Trace:
I20260709 13:00:45.313087  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:45.409423  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:45.410320  2265 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:45.254153  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:45.309402  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:45.411432  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:45.315011  1701 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:45.321842  1709 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:45.308568  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:45.414748  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 106281us
I20260709 13:00:45.412379  1705 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:45.415278  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:45.416488  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:45.325548  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.366369  5165 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.328256  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:45.419291  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:45.335824  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:44.474354   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:45.251583  5398 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.251358  5359 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:45.295858  5347 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.347430  5228 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:44.959517  5361 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.300388  5002 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:45.360540  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.358382  2269 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:45.240316  5385 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.358224  5322 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.259335  5353 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.368654  5341 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.330093  5348 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.228075  5104 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:45.400063  1704 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:45.347050  5370 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.341566  5461 raft_consensus.cc:697] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:00:45.404748  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1910) took 1543 ms (client timeout 1853 ms). Trace:
W20260709 13:00:45.463264  1629 rpcz_store.cc:269] 0709 13:00:43.861381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.861502 (+   121us) service_pool.cc:224] Handling call
0709 13:00:45.404577 (+1543075us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540018ecd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:45.404697 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3181739392}
I20260709 13:00:45.369650  5458 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:45.411541  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 102251us
I20260709 13:00:45.468211  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:45.310220  5389 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.417865  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:45.470347  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52576.1us
W20260709 13:00:45.418064  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 164041us
I20260709 13:00:45.326722  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:45.471416  1706 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:45.409278  1630 rpcz_store.cc:276] 0709 13:00:42.132591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.153128 (+ 20537us) service_pool.cc:224] Handling call
0709 13:00:42.202490 (+ 49362us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:42.292826 (+ 90336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.292877 (+    51us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:42.480226 (+187349us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b1800420f40. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a
0709 13:00:42.481627 (+  1401us) spinlock_profiling.cc:243] Waited 9.99 ms on lock 0x7b2c0005c228. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2
0709 13:00:42.489513 (+  7886us) log.cc:844] Serialized 78 byte log entry
0709 13:00:42.923280 (+433767us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:43.397418 (+474138us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.823141 (+425723us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.874216 (+ 51075us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.207765 (+333549us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:44.600886 (+393121us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b1800420f40. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:00:45.300059 (+699173us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b1800420f40. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddb774bc 00007f06daec548b 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287
0709 13:00:45.300206 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.300297 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.300357 (+    60us) raft_consensus.cc:1685] finished
0709 13:00:45.300374 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.300508 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":253984,"prepare.queue_time_us":782528,"prepare.run_cpu_time_us":365,"prepare.run_wall_time_us":2247,"raft.queue_time_us":1669285,"raft.run_cpu_time_us":706,"raft.run_wall_time_us":68674,"spinlock_wait_cycles":70621184,"thread_start_us":1396846,"threads_started":4,"wal-append.queue_time_us":760250}
I20260709 13:00:45.372610  5425 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.343492  5199 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.474368  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:45.348245  5371 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:00:45.419754  5469 raft_consensus.cc:2764] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:45.454382  5362 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.440629  5028 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.458278  1635 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:45.459090  1709 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:45.434175  1558 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
W20260709 13:00:45.421039  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 92873.7us
I20260709 13:00:45.488020  2236 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:45.488534  1628 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:45.464823  5465 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:45.493114  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:45.493783  1556 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.493868  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:45.494642  5341 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:45.495544  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.496166  1630 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:45.497093  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:45.497617  1630 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.447273  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:45.022846  5456 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:45.500626  5456 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.400435  5435 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.407518  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.502493  5459 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:45.466810  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.471798  1673 leader_election.cc:400] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11.
I20260709 13:00:45.503248  1673 leader_election.cc:403] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:00:45.504412  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:45.505546  5274 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:45.506095  5274 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.506192  5421 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11.
I20260709 13:00:45.506508  5274 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:45.506621  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.506964  5421 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:45.502236  5070 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:00:45.507522  5421 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:45.507903  5070 consensus_queue.cc:1243] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:45.508483  5070 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:45.508927  5284 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:45.508648  5421 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:45.509342  5284 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:45.472304  5375 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:45.511003  1632 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:45.483656  5386 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:00:45.502285  5461 consensus_queue.cc:237] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:45.505645  1673 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:45.513940  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:45.401952  5446 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:00:45.440752  5436 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:45.514796  5436 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:45.432739  5393 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:45.352530  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 563) took 1141 ms. Trace:
I20260709 13:00:45.463107  5370 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.408751  5463 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:45.489015  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:45.451082  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.461511  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:45.502382  1633 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:45.531797  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:45.532972  1633 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:45.463266  5359 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.483870  5447 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.437536  5398 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.433286  5232 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:45.515553  1635 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.512478  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.492570  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:45.572317  1702 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:45.518270  1629 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:45.576117  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.579429  5261 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:45.533025  5386 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:45.582391  5319 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.583057  5319 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:45.550894  5385 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:45.524631  1556 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:45.477787  5425 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.514850  5299 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:45.526348  2264 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.526896  1551 rpcz_store.cc:276] 0709 13:00:44.197313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.197641 (+   328us) service_pool.cc:224] Handling call
0709 13:00:45.338213 (+1140572us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400182254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:45.338357 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2405785856}
I20260709 13:00:45.437601  5165 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.528702  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:45.491670  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:45.595331  1706 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:45.595378  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 66786.8us
W20260709 13:00:45.535418  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 88287.9us
I20260709 13:00:45.535584  5441 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.596697  1601 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:45.462723  5426 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:45.530212  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:45.536437  1633 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:45.526968  5436 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.611498  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.537686  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:45.612725  1634 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.538372  5348 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.541242  5322 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:45.543886  5353 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.508900  5070 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:45.527266  5361 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.534950  5463 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:45.548117  5104 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.550338  5456 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:45.526841  5393 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:45.526530  5371 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:45.669524  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:45.632687  5459 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:45.520265  1630 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:45.585222  1557 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:45.314518  5384 consensus_queue.cc:1175] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f1725fe36e349ac85405627f9c93d95" responder_term: 10 status { last_received { term: 9 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:45.535574  5363 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.592332  2268 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:45.564926  5447 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.663038  5463 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.597788  1526 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:45.704814  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 107138us
I20260709 13:00:45.641700  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:45.643358  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.583431  5319 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:45.652423  2234 leader_election.cc:400] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9.
I20260709 13:00:45.663676  1704 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:00:45.664315  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 132603us
I20260709 13:00:45.667860  1635 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:00:45.602643  5075 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.534891  5284 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:45.569742  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 300972us
I20260709 13:00:45.664103  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:45.670480  1701 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:45.636592  5386 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:45.670488  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 194075us
I20260709 13:00:45.638347  5396 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:45.637482  5299 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:45.669131  5393 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.647254  5365 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:45.606532  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 76397.5us
I20260709 13:00:45.700469  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:45.651227  5426 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:45.661556  5456 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.661224  5353 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:45.746485  1629 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:45.767618  2234 leader_election.cc:403] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:45.706576  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:45.735514  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.768436  1709 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:45.769466  1630 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:45.706342  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:45.706295  1456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 232) took 14983 ms (client timeout 15000 ms). Trace:
I20260709 13:00:45.779088  1673 leader_election.cc:400] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8.
I20260709 13:00:45.779461  1673 leader_election.cc:403] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:00:45.767546  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 125940us
W20260709 13:00:45.768569  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 116283us
I20260709 13:00:45.781865  1557 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:45.784250  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:45.788981  1629 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:45.791365  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:45.791577  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:45.706871  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:45.792970  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 86169.3us
I20260709 13:00:45.793973  1706 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
W20260709 13:00:45.795557  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.795946  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 331125us
I20260709 13:00:45.780565  1701 raft_consensus.cc:2955] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 3 to 8, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:45.669548  5371 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:45.676759  5459 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:45.692390  5348 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:45.802847  1560 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:45.785401  1633 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
W20260709 13:00:45.741173  5454 consensus_meta.cc:287] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.805s	user 0.010s	sys 0.000s
W20260709 13:00:45.763770  5467 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:00:45.764546  5228 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:45.810256  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:45.705444  5447 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.699785  5104 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.818233  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.706219  5391 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.700733  5070 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:45.823931  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.807731  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:45.749333  5432 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:45.711344  5165 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.769330  5386 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:45.845206  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:46.700444  1552 raft_consensus.cc:2393] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 5: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:45.843307  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:45.789142  5319 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:45.805122  5472 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.135s	user 0.000s	sys 0.004s
I20260709 13:00:45.738812  5199 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.744150  5359 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:45.788909  5353 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:45.707398  5322 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.149s
I20260709 13:00:45.707204  5408 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.149s
I20260709 13:00:45.737668  5452 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:46.704069  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:45.952211  5424 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:45.952560  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1914) took 2067 ms. Trace:
I20260709 13:00:46.699965  5070 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:46.715768  1627 rpcz_store.cc:276] 0709 13:00:43.884956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.901015 (+ 16059us) service_pool.cc:224] Handling call
0709 13:00:43.901339 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.627584 (+726245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.627616 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.632119 (+  4503us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.397193 (+765074us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:45.638784 (+241591us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.952031 (+313247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.952243 (+   212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.952290 (+    47us) raft_consensus.cc:1685] finished
0709 13:00:45.952303 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.952487 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":773847,"prepare.queue_time_us":259017,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":979212,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":14285,"spinlock_wait_cycles":28759296,"thread_start_us":1223943,"threads_started":3,"wal-append.queue_time_us":686370}
W20260709 13:00:46.719262  1560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2113) took 1885 ms (client timeout 2504 ms). Trace:
W20260709 13:00:46.282984  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 500438us
I20260709 13:00:45.799347  5476 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:46.670074  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:45.826771  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.720975  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:46.701607  5386 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:45.918521  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:46.723382  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:45.830689  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:46.723932  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 739) took 2759 ms. Trace:
I20260709 13:00:45.919292  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:45.915926  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.913450  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:45.734402  1454 catalog_manager.cc:5697] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 7 to 9, pending config changed. New cstate: current_term: 9 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:46.725837  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:46.720600  1551 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:46.726009  1554 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
W20260709 13:00:46.670174  2233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.013s	sys 0.017s
W20260709 13:00:46.728157  2233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.014s	sys 0.017s
I20260709 13:00:45.936558  5371 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:46.734484  1701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.032s	sys 0.035s
W20260709 13:00:46.734951  1701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.032s	sys 0.035s
I20260709 13:00:45.859776  5002 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.815s
W20260709 13:00:46.273188  2264 consensus_meta.cc:287] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.679s	user 0.006s	sys 0.002s
I20260709 13:00:45.796442  5482 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9.
W20260709 13:00:45.849924  1673 connection.cc:256] RPC call timeout handler was delayed by -2.0358760639999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 13:00:46.647542  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.002s	sys 0.033s
W20260709 13:00:46.424934  2236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.002s	sys 0.007s
I20260709 13:00:45.801549  5385 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:45.980818  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 940) took 1143 ms. Trace:
W20260709 13:00:46.299810  5274 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.793s	user 0.008s	sys 0.003s
W20260709 13:00:46.210830  5488 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:00:45.798957  5446 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:45.824328  5423 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.867s
I20260709 13:00:45.860390  5234 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:46.403916  5463 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.000s
I20260709 13:00:45.801493  5232 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8.
W20260709 13:00:46.225425  5347 consensus_meta.cc:287] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.756s	user 0.001s	sys 0.008s
W20260709 13:00:46.091847  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.687183  5447 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:45.826341  5454 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:45.789294  5456 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:46.355381  5361 consensus_meta.cc:287] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.001s
W20260709 13:00:46.329329  5398 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.745s	user 0.009s	sys 0.000s
W20260709 13:00:46.357316  5425 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.725s	user 0.010s	sys 0.000s
W20260709 13:00:46.348734  5393 consensus_meta.cc:287] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.001s
I20260709 13:00:45.820225  5443 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.359153  5436 consensus_meta.cc:287] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.714s	user 0.010s	sys 0.000s
I20260709 13:00:45.819793  5396 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:46.689218  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:46.813199  1629 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
I20260709 13:00:45.913830  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:46.363423  5362 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.875s	user 0.011s	sys 0.000s
W20260709 13:00:46.122189  5370 consensus_meta.cc:287] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.001s
W20260709 13:00:45.818668  5483 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.107s	user 0.004s	sys 0.000s
W20260709 13:00:46.690976  1704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.007s	sys 0.006s
W20260709 13:00:46.817518  1704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.007s	sys 0.006s
I20260709 13:00:45.918941  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:46.817803  1708 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:00:45.897418  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:46.692934  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 885328us
I20260709 13:00:46.818346  1632 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:46.694296  5432 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:45.821416  5479 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.802477  5435 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:46.691846  5391 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:46.693985  2235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.005s	sys 0.021s
W20260709 13:00:46.833927  2235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.005s	sys 0.021s
W20260709 13:00:46.834292  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 1.04066e+06us
I20260709 13:00:46.796742  5446 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:00:45.777383  1456 rpcz_store.cc:269] 0709 13:00:30.723421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.723679 (+   258us) service_pool.cc:224] Handling call
0709 13:00:45.706072 (+14982393us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:39.056339 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:39.210082 (+153743us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:39.212636 (+  2554us) write_op.cc:435] Acquired schema lock
0709 13:00:39.216766 (+  4130us) tablet.cc:662] Decoding operations
0709 13:00:39.461327 (+244561us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:39.461400 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:39.461452 (+    52us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:00:39.569669 (+108217us) tablet.cc:701] Row locks acquired
0709 13:00:39.569683 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:00:39.569796 (+   113us) write_op.cc:270] Start()
0709 13:00:39.569879 (+    83us) write_op.cc:276] Timestamp: P: 1783602039569760 usec, L: 0
0709 13:00:39.569906 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:00:39.662052 (+ 92146us) log.cc:844] Serialized 7547 byte log entry
0709 13:00:40.704069 (+1042017us) op_driver.cc:464] REPLICATION: finished
0709 13:00:41.278584 (+574515us) write_op.cc:301] APPLY: starting
0709 13:00:41.278713 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:41.279154 (+   441us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:41.279308 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:41.281488 (+  2180us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:41.281890 (+   402us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:00:41.281938 (+    48us) write_op.cc:312] APPLY: finished
0709 13:00:41.527847 (+245909us) log.cc:844] Serialized 125 byte log entry
0709 13:00:41.925677 (+397830us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:41.995004 (+ 69327us) write_op.cc:454] Released schema lock
0709 13:00:42.013883 (+ 18879us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:42.049729 (+ 35846us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:42.052901 (+  3172us) write_op.cc:454] Released schema lock
0709 13:00:42.540103 (+487202us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
Metrics: {"mutex_wait_us":180367,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":539281,"apply.run_cpu_time_us":15863,"apply.run_wall_time_us":770752,"num_ops":18,"prepare.queue_time_us":332342,"prepare.run_cpu_time_us":44454,"prepare.run_wall_time_us":724637,"raft.queue_time_us":657348,"raft.run_cpu_time_us":15994,"raft.run_wall_time_us":430817,"replication_time_us":1133971,"spinlock_wait_cycles":8977792,"thread_start_us":1207781,"threads_started":5,"wal-append.queue_time_us":958144,"wal-append.run_cpu_time_us":36828,"wal-append.run_wall_time_us":3207427}]]}
W20260709 13:00:46.699703  5489 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.488s	user 0.006s	sys 0.007s
W20260709 13:00:46.290858  5481 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:00:45.854948  5348 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:46.705222  1555 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:45.861159  5135 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:45.919749  5458 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:46.669757  1633 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:00:46.691855  5196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.018s	sys 0.025s
W20260709 13:00:46.719661  1560 rpcz_store.cc:269] 0709 13:00:44.833893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.924126 (+ 90233us) service_pool.cc:224] Handling call
0709 13:00:46.719078 (+1794952us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b540031e054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:46.719197 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2017266048}
I20260709 13:00:46.080752  1634 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:00:46.700659  4939 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:46.723681  1628 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:46.853557  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2204) took 1316 ms. Trace:
I20260709 13:00:46.853658  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2218) took 1030 ms. Trace:
I20260709 13:00:46.672432  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:46.853919  1634 rpcz_store.cc:276] 0709 13:00:45.537054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.537441 (+   387us) service_pool.cc:224] Handling call
0709 13:00:46.853498 (+1316057us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.705976  5353 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.733101  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:46.854385  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1917) took 1042 ms. Trace:
I20260709 13:00:46.854959  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2217) took 1032 ms. Trace:
I20260709 13:00:46.855501  1627 rpcz_store.cc:276] 0709 13:00:45.822872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.732826 (+909954us) service_pool.cc:224] Handling call
0709 13:00:46.854888 (+122062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.855720  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:46.856739  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:45.926268  5461 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.761s
I20260709 13:00:46.732332  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:46.860831  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:46.861107  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 128868us
I20260709 13:00:46.082160  5299 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:46.865568  5499 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:46.866385  5499 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:46.867560  5499 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:45.936299  5426 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:46.871081  5447 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:46.873160  5454 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:46.724296  1626 rpcz_store.cc:276] 0709 13:00:43.964354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.968055 (+  3701us) service_pool.cc:224] Handling call
0709 13:00:44.005923 (+ 37868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.006168 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:44.023068 (+ 16900us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.237759 (+1214691us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b180031de00. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f23a 00007f06ddfd9a2a
0709 13:00:46.718112 (+1480353us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b180031de00. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddb774bc 00007f06daec548b 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287
0709 13:00:46.723581 (+  5469us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.723634 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:46.723683 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.723757 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.723880 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8616,"prepare.queue_time_us":16177,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":120928,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":3945,"spinlock_wait_cycles":92188032,"thread_start_us":570084,"threads_started":2,"wal-append.queue_time_us":1917718}
W20260709 13:00:46.728840  5466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.016s	sys 0.011s
W20260709 13:00:46.874506  5466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.016s	sys 0.026s
W20260709 13:00:46.775417  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.005s	sys 0.020s
W20260709 13:00:46.875061  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.005s	sys 0.020s
W20260709 13:00:46.775818  1674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.006s	sys 0.017s
W20260709 13:00:46.876032  1674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.006s	sys 0.018s
W20260709 13:00:46.776844  2236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.005s	sys 0.011s
I20260709 13:00:46.776131  2264 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
W20260709 13:00:46.779464  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.004s	sys 0.034s
I20260709 13:00:46.722276  5476 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:46.727442  5404 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:46.799099  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:46.776193  2271 rpcz_store.cc:276] 0709 13:00:44.837213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.837336 (+   123us) service_pool.cc:224] Handling call
0709 13:00:44.837642 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.837872 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:45.050300 (+212428us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.507012 (+456712us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b1800225d60. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddb774bc 00007f06daec548b 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f23a
0709 13:00:45.980303 (+473291us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.980385 (+    82us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:45.980452 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.980550 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.980735 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":503366,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":130621,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":16266,"spinlock_wait_cycles":24058240,"thread_start_us":914474,"threads_started":3,"wal-append.queue_time_us":451532}
I20260709 13:00:46.880046  1634 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:46.736384  1454 catalog_manager.cc:5697] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 5 to 8, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:46.880393  1560 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:46.881142  1553 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:46.881592  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:46.881237  1454 catalog_manager.cc:5697] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 6 to 11, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:46.882254  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:46.882560  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:46.882886  1551 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.883071  1556 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:46.883116  1454 catalog_manager.cc:5697] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:46.733870  5359 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:46.777271  5385 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.885572  5385 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.886183  5396 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:46.778534  5234 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.890228  5234 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:46.890657  1556 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:46.836208  5391 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.858821  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:46.892068  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 1.03335e+06us
I20260709 13:00:46.853976  1628 rpcz_store.cc:276] 0709 13:00:45.823298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.858998 (+ 35700us) service_pool.cc:224] Handling call
0709 13:00:46.853608 (+994610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.764940  5165 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:00:46.902737  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 82607.7us
I20260709 13:00:46.774716  5482 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:00:46.831183  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 110307us
I20260709 13:00:46.811008  5425 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:46.692049  1709 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.012s	sys 0.024s
W20260709 13:00:46.907385  1709 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.012s	sys 0.024s
I20260709 13:00:46.785045  5463 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:46.784353  5274 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:46.814594  5393 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:46.813277  5408 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:46.932163  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.844838  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2121) took 1363 ms. Trace:
I20260709 13:00:46.933288  1559 rpcz_store.cc:276] 0709 13:00:45.481344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.482129 (+   785us) service_pool.cc:224] Handling call
0709 13:00:45.482553 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.482804 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.482841 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.483400 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.683822 (+200422us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:45.684047 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.684572 (+   525us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.844455 (+1159883us) raft_consensus.cc:1685] finished
0709 13:00:46.844474 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.844619 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":189985,"threads_started":1,"wal-append.queue_time_us":443520}
I20260709 13:00:46.846944  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 581) took 1004 ms. Trace:
I20260709 13:00:46.935436  1555 rpcz_store.cc:276] 0709 13:00:45.842782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.842977 (+   195us) service_pool.cc:224] Handling call
0709 13:00:46.846865 (+1003888us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.790858  5347 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:46.819367  5500 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.857522  1627 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:46.949205  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1922) took 1119 ms. Trace:
I20260709 13:00:46.949513  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:46.949708  1627 rpcz_store.cc:276] 0709 13:00:45.829835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.856446 (+1026611us) service_pool.cc:224] Handling call
0709 13:00:46.949114 (+ 92668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.854327  1706 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:46.854954  1633 rpcz_store.cc:276] 0709 13:00:45.811998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.817965 (+  5967us) service_pool.cc:224] Handling call
0709 13:00:46.854310 (+1036345us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:46.860312  5196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.018s	sys 0.025s
I20260709 13:00:46.818115  5443 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:46.874848  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:46.960932  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2216) took 1138 ms. Trace:
W20260709 13:00:46.878248  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 1.10206e+06us
I20260709 13:00:46.879416  5476 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:46.816855  5362 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:46.895849  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.968156  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 169155us
I20260709 13:00:46.884859  1454 catalog_manager.cc:5697] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 5 to 8, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:46.969058  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:46.969928  1631 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:46.819526  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1915) took 1008 ms. Trace:
I20260709 13:00:46.904883  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:46.972384  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:46.973111  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 68327us
I20260709 13:00:46.973637  1627 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:46.834923  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:46.904975  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:46.974774  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1916) took 1163 ms. Trace:
I20260709 13:00:46.830895  5370 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:46.909231  5509 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:46.910444  4939 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:46.911947  5510 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.913015  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:46.912705  5446 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:46.906610  5322 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:46.917730  5478 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.203s	user 0.010s	sys 0.016s
I20260709 13:00:46.918910  5348 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:46.919788  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2124) took 1110 ms. Trace:
I20260709 13:00:46.811472  5398 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:46.817901  5436 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:46.850896  5135 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.953126  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:46.907076  5284 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:46.958195  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1925) took 1036 ms. Trace:
W20260709 13:00:46.998936  5421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.267s	user 0.020s	sys 0.037s
I20260709 13:00:46.987030  5452 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:46.961444  1626 rpcz_store.cc:276] 0709 13:00:45.822536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.874576 (+1052040us) service_pool.cc:224] Handling call
0709 13:00:46.960849 (+ 86273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.975200  1627 rpcz_store.cc:276] 0709 13:00:45.811699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.950965 (+1139266us) service_pool.cc:224] Handling call
0709 13:00:46.974714 (+ 23749us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.972111  1632 rpcz_store.cc:276] 0709 13:00:45.810856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.824398 (+ 13542us) service_pool.cc:224] Handling call
0709 13:00:46.819468 (+995070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.978698  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2155) took 2247 ms. Trace:
I20260709 13:00:47.047559  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:46.980749  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1921) took 1151 ms. Trace:
I20260709 13:00:47.048355  1627 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:47.048532  1634 rpcz_store.cc:276] 0709 13:00:45.829473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.854811 (+1025338us) service_pool.cc:224] Handling call
0709 13:00:46.980490 (+125679us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b540035be54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:46.980660 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42779520}
W20260709 13:00:46.981891  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 77045.2us
I20260709 13:00:47.050922  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:47.051321  2271 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:46.930917  5165 consensus_queue.cc:1243] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:46.970688  1454 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 4 to 9, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:47.060400  1454 catalog_manager.cc:5697] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 6 to 9, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:46.982740  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:46.988847  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 154006us
I20260709 13:00:47.062093  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:46.836553  5479 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:46.991714  1706 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:47.062913  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2127) took 1225 ms. Trace:
I20260709 13:00:46.909312  5432 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:46.999583  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1920) took 1170 ms. Trace:
I20260709 13:00:46.993932  5299 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.064989  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 82335.2us
I20260709 13:00:47.074620  1600 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:47.075588  1635 rpcz_store.cc:276] 0709 13:00:45.829124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.912660 (+1083536us) service_pool.cc:224] Handling call
0709 13:00:46.999510 (+ 86850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.076377  1702 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:47.014523  1704 rpcz_store.cc:276] 0709 13:00:45.809536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.809651 (+   115us) service_pool.cc:224] Handling call
0709 13:00:45.816281 (+  6630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.816529 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.816555 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.825641 (+  9086us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.817895 (+992254us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:46.817932 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.818000 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.919517 (+101517us) raft_consensus.cc:1685] finished
0709 13:00:46.919543 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.919715 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":889969,"threads_started":1,"wal-append.queue_time_us":1005160}
W20260709 13:00:47.021534  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 128082us
I20260709 13:00:47.036188  5135 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.072722  1454 catalog_manager.cc:5697] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 4 to 8, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:46.933578  5385 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:47.091560  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:47.025380  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1924) took 1111 ms. Trace:
I20260709 13:00:47.027112  1628 rpcz_store.cc:276] 0709 13:00:45.922016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.907458 (+985442us) service_pool.cc:224] Handling call
0709 13:00:46.958082 (+ 50624us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.963531  1554 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:47.029454  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 60479.2us
I20260709 13:00:47.093531  1633 rpcz_store.cc:276] 0709 13:00:45.914379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.952729 (+1038350us) service_pool.cc:224] Handling call
0709 13:00:47.025307 (+ 72578us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.986860  5028 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:46.990684  5408 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:47.044886  2268 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:00:47.105755  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.984126  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:47.047312  1708 rpcz_store.cc:276] 0709 13:00:44.731296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.181611 (+450315us) service_pool.cc:224] Handling call
0709 13:00:45.182013 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.820173 (+1638160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.978344 (+158171us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400220454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:46.978620 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3761469312}
I20260709 13:00:47.063233  1706 rpcz_store.cc:276] 0709 13:00:45.837805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.672161 (+834356us) service_pool.cc:224] Handling call
0709 13:00:47.062860 (+390699us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.063455  1551 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:47.064620  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:47.046614  5421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.315s	user 0.021s	sys 0.037s
I20260709 13:00:47.023231  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.110759  1634 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:00:47.111093  2265 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:46.999287  5503 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:47.080288  1454 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 5 to 7, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:47.111387  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2208) took 1573 ms. Trace:
I20260709 13:00:47.113281  1634 rpcz_store.cc:276] 0709 13:00:45.538256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.064346 (+1526090us) service_pool.cc:224] Handling call
0709 13:00:47.110531 (+ 46185us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.111160 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.111340 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.113682  1454 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 9 to 10, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.084661  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:46.999428  5504 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.097643  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:47.097800  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:47.118588  1559 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:47.045897  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.108316  2269 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:47.118518  1454 catalog_manager.cc:5697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:47.108654  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.109875  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:47.121410  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.121763  1706 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:47.123274  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.124655  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.125118  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.125849  2265 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:47.125291  2269 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:47.126223  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:47.124691  1454 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 7 to 9, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.128994  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:47.133287  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.081655  5423 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:47.020861  5396 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:00:47.125521  5519 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.141454  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:47.129565  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 78737.2us
I20260709 13:00:47.142174  2265 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:47.133559  1454 catalog_manager.cc:5697] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 2 to 6, term changed from 6 to 7, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to <none>, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:47.137753  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:46.961431  5500 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:47.099987  5002 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:47.147871  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.148923  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.151767  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.152170  2266 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:47.149313  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:47.112694  5426 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.099447  5028 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:47.125391  1632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:00:47.126399  5452 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:47.125231  5503 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:47.160413  1632 raft_consensus.cc:606] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:47.109511  5408 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:47.167459  5408 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.156479  5509 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:47.173434  5509 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:47.153614  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.142699  5453 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.181803  2262 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 4.
I20260709 13:00:47.180486  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:47.144677  1454 catalog_manager.cc:5697] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 2 to 7, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.108419  5361 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:47.155328  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.152117  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:47.157709  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:47.159001  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.148190  5432 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:47.144181  5477 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.021s	user 0.013s	sys 0.003s
I20260709 13:00:47.160817  1555 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:47.149746  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2156) took 2415 ms. Trace:
I20260709 13:00:47.091856  5299 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:47.093830  5469 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:00:47.163396  5426 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:47.144243  5196 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:00:47.138522  5456 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:47.166944  5370 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:47.223143  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.254302  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 192308us
I20260709 13:00:47.185766  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:47.138803  5423 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:47.021508  5510 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 13:00:47.163589  5508 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:47.173852  5509 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.356684  5463 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:47.177580  5274 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:47.357012  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.357262  5435 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:47.357986  5386 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.000s
I20260709 13:00:47.358932  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:47.183337  1553 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:47.184185  1454 catalog_manager.cc:5697] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 8 to 9, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:47.360737  2269 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.264917  2267 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:47.241822  1635 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:47.344110  1632 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:47.401274  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1926) took 1473 ms. Trace:
I20260709 13:00:47.363384  2235 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:47.402808  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:47.392755  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 576) took 1579 ms. Trace:
I20260709 13:00:47.401724  1632 rpcz_store.cc:276] 0709 13:00:45.927475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.343253 (+1415778us) service_pool.cc:224] Handling call
0709 13:00:47.343672 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.400961 (+ 57289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.401206 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.405206  1558 rpcz_store.cc:276] 0709 13:00:45.813025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.813190 (+   165us) service_pool.cc:224] Handling call
0709 13:00:45.856784 (+ 43594us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.857182 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.857233 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.898755 (+ 41522us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.813003 (+914248us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:46.813041 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.813117 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.392460 (+579343us) raft_consensus.cc:1685] finished
0709 13:00:47.392491 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.392676 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":546,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":55504,"thread_start_us":130568,"threads_started":1,"wal-append.queue_time_us":1039975}
I20260709 13:00:47.303944  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:47.371973  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 219936us
I20260709 13:00:47.377506  1555 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:00:47.368974  1700 rpcz_store.cc:276] 0709 13:00:44.734144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.258579 (+524435us) service_pool.cc:224] Handling call
0709 13:00:45.259087 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.266617 (+  7530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.266648 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.267211 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.610073 (+342862us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:45.610130 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.610224 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.917061 (+1306837us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:47.139587 (+222526us) raft_consensus.cc:1685] finished
0709 13:00:47.139609 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.149693 (+ 10084us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4035,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":173090048,"thread_start_us":330980,"threads_started":1,"wal-append.queue_time_us":446835}
I20260709 13:00:47.378683  5452 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:47.378849  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2203) took 1859 ms. Trace:
I20260709 13:00:47.379930  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2123) took 1570 ms. Trace:
I20260709 13:00:47.410632  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:47.381440  5520 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.189455  5515 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:00:47.381552  5421 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:00:47.342715  5474 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.601s	user 0.016s	sys 0.011s
I20260709 13:00:47.158214  5519 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:47.366354  5396 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.382164  5425 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:47.241004  5453 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:47.384320  5426 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:47.175557  5459 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:47.177201  5500 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:47.175647  5028 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:47.387423  5319 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.674s	user 0.011s	sys 0.000s
I20260709 13:00:47.410279  1555 pending_rounds.cc:85] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 5
I20260709 13:00:47.410847  1627 rpcz_store.cc:276] 0709 13:00:45.519704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.066718 (+1547014us) service_pool.cc:224] Handling call
0709 13:00:47.067007 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.067212 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:47.337633 (+270421us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.378514 (+ 40881us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.378582 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:47.378625 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.378690 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.378805 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12226,"prepare.queue_time_us":320793,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":119,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":264241,"threads_started":2,"wal-append.queue_time_us":48535}
W20260709 13:00:47.424844  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.178507  5393 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:47.149503  4939 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:47.175420  5479 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:47.245632  5398 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:47.915835  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.916462  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.223090  1555 pending_rounds.cc:107] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:00:48.223500  1555 raft_consensus.cc:2889] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:47.399801  1454 catalog_manager.cc:5697] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 6 to 7, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:47.866874  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:48.077708  2269 consensus_meta.cc:287] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
W20260709 13:00:47.374439  5070 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.004s
W20260709 13:00:47.846825  1551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.033s	sys 0.085s
W20260709 13:00:48.232393  1551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.065s	user 0.035s	sys 0.085s
I20260709 13:00:47.470995  1632 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:48.234179  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1927) took 2286 ms. Trace:
I20260709 13:00:48.225057  1558 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:48.234968  1627 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:48.226174  2269 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 5.
W20260709 13:00:47.590608  1701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.004s	sys 0.011s
I20260709 13:00:47.646173  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:48.235900  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 855) took 1107 ms. Trace:
I20260709 13:00:47.410903  1709 rpcz_store.cc:276] 0709 13:00:45.809139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.809312 (+   173us) service_pool.cc:224] Handling call
0709 13:00:45.855251 (+ 45939us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:46.907788 (+1052537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.907823 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:46.908419 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 13:00:47.088068 (+179649us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:47.253566 (+165498us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.379606 (+126040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.379678 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.379715 (+    37us) raft_consensus.cc:1685] finished
0709 13:00:47.379732 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.379876 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149044,"prepare.queue_time_us":62935,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":2936,"raft.queue_time_us":465446,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":236,"thread_start_us":1231253,"threads_started":3,"wal-append.queue_time_us":193289}
I20260709 13:00:47.512795  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:47.178274  5503 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:48.240723  2267 raft_consensus.cc:2393] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:48.241639  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 797) took 1054 ms. Trace:
I20260709 13:00:47.587909  1560 raft_consensus.cc:2955] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 3 to 8, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:48.225090  1454 catalog_manager.cc:5697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:47.515043  1629 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:48.218808  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 306974us
W20260709 13:00:48.218441  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.249189  1454 catalog_manager.cc:5697] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 1 to 6, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 6 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:48.250082  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.250451  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.222220  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:48.221439  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:48.239507  2269 rpcz_store.cc:276] 0709 13:00:47.128682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.148906 (+ 20224us) service_pool.cc:224] Handling call
0709 13:00:48.235841 (+1086935us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.235729  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 752) took 1154 ms. Trace:
W20260709 13:00:48.236093  1701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.248s	user 0.008s	sys 0.021s
I20260709 13:00:48.252043  1627 rpcz_store.cc:276] 0709 13:00:47.081618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.234364 (+1152746us) service_pool.cc:224] Handling call
0709 13:00:48.234675 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.235519 (+   844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.235661 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.361910  5507 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:47.354547  5347 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:48.249361  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:48.304373  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:47.389333  5232 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:48.258078  2266 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:48.007592  5135 consensus_meta.cc:287] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.897s	user 0.011s	sys 0.000s
I20260709 13:00:48.234674  1632 rpcz_store.cc:276] 0709 13:00:45.948266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.406384 (+1458118us) service_pool.cc:224] Handling call
0709 13:00:47.470641 (+ 64257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.233823 (+763182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.234100 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.250690  1454 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 4 to 7, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:47.374718  5423 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.319346  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2167) took 2478 ms. Trace:
I20260709 13:00:48.320088  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:47.552171  5370 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:47.977185  5463 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:47.359699  5353 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.574069  5353 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:47.304841  5234 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:48.576072  5234 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:48.577323  1634 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:48.578619  5475 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 2.868s	user 0.013s	sys 0.031s
I20260709 13:00:48.579989  5510 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:48.580525  5510 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.576876  2263 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:48.581094  5510 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:48.582285  2263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 846) took 1461 ms (client timeout 1535 ms). Trace:
W20260709 13:00:48.583367  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.112s	user 0.011s	sys 0.040s
W20260709 13:00:48.583833  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.011s	sys 0.040s
I20260709 13:00:48.222604  5421 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:47.366714  5487 consensus_queue.cc:1059] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.944s
I20260709 13:00:48.588656  1558 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:00:48.589704  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1950) took 1118 ms. Trace:
I20260709 13:00:48.004172  5530 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.497812  1526 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.605s (SENT) [suppressed 14 similar messages]
W20260709 13:00:48.372939  1706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.009s	sys 0.017s
W20260709 13:00:47.554980  5522 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:00:48.304061  5199 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:47.609952  5361 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:48.230525  5196 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.564577  1555 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:48.536072  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:48.567019  5463 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.565682  2265 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:48.055554  5436 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:00:47.845940  5527 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.644805  5322 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.051s	sys 0.056s
W20260709 13:00:48.658413  5322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.615s	user 0.054s	sys 0.080s
I20260709 13:00:48.658811  5322 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 8 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:48.660167  5322 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:47.666841  5452 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.561116  1454 catalog_manager.cc:5697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 3 to 7, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 7 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.535635  5393 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.550554  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:48.568077  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:48.560766  5232 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:47.512691  5386 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.672209  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1945) took 1515 ms. Trace:
I20260709 13:00:48.672622  1551 rpcz_store.cc:276] 0709 13:00:47.157307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.157416 (+   109us) service_pool.cc:224] Handling call
0709 13:00:47.166394 (+  8978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.166606 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.166629 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.167130 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.233012 (+1065882us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:48.233075 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.233350 (+   275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.671999 (+438649us) raft_consensus.cc:1685] finished
0709 13:00:48.672018 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.672150 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1065424,"threads_started":1,"wal-append.queue_time_us":1470565}
I20260709 13:00:48.673905  5386 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:48.564301  5370 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.674388  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:48.674777  5370 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.674865  5443 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:48.676218  5421 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:48.676661  5371 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.631631  5540 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:48.681053  5540 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.681432  5540 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.304726  5319 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.682390  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:48.683260  2268 raft_consensus.cc:2410] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:48.683573  5370 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.684159  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:48.684651  5319 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:48.686170  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1919) took 2857 ms (client timeout 2155 ms). Trace:
W20260709 13:00:48.686636  5528 log.cc:927] Time spent T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:48.686808  5370 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:48.674698  5476 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.682s	user 0.011s	sys 0.000s
I20260709 13:00:48.690359  5476 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:48.691017  5234 raft_consensus.cc:3055] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:48.691514  5234 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:48.692420  5234 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:48.693598  5234 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.321815  5479 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:48.313155  5521 consensus_queue.cc:1175] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6923294c847b48ebb577e0935d316aa3" responder_term: 11 status { last_received { term: 11 index: 6 } last_committed_idx: 3 last_received_current_leader { term: 11 index: 6 } }
I20260709 13:00:48.256098  5396 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:48.572225  5284 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.519s	user 0.010s	sys 0.000s
I20260709 13:00:48.577306  5456 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:48.580569  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2213) took 3040 ms. Trace:
W20260709 13:00:48.582638  2263 rpcz_store.cc:269] 0709 13:00:47.121021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.121156 (+   135us) service_pool.cc:224] Handling call
0709 13:00:48.581965 (+1460809us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400692dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:48.582230 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3345928576}
W20260709 13:00:48.584384  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 1.17441e+06us
I20260709 13:00:48.242159  2267 rpcz_store.cc:276] 0709 13:00:47.187217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.512509 (+325292us) service_pool.cc:224] Handling call
0709 13:00:48.241559 (+729050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.304637  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:48.560271  1701 rpcz_store.cc:276] 0709 13:00:45.774582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.779938 (+  5356us) service_pool.cc:224] Handling call
0709 13:00:45.780236 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.780452 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:45.868445 (+ 87993us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.952353 (+1083908us) log.cc:844] Serialized 14 byte log entry
0709 13:00:48.252247 (+1299894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:48.252306 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:48.252355 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.252428 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.252557 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69929,"prepare.queue_time_us":331200,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":142476,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":23707,"spinlock_wait_cycles":4740864,"thread_start_us":2347475,"threads_started":3,"wal-append.queue_time_us":948328}
I20260709 13:00:48.062294  5525 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:48.122468  5385 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:48.582633  5391 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.691s	user 0.010s	sys 0.003s
I20260709 13:00:48.555377  5507 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:48.589252  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2152) took 3868 ms. Trace:
I20260709 13:00:48.701417  1634 rpcz_store.cc:276] 0709 13:00:45.539669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.114141 (+1574472us) service_pool.cc:224] Handling call
0709 13:00:47.114462 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.578103 (+1463641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.580342 (+  2239us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400357354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:48.580517 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3364044032}
W20260709 13:00:48.610370  1552 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.025s	sys 0.051s
W20260709 13:00:48.722165  1552 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.026s	sys 0.051s
W20260709 13:00:48.612186  1706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.012s	sys 0.029s
I20260709 13:00:48.590269  1558 rpcz_store.cc:276] 0709 13:00:47.471114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.615857 (+144743us) service_pool.cc:224] Handling call
0709 13:00:48.589617 (+973760us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.723738  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2171) took 1597 ms. Trace:
I20260709 13:00:48.724244  1706 rpcz_store.cc:276] 0709 13:00:47.126786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.132641 (+  5855us) service_pool.cc:224] Handling call
0709 13:00:47.150551 (+ 17910us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.243120 (+ 92569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.243166 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.360041 (+116875us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.723307 (+1363266us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:48.723361 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.723445 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.723499 (+    54us) raft_consensus.cc:1685] finished
0709 13:00:48.723517 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.723671 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35956,"raft.queue_time_us":223934,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":1048757,"threads_started":1,"wal-append.queue_time_us":1106072}
W20260709 13:00:48.533285  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 283987us
I20260709 13:00:48.726943  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:48.564597  5435 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.623867  2262 raft_consensus.cc:2410] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 10 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:00:48.253966  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 753) took 1172 ms. Trace:
W20260709 13:00:48.643620  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.728176  1627 rpcz_store.cc:276] 0709 13:00:47.081941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.252958 (+1171017us) service_pool.cc:224] Handling call
0709 13:00:48.253342 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.253581 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.253614 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:48.253665 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:48.253708 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.253776 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.253903 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.729707  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42422
I20260709 13:00:48.730523  1627 raft_consensus.cc:606] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Received request to transfer leadership
I20260709 13:00:48.730832  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2162) took 3062 ms. Trace:
I20260709 13:00:48.650574  5519 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:48.654874  5408 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.487s	user 0.010s	sys 0.001s
I20260709 13:00:48.256794  5520 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:48.654309  5510 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:48.664074  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.785050  1599 leader_election.cc:336] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.507s (SENT)
W20260709 13:00:48.669215  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 118751us
I20260709 13:00:48.567124  5135 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.670295  5426 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:48.670099  5393 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.671574  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:48.667528  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:48.686604  1629 rpcz_store.cc:269] 0709 13:00:45.828703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.835693 (+1006990us) service_pool.cc:224] Handling call
0709 13:00:48.685899 (+1850206us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b540034dfd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:48.686074 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513575296}
I20260709 13:00:48.321570  5070 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.694324  1626 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:48.715507  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.715379  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:48.715684  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:48.716894  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:48.635903  5463 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.616676  5361 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.730957  1627 raft_consensus.cc:614] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:48.732193  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2210) took 3193 ms. Trace:
W20260709 13:00:48.654248  5523 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.655s	user 0.000s	sys 0.001s
I20260709 13:00:48.731503  1702 rpcz_store.cc:276] 0709 13:00:45.668234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.669565 (+  1331us) service_pool.cc:224] Handling call
0709 13:00:45.669863 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.076754 (+1406891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.730510 (+1653756us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001c3ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:48.730755 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3234550144}
I20260709 13:00:48.632298  5299 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:48.774581  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 47724.4us
I20260709 13:00:48.778319  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 804) took 1131 ms. Trace:
I20260709 13:00:48.780169  2262 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:48.719547  1707 rpcz_store.cc:276] 0709 13:00:44.720739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.176043 (+455304us) service_pool.cc:224] Handling call
0709 13:00:45.176460 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.176905 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.176948 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.177570 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.466360 (+288790us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:45.466416 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.466516 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.261816 (+1795300us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:48.564129 (+1302313us) raft_consensus.cc:1685] finished
0709 13:00:48.564150 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.589184 (+ 25034us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4835,"raft.queue_time_us":31848,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":8194,"spinlock_wait_cycles":61222784,"thread_start_us":288335,"threads_started":1,"wal-append.queue_time_us":460221}
I20260709 13:00:48.695850  1447 maintenance_manager.cc:419] P 72b78a86b5e34075b0982caa9c5426ab: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033349
I20260709 13:00:48.779002  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:48.788546  1554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2129) took 1909 ms (client timeout 1752 ms). Trace:
I20260709 13:00:48.789255  1559 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:48.785600  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:48.618136  5530 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.668699  5527 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.631507  5196 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:48.695386  5453 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:48.693966  5476 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:48.622629  5199 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.927421  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2130) took 1872 ms. Trace:
I20260709 13:00:48.833330  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 755) took 1720 ms. Trace:
I20260709 13:00:48.832399  5507 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:48.921849  1558 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:49.021260  2268 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.935745  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:48.856307  5423 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.949268  5510 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:48.846483  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2129) took 1793 ms. Trace:
I20260709 13:00:48.999722  5525 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.938745  2235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.017s	sys 0.029s
W20260709 13:00:49.028081  2235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.017s	sys 0.029s
W20260709 13:00:48.934458  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 146740us
W20260709 13:00:48.939322  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.935451  1555 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:48.936136  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42422 (request call id 0) took 1826 ms. Trace:
I20260709 13:00:49.031679  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:48.858351  2270 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:00:49.032344  2270 pending_rounds.cc:85] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 8
I20260709 13:00:49.033260  5501 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:49.030968  5347 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.694639  5479 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.034587  5347 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.944959  2267 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:48.700423  5396 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:48.945142  1554 rpcz_store.cc:269] 0709 13:00:46.879464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.881352 (+  1888us) service_pool.cc:224] Handling call
0709 13:00:48.788267 (+1906915us) spinlock_profiling.cc:243] Waited 81 ms on lock 0x7b540030b954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:48.788459 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186267904}
I20260709 13:00:49.035934  4939 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:49.036374  4939 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.036739  4939 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:48.807255  5537 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:00:49.032040  1627 rpcz_store.cc:276] 0709 13:00:47.110479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.729531 (+1619052us) service_pool.cc:224] Handling call
0709 13:00:48.936064 (+206533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.771512  5506 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.038295  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1948) took 1681 ms. Trace:
I20260709 13:00:49.038511  5506 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:48.839038  5432 consensus_meta.cc:287] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.444s	user 0.010s	sys 0.000s
I20260709 13:00:49.038666  1552 rpcz_store.cc:276] 0709 13:00:47.356535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.356740 (+   205us) service_pool.cc:224] Handling call
0709 13:00:47.357057 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.357383 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.357409 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.357849 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.591387 (+233538us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:47.605576 (+ 14189us) log.cc:844] Serialized 14 byte log entry
0709 13:00:48.722635 (+1117059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.722746 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.038068 (+315322us) raft_consensus.cc:1685] finished
0709 13:00:49.038098 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.038236 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":305519,"prepare.queue_time_us":1025508,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":1162125,"raft.run_cpu_time_us":597,"raft.run_wall_time_us":150292,"thread_start_us":1057681,"threads_started":3,"wal-append.queue_time_us":1255477}
W20260709 13:00:49.013108  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2187) took 3885 ms (client timeout 2644 ms). Trace:
I20260709 13:00:48.938505  5363 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.935972  5426 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:49.040969  1552 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:00:49.041239  5426 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.041644  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1956) took 1389 ms. Trace:
W20260709 13:00:48.942238  5446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.012s	sys 0.014s
W20260709 13:00:48.943816  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 228586us
I20260709 13:00:48.782981  5435 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.017424  1634 rpcz_store.cc:276] 0709 13:00:47.113339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.721324 (+1607985us) service_pool.cc:224] Handling call
0709 13:00:48.832852 (+111528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.833030 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.833055 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:48.833093 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:48.833123 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.833175 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.833273 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.935369  2269 rpcz_store.cc:276] 0709 13:00:47.646472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.304368 (+657896us) service_pool.cc:224] Handling call
0709 13:00:48.778254 (+473886us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.017338  1704 rpcz_store.cc:276] 0709 13:00:47.055479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.096185 (+ 40706us) service_pool.cc:224] Handling call
0709 13:00:47.103434 (+  7249us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:47.379036 (+275602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.379070 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:47.379663 (+   593us) log.cc:844] Serialized 52 byte log entry
0709 13:00:47.381157 (+  1494us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:47.381461 (+   304us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.381631 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.872780 (+1491149us) spinlock_profiling.cc:243] Waited 77.1 ms on lock 0x7b54001ac7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:48.872852 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.872918 (+    66us) raft_consensus.cc:1685] finished
0709 13:00:48.927110 (+ 54192us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.927336 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198016,"prepare.queue_time_us":18093,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":275884,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":434947712,"thread_start_us":1145,"threads_started":1,"wal-append.queue_time_us":1170403}
I20260709 13:00:49.019819  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:48.936622  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 805) took 1289 ms. Trace:
W20260709 13:00:49.003512  5028 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.001s
I20260709 13:00:49.021786  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1953) took 1370 ms. Trace:
I20260709 13:00:48.837088  5503 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:49.026290  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 90628.2us
I20260709 13:00:49.025542  1705 rpcz_store.cc:276] 0709 13:00:47.052917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.053066 (+   149us) service_pool.cc:224] Handling call
0709 13:00:47.053390 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.053756 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.053790 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.054467 (+   677us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.135930 (+ 81463us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:47.135983 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.136102 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.846226 (+1710124us) raft_consensus.cc:1685] finished
0709 13:00:48.846253 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.846415 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84939,"raft.queue_time_us":89694,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":7760,"thread_start_us":10602,"threads_started":1,"wal-append.queue_time_us":1444505}
I20260709 13:00:48.937369  1635 rpcz_store.cc:276] 0709 13:00:45.538793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.107311 (+1568518us) service_pool.cc:224] Handling call
0709 13:00:47.139371 (+ 32060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.400631 (+261260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.731849 (+1331218us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b5400088ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:48.732099 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115642624}
W20260709 13:00:49.026870  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.115s	user 0.030s	sys 0.017s
I20260709 13:00:49.031927  5524 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.034240  5501 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:48.939628  5361 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.000913  5544 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.925570  5408 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:49.040802  1631 rpcz_store.cc:269] 0709 13:00:45.127324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.128013 (+   689us) service_pool.cc:224] Handling call
0709 13:00:49.012772 (+3884759us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54003377d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:49.013004 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3868664192}
I20260709 13:00:49.043409  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1947) took 1802 ms. Trace:
I20260709 13:00:49.032860  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1955) took 1381 ms. Trace:
I20260709 13:00:49.061852  1555 rpcz_store.cc:276] 0709 13:00:47.651783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.702802 (+1051019us) service_pool.cc:224] Handling call
0709 13:00:49.032797 (+329995us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:49.033118  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.033823  2270 pending_rounds.cc:107] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 8.9
W20260709 13:00:49.001212  2233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.017s	sys 0.023s
W20260709 13:00:49.063865  2233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.017s	sys 0.024s
I20260709 13:00:48.772997  5391 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:49.035873  5396 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:00:49.041971  1552 rpcz_store.cc:276] 0709 13:00:47.652096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.040403 (+1388307us) service_pool.cc:224] Handling call
0709 13:00:49.040733 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.041404 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.041593 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.782258  5365 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:49.046840  2263 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:49.047328  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:49.049510  2262 rpcz_store.cc:276] 0709 13:00:47.646849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.772183 (+1125334us) service_pool.cc:224] Handling call
0709 13:00:48.779977 (+  7794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.936369 (+156392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.936568 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.050812  1558 rpcz_store.cc:276] 0709 13:00:47.651129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.778393 (+1127264us) service_pool.cc:224] Handling call
0709 13:00:48.921574 (+143181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.021449 (+ 99875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.021713 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.052095  1632 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:48.951939  5070 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:49.053741  2266 raft_consensus.cc:2410] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 10 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:00:49.053944  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.030s	sys 0.017s
I20260709 13:00:49.024843  5456 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:49.053629  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:49.048089  5446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.012s	sys 0.015s
I20260709 13:00:49.079609  1556 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:49.081298  1524 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:49.083035  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.085253  1551 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:49.050145  5363 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.086475  5299 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:49.086925  5299 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:49.087292  5299 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.087893  5363 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:49.088711  1556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1938) took 1997 ms (client timeout 1672 ms). Trace:
W20260709 13:00:49.089130  1556 rpcz_store.cc:269] 0709 13:00:47.091057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.091200 (+   143us) service_pool.cc:224] Handling call
0709 13:00:49.088518 (+1997318us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54001d38d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:49.088644 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4570046208}
I20260709 13:00:49.066118  5453 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:49.090400  5453 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:49.056834  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 271840us
I20260709 13:00:49.056797  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:49.093454  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:49.036386  5479 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:49.046306  5507 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:49.063802  2270 raft_consensus.cc:2889] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:49.014616  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 516868us
W20260709 13:00:49.130249  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 61685us
W20260709 13:00:49.136336  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.137835  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 122936us
I20260709 13:00:49.055135  5028 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.085474  5322 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:49.083309  5519 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.123512  2262 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:49.135799  1600 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:49.123612  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:00:49.110960  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.130057  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.141163  2269 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:49.059087  5524 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.074929  5365 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.141970  5456 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.143713  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:49.129528  1673 connection.cc:256] RPC call timeout handler was delayed by -1.9055171539999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 13:00:49.087944  5506 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:49.088752  5393 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.139473  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:49.145547  1555 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:49.128813  5443 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:49.155230  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:49.155772  1673 connection.cc:256] RPC call timeout handler was delayed by -1.888417153999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:00:49.138271  5370 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.092646  5385 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:00:49.164633  1552 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:49.166469  1599 leader_election.cc:336] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.672s (SENT)
I20260709 13:00:49.164575  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.158463  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:49.134636  5284 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:49.164987  1673 connection.cc:256] RPC call timeout handler was delayed by -1.8596171539999773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 13:00:49.140100  5396 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:49.167411  1599 leader_election.cc:336] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.730s (SENT)
W20260709 13:00:49.167621  1673 connection.cc:256] RPC call timeout handler was delayed by -1.5878171539999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 13:00:49.167829  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:49.168984  1673 connection.cc:256] RPC call timeout handler was delayed by -1.5437171539999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
W20260709 13:00:49.169553  1673 connection.cc:256] RPC call timeout handler was delayed by -1.3826171540000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 13:00:49.170333  1673 connection.cc:256] RPC call timeout handler was delayed by -1.3502171540000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
I20260709 13:00:49.134373  5507 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:49.170846  1673 connection.cc:256] RPC call timeout handler was delayed by -1.335817153999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 13:00:49.171288  1673 connection.cc:256] RPC call timeout handler was delayed by -1.3304171539999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260709 13:00:49.171669  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1963171539999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2304s for a response
I20260709 13:00:49.175999  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:49.177101  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:49.179477  1555 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:49.179592  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:49.066443  5544 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:49.154980  5070 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:49.183409  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:49.163550  5347 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:49.048954  5525 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.184746  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:49.170014  5506 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:49.192704  1555 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:49.175454  5507 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.169158  5393 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:49.153019  5542 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:49.170444  5396 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:49.194353  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:49.145010  5554 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:00:49.153154  5519 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.177342  5386 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.214478  5530 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:49.215330  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:49.197324  5548 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:00:49.177193  5555 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:49.211598  1552 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:49.187331  5545 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:00:49.217443  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:49.174645  5370 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.163311  5456 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 13:00:49.219180  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.207742  5520 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:49.207247  5196 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:49.218910  5234 consensus_meta.cc:287] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.525s	user 0.013s	sys 0.000s
W20260709 13:00:49.221922  5553 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:00:49.221962  5432 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:49.177081  5284 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.199765  5135 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:49.190716  5421 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:49.190109  5551 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:49.231454  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.236181  5559 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:49.210130  5542 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:49.239208  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:49.213852  5386 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:49.211819  5506 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:49.279148  2264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 952) took 3998 ms (client timeout 1666 ms). Trace:
I20260709 13:00:49.231547  5555 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:49.234381  5423 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.346243  1552 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:49.347936  2264 rpcz_store.cc:269] 0709 13:00:45.271517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.275419 (+  3902us) service_pool.cc:224] Handling call
0709 13:00:49.270006 (+3994587us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b540005ee54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:49.270169 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575066496}
I20260709 13:00:49.245826  2268 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:49.349280  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.232923  5234 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:49.353204  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 185829us
W20260709 13:00:49.285269  5557 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:00:49.279064  5549 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
W20260709 13:00:49.315735  5552 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
W20260709 13:00:49.369310  1599 leader_election.cc:336] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.749s (SENT)
I20260709 13:00:49.373157  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:49.250447  5199 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:49.369299  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.251508  5391 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:49.307811  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 164166us
I20260709 13:00:49.271106  5503 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.382185  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:49.383235  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:49.242658  5432 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:49.375926  1599 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:49.386495  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:49.344811  5544 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:49.314275  5284 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.384315  5443 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:49.378861  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.393412  2266 raft_consensus.cc:2410] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:49.380239  1552 raft_consensus.cc:2410] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:00:49.294119  5408 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.280104  5456 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:49.370080  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.394805  2264 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:49.351346  5542 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.370843  5028 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.399132  2264 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:00:49.389613  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:49.245463  5196 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:00:49.366789  5559 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.347189  4939 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:49.403055  5559 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.368029  5551 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.391255  5070 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:49.390865  5393 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:49.397823  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:49.373255  5524 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:49.378504  5423 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:49.256176  5396 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.391240  5432 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:49.389084  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 209540us
I20260709 13:00:49.392606  5234 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.397454  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:49.414881  2266 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:00:49.415589  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1954) took 1764 ms. Trace:
I20260709 13:00:49.403715  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 806) took 1752 ms. Trace:
I20260709 13:00:49.416056  5567 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
W20260709 13:00:49.419785  5509 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.904s	user 0.012s	sys 0.000s
W20260709 13:00:49.416240  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 226925us
I20260709 13:00:49.406126  5456 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:49.417989  1552 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:49.426407  2264 rpcz_store.cc:276] 0709 13:00:47.647326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.398564 (+1751238us) service_pool.cc:224] Handling call
0709 13:00:49.398916 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.399553 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.399734 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.427726  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:49.432701  5370 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:49.415903  5385 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:00:49.428208  1524 connection.cc:256] RPC call timeout handler was delayed by -3.4907006589999696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 13:00:49.416435  5540 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.735s	user 0.008s	sys 0.003s
I20260709 13:00:49.426478  1554 rpcz_store.cc:276] 0709 13:00:47.651442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.036443 (+1385001us) service_pool.cc:224] Handling call
0709 13:00:49.036824 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.043242 (+  6418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.043278 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.043718 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:00:49.067050 (+ 23332us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:49.067106 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.067196 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.415369 (+348173us) raft_consensus.cc:1685] finished
0709 13:00:49.415393 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.415532 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6029,"raft.queue_time_us":6849,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4274,"thread_start_us":22993,"threads_started":1,"wal-append.queue_time_us":122367}
I20260709 13:00:49.404271  5525 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.407891  5519 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.429816  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:49.409358  5391 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:49.433653  5506 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.431831  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:49.434417  1524 connection.cc:256] RPC call timeout handler was delayed by -3.1632569589999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
I20260709 13:00:49.439944  2264 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:49.440946  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.439934  1524 connection.cc:256] RPC call timeout handler was delayed by -3.1066512419999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
W20260709 13:00:49.441545  1599 leader_election.cc:336] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.924s (SENT)
I20260709 13:00:49.429077  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 807) took 1781 ms. Trace:
I20260709 13:00:49.443357  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:49.432024  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:49.434078  5435 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:49.439025  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.415822  5070 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:49.445398  1555 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:00:49.445925  5563 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.414563  5544 consensus_queue.cc:1059] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:00:49.452666  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:49.443480  2266 rpcz_store.cc:276] 0709 13:00:47.647709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.399919 (+1752210us) service_pool.cc:224] Handling call
0709 13:00:49.409844 (+  9925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.428778 (+ 18934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.429010 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:49.431797  5423 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:49.442956  1524 connection.cc:256] RPC call timeout handler was delayed by -2.9858317000000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
I20260709 13:00:49.451381  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:49.456194  1524 connection.cc:256] RPC call timeout handler was delayed by -2.9842370490000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
I20260709 13:00:49.450330  5386 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:49.439450  5396 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.444712  5424 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:49.452154  5070 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:49.476577  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:49.477254  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:49.443089  5525 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.440330  5391 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:49.476140  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:49.477047  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:49.480461  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:49.451812  5565 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:49.481920  1627 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
W20260709 13:00:49.486392  1524 connection.cc:256] RPC call timeout handler was delayed by -2.1190832479999813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
I20260709 13:00:49.488400  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:49.485802  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:49.490478  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:49.490767  1524 connection.cc:256] RPC call timeout handler was delayed by -2.0273423689999959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
I20260709 13:00:49.490341  1633 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:49.492081  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:49.492611  5544 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.488833  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:49.497025  1524 connection.cc:256] RPC call timeout handler was delayed by -1.7015423689999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
I20260709 13:00:49.493162  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:49.455806  5423 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.506738  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:49.500168  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:49.514847  1629 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:49.516024  1627 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:49.435343  5509 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.481325  5386 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:49.519029  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.507131  5519 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:49.521407  5519 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.523675  5519 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.490008  5391 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.521417  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:49.526414  2264 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:49.494961  4939 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:49.527647  5566 raft_consensus.cc:3055] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:49.530593  5463 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.001s
I20260709 13:00:49.419843  5555 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:49.516191  5423 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.439230  5540 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:49.536603  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:49.479262  5506 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:00:49.538822  1553 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:49.489830  5525 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.513962  5393 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:00:49.540874  1554 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:49.493141  5544 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.455322  5443 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:49.524767  5385 raft_consensus.cc:2764] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:49.494554  5361 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.533341  5386 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:49.546452  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.551594  5525 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:49.552687  5571 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:49.552845  5551 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.479640  5563 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:49.541263  5566 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:49.520340  5299 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.540374  5463 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.554289  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.582528  2262 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:49.571061  1555 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:49.774839  2266 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 5.
I20260709 13:00:49.782555  5375 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:49.783002  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:49.783473  5567 raft_consensus.cc:3055] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:49.783761  2266 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 8: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:49.784698  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.784035  5567 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:49.785298  2266 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:49.785791  4939 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:00:49.635674  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.786845  5424 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:49.787213  5424 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:49.786473  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.778110  5559 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:49.781306  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:49.624380  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:49.787997  5424 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:49.788130  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.793043  2267 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:49.795717  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.787972  5459 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:49.796761  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.804831  2267 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:49.804859  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:49.805344  1558 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:49.793869  5424 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.806854  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:49.591461  5511 log.cc:927] Time spent T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 2.486s	user 0.010s	sys 0.012s
I20260709 13:00:49.788607  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:49.812897  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 312796us
I20260709 13:00:49.816640  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:49.627314  5510 consensus_meta.cc:287] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.004s
I20260709 13:00:49.813467  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:49.838368  1631 raft_consensus.cc:2368] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 8. Current term is 9.
W20260709 13:00:49.815704  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.594635  5453 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.820912  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:49.820976  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:49.824628  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.825379  1524 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:49.817338  2266 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:49.595368  5509 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:49.895618  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.897047  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:49.897358  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 72076.6us
I20260709 13:00:49.807734  5562 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:49.895403  5525 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:00:49.928897  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.907056  5393 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:49.818533  5361 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:49.787331  5567 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.942559  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:49.890424  5426 consensus_meta.cc:287] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.849s	user 0.005s	sys 0.008s
I20260709 13:00:49.886487  5510 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:49.974247  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:49.947084  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:49.976220  2271 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:49.946435  5393 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:49.977283  5393 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.979092  1554 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
I20260709 13:00:49.978399  5386 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:50.019363  5365 consensus_meta.cc:287] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.854s	user 0.007s	sys 0.005s
I20260709 13:00:50.019832  5365 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:49.978138  5426 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.022320  2267 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 8: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:50.022243  5559 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:49.907532  5544 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:50.104027  5393 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.033223  5567 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.110400  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2128) took 4272 ms. Trace:
I20260709 13:00:50.110741  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.118346  2271 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:00:50.119199  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 809) took 2470 ms. Trace:
I20260709 13:00:50.119580  2271 rpcz_store.cc:276] 0709 13:00:47.648580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.029633 (+2381053us) service_pool.cc:224] Handling call
0709 13:00:50.118018 (+ 88385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:50.118871 (+   853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.119128 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:50.125911  5563 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:50.110859  1703 rpcz_store.cc:276] 0709 13:00:45.838163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.725510 (+887347us) service_pool.cc:224] Handling call
0709 13:00:46.728763 (+  3253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.729005 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.729029 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.736033 (+  7004us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.846463 (+110430us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:46.846565 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.846753 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.590855 (+2744102us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:50.110078 (+519223us) raft_consensus.cc:1685] finished
0709 13:00:50.110101 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.110319 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10647936,"thread_start_us":83596,"threads_started":1,"wal-append.queue_time_us":219950}
I20260709 13:00:50.009112  5361 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.944924  5562 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:50.142263  5453 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:50.142887  5453 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:50.145208  5453 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:50.116935  2266 raft_consensus.cc:2955] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 3 to 8, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:49.971143  5509 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 13:00:50.011183  5525 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.147s
I20260709 13:00:50.164769  2271 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:50.165738  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 811) took 2516 ms. Trace:
I20260709 13:00:49.948707  5566 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:50.166633  2271 rpcz_store.cc:276] 0709 13:00:47.649338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.134327 (+2484989us) service_pool.cc:224] Handling call
0709 13:00:50.164306 (+ 29979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:50.165417 (+  1111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.165667 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:50.160432  5234 consensus_meta.cc:287] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.000s
W20260709 13:00:50.180902  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.155470  5361 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:50.169896  5565 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
I20260709 13:00:50.185954  2271 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:50.189283  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 812) took 2539 ms. Trace:
I20260709 13:00:50.189814  2271 rpcz_store.cc:276] 0709 13:00:47.649853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.168474 (+2518621us) service_pool.cc:224] Handling call
0709 13:00:50.185781 (+ 17307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:50.189048 (+  3267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.189229 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:50.180166  5234 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.182660  5365 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:50.188591  5566 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.188478  5565 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:50.213775  5391 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.676s	user 0.007s	sys 0.003s
I20260709 13:00:50.216176  5393 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:50.242399  5555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.016s	sys 0.014s
I20260709 13:00:50.218608  5299 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:50.246724  5463 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:50.266140  5423 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.001s
W20260709 13:00:50.278226  5542 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.875s	user 0.006s	sys 0.007s
I20260709 13:00:50.281363  5423 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.284637  5423 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:50.267562  5391 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.297034  5391 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:50.206737  5540 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:50.219090  5426 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:50.257690  5562 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:50.241811  5432 consensus_meta.cc:287] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.811s	user 0.007s	sys 0.005s
I20260709 13:00:50.298951  5432 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.301759  5432 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:50.265405  5361 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:50.253931  5507 consensus_meta.cc:287] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.037s	user 0.006s	sys 0.007s
W20260709 13:00:50.268276  5555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.016s	sys 0.014s
I20260709 13:00:50.303993  5507 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.307174  5507 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:50.278833  5542 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:50.355023  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 597) took 1071 ms. Trace:
I20260709 13:00:50.358994  1554 rpcz_store.cc:276] 0709 13:00:49.283114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.351129 (+1068015us) service_pool.cc:224] Handling call
0709 13:00:50.353598 (+  2469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:50.354180 (+   582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.354238 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:50.354336 (+    98us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:50.354386 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.354500 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.354725 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:50.367530  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 598) took 1050 ms. Trace:
I20260709 13:00:50.368194  1552 rpcz_store.cc:276] 0709 13:00:49.316755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.397579 (+ 80824us) service_pool.cc:224] Handling call
0709 13:00:50.367000 (+969421us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b5400182754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:50.367292 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19305216}
I20260709 13:00:50.367596  1554 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:50.373770  1557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 1941) took 3245 ms (client timeout 1891 ms). Trace:
W20260709 13:00:50.374465  1557 rpcz_store.cc:269] 0709 13:00:47.128619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.128747 (+   128us) service_pool.cc:224] Handling call
0709 13:00:50.373262 (+3244515us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54003133d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:50.373534 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4411116800}
I20260709 13:00:50.377609  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1952) took 2726 ms. Trace:
I20260709 13:00:50.378165  1551 rpcz_store.cc:276] 0709 13:00:47.650793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.675296 (+1024503us) service_pool.cc:224] Handling call
0709 13:00:48.675602 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.085875 (+410273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.377064 (+1291189us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400372b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:50.377420 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941622528}
I20260709 13:00:50.383294  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 589) took 1245 ms. Trace:
I20260709 13:00:50.383862  1558 rpcz_store.cc:276] 0709 13:00:49.137529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.137678 (+   149us) service_pool.cc:224] Handling call
0709 13:00:50.382748 (+1245070us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b5400177d54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:50.383042 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1488627456}
W20260709 13:00:50.386904  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.061795  1560 rpcz_store.cc:276] 0709 13:00:47.241477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.394359 (+152882us) service_pool.cc:224] Handling call
0709 13:00:47.587506 (+193147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.587760 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:48.604057 (+1016297us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.023891 (+419834us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.043093 (+ 19202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:49.043142 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:49.043181 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.043241 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.043356 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2566,"prepare.queue_time_us":20224,"prepare.run_wall_time_us":35,"raft.queue_time_us":19952,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":10818,"spinlock_wait_cycles":4510080,"thread_start_us":399003,"threads_started":1}
W20260709 13:00:50.394841  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.399005  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.399576  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2209) took 4860 ms. Trace:
I20260709 13:00:50.401072  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 585) took 2995 ms. Trace:
I20260709 13:00:50.404338  1630 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:50.404803  1629 raft_consensus.cc:2410] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:00:49.970508  1635 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:50.405535  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.406951  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 754) took 3310 ms. Trace:
I20260709 13:00:50.408174  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.409354  1634 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:50.405529  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.414510  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:50.416947  1558 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:50.418109  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:50.418772  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:50.418949  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:50.427675  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:50.430586  1673 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.004s	sys 0.008s
I20260709 13:00:50.439105  1627 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:50.449210  1673 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.005s	sys 0.009s
I20260709 13:00:50.433666  1626 rpcz_store.cc:276] 0709 13:00:45.538510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.078962 (+1540452us) service_pool.cc:224] Handling call
0709 13:00:48.694127 (+1615165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.938146 (+244019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.398847 (+1460701us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540034dfd0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:50.399239 (+   392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3643950464}
I20260709 13:00:50.433719  1559 rpcz_store.cc:276] 0709 13:00:47.405592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.512447 (+106855us) service_pool.cc:224] Handling call
0709 13:00:48.789031 (+1276584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.945351 (+156320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.400528 (+1455177us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540030b950. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:50.400824 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2599954688}
W20260709 13:00:50.450793  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.454365  1560 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.454622  2271 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:50.455510  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 823) took 1617 ms. Trace:
I20260709 13:00:50.455875  2271 rpcz_store.cc:276] 0709 13:00:48.838323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.209865 (+1371542us) service_pool.cc:224] Handling call
0709 13:00:50.453794 (+243929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:50.455152 (+  1358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.455390 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:50.458937  5542 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:50.459614  1554 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:50.462817  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.463210  1551 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.463904  1626 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.447943  1632 rpcz_store.cc:276] 0709 13:00:47.096699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.560449 (+1463750us) service_pool.cc:224] Handling call
0709 13:00:48.567409 (+  6960us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.070900 (+503491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.406382 (+1335482us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b540034b554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:50.406716 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114250496}
I20260709 13:00:50.466982  1631 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:50.468556  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.468755  1631 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:50.469007  5322 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:50.469444  5322 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:50.475466  5322 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:50.477698  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.478699  2268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 818) took 1844 ms (client timeout 1924 ms). Trace:
I20260709 13:00:50.479681  2265 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:50.492640  2268 rpcz_store.cc:269] 0709 13:00:48.634140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.683932 (+ 49792us) service_pool.cc:224] Handling call
0709 13:00:50.478170 (+1794238us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b5400442d54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:50.478477 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773858560}
I20260709 13:00:50.493208  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 857) took 1564 ms. Trace:
I20260709 13:00:50.493698  2265 rpcz_store.cc:276] 0709 13:00:48.928643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.478542 (+1549899us) service_pool.cc:224] Handling call
0709 13:00:50.479082 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:50.492814 (+ 13732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.493105 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:50.482203  2271 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:50.482779  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 956) took 3467 ms. Trace:
I20260709 13:00:50.483676  1633 raft_consensus.cc:2410] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:00:50.485652  2269 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:50.491438  1627 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:50.494375  1552 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.495059  2268 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:50.495177  5363 raft_consensus.cc:3055] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:50.497354  5426 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.499137  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52450.8us
I20260709 13:00:50.501402  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.480748  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:50.511406  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 1.01221e+06us
I20260709 13:00:50.511925  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 584) took 3098 ms. Trace:
I20260709 13:00:50.512436  1553 rpcz_store.cc:276] 0709 13:00:47.405254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.512367 (+107113us) service_pool.cc:224] Handling call
0709 13:00:47.658116 (+145749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.542030 (+1883914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.401871 (+859841us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54002dafd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:50.503747 (+101876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4325161216}
I20260709 13:00:50.502681  2270 rpcz_store.cc:276] 0709 13:00:47.015267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.015399 (+   132us) service_pool.cc:224] Handling call
0709 13:00:47.044633 (+ 29234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:49.134568 (+2089935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.482148 (+1347580us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400730fd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:50.482532 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4170343168}
I20260709 13:00:50.514310  5452 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:50.509951  5232 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:50.515141  5452 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:50.518711  5443 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.519698  5443 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:50.523224  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:50.523635  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:50.524142  1708 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.524645  1703 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:50.505052  5363 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:50.527027  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.528041  5363 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.531059  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:50.540405  1705 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:50.541014  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.538596  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:50.541296  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.542380  1703 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.542558  1707 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:50.548069  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2221) took 1098 ms. Trace:
W20260709 13:00:50.548686  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.548589  1634 rpcz_store.cc:276] 0709 13:00:49.449934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.450072 (+   138us) service_pool.cc:224] Handling call
0709 13:00:50.547759 (+1097687us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b5400089dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:50.547982 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2132072704}
I20260709 13:00:50.550657  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.551282  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2220) took 1108 ms. Trace:
I20260709 13:00:50.550945  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:50.551954  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 71578.9us
I20260709 13:00:50.553133  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 860) took 1394 ms. Trace:
I20260709 13:00:50.553583  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.553668  2262 rpcz_store.cc:276] 0709 13:00:49.158793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.191459 (+ 32666us) service_pool.cc:224] Handling call
0709 13:00:50.552669 (+1361210us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b5400530054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:50.552926 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808133888}
I20260709 13:00:50.553073  5491 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:50.556342  5491 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.556547  1627 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:50.556842  5491 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.513813  5426 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:50.558835  1628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.000s	sys 0.011s
W20260709 13:00:50.559298  1628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.000s	sys 0.011s
I20260709 13:00:50.560225  5426 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:50.561060  1632 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:50.554822  5365 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:50.561909  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.551756  1635 rpcz_store.cc:276] 0709 13:00:49.442984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.444484 (+  1500us) service_pool.cc:224] Handling call
0709 13:00:50.550901 (+1106417us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b540007f3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:50.551122 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156428672}
I20260709 13:00:50.562949  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 825) took 1724 ms. Trace:
I20260709 13:00:50.563059  1707 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:00:50.563482  2271 rpcz_store.cc:276] 0709 13:00:48.838846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.456823 (+1617977us) service_pool.cc:224] Handling call
0709 13:00:50.481549 (+ 24726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:50.502595 (+ 21046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.562648 (+ 60053us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b5400442d50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:50.562833 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55694080}
I20260709 13:00:50.565683  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.566115  1674 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:50.557682  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:50.555220  2263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 810) took 2906 ms (client timeout 3021 ms). Trace:
I20260709 13:00:50.567101  1627 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.571456  1633 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:50.563498  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:50.567322  2263 rpcz_store.cc:269] 0709 13:00:47.648961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.716607 (+1067646us) service_pool.cc:224] Handling call
0709 13:00:50.554846 (+1838239us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540064c8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:50.555048 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245996288}
I20260709 13:00:50.529744  5363 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.576517  1552 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:50.575436  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:50.579800  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 64014.7us
I20260709 13:00:50.586293  1703 raft_consensus.cc:2410] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:50.587476  5520 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:00:50.589632  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:50.590266  5538 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:50.590898  5538 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:50.591281  5520 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:50.591965  5520 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:50.585999  1631 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:50.592384  5538 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:50.593228  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.593091  5520 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:50.594975  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.598662  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.586212  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.599787  1626 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:50.601480  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.601584  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:50.603047  1633 raft_consensus.cc:2410] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:00:50.603847  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.590929  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:50.609128  5423 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.609953  5423 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.612583  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.612959  1708 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:00:50.616318  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.619511  5500 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.615754  5274 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:00:50.604123  5452 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:50.621775  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.622310  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1964) took 1081 ms. Trace:
I20260709 13:00:50.625298  5519 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.624481  1635 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.622633  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:50.622643  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.010s	sys 0.044s
W20260709 13:00:50.630878  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.011s	sys 0.045s
I20260709 13:00:50.633204  1626 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:00:50.635303  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.638547  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:50.639006  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.639758  1633 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.623958  5443 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:50.645845  1629 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:50.620221  5500 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:50.649066  5500 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:50.624285  1556 rpcz_store.cc:276] 0709 13:00:49.487285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.356207 (+868922us) service_pool.cc:224] Handling call
0709 13:00:50.357135 (+   928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:50.358012 (+   877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.370580 (+ 12568us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:50.371617 (+  1037us) log.cc:844] Serialized 26 byte log entry
0709 13:00:50.402967 (+ 31350us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:50.403020 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.403122 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.568369 (+165247us) raft_consensus.cc:1685] finished
0709 13:00:50.568396 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.568583 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28508,"raft.queue_time_us":93343,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":233,"thread_start_us":30814,"threads_started":1,"wal-append.queue_time_us":133475}
W20260709 13:00:50.650949  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 60180.4us
I20260709 13:00:50.653939  1705 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:50.656051  1634 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:50.657178  5527 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:50.634543  5196 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.661123  5196 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:50.662658  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:50.663556  5002 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:50.663925  5196 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:50.664510  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:50.664827  5196 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.665367  5562 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.664193  5002 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.666502  5002 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.667716  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.668148  5028 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:50.668771  5028 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:50.669271  1701 raft_consensus.cc:2410] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:50.670511  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.671520  1706 raft_consensus.cc:2410] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:00:50.672384  5575 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.662s	user 0.005s	sys 0.000s
I20260709 13:00:50.668807  5487 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:50.673395  5487 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:50.673947  5487 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:50.674530  5028 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.675971  5028 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.675499  5487 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:50.676940  5375 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:50.677657  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.678251  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.678685  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:50.683668  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 56451us
I20260709 13:00:50.685738  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.666065  5562 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:50.657310  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:50.643472  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 743915us
I20260709 13:00:50.634518  5452 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:00:50.688552  5491 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.689049  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:50.689402  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.689713  1709 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.691262  5491 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:50.692396  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.692983  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.681560  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.695228  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.713871  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.715301  1551 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
W20260709 13:00:50.725497  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 81552.1us
I20260709 13:00:50.731006  1635 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:50.731052  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.733227  1632 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:50.733269  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.736092  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:50.736873  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.737229  1560 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:50.742597  1634 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:50.741977  1631 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
W20260709 13:00:50.748607  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 92036.1us
I20260709 13:00:50.748696  1700 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:50.748976  1701 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
W20260709 13:00:50.749679  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.750272  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.751672  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.738734  5452 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:00:50.754009  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:50.754225  5491 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:50.746397  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:50.755192  5461 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:50.755622  5461 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.756022  5461 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.756251  1632 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:50.756560  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 92188.3us
I20260709 13:00:50.757702  1632 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:50.756099  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:50.766645  1705 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:50.767588  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:50.768260  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:50.775234  1709 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:50.779251  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.765620  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:50.785800  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.786453  1706 raft_consensus.cc:2410] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:50.786463  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:50.762601  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:50.785854  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:50.781095  1708 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:50.790320  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 808) took 2988 ms. Trace:
I20260709 13:00:50.790936  4939 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.792001  5562 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:50.790722  2266 rpcz_store.cc:276] 0709 13:00:47.648069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.025586 (+2377517us) service_pool.cc:224] Handling call
0709 13:00:50.116504 (+ 90918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:50.116774 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:50.191059 (+ 74285us) log.cc:844] Serialized 14 byte log entry
0709 13:00:50.579885 (+388826us) log.cc:844] Serialized 14 byte log entry
0709 13:00:50.596450 (+ 16565us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:50.600369 (+  3919us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:50.614794 (+ 14425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.620673 (+  5879us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.636068 (+ 15395us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12670,"prepare.queue_time_us":148544,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":18689,"raft.run_cpu_time_us":486,"raft.run_wall_time_us":13437,"thread_start_us":368526,"threads_started":2,"wal-append.queue_time_us":250341}
I20260709 13:00:50.793068  5452 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:50.793567  5452 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:50.793989  5452 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.794307  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.794764  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:50.795395  1558 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.798573  5322 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.803409  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:50.799858  1634 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:50.804140  1560 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.805644  1626 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.799628  5491 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:50.806813  5491 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:50.807185  5491 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:50.808146  5491 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.809408  5491 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.810235  5234 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 13:00:50.810817  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 49912.3us
I20260709 13:00:50.811287  5234 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:50.811635  5234 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:50.812004  5234 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.812474  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:50.800467  1630 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:50.800637  5476 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:50.802371  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:50.802626  1632 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:50.815392  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 71412.5us
I20260709 13:00:50.821682  1551 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:50.823939  1556 raft_consensus.cc:2410] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:00:50.830201  1626 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:00:50.787812  5487 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.823024  5476 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.852885  5375 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:50.853842  5196 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:50.854158  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 120807us
I20260709 13:00:50.855760  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:50.857381  1601 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:50.858562  5501 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:50.862430  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 48151.5us
I20260709 13:00:50.864516  1524 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:50.865695  5566 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:50.866283  5566 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 8 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:50.867249  5566 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.835044  5362 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:00:50.870744  5362 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:50.871129  5362 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:50.872258  5362 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.873673  5362 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.878659  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.879853  1629 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:00:50.879995  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.880833  1703 raft_consensus.cc:2410] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:00:50.884847  1601 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:50.886143  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.887967  5452 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:50.889422  5359 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.836073  5562 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:50.852499  1702 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:50.891237  5565 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.891641  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:50.891827  5555 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:50.892441  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:50.892598  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:50.892632  5567 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:50.893608  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:50.914810  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:50.894826  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:50.894927  5423 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:50.895700  5396 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:50.897125  5580 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.309s	user 0.002s	sys 0.001s
I20260709 13:00:50.897644  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:50.844461  5476 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.899273  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:50.899819  4939 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:50.948711  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 53411.6us
I20260709 13:00:50.900918  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.881726  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:50.902225  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 109578us
I20260709 13:00:50.903009  1556 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:50.906805  1633 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:50.910732  1627 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:50.903522  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:50.915371  1700 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:50.915305  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.915918  1560 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:50.925498  5375 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:50.925901  1707 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:50.944463  2270 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:50.916105  5562 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:50.957477  1709 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.957832  5375 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:50.959513  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 117956us
I20260709 13:00:50.947643  5426 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:50.965050  1705 raft_consensus.cc:2368] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9.
I20260709 13:00:50.947732  5396 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.954221  5527 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:50.957856  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:50.966456  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:50.967139  2262 raft_consensus.cc:2368] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9.
I20260709 13:00:50.970561  5452 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:50.966235  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:51.007568  1702 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:51.002640  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:51.009819  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50561us
I20260709 13:00:51.015960  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.016535  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.914762  5232 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:00:51.008953  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 43602.3us
I20260709 13:00:51.018703  2266 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:00:51.022846  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:50.916594  5447 consensus_queue.cc:1059] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:00:51.020102  1708 raft_consensus.cc:2410] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:51.025316  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.032800  1707 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:51.036832  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:51.035776  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:51.027473  5234 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:51.036420  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:51.049721  1559 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:51.012004  5396 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.047204  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:51.021377  1706 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:51.055696  1706 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
I20260709 13:00:51.056974  2270 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:51.057312  1702 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:50.972549  5426 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.035221  2267 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:51.065328  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:51.065670  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.061302  2262 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 12. Ops: []
I20260709 13:00:51.061991  1556 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.062202  1524 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:51.062445  5604 raft_consensus.cc:3055] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:51.062865  2271 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.068969  1707 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:51.063347  1700 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:51.063719  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 99274.3us
I20260709 13:00:51.021174  5565 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:51.023916  5542 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:51.067699  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.947485  5359 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:51.074875  5601 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.096s	user 0.000s	sys 0.009s
I20260709 13:00:51.075248  5525 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:51.075788  5590 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.188s	user 0.000s	sys 0.004s
I20260709 13:00:51.076215  1551 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:51.078256  5452 raft_consensus.cc:3055] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:51.079473  1559 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:51.022505  5527 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:50.974715  5196 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:00:51.077683  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:51.082455  1703 raft_consensus.cc:2410] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:51.085153  1635 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:51.088033  1558 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:00:51.090647  1709 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:51.096060  5234 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:51.096787  5542 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:51.103837  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:51.106240  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 221477us
I20260709 13:00:51.108532  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:51.081277  5002 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:51.136122  2266 raft_consensus.cc:2393] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:51.119280  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:51.068917  5426 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:51.123957  5359 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:51.124658  2269 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:51.127885  1555 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:51.131014  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:51.137938  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:51.130869  1557 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:51.068342  5604 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:51.125241  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 756) took 1321 ms. Trace:
I20260709 13:00:51.148869  2262 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:51.150805  5605 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:51.154239  5565 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:51.144672  1628 rpcz_store.cc:276] 0709 13:00:49.803636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.803774 (+   138us) service_pool.cc:224] Handling call
0709 13:00:49.816622 (+ 12848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.901183 (+ 84561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.901237 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.918806 (+ 17569us) log.cc:844] Serialized 26 byte log entry
0709 13:00:50.559946 (+641140us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:50.560011 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.560084 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.896421 (+336337us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:51.098596 (+202175us) raft_consensus.cc:1685] finished
0709 13:00:51.098627 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:51.125178 (+ 26551us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70145,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":11449,"spinlock_wait_cycles":16841088,"thread_start_us":587639,"threads_started":1,"wal-append.queue_time_us":668234}
I20260709 13:00:51.155504  5002 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:51.155803  5525 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:51.156618  1631 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:51.158419  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:51.159381  5359 consensus_queue.cc:1059] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:51.160511  1702 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:51.162153  5363 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:51.162621  5363 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:51.163741  5363 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:51.168320  1526 leader_election.cc:336] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.708s (SENT)
I20260709 13:00:51.168910  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:51.165830  5363 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.116542  5566 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:51.111600  5452 raft_consensus.cc:740] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:51.146701  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:51.147852  1707 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:51.177495  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:51.181146  1558 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:51.179629  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 75967.5us
I20260709 13:00:51.182305  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:51.155571  5565 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:51.183327  5362 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:51.190719  5362 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:51.191102  5362 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.192631  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:51.194473  5359 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:51.190104  1556 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:51.195104  5359 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:51.196219  5359 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:51.213310  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 92034.9us
I20260709 13:00:51.214457  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:51.176182  5605 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:51.130115  5461 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:51.235244  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 104343us
I20260709 13:00:51.180953  5525 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:51.243047  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:51.244024  2269 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:51.244052  5566 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:51.245083  5566 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.244364  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:51.206854  5234 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:51.260450  1558 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:51.261332  5319 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:00:51.262949  5604 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:51.264674  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:51.265173  5604 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.221392  5491 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:00:51.275591  5542 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:51.276469  5542 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:51.277264  5542 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:51.283330  1701 raft_consensus.cc:2368] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 10. Current term is 11.
I20260709 13:00:51.239737  5365 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:51.170518  5527 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:51.277853  5542 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:51.293025  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 56040.5us
I20260709 13:00:51.300822  1599 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:51.311036  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46495.9us
I20260709 13:00:51.316051  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:51.316843  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:51.395170  5603 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:00:51.397248  5562 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:51.391979  5452 consensus_queue.cc:260] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:51.401695  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 233395us
I20260709 13:00:51.388621  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:51.443601  1706 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:51.403570  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 109106us
I20260709 13:00:51.465448  5608 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:51.466771  5605 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:51.404834  5610 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:51.471264  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:51.471920  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 135454us
I20260709 13:00:51.475052  5447 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:51.475337  1551 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.485921  2271 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
W20260709 13:00:51.487226  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.315562  5396 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:51.303567  5476 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:51.516227  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:51.553856  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:51.559197  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 67305.4us
I20260709 13:00:51.565340  2262 raft_consensus.cc:2393] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:51.567896  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:51.571712  5607 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:00:51.571543  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:51.578397  1556 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:51.611528  1551 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:00:51.620213  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.626349  1705 raft_consensus.cc:2368] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9.
I20260709 13:00:51.555543  5452 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.622100  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:51.632357  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.636317  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.640129  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:51.640849  1708 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:51.645967  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.662317  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64731us
I20260709 13:00:51.581285  5234 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:00:51.664242  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 347466us
I20260709 13:00:51.671110  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.672219  1703 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:51.672749  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:51.558588  5608 consensus_queue.cc:1243] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:00:51.677260  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 198585us
I20260709 13:00:51.680321  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:51.627930  5562 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.690176  1701 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:00:51.681571  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.695081  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:51.695431  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.701231  1704 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:51.678519  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:51.660457  5447 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:51.483935  5542 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:51.705817  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.619853  5487 consensus_queue.cc:1059] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:00:51.626600  5423 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:00:51.718683  1673 leader_election.cc:400] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9.
I20260709 13:00:51.719221  1673 leader_election.cc:403] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:51.720121  1700 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:51.673861  5375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.005s	sys 0.014s
I20260709 13:00:51.723057  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.729372  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.730250  1703 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:51.731664  1708 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
W20260709 13:00:51.712632  5359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.013s	sys 0.005s
I20260709 13:00:51.734376  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:51.643399  5614 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:00:51.671386  5002 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:00:51.739300  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.740392  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:51.742446  5501 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:51.708029  5608 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:51.724107  5375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.005s	sys 0.014s
I20260709 13:00:51.695375  4939 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:00:51.737874  1704 raft_consensus.cc:2376] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9. Re-sending same reply.
I20260709 13:00:51.757903  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:51.736296  5234 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:51.758126  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 52357.9us
I20260709 13:00:51.713881  5461 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:51.735219  5359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.013s	sys 0.005s
W20260709 13:00:51.736943  5362 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260709 13:00:51.763573  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:51.767251  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:51.747766  5566 consensus_meta.cc:287] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.000s
I20260709 13:00:51.766498  5002 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:51.769210  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.859174  1703 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:51.813621  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 177216us
I20260709 13:00:51.817631  2263 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:51.762138  5423 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:51.862795  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:51.769588  5459 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9.
W20260709 13:00:51.812359  5463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.011s	sys 0.041s
I20260709 13:00:51.867273  1701 raft_consensus.cc:2393] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:51.877434  1600 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:51.815527  5234 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.879966  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.881652  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:51.816658  5362 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:51.889571  1700 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:51.864051  5375 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:51.893978  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:51.865612  5423 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:51.877996  5463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.011s	sys 0.041s
I20260709 13:00:51.925086  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:51.877707  5426 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.003s
I20260709 13:00:51.900647  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:51.902815  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.878605  5461 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:51.913375  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:51.915060  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:51.938058  1704 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.916898  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:51.919497  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:51.925803  1631 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.865033  5365 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:51.936118  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:51.864177  5002 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:51.916010  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:51.939792  5613 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.962813  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:51.963171  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:51.883209  5234 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:51.941650  1629 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:51.964529  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:51.943470  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:51.949753  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.949541  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:51.942768  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:51.971635  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:51.962818  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:51.973585  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 82078.7us
I20260709 13:00:51.939543  5423 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.971617  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:51.977186  1630 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
W20260709 13:00:51.975379  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 52904.3us
I20260709 13:00:51.975732  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:51.975862  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:51.971395  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:51.979482  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:51.980203  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:51.863729  5566 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:51.982803  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:51.918419  5608 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:51.901445  5375 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:51.984543  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:51.987187  1708 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:51.991577  1627 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:51.942768  5461 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:51.971690  4939 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:52.009285  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.055809  1630 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:00:51.992434  1635 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:00:52.045274  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:52.043900  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:52.049970  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:51.971379  5196 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:51.924980  5359 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:00:52.050267  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:51.973295  5476 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:51.972280  1628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:00:51.992247  5615 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.069550  5002 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:52.122445  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:52.123215  1708 raft_consensus.cc:2376] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9. Re-sending same reply.
W20260709 13:00:52.070219  1526 leader_election.cc:336] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.605s (SENT)
I20260709 13:00:52.070394  1557 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12.
W20260709 13:00:52.070760  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 405657us
I20260709 13:00:52.124665  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:52.075695  1700 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:52.078408  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 88053.2us
I20260709 13:00:52.078842  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:52.079596  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:52.083055  1703 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:51.987800  5232 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:51.988761  5608 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.070480  5630 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.086721  1701 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:52.098071  2271 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:52.053839  5461 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.125208  1700 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:52.111063  5365 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:52.111755  5363 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.941s	user 0.008s	sys 0.004s
I20260709 13:00:52.112322  1554 raft_consensus.cc:2410] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:52.113418  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:52.125924  1560 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:52.121289  2262 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:52.050148  5396 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:52.107343  1628 raft_consensus.cc:606] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:52.128903  1631 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:00:52.142426  1555 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:52.150077  1553 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:52.118932  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:52.143713  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:52.155788  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:52.157573  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:52.164606  2236 leader_election.cc:336] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.712s (SENT)
I20260709 13:00:52.165244  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:51.972888  5426 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:52.149106  5028 raft_consensus.cc:993] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 13:00:52.194090  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:52.200626  1631 raft_consensus.cc:2376] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8. Re-sending same reply.
I20260709 13:00:52.128149  5608 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:52.196077  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:52.203581  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:52.194216  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:51.991791  5613 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.198920  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:52.202612  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 474868us
I20260709 13:00:52.195859  1700 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:52.215019  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:52.193610  5002 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.225454  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:52.197842  5359 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.225454  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:52.235179  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:52.229831  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.236400  1701 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:52.237883  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 167696us
I20260709 13:00:52.243228  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:52.244089  5567 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:52.244561  5567 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:52.244656  5638 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:52.245476  5638 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:52.246321  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:52.246937  1635 raft_consensus.cc:2376] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8. Re-sending same reply.
I20260709 13:00:52.246809  5638 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.248154  5501 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.248764  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:52.249584  5363 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:52.249972  5363 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:52.153057  5232 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.248080  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:52.252511  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 44079.7us
I20260709 13:00:52.157671  5630 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.255314  1708 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:52.255636  1700 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:52.255964  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 59486.9us
I20260709 13:00:52.256860  1556 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:52.214589  5525 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.266559  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:00:52.266971  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 102423us
I20260709 13:00:52.266738  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:52.275882  1555 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 7: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:52.132452  5615 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:52.282783  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:52.226460  5632 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.279068  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 154487us
I20260709 13:00:52.284655  1599 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:52.269234  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:52.281208  1560 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:00:52.250900  5363 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.286145  1560 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:52.288815  2269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.012s	sys 0.007s
I20260709 13:00:52.289403  1635 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
W20260709 13:00:52.291635  2269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.012s	sys 0.007s
I20260709 13:00:52.292663  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:52.293663  1708 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 6: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:52.306257  1555 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:52.278244  5491 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:52.321249  1560 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:00:52.317545  1628 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:00:52.318645  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 671) took 1423 ms. Trace:
I20260709 13:00:52.323716  1635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:00:52.324911  1559 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:52.245576  5567 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:52.324337  1705 rpcz_store.cc:276] 0709 13:00:50.883384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.007127 (+123743us) service_pool.cc:224] Handling call
0709 13:00:52.306972 (+1299845us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54003a0554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:52.307117 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385960704}
I20260709 13:00:52.290704  5396 raft_consensus.cc:1081] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Signalling peer 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 13:00:52.322840  1560 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:52.255398  5359 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.308099  5459 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:52.341917  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.343689  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1981) took 1052 ms. Trace:
I20260709 13:00:52.298626  5362 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:52.329854  5605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.011s	sys 0.002s
I20260709 13:00:52.353888  1555 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:52.346390  1558 rpcz_store.cc:276] 0709 13:00:51.291449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.291636 (+   187us) service_pool.cc:224] Handling call
0709 13:00:51.302850 (+ 11214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.303104 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:51.748402 (+445298us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.342850 (+594448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.343394 (+   544us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:52.343432 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.343502 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.343626 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15874,"prepare.queue_time_us":276014,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":16315,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2975,"thread_start_us":1002237,"threads_started":3,"wal-append.queue_time_us":560661}
I20260709 13:00:52.319962  5491 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:52.284905  5525 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.226116  5375 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:52.358512  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 212779us
W20260709 13:00:52.394363  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 159379us
I20260709 13:00:52.396366  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:52.393491  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:52.391057  1524 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:52.345510  5459 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:52.410741  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 56089.2us
I20260709 13:00:52.402758  1701 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:52.358458  5605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.011s	sys 0.002s
I20260709 13:00:52.398967  2234 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:52.422732  1555 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:52.334334  5447 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:00:52.357370  5028 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:52.395797  5567 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.453459  5630 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:52.423014  5459 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:52.455355  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:52.456527  1701 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.466835  1524 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:52.323469  5632 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.430488  5614 raft_consensus.cc:2764] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:52.428792  5425 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.426947  5635 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:52.472157  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 66692.9us
I20260709 13:00:52.480930  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:52.477850  1558 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:52.493928  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.466555  5396 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:52.504655  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.464473  5362 raft_consensus.cc:2764] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:52.507860  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:52.511893  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:52.512691  1709 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:52.464805  5631 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:52.515487  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:52.478735  5542 raft_consensus.cc:2764] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:00:52.520635  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 121723us
I20260709 13:00:52.500232  5605 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.471139  5624 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:00:52.488706  5661 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:52.478488  5028 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.531791  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:52.533344  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:52.537997  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.517149  5396 raft_consensus.cc:697] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:52.534757  1554 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:52.519903  5447 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.518354  5565 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:52.568358  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:52.535135  5452 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.890s	user 0.012s	sys 0.000s
W20260709 13:00:52.592262  5654 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:00:52.593233  5640 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:00:52.590477  5396 consensus_queue.cc:237] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:52.529930  5661 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.590868  5634 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:52.595471  5630 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:00:52.606352  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.633277  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 64299.9us
I20260709 13:00:52.499390  5491 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.554265  5408 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:52.514174  5425 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.514694  5648 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
W20260709 13:00:52.683246  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.698547  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:52.634478  5646 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.693472  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 184738us
I20260709 13:00:52.534353  5605 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.684290  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 1976) took 1571 ms. Trace:
W20260709 13:00:52.700942  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 144681us
I20260709 13:00:52.702214  1707 raft_consensus.cc:2410] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:52.764137  1701 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:00:52.560009  5362 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:52.758517  5643 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 13:00:52.755426  5647 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:00:52.679750  5661 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:52.764932  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 81515us
W20260709 13:00:52.779551  1704 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.814s	user 0.016s	sys 0.012s
I20260709 13:00:52.658665  5565 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.713626  1552 rpcz_store.cc:276] 0709 13:00:51.112671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.112921 (+   250us) service_pool.cc:224] Handling call
0709 13:00:51.126990 (+ 14069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.179254 (+ 52264us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:51.679029 (+499775us) log.cc:844] Serialized 14 byte log entry
0709 13:00:51.868291 (+189262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:51.868373 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:51.868432 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.683951 (+815519us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b540020add4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:52.684018 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.684193 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":294625,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":23381,"raft.queue_time_us":12860,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12435,"spinlock_wait_cycles":119619328,"thread_start_us":664112,"threads_started":2,"wal-append.queue_time_us":373158}
I20260709 13:00:52.691104  5319 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:52.784339  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.812898  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:52.814929  1702 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:52.767351  5654 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:00:52.776847  5461 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.017s
I20260709 13:00:52.805042  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:52.776578  5002 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.524s	user 0.018s	sys 0.020s
I20260709 13:00:52.776674  5447 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.707437  5359 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:52.813982  1704 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
W20260709 13:00:52.781137  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.777849  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:52.831789  1560 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:00:52.782001  5362 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:52.832674  5362 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.834487  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2132) took 1195 ms. Trace:
W20260709 13:00:52.834882  5664 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:00:52.835378  5452 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.835949  5452 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 13:00:52.776342  5234 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.784s	user 0.020s	sys 0.018s
I20260709 13:00:52.834928  1706 rpcz_store.cc:276] 0709 13:00:51.638843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.639045 (+   202us) service_pool.cc:224] Handling call
0709 13:00:51.674840 (+ 35795us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:51.987822 (+312982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:51.987886 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.051483 (+ 63597us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.389568 (+338085us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:52.389615 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.389693 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.834217 (+444524us) raft_consensus.cc:1685] finished
0709 13:00:52.834241 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.834407 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12808,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":52879,"thread_start_us":475340,"threads_started":2,"wal-append.queue_time_us":455198}
I20260709 13:00:52.838590  5234 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:52.839473  5605 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:52.839741  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.840266  1524 leader_election.cc:400] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 8. Current term is 9.
I20260709 13:00:52.840555  1524 leader_election.cc:403] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:52.840704  5234 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:52.771740  5638 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:52.841444  5638 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.841606  5408 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:52.842481  5651 consensus_queue.cc:1059] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:00:52.842944  5618 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.879s	user 0.001s	sys 0.000s
I20260709 13:00:52.766006  5525 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:52.843643  5525 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:52.844019  5525 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:52.844863  5525 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:52.845716  5660 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:00:52.841866  5631 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 8. Current term is 9.
I20260709 13:00:52.841876  5638 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.846944  5028 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:52.847218  5641 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
W20260709 13:00:52.848791  5644 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:00:52.849148  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 837) took 1664 ms. Trace:
I20260709 13:00:52.849550  2268 rpcz_store.cc:276] 0709 13:00:51.185110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.185383 (+   273us) service_pool.cc:224] Handling call
0709 13:00:51.211482 (+ 26099us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:51.738317 (+526835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:51.738354 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:51.752318 (+ 13964us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.159751 (+407433us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:52.338651 (+178900us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.340643 (+  1992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.340714 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.848927 (+508213us) raft_consensus.cc:1685] finished
0709 13:00:52.848942 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.849058 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28593,"prepare.queue_time_us":77492,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":37178,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":15825,"thread_start_us":870071,"threads_started":3,"wal-append.queue_time_us":443428}
I20260709 13:00:52.850920  5673 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.761222  5646 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:52.852423  5612 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.107s	user 0.004s	sys 0.000s
I20260709 13:00:52.844035  1635 raft_consensus.cc:606] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:52.853653  1635 raft_consensus.cc:614] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:52.853817  5646 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:52.849157  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 839) took 1592 ms. Trace:
I20260709 13:00:52.854342  2269 rpcz_store.cc:276] 0709 13:00:51.257097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.257266 (+   169us) service_pool.cc:224] Handling call
0709 13:00:51.286971 (+ 29705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.292834 (+1005863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.292862 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.323993 (+ 31131us) log.cc:844] Serialized 26 byte log entry
0709 13:00:52.476722 (+152729us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:52.476839 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.476940 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.848924 (+371984us) raft_consensus.cc:1685] finished
0709 13:00:52.848943 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.849058 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65801,"raft.queue_time_us":596453,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":30448,"thread_start_us":1058878,"threads_started":2,"wal-append.queue_time_us":253872}
I20260709 13:00:52.856019  5461 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.839732  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:52.858156  1703 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:52.785351  5542 raft_consensus.cc:2764] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:52.851508  5673 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.789202  5491 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:52.899369  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 70650.4us
I20260709 13:00:52.855656  5452 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:52.816390  5319 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.904307  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:52.893220  5661 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:52.859086  5636 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:00:52.905591  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:52.919261  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:52.919409  2236 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.046s (SENT)
I20260709 13:00:52.908027  2263 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:52.919780  1701 raft_consensus.cc:2376] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10. Re-sending same reply.
I20260709 13:00:52.919873  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:52.908782  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:52.907935  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:52.854696  5615 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:52.924748  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 397882us
W20260709 13:00:52.917945  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 73308.2us
I20260709 13:00:52.922359  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:52.922267  2268 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEARNER]: Advancing to term 12
W20260709 13:00:52.931658  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.936085  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 777) took 1027 ms. Trace:
I20260709 13:00:52.922374  1702 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:52.937541  1706 raft_consensus.cc:2368] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 10. Current term is 11.
I20260709 13:00:52.918745  5461 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:52.940022  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:52.940442  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:52.940332  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:52.900247  5613 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:52.940575  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:52.944929  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:52.945978  1704 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:52.910799  5319 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.936700  1633 rpcz_store.cc:276] 0709 13:00:51.895452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.913852 (+ 18400us) service_pool.cc:224] Handling call
0709 13:00:51.914368 (+   516us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:51.936577 (+ 22209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:51.936626 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:51.982130 (+ 45504us) log.cc:844] Serialized 52 byte log entry
0709 13:00:52.275246 (+293116us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:52.406760 (+131514us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.421751 (+ 14991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.422068 (+   317us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:52.922869 (+500801us) raft_consensus.cc:1685] finished
0709 13:00:52.922896 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.923085 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6490,"prepare.queue_time_us":190372,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4810,"raft.queue_time_us":143973,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":33680,"thread_start_us":311435,"threads_started":3,"wal-append.queue_time_us":296046}
W20260709 13:00:52.951476  2234 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Timed out: RequestConsensusVote RPC to 127.0.107.194:39441 timed out after 1.627s (SENT)
I20260709 13:00:52.954470  1701 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:00:52.956290  5487 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.217s	user 0.011s	sys 0.033s
I20260709 13:00:52.936595  5632 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:52.949029  5615 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:52.963676  2234 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Timed out: RequestConsensusVote RPC to 127.0.107.194:39441 timed out after 1.671s (SENT)
I20260709 13:00:52.896914  5447 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:52.968514  5555 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.969025  5425 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:52.962240  5461 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:52.969537  5423 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.925s	user 0.008s	sys 0.002s
W20260709 13:00:52.965376  5487 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.230s	user 0.012s	sys 0.033s
I20260709 13:00:52.970217  5632 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.971562  5604 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.706s	user 0.015s	sys 0.002s
W20260709 13:00:52.971617  4939 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.905s	user 0.019s	sys 0.005s
W20260709 13:00:52.978377  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 58998us
I20260709 13:00:52.959147  5501 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 13:00:52.979876  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 75681.3us
W20260709 13:00:52.982352  5619 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.005s	user 0.003s	sys 0.000s
I20260709 13:00:52.985460  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2194) took 1418 ms. Trace:
I20260709 13:00:52.947620  5452 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:00:52.990192  5670 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:00:52.990515  5639 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:52.988708  5319 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:53.111605  5319 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:52.992401  5673 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:52.993580  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.997365  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.998782  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:53.002604  5542 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:53.114756  1553 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:53.115058  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:53.118199  5525 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:53.118440  5608 consensus_meta.cc:287] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.888s	user 0.012s	sys 0.021s
I20260709 13:00:53.118891  5608 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:53.003357  5668 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.215s	user 0.002s	sys 0.000s
I20260709 13:00:53.007709  5566 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:53.008917  5661 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:53.009433  5623 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 1.029s	user 0.000s	sys 0.001s
I20260709 13:00:53.009961  5408 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:53.010188  5565 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:53.010308  5631 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:53.010627  1526 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:53.011173  5613 consensus_queue.cc:1059] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:53.123497  5613 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:53.123974  5613 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:53.124982  5661 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.124969  5613 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:53.015969  5611 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.156s	user 0.000s	sys 0.003s
I20260709 13:00:53.125669  5661 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:53.126555  2236 leader_election.cc:336] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.118s (SENT)
I20260709 13:00:52.953858  5365 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:53.126992  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:53.127928  5661 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:53.128008  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 882) took 2181 ms. Trace:
I20260709 13:00:53.128648  2265 rpcz_store.cc:276] 0709 13:00:50.946978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.947124 (+   146us) service_pool.cc:224] Handling call
0709 13:00:50.960602 (+ 13478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:50.960938 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.960978 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:51.007116 (+ 46138us) log.cc:844] Serialized 26 byte log entry
0709 13:00:51.281426 (+274310us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:51.281467 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:51.281541 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.015238 (+1733697us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:53.127607 (+112369us) raft_consensus.cc:1685] finished
0709 13:00:53.127637 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.127932 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496156544,"thread_start_us":246612,"threads_started":1,"wal-append.queue_time_us":704900}
I20260709 13:00:53.051875  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2147) took 1112 ms. Trace:
I20260709 13:00:53.130386  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:53.130556  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:53.131042  1708 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:53.131167  1703 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:52.989849  5459 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.000s
I20260709 13:00:53.131875  1702 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:53.132246  5459 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:53.132992  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:53.133739  1709 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:53.134814  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:53.134958  5459 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:53.135612  5565 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.136188  5565 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:53.137075  1705 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:53.066560  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 135477us
I20260709 13:00:53.130427  1556 rpcz_store.cc:276] 0709 13:00:51.939691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.979164 (+ 39473us) service_pool.cc:224] Handling call
0709 13:00:53.051643 (+1072479us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400181d54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:53.051804 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435010944}
I20260709 13:00:53.138540  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:53.067075  2268 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEARNER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:00:53.139930  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 129471us
I20260709 13:00:53.034819  5232 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:53.140666  5676 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:53.141518  5613 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:53.047235  5658 log.cc:927] Time spent T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.446s	user 0.003s	sys 0.000s
I20260709 13:00:53.136198  1627 raft_consensus.cc:2368] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11.
W20260709 13:00:53.018018  5567 consensus_meta.cc:287] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.558s	user 0.005s	sys 0.001s
W20260709 13:00:53.068066  5647 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:00:53.031665  5634 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:53.071386  5562 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.364s	user 0.011s	sys 0.001s
I20260709 13:00:53.047523  5665 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.153471  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:53.086287  5632 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:53.154268  1556 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:53.155573  5632 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:53.083842  5423 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:53.156185  1630 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:00:53.097774  5555 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:53.156774  1634 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:53.157271  1632 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:53.157768  5423 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:53.101011  1707 rpcz_store.cc:276] 0709 13:00:51.567388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.567556 (+   168us) service_pool.cc:224] Handling call
0709 13:00:52.985195 (+1417639us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400233f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:52.985394 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2605806464}
I20260709 13:00:53.158368  5555 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:53.158694  1554 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:00:53.153571  5665 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:53.159030  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:53.159565  1707 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.159754  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:53.160408  1554 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:53.036691  1631 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:00:53.068792  2234 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:53.012205  5621 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.028s	user 0.000s	sys 0.002s
I20260709 13:00:53.161403  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:53.161558  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 201432us
I20260709 13:00:53.146806  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:53.128206  2236 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.120s (SENT)
I20260709 13:00:53.165524  2236 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:53.108163  5362 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:53.139997  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:53.149688  5634 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:53.171290  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:53.172006  1560 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:00:53.154304  5608 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:53.157261  1552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:42086
I20260709 13:00:53.174458  1552 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:53.174886  1552 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.105989  5638 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:53.102424  4939 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:53.144201  1601 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:53.166356  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:53.179088  1709 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:53.161990  1554 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:53.168629  1626 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
W20260709 13:00:53.149034  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 220872us
I20260709 13:00:53.179730  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:53.182456  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:53.183315  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:53.190306  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50370.4us
I20260709 13:00:53.193048  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2200) took 1227 ms. Trace:
I20260709 13:00:53.163036  5408 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:53.162518  5002 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.150396  5365 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.197625  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:53.198010  2263 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:53.198324  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:53.202143  2271 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:53.196751  1703 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:00:53.193506  1700 rpcz_store.cc:276] 0709 13:00:51.966064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.043279 (+ 77215us) service_pool.cc:224] Handling call
0709 13:00:52.075488 (+ 32209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.949572 (+874084us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:52.966395 (+ 16823us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.192713 (+226318us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:53.192766 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.192809 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.192874 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.192977 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6913,"prepare.queue_time_us":16431,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":76030,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":385940,"threads_started":2}
I20260709 13:00:53.160537  5665 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:53.201346  1628 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:00:53.205451  1601 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:53.207020  1704 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:53.214955  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.235909  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:53.349222  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:53.349855  1553 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:53.190640  5555 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:53.189749  5319 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:53.351747  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.353677  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 127003us
I20260709 13:00:53.352085  2266 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:53.395244  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:53.403535  5631 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:53.405609  5631 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.406553  5631 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:53.204490  5002 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:53.408098  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 279918us
I20260709 13:00:53.197471  5565 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:53.200773  5408 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:53.375416  4939 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:00:53.411494  5461 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:53.411664  5674 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:53.412151  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 231459us
I20260709 13:00:53.462730  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42424 (request call id 0) took 1208 ms. Trace:
I20260709 13:00:53.470309  1635 rpcz_store.cc:276] 0709 13:00:52.237834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.904975 (+667141us) service_pool.cc:224] Handling call
0709 13:00:53.445939 (+540964us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b5400165dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd5735 00007f06e2f95d29 00007f06dc5141d4 00007f06dc514162 00007f06dc514091 00007f06dc51400c 00007f06dc5132c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:53.446208 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80564096}
I20260709 13:00:53.422278  1554 raft_consensus.cc:2410] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:00:53.424750  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 219394us
I20260709 13:00:53.450070  2265 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:53.349917  5678 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:53.449051  5396 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:53.468947  1552 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:53.206984  5232 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:53.487111  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:53.467092  5408 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:53.525538  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 130430us
I20260709 13:00:53.531742  1552 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:53.532765  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 296988us
I20260709 13:00:53.535632  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:53.477201  5615 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.539053  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:53.472295  5322 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.479844  5608 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.476358  5678 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.537344  5232 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:53.535015  5565 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:53.550719  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.551206  5565 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:53.543471  5638 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:53.480171  5555 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:53.556128  5555 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:53.544090  5608 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:53.559131  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1961) took 1440 ms. Trace:
I20260709 13:00:53.559630  1627 rpcz_store.cc:276] 0709 13:00:52.118615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.142328 (+ 23713us) service_pool.cc:224] Handling call
0709 13:00:53.558900 (+1416572us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b540008a2d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:53.559064 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142680832}
I20260709 13:00:53.560783  5608 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:53.545636  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:53.561053  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:53.564173  5362 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:53.566094  5542 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:53.566690  5232 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:53.546407  2236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.715s (SENT) [suppressed 54 similar messages]
I20260709 13:00:53.570188  5525 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.571738  5525 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:53.573272  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:53.574132  5677 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:53.575461  5659 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:53.575702  1506 auto_rebalancer.cc:893] Removing replace marker failed: Replica 7e99891af85f4b10aa1cc2da6aa33082 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:00:53.576318  1506 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:00:53.576134  5659 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:53.576738  1506 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:00:53.577488  5692 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:00:53.579756  2264 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEARNER]: Advancing to term 12
I20260709 13:00:53.547376  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:53.478263  5396 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:53.586014  1707 raft_consensus.cc:2410] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:53.573887  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:53.561822  1627 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:00:53.599148  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:53.587611  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1963) took 1468 ms. Trace:
I20260709 13:00:53.601132  5396 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:54.660919  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.657070  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 170081us
I20260709 13:00:53.727751  5319 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.935s
I20260709 13:00:54.662729  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:54.101972  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 790) took 1129 ms. Trace:
W20260709 13:00:54.058633  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 493325us
W20260709 13:00:54.454545  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.663992  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2209) took 1533 ms. Trace:
I20260709 13:00:54.676191  5700 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:00:53.805029  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 783) took 1901 ms (client timeout 1671 ms). Trace:
W20260709 13:00:54.677120  1634 rpcz_store.cc:269] 0709 13:00:51.903425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.903542 (+   117us) service_pool.cc:224] Handling call
0709 13:00:53.804671 (+1901129us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540034d5d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:53.804868 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2743721344}
I20260709 13:00:54.687090  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:54.687467  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:54.687762  1557 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:54.688162  1634 raft_consensus.cc:2376] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6. Re-sending same reply.
W20260709 13:00:54.688745  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1972) took 1715 ms (client timeout 1973 ms). Trace:
W20260709 13:00:54.688905  5408 consensus_meta.cc:287] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.147s	user 0.011s	sys 0.000s
I20260709 13:00:53.752357  5365 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.913s
W20260709 13:00:54.689193  1634 rpcz_store.cc:269] 0709 13:00:52.973605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.687204 (+1713599us) service_pool.cc:224] Handling call
0709 13:00:54.688682 (+  1478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.689997  5365 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:53.681403  5672 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:54.690423  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:54.402750  2269 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.212s	user 0.012s	sys 0.000s
W20260709 13:00:53.643110  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.691183  1634 raft_consensus.cc:2368] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10.
W20260709 13:00:54.691238  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.691709  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2235) took 1588 ms (client timeout 1857 ms). Trace:
I20260709 13:00:53.589975  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:54.692080  1634 rpcz_store.cc:269] 0709 13:00:53.103224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.690150 (+1586926us) service_pool.cc:224] Handling call
0709 13:00:54.691656 (+  1506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.692493  1633 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:54.692958  1633 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2233) took 1736 ms (client timeout 1938 ms). Trace:
I20260709 13:00:54.693171  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:54.693301  1633 rpcz_store.cc:269] 0709 13:00:52.956037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.589722 (+633685us) service_pool.cc:224] Handling call
0709 13:00:54.692896 (+1103174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.676278  1707 rpcz_store.cc:276] 0709 13:00:53.130901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.158812 (+ 27911us) service_pool.cc:224] Handling call
0709 13:00:54.663913 (+1505101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.694312  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:54.695324  1633 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2234) took 1727 ms (client timeout 2204 ms). Trace:
W20260709 13:00:54.695791  1633 rpcz_store.cc:269] 0709 13:00:52.967899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.694056 (+1726157us) service_pool.cc:224] Handling call
0709 13:00:54.695256 (+  1200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.696890  1557 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:00:54.696904  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:54.698048  1633 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.699843  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:54.700359  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:54.701130  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:54.701659  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:53.550323  5678 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.702659  1557 raft_consensus.cc:2410] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:54.028142  5608 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.701156  1555 raft_consensus.cc:2410] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:54.703258  5608 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.703841  1556 raft_consensus.cc:2410] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:54.704589  2269 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:53.794997  5426 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:54.710592  5426 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:00:54.711295  2269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 973) took 1879 ms (client timeout 2176 ms). Trace:
I20260709 13:00:54.711127  5426 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:54.711688  2269 rpcz_store.cc:269] 0709 13:00:52.866548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.897255 (+ 30707us) service_pool.cc:224] Handling call
0709 13:00:54.711116 (+1813861us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54005933d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:54.711236 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623919360}
I20260709 13:00:54.690443  5365 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:54.713594  5426 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:54.294119  5691 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.391s	user 0.000s	sys 0.001s
I20260709 13:00:54.713832  5365 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.715229  5365 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:54.038364  5689 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:00:54.463007  5566 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.399822  5555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.018s	sys 0.037s
W20260709 13:00:54.669145  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.738191  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.550401  5322 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:54.233510  1626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 780) took 2334 ms (client timeout 1627 ms). Trace:
W20260709 13:00:53.644572  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.734874  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 840) took 1156 ms. Trace:
I20260709 13:00:53.812826  5424 raft_consensus.cc:3055] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:54.455030  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:53.806654  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1965) took 1687 ms (client timeout 1560 ms). Trace:
W20260709 13:00:54.670545  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 788) took 1699 ms (client timeout 1834 ms). Trace:
W20260709 13:00:53.671309  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 123998us
I20260709 13:00:54.660763  1628 rpcz_store.cc:276] 0709 13:00:52.119089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.325405 (+206316us) service_pool.cc:224] Handling call
0709 13:00:52.325950 (+   545us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.351020 (+1025070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.587353 (+236333us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54002fadd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:53.587550 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012806528}
I20260709 13:00:53.808954  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:54.748829  2263 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:54.659912  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 787) took 1689 ms (client timeout 1728 ms). Trace:
W20260709 13:00:54.749454  1635 rpcz_store.cc:269] 0709 13:00:52.971184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.541255 (+570071us) service_pool.cc:224] Handling call
0709 13:00:54.659823 (+1118568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:53.818193  1706 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:54.750593  1706 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:54.217742  2270 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:54.752110  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 984) took 1163 ms. Trace:
I20260709 13:00:54.752596  2270 rpcz_store.cc:276] 0709 13:00:53.588826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.215608 (+626782us) service_pool.cc:224] Handling call
0709 13:00:54.216063 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.751707 (+535644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.752013 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.672644  2262 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:54.673220  1632 rpcz_store.cc:276] 0709 13:00:52.972426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.114831 (+142405us) service_pool.cc:224] Handling call
0709 13:00:54.101705 (+986874us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b540034b554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:54.101874 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95685888}
W20260709 13:00:53.927350  5687 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.494s	user 0.003s	sys 0.000s
W20260709 13:00:53.769878  5695 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:00:53.851846  5632 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.028527  5363 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:53.735208  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:54.663978  5699 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:53.909310  5542 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:54.677110  5700 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:54.648988  1526 leader_election.cc:336] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.919s (SENT)
I20260709 13:00:54.776898  1634 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:54.777469  1526 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:53.783300  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.678948  1559 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:00:54.777609  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2237) took 1426 ms (client timeout 1645 ms). Trace:
I20260709 13:00:54.679978  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:54.680620  5613 consensus_meta.cc:287] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.539s	user 0.009s	sys 0.003s
I20260709 13:00:54.681556  1558 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:00:54.778788  1634 rpcz_store.cc:269] 0709 13:00:53.351170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.692898 (+1341728us) service_pool.cc:224] Handling call
0709 13:00:54.777545 (+ 84647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.682860  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:54.781177  1552 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.684132  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:54.782873  1554 raft_consensus.cc:2410] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:54.685982  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:54.702394  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:54.705119  5672 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:53.642819  5648 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 1.024s
I20260709 13:00:54.705442  5608 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:53.592694  2264 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:54.703884  1557 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:54.715298  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 977) took 1765 ms. Trace:
I20260709 13:00:54.791458  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 842) took 1212 ms. Trace:
W20260709 13:00:53.809722  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1960) took 1691 ms (client timeout 1908 ms). Trace:
I20260709 13:00:54.715977  5426 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.731178  1633 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:54.795141  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2236) took 1612 ms. Trace:
I20260709 13:00:54.746891  5566 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:53.586179  5680 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:54.744867  1626 rpcz_store.cc:269] 0709 13:00:51.897063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.915711 (+ 18648us) service_pool.cc:224] Handling call
0709 13:00:54.231610 (+2315899us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001662d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:54.231785 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2643856768}
I20260709 13:00:53.586951  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2167) took 1111 ms. Trace:
I20260709 13:00:54.661345  5002 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:53.734226  5659 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:54.731199  5232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.012s	sys 0.020s
I20260709 13:00:54.745159  2266 rpcz_store.cc:276] 0709 13:00:53.578458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.579745 (+  1287us) service_pool.cc:224] Handling call
0709 13:00:53.580163 (+   418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:53.586676 (+  6513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.586707 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:53.587525 (+   818us) log.cc:844] Serialized 52 byte log entry
0709 13:00:54.027230 (+439705us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:54.733182 (+705952us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.733561 (+   379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.733932 (+   371us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.734010 (+    78us) raft_consensus.cc:1685] finished
0709 13:00:54.734049 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.734791 (+   742us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10530,"prepare.queue_time_us":632421,"prepare.run_wall_time_us":65,"raft.queue_time_us":1944,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":2023,"thread_start_us":767697,"threads_started":2,"wal-append.queue_time_us":1080690}
I20260709 13:00:53.599323  5565 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:54.747054  1631 rpcz_store.cc:269] 0709 13:00:52.119566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.225962 (+106396us) service_pool.cc:224] Handling call
0709 13:00:53.806409 (+1580447us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54002fa3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:53.806567 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1483313024}
W20260709 13:00:54.755663  1627 rpcz_store.cc:269] 0709 13:00:52.971609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.560755 (+589146us) service_pool.cc:224] Handling call
0709 13:00:54.670485 (+1109730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.757995  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:54.805693  1628 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.759941  1706 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:54.735397  5630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.054s	user 0.007s	sys 0.019s
W20260709 13:00:54.744436  5555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.018s	sys 0.040s
I20260709 13:00:54.770449  5632 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:54.689462  5408 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.765077  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:54.804741  5232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.012s	sys 0.020s
I20260709 13:00:54.820762  1635 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:54.800531  5680 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.415525  5447 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:54.809404  5630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.128s	user 0.008s	sys 0.019s
I20260709 13:00:54.768947  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1964) took 2649 ms. Trace:
I20260709 13:00:54.779426  5699 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:54.775123  2262 raft_consensus.cc:2410] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:00:53.680631  5627 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 1.084s
W20260709 13:00:54.778862  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.779196  1551 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
W20260709 13:00:54.682452  5631 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.209s	user 0.006s	sys 0.005s
I20260709 13:00:54.783702  1560 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:54.795478  1633 rpcz_store.cc:276] 0709 13:00:53.188819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.696609 (+1507790us) service_pool.cc:224] Handling call
0709 13:00:54.795081 (+ 98472us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.801074  5426 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:54.793303  1630 rpcz_store.cc:269] 0709 13:00:52.118360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.118671 (+   311us) service_pool.cc:224] Handling call
0709 13:00:53.809493 (+1690822us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540006d1d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:53.809643 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2312415616}
I20260709 13:00:54.792109  2264 rpcz_store.cc:276] 0709 13:00:53.579141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.579278 (+   137us) service_pool.cc:224] Handling call
0709 13:00:53.579595 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.791159 (+1211564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.791397 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.847297  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:54.799970  1705 rpcz_store.cc:276] 0709 13:00:52.475972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.476166 (+   194us) service_pool.cc:224] Handling call
0709 13:00:52.498883 (+ 22717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.137576 (+638693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.586681 (+449105us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54001def54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:53.586887 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1467300224}
I20260709 13:00:54.791456  2267 rpcz_store.cc:276] 0709 13:00:52.950255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.956206 (+  5951us) service_pool.cc:224] Handling call
0709 13:00:52.956546 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.129349 (+172803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.129377 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.129851 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.479196 (+349345us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:53.526342 (+ 47146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.572196 (+ 45854us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400550854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:53.572260 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.715020 (+1142760us) raft_consensus.cc:1685] finished
0709 13:00:54.715040 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.715233 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15400,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":18878,"spinlock_wait_cycles":396560256,"thread_start_us":348912,"threads_started":1,"wal-append.queue_time_us":651225}
W20260709 13:00:54.781533  1524 connection.cc:256] RPC call timeout handler was delayed by -1.0336394789999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2752s for a response
I20260709 13:00:54.808770  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:54.786494  5672 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:54.763238  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:54.816047  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:54.816421  1706 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.819094  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 978) took 1655 ms. Trace:
I20260709 13:00:54.799837  5608 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.804344  5002 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.823454  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:54.890298  1627 raft_consensus.cc:3055] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:54.890226  5447 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:54.890785  1627 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:54.891390  5447 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:54.891760  5447 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:54.892541  5447 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.747850  5424 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:54.893952  5424 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.895010  5424 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.896951  5002 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.824738  1552 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:54.810397  5659 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:54.848202  5232 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.900662  5659 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.900884  5232 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.902875  5659 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:54.903072  5232 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:54.846812  1674 leader_election.cc:400] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12.
I20260709 13:00:53.663106  5501 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.908424  5704 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:00:54.908720  5501 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.910935  5501 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:54.835469  1629 rpcz_store.cc:276] 0709 13:00:52.119319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.856264 (+736945us) service_pool.cc:224] Handling call
0709 13:00:52.856604 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:52.857009 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.857036 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:52.857594 (+   558us) log.cc:844] Serialized 52 byte log entry
0709 13:00:53.178386 (+320792us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:53.204122 (+ 25736us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.204345 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.204433 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.800486 (+596053us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b180041f3e0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:00:54.764497 (+964011us) raft_consensus.cc:1685] finished
0709 13:00:54.768705 (+  4208us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.768883 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58503,"prepare.queue_time_us":25532,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":13552,"raft.queue_time_us":181460,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":38084,"spinlock_wait_cycles":68641664,"thread_start_us":320386,"threads_started":1,"wal-append.queue_time_us":517540}
I20260709 13:00:54.847311  1628 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:54.850180  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:54.911774  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 249201us
I20260709 13:00:54.912113  1633 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:54.834573  5624 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:54.823443  5680 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.846791  5707 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:54.886178  1631 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:54.918098  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:54.918787  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2241) took 1270 ms. Trace:
I20260709 13:00:54.919122  1631 rpcz_store.cc:276] 0709 13:00:53.649013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.805430 (+1156417us) service_pool.cc:224] Handling call
0709 13:00:54.918729 (+113299us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:54.920490  5679 raft_consensus.cc:670] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } [suppressed 3 similar messages]
W20260709 13:00:54.906703  5695 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:54.800109  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:54.886332  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:54.834410  5491 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:54.885551  1632 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:54.884552  5672 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.892917  5426 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:54.815654  5565 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.904027  1674 leader_election.cc:403] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:54.907330  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:54.926568  5686 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.518s	user 0.017s	sys 0.022s
I20260709 13:00:54.912027  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:54.944576  5708 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:54.946341  1629 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:54.946661  5708 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.947134  5708 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:54.884061  5631 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.952684  5631 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:54.953307  5631 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.912940  1633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
W20260709 13:00:54.848062  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.914774  5624 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:54.864770  2268 rpcz_store.cc:276] 0709 13:00:53.163405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.175249 (+ 11844us) service_pool.cc:224] Handling call
0709 13:00:53.175550 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.348377 (+172827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.348417 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.353159 (+  4742us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.527453 (+174294us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:53.918392 (+390939us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.918739 (+   347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.918841 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.818832 (+899991us) raft_consensus.cc:1685] finished
0709 13:00:54.818853 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.819027 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64946,"prepare.queue_time_us":1131909,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":17397,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":102787,"thread_start_us":487161,"threads_started":2,"wal-append.queue_time_us":221906}
I20260709 13:00:54.917327  5699 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:54.893400  5396 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.847653  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 885) took 1275 ms. Trace:
I20260709 13:00:54.886402  1626 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:54.936520  5002 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:54.939045  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2243) took 1189 ms. Trace:
I20260709 13:00:54.914856  5319 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.943202  2263 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:54.908202  5613 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.968787  5232 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12.
I20260709 13:00:54.953758  5631 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:54.945760  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2232) took 1992 ms. Trace:
I20260709 13:00:54.958354  1633 raft_consensus.cc:606] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:54.958503  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.974740  1634 rpcz_store.cc:276] 0709 13:00:52.954716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.796726 (+1842010us) service_pool.cc:224] Handling call
0709 13:00:54.945686 (+148960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.913448  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 794) took 1308 ms. Trace:
I20260709 13:00:54.959589  1630 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:54.888203  5542 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.976343  1628 rpcz_store.cc:276] 0709 13:00:53.604980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.757611 (+1152631us) service_pool.cc:224] Handling call
0709 13:00:54.913402 (+155791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.976609  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2238) took 1550 ms. Trace:
I20260709 13:00:54.977001  1630 rpcz_store.cc:276] 0709 13:00:53.426106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.907081 (+1480975us) service_pool.cc:224] Handling call
0709 13:00:54.976553 (+ 69472us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.978113  1628 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:54.978698  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2239) took 1476 ms. Trace:
I20260709 13:00:54.962920  1629 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
W20260709 13:00:54.963495  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 116870us
I20260709 13:00:54.980165  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 791) took 1816 ms. Trace:
I20260709 13:00:54.942716  5491 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:54.959164  5709 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:54.965150  5700 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:54.969400  5699 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:54.942715  5447 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:54.968948  1632 rpcz_store.cc:276] 0709 13:00:53.749793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.762844 (+1013051us) service_pool.cc:224] Handling call
0709 13:00:54.938981 (+176137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.995205  1634 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:00:54.969161  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2240) took 1430 ms. Trace:
I20260709 13:00:54.995641  1634 pending_rounds.cc:85] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 4
I20260709 13:00:54.996788  5491 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:54.978647  5232 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.903967  5608 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:54.987906  5709 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.995947  1634 pending_rounds.cc:107] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:00:54.998778  1674 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:54.971314  5613 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.007246  1634 raft_consensus.cc:2889] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.005648  2235 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:54.973949  5319 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.011718  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:54.945199  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 58941us
I20260709 13:00:55.013058  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 1971) took 2039 ms. Trace:
I20260709 13:00:54.980522  1629 rpcz_store.cc:276] 0709 13:00:53.164063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.911778 (+1747715us) service_pool.cc:224] Handling call
0709 13:00:54.980109 (+ 68331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.980777  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57634 (request call id 20) took 2002 ms. Trace:
I20260709 13:00:55.013484  1634 rpcz_store.cc:276] 0709 13:00:52.973224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.980964 (+2007740us) service_pool.cc:224] Handling call
0709 13:00:54.988951 (+  7987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.012756 (+ 23805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.012991 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.979038  1628 rpcz_store.cc:276] 0709 13:00:53.502280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.977407 (+1475127us) service_pool.cc:224] Handling call
0709 13:00:54.977945 (+   538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.978471 (+   526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.978647 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:55.013988  1633 rpcz_store.cc:276] 0709 13:00:52.974845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.912853 (+1938008us) service_pool.cc:224] Handling call
0709 13:00:54.977142 (+ 64289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.979069  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:54.986639  5375 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:54.962884  5565 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:55.019295  2235 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:54.970676  2263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 985) took 1381 ms (client timeout 1698 ms). Trace:
I20260709 13:00:54.995795  1626 rpcz_store.cc:276] 0709 13:00:53.538638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.802797 (+1264159us) service_pool.cc:224] Handling call
0709 13:00:54.969102 (+166305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:54.999006  1632 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:54.983175  5566 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:54.973141  1631 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:55.015280  1628 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:54.967901  2262 rpcz_store.cc:276] 0709 13:00:53.572324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.573637 (+  1313us) service_pool.cc:224] Handling call
0709 13:00:54.847580 (+1273943us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:55.020051  2263 rpcz_store.cc:269] 0709 13:00:53.589108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.808463 (+219355us) service_pool.cc:224] Handling call
0709 13:00:54.970620 (+1162157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:55.022387  1600 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:55.025600  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 793) took 1421 ms. Trace:
I20260709 13:00:55.026057  1632 rpcz_store.cc:276] 0709 13:00:53.604640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.995067 (+1390427us) service_pool.cc:224] Handling call
0709 13:00:54.995397 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.023091 (+ 27694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.025535 (+  2444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:55.004388  5674 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:55.027951  1632 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:55.008186  5626 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.009135  5365 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.009415  5709 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:54.997967  5699 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.061892  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:55.019811  5627 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:55.021164  5632 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:55.057926  1634 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:55.086259  5627 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.086660  5396 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.086751  5627 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:55.033681  5426 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:55.064093  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:54.989028  5624 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.010488  5232 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.093689  5232 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.094285  5232 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:55.094835  5232 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:55.095541  5699 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.096158  5699 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:55.097048  5232 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:55.097705  5232 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:55.024459  5408 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.091691  5624 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.107512  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:55.108219  1559 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:00:55.109138  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:55.109810  1556 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:55.064533  5365 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.032476  5566 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:55.078682  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:55.121214  1557 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:55.079414  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:55.083052  5631 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:55.084700  5608 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:55.057121  5626 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.023674  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2242) took 1323 ms. Trace:
W20260709 13:00:55.063766  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.076572  5709 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:55.117261  1554 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:55.123054  1628 rpcz_store.cc:276] 0709 13:00:53.700708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.014595 (+1313887us) service_pool.cc:224] Handling call
0709 13:00:55.014936 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.023405 (+  8469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.023615 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:55.021440  5630 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:55.039342  5501 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:55.120007  5426 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:55.120361  5650 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:00:55.126879  5501 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.127547  5426 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:55.123082  1706 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:00:55.023957  5002 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:00:55.129182  5322 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.130227  1706 pending_rounds.cc:85] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 4
I20260709 13:00:55.130816  1706 pending_rounds.cc:107] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:00:55.131248  1706 raft_consensus.cc:2889] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.132445  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2208) took 2001 ms. Trace:
I20260709 13:00:55.093374  5672 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.133002  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:55.133975  1554 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:55.131749  5630 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:55.133561  5673 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:00:55.105553  5708 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.127632  5501 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.152099  5565 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:55.120675  5566 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.133162  1706 rpcz_store.cc:276] 0709 13:00:53.130603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.134128 (+  3525us) service_pool.cc:224] Handling call
0709 13:00:53.134439 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.818049 (+683610us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b5400350820. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddf46dc0 00007f06ddfd11c0 00007f06ddfd2231 00007f06ddfced8f 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c
0709 13:00:55.132109 (+1314060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.132376 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23112960}
I20260709 13:00:55.168087  1601 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:55.169699  5672 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.166177  5566 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.170647  5672 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:55.134920  5232 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:00:55.179946  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.026s	sys 0.070s
W20260709 13:00:55.200317  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.027s	sys 0.070s
I20260709 13:00:55.185637  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:55.139910  5630 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.211899  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:55.060268  5674 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:55.206523  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 225912us
I20260709 13:00:55.164040  5631 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.164108  5679 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:55.212657  1557 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:55.218257  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.224301  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.203531  5712 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.231812  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.224936  1704 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:55.266299  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 617371us
I20260709 13:00:55.211889  5650 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:55.207507  5565 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:00:55.266904  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 1.53179e+06us
I20260709 13:00:55.308017  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.309060  1702 raft_consensus.cc:2410] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:00:55.272898  1526 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.943s (SENT)
W20260709 13:00:55.288203  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 272713us
I20260709 13:00:55.309886  1526 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:55.313373  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:55.314532  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.315769  1707 raft_consensus.cc:2410] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:55.221581  5365 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:55.322135  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.173249  5680 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.322850  1705 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:55.311049  5718 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.332085  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:55.333606  1557 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:55.333827  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 111674us
W20260709 13:00:55.334585  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 61721.2us
W20260709 13:00:55.335253  1526 leader_election.cc:336] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.983s (SENT)
I20260709 13:00:55.335682  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:55.339389  5634 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.340543  5634 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.341651  1628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:00:55.271651  5679 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.362421  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 789) took 2390 ms. Trace:
I20260709 13:00:55.372005  1631 rpcz_store.cc:276] 0709 13:00:52.972054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.919710 (+1947656us) service_pool.cc:224] Handling call
0709 13:00:54.931780 (+ 12070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.020819 (+ 89039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.362097 (+341278us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b540018f1d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:55.362338 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94681472}
I20260709 13:00:55.363310  1628 raft_consensus.cc:606] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:55.373687  1628 raft_consensus.cc:614] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:55.379237  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 294153us
I20260709 13:00:55.344411  1524 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:55.319940  5565 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:55.402570  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:55.402915  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 58584us
I20260709 13:00:55.265746  5631 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:55.408592  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 73376.9us
W20260709 13:00:55.439294  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.442042  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.442922  1705 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:55.444360  1557 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
W20260709 13:00:55.452242  5724 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:00:55.453401  5365 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:55.407449  1627 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.454103  5365 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.455051  1627 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.456374  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2246) took 1208 ms. Trace:
W20260709 13:00:55.457432  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.457726  5673 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:55.459398  5408 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:55.460351  5700 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:55.460393  5408 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:55.457821  2236 connection.cc:256] RPC call timeout handler was delayed by -1.9650955490000115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 13:00:55.462826  2236 connection.cc:256] RPC call timeout handler was delayed by -1.9416955490000305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 13:00:55.463197  1629 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:00:55.463306  2236 connection.cc:256] RPC call timeout handler was delayed by -1.6617955490000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 13:00:55.464102  2236 connection.cc:256] RPC call timeout handler was delayed by -1.66018821199998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2657s for a response
I20260709 13:00:55.456796  1626 rpcz_store.cc:276] 0709 13:00:54.248058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.020348 (+772290us) service_pool.cc:224] Handling call
0709 13:00:55.054581 (+ 34233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.059335 (+  4754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.059385 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.124083 (+ 64698us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.380030 (+255947us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:55.380092 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.380193 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.456140 (+ 75947us) raft_consensus.cc:1685] finished
0709 13:00:55.456162 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.456311 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":4838,"thread_start_us":199058,"threads_started":1,"wal-append.queue_time_us":313724}
I20260709 13:00:55.468181  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.469030  1705 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:55.335462  5715 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:55.470438  2236 connection.cc:256] RPC call timeout handler was delayed by -1.2569882119999534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3105s for a response
I20260709 13:00:55.468945  1627 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
W20260709 13:00:55.412061  5678 consensus_meta.cc:287] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.000s
I20260709 13:00:55.470536  1600 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:55.479025  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:55.479818  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.481571  1634 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:55.461454  5700 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.403980  5542 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:55.475726  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:55.477974  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2249) took 1079 ms. Trace:
W20260709 13:00:55.477509  2236 connection.cc:256] RPC call timeout handler was delayed by -1.0499771579999901s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
I20260709 13:00:55.490804  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.491533  2262 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:55.493299  2264 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:00:55.494606  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.481743  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:55.307857  5712 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:55.411244  5709 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:55.413029  5613 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.408026  5713 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:55.409643  5525 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:55.517997  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.441735  5424 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:00:55.410600  5708 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.494406  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:55.484107  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.485172  1705 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:55.496869  1627 rpcz_store.cc:276] 0709 13:00:54.398334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.811181 (+412847us) service_pool.cc:224] Handling call
0709 13:00:55.356732 (+545551us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4c00260040. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc29ba20 00007f06dc2aca29 00007f06dc272644 00007f06dc299f2d 00007f06dc299b93 00007f06ddfca18b 00007f06ddfcacb5 00007f06ddfc5f30 00007f06ddfc77de 00007f06ddfd327c 00007f06e2f94b17
0709 13:00:55.477885 (+121153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36082560}
I20260709 13:00:55.496137  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:55.502558  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.503759  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.512732  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.474990  5648 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.513651  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 175888us
I20260709 13:00:55.507267  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.515910  2268 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:55.475725  5322 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:55.516654  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:55.350473  5718 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:55.456391  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.537465  2234 connection.cc:256] RPC call timeout handler was delayed by -1.0245999310000116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
I20260709 13:00:55.412521  5232 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:55.516034  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 792) took 1916 ms. Trace:
I20260709 13:00:55.523029  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:55.543413  5722 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:00:55.544158  1601 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:55.523351  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.546000  5631 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:55.546617   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:55.535609  5322 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:55.548040  5322 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.549422  5322 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.549738  5712 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:55.518261  5525 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.550508  5650 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.534555  5396 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:00:55.523917  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.551704  5674 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:55.552037  5002 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:55.552763  5002 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:55.554170  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:55.487926  5711 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:55.532845  2270 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.555083  5711 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.555483  5711 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.557343  5709 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:55.503728  5632 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:55.558233  5632 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.541678  1630 rpcz_store.cc:276] 0709 13:00:53.599860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.977564 (+1377704us) service_pool.cc:224] Handling call
0709 13:00:54.977835 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.978080 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:55.220254 (+242174us) log.cc:844] Serialized 14 byte log entry
0709 13:00:55.515681 (+295427us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.515736 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:55.515783 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.515844 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.515980 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1977,"prepare.queue_time_us":350681,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":84,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":1466,"thread_start_us":536857,"threads_started":2}
I20260709 13:00:55.550360  5525 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.475407  5723 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:00:55.538374  5648 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.558620  5632 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.527802  2266 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.563170  5648 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:55.564450  5680 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.487588  5678 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.581919  5678 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:55.584398  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.534987  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.585695  1701 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:55.534873  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.586735  5608 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:55.586927  2262 raft_consensus.cc:2410] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:55.567169  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:55.587831  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.588418  2262 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
W20260709 13:00:55.588650  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.588798  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:55.589246  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.589651  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:55.491278  5700 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.526225  5727 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:55.511469  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:55.515569  5717 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:00:55.540194  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44136.9us
I20260709 13:00:55.551066  5650 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.558537  2271 raft_consensus.cc:2410] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:00:55.565250  2270 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:55.533262  2265 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:55.530449  2267 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:55.570228  2266 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:55.594995  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:55.604775  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 389332us
I20260709 13:00:55.598496   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:55.525444  5713 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.536856  5626 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:55.536139  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:55.706192  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 243765us
W20260709 13:00:55.731946  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.816560  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 226973us
I20260709 13:00:55.817239  5608 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:55.589800  2262 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:55.817834  5700 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:55.818045  5566 consensus_meta.cc:287] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.647s	user 0.016s	sys 0.000s
I20260709 13:00:55.818442  1552 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 7.
I20260709 13:00:55.818742  5632 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.609597  5565 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:55.819829  5729 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:55.820349  5679 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:55.820711  5232 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.840205  5707 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.889732  5232 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:55.890113  5707 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:55.845141  5408 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:00:55.817874  5375 consensus_meta.cc:287] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.796s	user 0.004s	sys 0.012s
I20260709 13:00:55.829047  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:55.826828  5501 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.007s
W20260709 13:00:55.821796  5721 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.213s	user 0.004s	sys 0.006s
W20260709 13:00:55.822980  5624 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.724s	user 0.013s	sys 0.007s
I20260709 13:00:55.823318  5715 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:55.823657  5525 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:55.519515  5542 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:00:55.824568  5002 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:55.609511  5672 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:00:55.526691  5613 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
W20260709 13:00:55.826371  1526 leader_election.cc:336] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.232s (SENT)
W20260709 13:00:55.907001  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80669.9us
W20260709 13:00:55.825964  5630 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.607s	user 0.015s	sys 0.000s
I20260709 13:00:55.831025  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:55.908601  2270 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.831665  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.909224  2265 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:55.832703  2268 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
W20260709 13:00:55.833400  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.826988  5627 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.740s	user 0.014s	sys 0.005s
W20260709 13:00:55.835186  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.909927  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.914254  2265 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:00:55.876626  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.827105  5712 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:55.828091  5718 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.828495  5727 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:55.828667  5717 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:55.838213  2271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 841) took 2259 ms (client timeout 1972 ms). Trace:
I20260709 13:00:55.841089  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:55.925104  2271 rpcz_store.cc:269] 0709 13:00:53.578804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.580765 (+  1961us) service_pool.cc:224] Handling call
0709 13:00:55.837881 (+2257116us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400289bd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:55.838125 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866125184}
I20260709 13:00:55.841312  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:55.828863  1704 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:00:55.834106  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 298067us
I20260709 13:00:55.927773  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:55.928757  5727 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:55.826176  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:55.929972  5727 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:55.930357  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 104339us
I20260709 13:00:55.931008  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:55.932904  2234 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:55.840574  5608 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:55.933615  5608 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.933743  5632 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.839955  5713 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.829252  5650 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.892493  5232 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:55.844765  5319 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:55.821273  5680 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.893613  5365 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:55.894018  1635 raft_consensus.cc:2410] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:00:55.821882  5447 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:55.969792  1555 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:55.971051  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:55.971868  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:55.973059  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:55.974239  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:55.975194  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.975987  1701 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:55.976713  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:55.977684  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.978261  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.978842  1702 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:55.979265  5650 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.979640  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:55.979691  5680 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.980336  1702 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.981417  5650 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:55.845166  5723 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:55.895069  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 66105.3us
W20260709 13:00:55.895370  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 60757.2us
I20260709 13:00:55.895610  5375 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:55.892485  5707 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:55.835659  2236 leader_election.cc:336] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.601s (SENT)
I20260709 13:00:55.821007  5711 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.903069  2264 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:55.867164  5566 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.887373  5729 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:55.902961  5715 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:55.922464  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:55.923403  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:55.916213  5712 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:55.936218  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.938699  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:55.939018  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:55.939455  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:55.932896  1552 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:55.940100  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:55.905412  5002 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.943807  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:55.944789  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:55.944850  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.946053  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.946224  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:55.947563  1709 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:55.907991  5672 consensus_queue.cc:1243] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:55.943591  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:55.939808  5736 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.959180  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:56.050932  1628 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:56.084801  1630 raft_consensus.cc:2368] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10.
I20260709 13:00:56.084729  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.085461  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.053684  1632 raft_consensus.cc:2376] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10. Re-sending same reply.
W20260709 13:00:56.052011  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.983196  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:56.014155  1706 raft_consensus.cc:3055] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:56.051192  1629 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:55.989346  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49507.6us
I20260709 13:00:56.089118  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.089748  1629 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:00:56.090519  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:55.962638  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:55.963332  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:56.055569  1631 raft_consensus.cc:2376] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10. Re-sending same reply.
I20260709 13:00:55.963111  2271 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:56.093966  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:56.094168  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:55.982342  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:55.965054  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:55.953979  2270 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:00:56.056614  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:55.982856  1557 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:55.975287  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:56.098251  1553 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:55.963352  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.056034  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:56.052794  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:56.100903  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44375.6us
W20260709 13:00:56.101557  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 48838.5us
I20260709 13:00:55.924818  5426 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.054790  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.103719  1709 raft_consensus.cc:2410] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:56.085588  1634 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:55.962688  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:56.104862  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.105211  2268 raft_consensus.cc:2376] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10. Re-sending same reply.
I20260709 13:00:56.086239  1628 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:56.087857  1706 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:00:56.012328  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 1974) took 3038 ms (client timeout 3291 ms). Trace:
I20260709 13:00:56.094806  1632 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
W20260709 13:00:56.107299  1635 rpcz_store.cc:269] 0709 13:00:52.974384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.821619 (+1847235us) service_pool.cc:224] Handling call
0709 13:00:56.012100 (+1190481us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540019a5d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:56.012246 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2319850368}
I20260709 13:00:56.107880  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.047415  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:56.091269  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:56.109745  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.110725  1629 raft_consensus.cc:2376] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10. Re-sending same reply.
W20260709 13:00:56.112203  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.903708  5501 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.108508  1632 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:56.114194  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:56.127328  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.128302  1627 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:56.130141  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.131078  1704 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:56.131990  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.132949  1633 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:56.134294  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:56.134994  1701 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.114989  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:56.115922  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:56.116559  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.116845  5711 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:56.118112  1454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35568 (request call id 321) took 11097 ms. Trace:
I20260709 13:00:56.143177  1555 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:56.118189  5424 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:56.119086  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:56.119732  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:56.120594  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.122305  5672 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:55.964651  5679 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.159s
I20260709 13:00:55.986116  5626 consensus_queue.cc:1059] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 13:00:55.954980  5718 raft_consensus.cc:2764] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:56.173074  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.173837  1709 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:56.174472  2269 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:56.174331  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.084117  5365 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:56.114351  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.175794  1631 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:55.964597  5624 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:55.917665  5630 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:55.964494  5634 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:56.154449  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.126420  5659 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:56.183250  1706 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:55.921072  5627 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.201957  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:56.202132  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 366529us
I20260709 13:00:56.059728  5712 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.981918  5680 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:56.214344  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.214594  5680 consensus_queue.cc:1059] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:56.215411  5680 raft_consensus.cc:3055] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:56.215667  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.002501  5542 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.216450  5542 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:55.988906  5555 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.059577  5002 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.163853  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:56.167169  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:56.221549  2263 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:56.062497  5723 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.221904  1559 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:56.142385  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.165295  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.223047  1704 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:56.223910  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:56.224359  1526 leader_election.cc:336] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.645s (SENT)
I20260709 13:00:56.177430  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.111932  5707 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:56.155689  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:56.229857  1703 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:56.129114  5632 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:56.182618  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:56.142190  5319 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.183746  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:55.989343  5648 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:56.163952  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:56.241590  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:56.241935  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 78149.9us
I20260709 13:00:56.113224  5736 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.186932  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:56.231956  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:56.243844  1629 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:55.965148  5713 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.203s
I20260709 13:00:56.202663  1558 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
W20260709 13:00:56.202813  2236 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.627s (SENT)
I20260709 13:00:56.246127  2236 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:56.203332  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:56.204891  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:56.204982  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.205277  1627 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:56.150861  5426 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:56.205626  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:56.206930  5630 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:56.279323  1701 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:56.279371  1526 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:56.207231  5650 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:56.208381  5747 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:00:56.209764  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.015s	sys 0.019s
I20260709 13:00:56.234716  5632 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.215788  5680 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:56.153513  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:56.012491  5525 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:56.216887  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.297839  1558 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:00:56.298406  1709 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:56.217500  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:56.062793  5375 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.224946  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:56.299386  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 74548.6us
I20260709 13:00:56.221609  1632 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:56.232540  1707 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:56.233952  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:56.235661  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.183861  5659 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.235046  1555 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:00:56.247723  1630 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:00:56.250205  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:56.167506  5608 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:56.269080  1635 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:00:56.320806  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.278082  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 164006us
I20260709 13:00:56.322630  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:56.322973  1554 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:00:56.280471  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.282673  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.229377  5707 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.229110  5723 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:56.205590  1456 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
W20260709 13:00:56.288962  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.015s	sys 0.020s
I20260709 13:00:55.994807  5717 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:56.291276  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.143306  1454 rpcz_store.cc:276] 0709 13:00:45.020429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.146403 (+125974us) service_pool.cc:224] Handling call
0709 13:00:56.117846 (+10971443us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:49.279474 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:49.280124 (+   650us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:49.280184 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:00:49.280212 (+    28us) tablet.cc:662] Decoding operations
0709 13:00:49.286613 (+  6401us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:49.311985 (+ 25372us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:49.331459 (+ 19474us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:00:49.447116 (+115657us) tablet.cc:701] Row locks acquired
0709 13:00:49.447163 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:00:49.447358 (+   195us) write_op.cc:270] Start()
0709 13:00:49.447507 (+   149us) write_op.cc:276] Timestamp: P: 1783602049447293 usec, L: 0
0709 13:00:49.447532 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:00:49.493574 (+ 46042us) log.cc:844] Serialized 8236 byte log entry
0709 13:00:50.661190 (+1167616us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:00:50.853194 (+192004us) op_driver.cc:464] REPLICATION: finished
0709 13:00:51.060389 (+207195us) write_op.cc:301] APPLY: starting
0709 13:00:51.060596 (+   207us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:51.062622 (+  2026us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:51.062669 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:51.105594 (+ 42925us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:51.106051 (+   457us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=40
0709 13:00:51.106104 (+    53us) write_op.cc:312] APPLY: finished
0709 13:00:51.106661 (+   557us) log.cc:844] Serialized 139 byte log entry
0709 13:00:51.106898 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:51.107145 (+   247us) write_op.cc:454] Released schema lock
0709 13:00:51.107302 (+   157us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:51.140249 (+ 32947us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:51.146393 (+  6144us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":67616,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":153382,"apply.run_cpu_time_us":7064,"apply.run_wall_time_us":73311,"num_ops":20,"prepare.queue_time_us":153201,"prepare.run_cpu_time_us":22940,"prepare.run_wall_time_us":294660,"raft.queue_time_us":158185,"raft.run_cpu_time_us":17243,"raft.run_wall_time_us":96655,"replication_time_us":1405442,"spinlock_wait_cycles":91049216,"thread_start_us":248731,"threads_started":4,"wal-append.queue_time_us":401848,"wal-append.run_cpu_time_us":50754,"wal-append.run_wall_time_us":2241740}]]}
I20260709 13:00:56.241308  5648 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.306731  2234 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:56.339291  1553 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:56.292011  1556 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:56.201608  5365 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.310734  1628 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:56.312752  1559 raft_consensus.cc:2393] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 6: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:56.318775  1552 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 8: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:56.323741  1701 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:56.326372  1555 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:00:56.326551  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 805341us
I20260709 13:00:56.326855  1551 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:56.329329  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 86560.8us
I20260709 13:00:56.283931  5650 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.323081  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:56.350718  1626 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:56.297873  5737 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:56.289893  5565 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:56.336618  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 57341us
I20260709 13:00:56.336799  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:56.234851  5555 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.325007  5718 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:56.342043  1630 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:00:56.303862  5632 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:56.332063  1700 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:00:56.324836  5659 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:56.248483  5319 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.310132  5375 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:56.355898  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:56.356393  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.335666  5634 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:56.343230  5648 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:56.236644  5729 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:56.330787  5707 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:56.362581  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:56.371919  5718 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.362311  5741 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:56.376411  5717 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:56.373193  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:56.341207  1558 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:56.373966  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:00:56.374993  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 226580us
I20260709 13:00:56.338136  5525 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:56.297473  5613 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:00:56.378188  5761 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:56.359395  5700 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:00:56.380056  5715 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:56.289160  5322 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:00:56.387890  5713 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:00:56.371429  1456 catalog_manager.cc:5697] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 7, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:56.344440  5624 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:00:56.448441  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 74567us
I20260709 13:00:56.389844  1702 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:56.452956  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:56.403976  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52399.5us
I20260709 13:00:56.456259  1702 raft_consensus.cc:2368] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10.
I20260709 13:00:56.362406  5626 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:56.356195  5650 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:56.408021  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 45512.4us
I20260709 13:00:56.354436  5746 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:56.356585  5565 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:56.358794  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:56.416517  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:56.389731  5679 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:56.420545  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:56.480047  1700 raft_consensus.cc:2410] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:00:56.422623  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 66829.6us
I20260709 13:00:56.376362  5680 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:56.380409  5555 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:56.429833  5363 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:56.430673  5742 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:00:56.430608  5755 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:56.462620  5626 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:00:56.434978  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.413928  5718 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:56.493957  5322 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:56.383045  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:56.414847  5741 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.446480  1632 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:00:56.417444  5566 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:56.421974  5232 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:56.525177  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:56.388701  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 185936us
I20260709 13:00:56.525959  1702 raft_consensus.cc:2368] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10.
I20260709 13:00:56.327316  5424 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:00:56.455924  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:56.527058  1630 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:56.459635  1553 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:00:56.475965  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 117273us
I20260709 13:00:56.444413  5525 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:56.387020  5630 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:56.484438  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 68019.2us
I20260709 13:00:56.490332  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:56.459187  5542 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:56.469010  5713 consensus_queue.cc:1243] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:56.469189  5715 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:56.461206  5501 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:56.477355  5699 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:56.431280  5756 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.508183  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:56.471417  5761 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:56.493170  5749 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:56.517102  5765 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:56.516995  5754 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:56.481942  5565 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.487248  1456 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 8 to 11, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:56.524742  5741 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.528045  1526 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:56.505709  5555 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:56.490916  5760 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:56.543046  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.543393  1707 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:00:56.559846  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.548753  1702 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:00:56.560292  5375 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:56.561800  1702 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:56.560515  1707 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:56.564283  5375 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:56.564766  1707 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:56.566196  1707 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: [8.11-8.11]
I20260709 13:00:56.567482  1707 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:56.527576  5322 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:56.563097  1702 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:00:56.602892  5322 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.603606  1702 pending_rounds.cc:85] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 6
I20260709 13:00:56.603973  1702 pending_rounds.cc:107] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:00:56.604202  1702 raft_consensus.cc:2889] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:56.527243  5766 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:56.490428  5634 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.607636  1700 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:56.539976  5736 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:56.596359  5626 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.486529  5746 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:56.597918  5727 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.003s
I20260709 13:00:56.601984  5713 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:56.568746  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 184976us
W20260709 13:00:56.610736  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 82786.7us
I20260709 13:00:56.640960  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:56.642586  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 161426us
I20260709 13:00:56.643002  1526 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:56.543591  5699 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:56.569379  5739 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 13:00:56.636588  5753 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:00:56.551431  5754 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:56.651500  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:56.551064  5426 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:56.572199  5408 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:56.643925  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:56.551883  5756 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:56.672111  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.640137  5365 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:56.654385  5736 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:56.654016  5713 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:56.674228  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:56.813263  5659 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.569043  5232 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:56.663446  5626 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.657272  5760 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:56.715826  5002 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.722383  5773 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:56.748490  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.665953  5525 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.668442  5555 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:56.786387  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 142530us
I20260709 13:00:56.635974  5624 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.655824  5712 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:56.839959  1634 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:56.789273  1705 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:56.791026  5565 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:56.791814  5739 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.130s	user 0.002s	sys 0.005s
I20260709 13:00:56.792415  1456 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:56.672996  5771 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:56.795156  5753 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:00:56.676064  5736 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.793803  5754 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.812215  5756 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:56.814333  5713 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.656713  5319 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:56.616032  5723 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:56.821326  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 295088us
W20260709 13:00:56.833891  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.840246  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:56.819974  5769 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.781817  5648 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:56.848920  2267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.035s	sys 0.043s
I20260709 13:00:56.819130  5632 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:56.839244  5650 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:56.819106  5699 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.834218  5761 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.840302  5760 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:57.265854  1556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2167) took 1307 ms (client timeout 1568 ms). Trace:
I20260709 13:00:56.935418  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:57.276124  2236 leader_election.cc:336] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.938s (SENT)
I20260709 13:00:57.276405  2271 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:00:56.994190  2235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.005s	sys 0.009s
I20260709 13:00:57.276859  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:57.277324  2235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.011s	sys 0.033s
W20260709 13:00:57.278236  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 1.04635e+06us
W20260709 13:00:57.279721  1599 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.002s	sys 0.010s
W20260709 13:00:57.280057  1599 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.002s	sys 0.010s
W20260709 13:00:57.045817  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.274119  1556 rpcz_store.cc:269] 0709 13:00:55.958787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.958919 (+   132us) service_pool.cc:224] Handling call
0709 13:00:57.265647 (+1306728us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540030b954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:57.265779 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468273024}
W20260709 13:00:57.280308  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 800625us
W20260709 13:00:57.034627  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.280859  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.281616  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.280318  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:56.933815  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.272672  2267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.045s	sys 0.086s
I20260709 13:00:56.946803  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:57.286504  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.286911  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 340238us
I20260709 13:00:57.287020  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 987) took 1748 ms. Trace:
I20260709 13:00:57.284418  2235 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:56.928762  5002 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:56.951336  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:57.272040  2265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.009s	sys 0.051s
W20260709 13:00:57.307628  2265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.009s	sys 0.051s
I20260709 13:00:57.044039  1456 catalog_manager.cc:5697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 3 to 9, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
W20260709 13:00:56.930151  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.288197  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 448052us
I20260709 13:00:57.287815  2267 rpcz_store.cc:276] 0709 13:00:55.538665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.962568 (+423903us) service_pool.cc:224] Handling call
0709 13:00:55.974346 (+ 11778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.974558 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:56.171164 (+196606us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.286436 (+1115272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.286517 (+    81us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:57.286585 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.286684 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.286941 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5391,"prepare.queue_time_us":245588,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":122038,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":18263,"thread_start_us":1306808,"threads_started":3,"wal-append.queue_time_us":199230}
I20260709 13:00:56.919251   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:56.881942  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e99891af85f4b10aa1cc2da6aa33082 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:57.292491  5630 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 8.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:57.105041  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 986) took 1566 ms. Trace:
I20260709 13:00:57.293574  5760 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:56.843861  5771 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.295205  5756 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:56.843780  5555 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.297240  5778 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:57.298297  5746 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:57.299976  5634 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:57.302318  5741 consensus_meta.cc:287] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.004s
W20260709 13:00:57.303504  5707 consensus_meta.cc:287] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.893s	user 0.005s	sys 0.005s
W20260709 13:00:57.046489  5777 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 13:00:57.312502  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:57.314669  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:57.315462  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:57.309208  1456 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 5 to 7, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:57.041484  5767 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
W20260709 13:00:57.202327  5782 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:00:57.317162  2266 rpcz_store.cc:276] 0709 13:00:55.538335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.955906 (+417571us) service_pool.cc:224] Handling call
0709 13:00:55.956214 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.017733 (+ 61519us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:56.162731 (+144998us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.515157 (+352426us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.515578 (+   421us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.515747 (+   169us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.516197 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.516319 (+   122us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:56.516349 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.516439 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.104729 (+588290us) raft_consensus.cc:1685] finished
0709 13:00:57.104759 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.104958 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64842,"prepare.queue_time_us":228569,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":5210,"raft.queue_time_us":190615,"raft.run_cpu_time_us":422,"raft.run_wall_time_us":12229,"thread_start_us":455611,"threads_started":3,"wal-append.queue_time_us":217470}
I20260709 13:00:57.092396  5718 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:57.323592  1673 leader_election.cc:400] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11.
I20260709 13:00:56.849756  5736 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.323882  2264 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:56.928972  5732 raft_consensus.cc:3055] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:57.327039  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:57.327162  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:57.291751  5319 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.331285  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:57.306496  5775 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:57.335400  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:57.333310  5002 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.337780  5707 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.369681  1553 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 12: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:57.339547  1524 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:57.370168  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46725.3us
I20260709 13:00:57.370434  1706 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.322387  5717 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:00:57.344631  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:57.328092  5771 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.332604  5634 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.349536  5732 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:57.350050  1704 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:57.324398  1443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 450253us
I20260709 13:00:57.334154  5754 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.399173  5718 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:57.389762  5717 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.399791  5718 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:57.397557  5632 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:57.291338  5769 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.333847  5712 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:57.323252  5773 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:57.366056  1629 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:57.369477  5002 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.338344  5778 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:57.371757  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:57.371803  1524 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:57.430943  1704 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:00:57.372462  1701 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:56.919998  5232 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.344357  5731 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:57.377406  1630 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 6.
I20260709 13:00:57.347854  5784 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.397506  5659 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:57.367115  5775 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.386722  5525 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:57.402179  1556 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:00:57.374274  5715 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.000s
I20260709 13:00:57.336570  5741 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.402823  1456 catalog_manager.cc:5697] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 5 to 6, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.436132  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:57.401747  5717 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:57.445803  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:00:57.447003  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 75321.7us
I20260709 13:00:57.455770  1673 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:57.433301  5322 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.449674  5002 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:57.436591  5789 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:00:57.392067  5634 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.452766  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:57.427872  5555 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:57.462376  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2275) took 1339 ms. Trace:
I20260709 13:00:57.462668  5796 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.457835  5659 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:57.462788  1627 rpcz_store.cc:276] 0709 13:00:56.123337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.248640 (+125303us) service_pool.cc:224] Handling call
0709 13:00:56.293241 (+ 44601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.354760 (+ 61519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.354790 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.371630 (+ 16840us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.506657 (+135027us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:56.506698 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.506765 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.462141 (+955376us) raft_consensus.cc:1685] finished
0709 13:00:57.462164 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.462318 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16062,"raft.queue_time_us":51508,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":97712,"threads_started":1,"wal-append.queue_time_us":155540}
W20260709 13:00:57.457787  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.447970  1706 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:00:57.465732  1706 pending_rounds.cc:85] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 5
I20260709 13:00:57.466358  1706 pending_rounds.cc:107] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:00:57.448585  5775 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.466678  1706 raft_consensus.cc:2889] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:57.467438  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2229) took 1950 ms. Trace:
W20260709 13:00:57.460638  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 149148us
I20260709 13:00:57.467880  1706 rpcz_store.cc:276] 0709 13:00:55.517044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.517268 (+   224us) service_pool.cc:224] Handling call
0709 13:00:55.531388 (+ 14120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.014053 (+482665us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400351720. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddf46dc0 00007f06ddfd11c0 00007f06ddfd2231 00007f06ddfced8f 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c
0709 13:00:57.370199 (+1356146us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5800418ad0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddf2b0aa 00007f06ddfad447 00007f06ddfc5fe7 00007f06ddfc77de 00007f06ddfd1b49 00007f06ddfd2416 00007f06ddfced8f 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4
0709 13:00:57.467173 (+ 96974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.467367 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1378322432}
I20260709 13:00:57.426777  5650 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:57.470175  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 194099us
I20260709 13:00:57.448506  5731 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:57.470885  2236 leader_election.cc:336] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.942s (SENT)
I20260709 13:00:57.454576  5778 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:57.479063  1707 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:57.481459  2236 leader_election.cc:336] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.657s (SENT)
I20260709 13:00:57.490505  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:57.475509  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.493717  1556 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:00:57.498943  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:57.500545  1706 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
W20260709 13:00:57.486189  5673 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:00:57.505790  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:57.504488  1629 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:57.504594  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:57.459443  5792 raft_consensus.cc:2764] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:00:57.507283  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 135578us
I20260709 13:00:57.478258  5659 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:57.513041  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:57.513846  1630 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:57.514456  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:57.515578  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:00:57.516306  5744 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.100s	user 0.002s	sys 0.001s
W20260709 13:00:57.519141  5786 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:00:57.521102  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2234) took 1283 ms. Trace:
I20260709 13:00:57.512322  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:57.522110  1629 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:00:57.523073  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2176) took 1580 ms (client timeout 1645 ms). Trace:
I20260709 13:00:57.521620  1700 rpcz_store.cc:276] 0709 13:00:56.237309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.608525 (+371216us) service_pool.cc:224] Handling call
0709 13:00:56.608853 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.615614 (+  6761us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:56.661668 (+ 46054us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.844951 (+183283us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.850592 (+  5641us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.850722 (+   130us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:56.850757 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.850824 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.520836 (+670012us) raft_consensus.cc:1685] finished
0709 13:00:57.520860 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.521036 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":221634,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":40859,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":34941,"thread_start_us":104073,"threads_started":2,"wal-append.queue_time_us":536778}
W20260709 13:00:57.523504  1705 rpcz_store.cc:269] 0709 13:00:55.943187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.943315 (+   128us) service_pool.cc:224] Handling call
0709 13:00:57.522904 (+1579589us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b54001df454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:57.523020 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1347047168}
I20260709 13:00:57.524757  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:57.524945  5787 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:00:57.526846  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2256) took 1581 ms. Trace:
I20260709 13:00:57.527261  1626 rpcz_store.cc:276] 0709 13:00:55.945508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.945623 (+   115us) service_pool.cc:224] Handling call
0709 13:00:55.979178 (+ 33555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.351240 (+372062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.526606 (+1175366us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b5400088ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:57.526788 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853996416}
I20260709 13:00:57.529693  5756 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:57.530156  5756 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:57.530396  5613 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:57.530781  5613 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:00:57.531293  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.531087  5756 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:57.531878  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.532356  5756 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.532630  5737 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:57.529428  5775 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:57.754891  5737 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:57.755806  5737 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.756313  5775 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:57.756760  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1000) took 1607 ms. Trace:
I20260709 13:00:57.756340  5319 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:57.535324  5776 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.583s	user 0.001s	sys 0.000s
I20260709 13:00:57.757138  2265 rpcz_store.cc:276] 0709 13:00:56.149164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.149314 (+   150us) service_pool.cc:224] Handling call
0709 13:00:56.149711 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.327379 (+177668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.327451 (+    72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.328422 (+   971us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.308100 (+979678us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:57.308160 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.308269 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.756585 (+448316us) raft_consensus.cc:1685] finished
0709 13:00:57.756604 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.756713 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15307,"raft.queue_time_us":148441,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":18149,"thread_start_us":1072276,"threads_started":2,"wal-append.queue_time_us":979195}
I20260709 13:00:57.758893  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:57.761791  5754 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:57.761937  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.762328  5754 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.762907  5707 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:57.763510  5707 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.763726  2268 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:57.763983  5707 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:57.764475  5754 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:57.753942  5741 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:57.449848  5784 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.525854  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:57.542716  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:57.508533  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:57.788045  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:57.788354  5784 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:57.769959  5771 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.788766  1627 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.762352  1552 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:57.521869  5565 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:57.570549  5769 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:57.471352  5322 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.790402  1553 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
W20260709 13:00:57.791617  1628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2261) took 1843 ms (client timeout 2208 ms). Trace:
I20260709 13:00:57.791777  5322 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:57.539307  5723 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:57.791989  1628 rpcz_store.cc:269] 0709 13:00:55.947713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.109467 (+161754us) service_pool.cc:224] Handling call
0709 13:00:57.791437 (+1681970us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54001653d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:57.791561 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459991424}
I20260709 13:00:57.652926  1456 catalog_manager.cc:5697] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
W20260709 13:00:57.684549  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.793191  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:57.793627  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.793897  1456 catalog_manager.cc:5697] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 8 to 11, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.794936  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 702) took 1702 ms. Trace:
I20260709 13:00:57.795569  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:57.796200  1700 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:57.795928  1456 catalog_manager.cc:5697] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:00:57.797089  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:57.534056  5624 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.803397  1700 raft_consensus.cc:2376] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10. Re-sending same reply.
I20260709 13:00:57.781533  5648 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:57.783419  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 997) took 1690 ms. Trace:
I20260709 13:00:57.770705  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:57.807035  5648 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.807361  5707 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:57.807512  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:57.774776  5634 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.808791  2236 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:57.797523  5608 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:57.810161  5634 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:57.738058  5762 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:00:57.809382  5624 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.810895  5762 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:57.812913  5762 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:57.538934  5773 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:57.806164  2270 rpcz_store.cc:276] 0709 13:00:56.092960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.112614 (+ 19654us) service_pool.cc:224] Handling call
0709 13:00:56.112937 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.376595 (+263658us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:56.403954 (+ 27359us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.669848 (+265894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.669904 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:56.669951 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.783185 (+1113234us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400550854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:57.783234 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.783357 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28708,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":103,"raft.run_cpu_time_us":7075,"raft.run_wall_time_us":41555,"spinlock_wait_cycles":605908864,"thread_start_us":265497,"threads_started":1,"wal-append.queue_time_us":441839}
I20260709 13:00:57.505002  5525 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 13:00:57.741240  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:57.816614  1632 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:57.742039  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:00:57.740132  5626 consensus_meta.cc:287] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.905s	user 0.013s	sys 0.000s
I20260709 13:00:57.742760  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:57.819073  5648 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.819774  5784 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:57.820068  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:57.820665  1700 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:00:57.821441  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:57.822005  1700 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:57.780233  5736 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:57.510640  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:57.743924  2266 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:00:57.486938  5712 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.215s
I20260709 13:00:57.745929  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:57.825441  1630 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:57.825508  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 314973us
I20260709 13:00:57.826066  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:57.531577  5613 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:57.747248  1631 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:57.826824  2266 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:57.826879  5613 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.827828  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:57.828626  2266 raft_consensus.cc:2410] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:57.829303  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:57.746631  1673 connection.cc:256] RPC call timeout handler was delayed by -5.125600362000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 13:00:57.830542  1673 connection.cc:256] RPC call timeout handler was delayed by -3.3603055750000408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
W20260709 13:00:57.830880  1673 connection.cc:256] RPC call timeout handler was delayed by -2.1876055750000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3291s for a response
I20260709 13:00:57.831396  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:57.833022  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:57.833225  5762 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:57.833707  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2195) took 1610 ms (client timeout 2114 ms). Trace:
I20260709 13:00:57.834141  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:57.834110  1701 rpcz_store.cc:269] 0709 13:00:56.223317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.344735 (+121418us) service_pool.cc:224] Handling call
0709 13:00:57.833524 (+1488789us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b5400387cd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:57.833646 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2201887616}
I20260709 13:00:57.835014  5723 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.835290  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:57.835901  1701 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:57.836573  5802 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:57.836803  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:57.837157  5736 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:57.837587  1701 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:57.746657  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:57.838094  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:57.838434  1633 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.838963  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:57.839321  5736 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:57.840077  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:57.516309  1706 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:57.749384  2267 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:57.841351  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:57.841480  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:57.752091  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:57.842178  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2233) took 1615 ms (client timeout 2111 ms). Trace:
I20260709 13:00:57.840201  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:57.842374  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:57.842792  2269 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:00:57.842628  1708 rpcz_store.cc:269] 0709 13:00:56.226471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.361605 (+135134us) service_pool.cc:224] Handling call
0709 13:00:57.841962 (+1480357us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400234454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:57.842122 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2895333120}
I20260709 13:00:57.750628  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:57.842105  2267 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:57.504786  5715 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:00:57.846788  5627 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:57.847451  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2239) took 1608 ms. Trace:
I20260709 13:00:57.844270  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:57.849200  5613 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:57.837713  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:57.850334  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:57.851480  5795 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:57.852972  1446 thread.cc:641] dir /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.001s	sys 0.005s
W20260709 13:00:57.853422  1446 thread.cc:608] dir /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.001s	sys 0.005s
I20260709 13:00:57.847817  1700 rpcz_store.cc:276] 0709 13:00:56.238631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.843148 (+1604517us) service_pool.cc:224] Handling call
0709 13:00:57.846979 (+  3831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.847149 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.847174 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.847211 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:57.847240 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.847292 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.847390 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14592}
W20260709 13:00:57.854580  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 801) took 1764 ms (client timeout 1765 ms). Trace:
I20260709 13:00:57.855027  1700 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:00:57.854974  1634 rpcz_store.cc:269] 0709 13:00:56.090651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.116329 (+ 25678us) service_pool.cc:224] Handling call
0709 13:00:57.854413 (+1738084us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b5400089dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:57.854531 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613370240}
W20260709 13:00:57.855834  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.856048  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:57.856554  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:57.857317  1634 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:57.857535  5613 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:57.858064  5613 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.858106  5795 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:57.858505  5613 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.752641  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:57.860424  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 995) took 1768 ms. Trace:
I20260709 13:00:57.860800  2264 rpcz_store.cc:276] 0709 13:00:56.092450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.093188 (+   738us) service_pool.cc:224] Handling call
0709 13:00:56.093483 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.347182 (+1253699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.860224 (+513042us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400269154. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:57.860371 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2829506432}
W20260709 13:00:57.861228  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 108676us
I20260709 13:00:57.519145  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:57.688828  5713 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.862703  5608 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:57.862346  5713 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.862887  5447 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:57.863131  5608 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.863333  5447 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:57.863555  5608 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.864187  5447 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.864745  5713 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:57.865378  5447 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.770123  5792 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:00:57.798885  5699 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.869745  5322 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:57.870137  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 351094us
I20260709 13:00:57.870529  5322 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.871411  5769 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:57.871836  5769 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.872153  5769 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:57.874207  5729 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.875115  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:57.878468  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:57.879132  1559 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.747031  5659 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:57.873728  5322 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:57.798287  1456 catalog_manager.cc:5697] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 7 to 8, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.771939  5799 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:00:57.787065  1705 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:57.753875  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:57.883378  1456 catalog_manager.cc:5697] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:00:57.795312  1707 rpcz_store.cc:276] 0709 13:00:56.092727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.568265 (+475538us) service_pool.cc:224] Handling call
0709 13:00:56.568559 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.490463 (+921904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.794710 (+304247us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54001fde54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:57.794884 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093600128}
I20260709 13:00:57.886478  1630 raft_consensus.cc:2410] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:00:57.886842  1707 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:57.887276  5542 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.801959  1627 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:00:57.826210  5525 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:57.843443  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.817626  1629 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:57.846745  5715 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:57.886894  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.888825  5715 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:57.889232  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:57.889907  1553 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:00:57.815883  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:57.889809  5715 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.890921  2270 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:57.891279  5715 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.891580  1551 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:00:57.893286  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:57.893890  1557 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.887786  5542 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:57.896922  1705 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:57.897807  5525 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.898257  5525 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:57.899013  1552 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:57.899968  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:57.901837  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e99891af85f4b10aa1cc2da6aa33082 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:00:57.902240  1560 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:00:57.901252  5799 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:57.902766  5799 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:57.753147  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:57.903198  5799 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:57.903496  2263 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:57.903565  5542 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:57.905733  5680 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:57.908061  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:57.908910  1626 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:57.911857  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:57.912707  1560 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.912945  1706 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:57.914220  5624 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:57.914983  5624 consensus_queue.cc:1243] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:57.915489  5624 consensus_queue.cc:1059] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:57.916320  5624 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:57.916664  5624 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:57.917142  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:57.918047  5756 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:57.918342  5627 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:57.918465  5756 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:57.862335  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:57.919502  5756 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.920791  5756 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.777467  5731 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:57.927560  1628 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:57.857450  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:57.930135  5770 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:57.930614  5770 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.931051  5770 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:57.934559  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.934870  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 72612.3us
W20260709 13:00:57.935465  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 78091.9us
I20260709 13:00:57.737651  5747 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.939474  5747 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:57.939889  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64852.4us
I20260709 13:00:57.948912  1559 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:58.000000  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.002231  1556 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:57.842257  5736 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:57.737702  5749 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:57.950678  5712 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:57.951628  5771 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:57.824848  2265 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:00:57.952190  5608 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.953872  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:57.882017  5769 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.956493  1558 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:00:57.947068  5784 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:57.962092  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.027463  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:57.962540  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:57.952047  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2240) took 1713 ms. Trace:
I20260709 13:00:57.975879  5232 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:58.029026  1706 rpcz_store.cc:276] 0709 13:00:56.238942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.843151 (+1604209us) service_pool.cc:224] Handling call
0709 13:00:57.843463 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.913397 (+ 69934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.913980 (+   583us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b54001bdad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:57.951971 (+ 37991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158759040}
I20260709 13:00:57.885388  1456 catalog_manager.cc:5697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.962158  1551 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:00:57.966732  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 116485us
I20260709 13:00:57.470911  5732 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:57.970352  1705 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:57.971477  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:58.036078  1707 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:00:58.037225  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:57.972976  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.038645  1553 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:57.973407  1701 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:57.973605  5778 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:57.933853  1560 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:57.979513  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:58.041739  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:58.042618  1631 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:58.043758  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:58.044723  1631 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:57.979745  1526 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:57.982218  1627 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:57.983639  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:57.937774  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:58.047672  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 109991us
I20260709 13:00:58.047679  1630 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:58.048499  1673 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:57.990110  2262 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:57.993563  1557 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:00:57.995041  2235 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:00:58.051250  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 56359.4us
I20260709 13:00:57.980644  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:58.052278  1629 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:57.970463  1633 raft_consensus.cc:2410] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:58.053112  1560 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:00:57.998001  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:58.053489  1560 pending_rounds.cc:85] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 6
I20260709 13:00:58.053786  1560 pending_rounds.cc:107] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:00:58.054122  1560 raft_consensus.cc:2889] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.018666  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:58.018796  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:58.054929  1556 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:00:57.917534  5624 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:58.028898  1552 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.943257  5747 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:58.008496  5773 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.010568  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:58.035291  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:58.011011  5613 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:58.077229  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 79325.5us
I20260709 13:00:58.122720  1705 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:00:58.057152  1456 catalog_manager.cc:5697] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 4 to 7, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.074802  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 1001) took 1140 ms. Trace:
I20260709 13:00:58.122071  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:58.126058  2268 rpcz_store.cc:276] 0709 13:00:56.934353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.934921 (+   568us) service_pool.cc:224] Handling call
0709 13:00:58.074558 (+1139637us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54007701d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:58.074725 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1024990080}
I20260709 13:00:58.126663  1552 raft_consensus.cc:2410] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:58.110610  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:58.127784  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:58.060045  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80410.4us
I20260709 13:00:58.128815  1634 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:58.129377  2235 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:58.118639  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.130220  1526 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:58.130527  1558 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:58.113531  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 65152.7us
I20260709 13:00:58.072182  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:58.132050  1707 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:58.086253  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2271) took 2100 ms. Trace:
I20260709 13:00:58.132787  1635 rpcz_store.cc:276] 0709 13:00:55.985454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.233256 (+247802us) service_pool.cc:224] Handling call
0709 13:00:56.233555 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.320505 (+ 86950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.085957 (+1765452us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b540018e7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:00:58.086191 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81085312}
W20260709 13:00:58.134502  1599 leader_election.cc:336] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.972s (SENT)
I20260709 13:00:58.136792  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:58.056663  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:58.126148  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 172366us
W20260709 13:00:58.125558  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 92036.4us
W20260709 13:00:58.141989  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 159300us
I20260709 13:00:58.142982  1524 leader_election.cc:400] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10.
I20260709 13:00:58.139400  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:58.144093  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:58.146368  1628 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:00:58.146832  2234 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:58.018519  5749 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.151767  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:58.027740  5626 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.028479  5634 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.100090  5732 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.057721  5766 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:58.190766  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44017.3us
I20260709 13:00:58.057116  5748 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.148981  5648 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:58.083878  5673 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:58.073596  5363 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:58.212248  1632 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:58.212850  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.102924  5525 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.110953  5760 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:58.180297  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:58.321779  5760 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.323570  5760 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:58.185665  5815 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:00:58.185935  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:58.327533  1705 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.330780  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:58.330905  5760 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:58.331586  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.332680  1557 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:58.333606  5760 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:58.335390  5613 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:58.269663  5778 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:58.186513  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46022.1us
I20260709 13:00:58.186656  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:58.338270  2236 leader_election.cc:400] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10.
I20260709 13:00:58.338819  2236 leader_election.cc:403] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:00:58.339855  5813 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:00:58.340489  2236 leader_election.cc:400] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10.
I20260709 13:00:58.341210  5737 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.088702  5424 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:58.192183  2234 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:58.152689  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.348587  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.148403  5319 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:58.151700  5754 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:58.210986  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:58.373271  1703 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:58.168010  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:58.166971  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.375105  1559 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:58.375466  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 207538us
I20260709 13:00:58.376670  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:58.152694  5747 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.152061  5771 raft_consensus.cc:2764] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:00:58.153261  5707 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:58.179694  5808 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:00:58.149194  5756 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:58.290246  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.136245  5773 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.181352  5792 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:00:58.167057  5804 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:00:58.259024  1709 raft_consensus.cc:2410] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:00:58.166920  5699 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:00:58.125644  5736 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.309023  1704 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.309731  5608 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:58.310642  5002 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:58.311549  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:58.313608  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:58.411393  5002 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:58.411711  5002 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:00:58.411870  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 98348.7us
I20260709 13:00:58.412457  5002 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.413507  5002 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:58.288419  5817 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:00:58.414095  5775 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:58.414559  5659 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:58.414994  5712 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:58.208529  5748 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.417292  5748 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:58.314872  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.203470  5634 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:58.208840  5673 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.418340  5673 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.419648  5773 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:58.420116  5634 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:58.420708  5634 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:58.151564  5565 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.422050  5565 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:58.425365  5565 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:58.252756  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 46313.4us
I20260709 13:00:58.384369  5754 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.427333  5754 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:58.251592  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.191114  5672 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.205564  5648 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.431965  5648 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.315433  1558 raft_consensus.cc:2410] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:58.305759  5626 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:00:58.316912  1601 leader_election.cc:336] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.919s (SENT)
W20260709 13:00:58.451150  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 134300us
I20260709 13:00:58.451969  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.269344  5363 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:58.338459  1707 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:58.455281  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:58.184966  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.457363  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.341892  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:58.333778  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:58.459774  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.329598  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.461285  1551 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.349426  1705 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:58.346942  5770 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:58.379767  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:58.361970  5319 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:58.362596  5769 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:58.380901  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:58.363492  5784 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10.
I20260709 13:00:58.381629  5760 raft_consensus.cc:2764] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:58.367775  5424 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:58.389003  1555 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:58.395973  1559 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:58.372092  5799 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:58.381822  5613 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:58.400179  5707 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.407300  1704 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
W20260709 13:00:58.409509  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.409358  5749 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:58.319604  5788 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 1.384s	user 0.004s	sys 0.000s
I20260709 13:00:58.463428  1705 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 12. (index mismatch)
I20260709 13:00:58.465950  1558 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:00:58.529320  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 187530us
I20260709 13:00:58.414553  5775 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.476998  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.534135  1552 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:58.502626  1551 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:58.479384  5363 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:58.450459  5631 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.582607  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 52348.1us
I20260709 13:00:58.585459  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:58.479749  5319 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:58.515017  5823 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:00:58.587215  1558 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:00:58.515339  5626 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:58.603451  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 411359us
I20260709 13:00:58.607849  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:58.608947  2268 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:58.581596  5775 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:58.508008  5565 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:00:58.527339  5727 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.528694  5707 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.611382  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:58.623736  1628 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:58.616220  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:58.531255  5525 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:58.625294  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:58.591832  5731 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.627693  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2252) took 1230 ms. Trace:
I20260709 13:00:58.628885  2268 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.621686  2262 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
W20260709 13:00:58.630129  1599 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.033s (SENT) [suppressed 41 similar messages]
I20260709 13:00:58.630604  2262 pending_rounds.cc:85] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 9
I20260709 13:00:58.634718  2262 pending_rounds.cc:107] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:00:58.635033  2262 raft_consensus.cc:2889] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.614446  5756 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:58.602998  5631 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.637367  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:58.637455  5756 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:58.638878  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 458689us
I20260709 13:00:58.640638  5802 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:58.641307  5802 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:00:58.642656  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.612978  5821 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:00:58.646651  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2241) took 2407 ms. Trace:
I20260709 13:00:58.649699  1708 rpcz_store.cc:276] 0709 13:00:56.239162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.843522 (+1604360us) service_pool.cc:224] Handling call
0709 13:00:57.843796 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.843970 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:58.064858 (+220888us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.646338 (+581480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.646390 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:58.646431 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.646489 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.646601 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":325658,"prepare.queue_time_us":257868,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"thread_start_us":409627,"threads_started":2,"wal-append.queue_time_us":257047}
W20260709 13:00:58.647337  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.609753  5634 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:58.613179  5799 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:58.649094  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 337633us
I20260709 13:00:58.654395  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:58.674973  2265 raft_consensus.cc:2410] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:58.629981  1700 rpcz_store.cc:276] 0709 13:00:57.397799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.856652 (+458853us) service_pool.cc:224] Handling call
0709 13:00:57.856873 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.857040 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:58.141560 (+284520us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.626991 (+485431us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b180043f600. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:00:58.627208 (+   217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.627276 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:58.627345 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.627447 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.627616 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14439,"prepare.queue_time_us":294483,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":434397,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":33691136,"thread_start_us":345037,"threads_started":2,"wal-append.queue_time_us":140732}
I20260709 13:00:58.680321  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:58.683384  5732 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:58.610952  5424 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.683987  5732 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:58.684875  5732 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.685923  5749 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:58.625186  5727 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.603554  5784 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:00:58.696900  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:58.697989  2263 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:58.629422  5741 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:58.708559  1630 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:58.712224  1702 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:58.719357  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:58.720228  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:58.720968  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:58.726787  1554 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:00:58.730402  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:58.731500  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:58.736994  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:58.721076  1708 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:58.729355  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.736845  1635 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:58.737649  1705 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:58.741566  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:58.743551  1626 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:58.747092  1554 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:58.748057  1709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2237) took 2500 ms (client timeout 1919 ms). Trace:
I20260709 13:00:58.749588  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:58.750430  2262 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:00:58.754693  2268 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
W20260709 13:00:58.748560  1709 rpcz_store.cc:269] 0709 13:00:56.238077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.336452 (+ 98375us) service_pool.cc:224] Handling call
0709 13:00:58.711652 (+2375200us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b5400220454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:58.738604 (+ 26952us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4367475456}
I20260709 13:00:58.811071  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:58.811921  1709 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:58.784967  5760 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.802567  5819 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.424s	user 0.001s	sys 0.000s
I20260709 13:00:58.665107  5731 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:58.712652  5634 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.781431  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.783082  1705 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
W20260709 13:00:58.786953  1706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.128s	sys 0.195s
W20260709 13:00:58.829629  1706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.128s	sys 0.195s
I20260709 13:00:58.758067  5792 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.800519  1558 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:58.838106  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:58.838752  1705 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.812929  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:58.840567  1709 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:58.841955  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:58.842701  1709 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:58.817328  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 437677us
I20260709 13:00:58.768054  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:58.389339  5747 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.773442  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:58.818568  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:58.852777  1708 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.853188  2270 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.770689  5680 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:00:58.776988  5447 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:00:58.704324  5802 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.824525  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:58.871021  1557 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:58.830257  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:58.832602  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2235) took 2595 ms. Trace:
I20260709 13:00:58.832798  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:58.874402  1526 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:58.785552  5804 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:00:58.788434  5565 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.843895  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:58.843924  1630 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.842324  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:58.855149  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 79800.7us
W20260709 13:00:58.891819  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 49577.4us
I20260709 13:00:58.871076  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:58.800577  5713 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:00:58.881852  1705 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:00:58.889345  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:58.900012  1558 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:58.901031  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.892073  5002 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:58.901647  5002 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.901988  2270 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:00:58.902184  5002 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.905517  1630 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:00:58.872085  1702 rpcz_store.cc:276] 0709 13:00:56.237590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.789280 (+551690us) service_pool.cc:224] Handling call
0709 13:00:58.711793 (+1922513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.712683 (+   890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.832340 (+119657us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b5400220450. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:58.832526 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4420906368}
I20260709 13:00:58.898203  5736 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:00:58.892858  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:58.892897  2264 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:58.908594  1702 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:58.890646  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.917650  1557 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:00:58.919935  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.919999  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 76209.8us
W20260709 13:00:58.920733  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 90568.8us
I20260709 13:00:58.921583  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:58.921833  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:58.925020  5002 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.858309  5770 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:58.931237  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.940133  1708 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
W20260709 13:00:58.950230  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 57461.1us
I20260709 13:00:58.965708  5002 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:58.839978  5634 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:58.971709  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:58.890607  5525 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:58.906740  5762 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:58.967638  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:58.825553  5760 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:58.890357  5833 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:58.975225  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 53708.7us
I20260709 13:00:59.009521  1708 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:58.968983  5002 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:00:59.012391  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:00:58.974668  1709 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
W20260709 13:00:58.970603  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 48847.6us
I20260709 13:00:58.859154  5792 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:58.894160  5673 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:59.021524  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.017531  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.019909  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:59.010298  5525 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.028570  5525 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.025068  2234 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:58.963330  5830 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:58.958477  5680 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:58.968456  5424 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:59.039000  1708 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:58.907008  5565 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:59.005715  5762 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:59.046393  1705 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:00:59.004917  5804 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:59.009554  5833 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.979390  5827 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.057091  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:59.057474  1705 pending_rounds.cc:85] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 8
I20260709 13:00:59.057583  1633 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:59.063400  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.066540  1705 pending_rounds.cc:107] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:00:59.068218  1705 raft_consensus.cc:2889] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.068280  1632 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:59.066573  1557 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:59.062605  5804 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:59.051038  5784 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:59.077883  1630 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:59.055135  5778 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.080947  5804 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.032577  5447 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:00:59.084591  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.085390  2265 raft_consensus.cc:2376] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9. Re-sending same reply.
I20260709 13:00:58.968854  5746 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:00:59.064682  5424 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:59.065972  5830 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:59.091933  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 50793.2us
I20260709 13:00:59.049052  5756 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:00:59.071344  5833 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.077359  5799 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.098204  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.088624  5746 consensus_queue.cc:1243] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:00:59.099200  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.102600  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.085218  5784 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:59.085378  5778 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:59.077162  5827 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.099570  5762 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:59.109661  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.116318  5799 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.104890  5424 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.098683  5736 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 13:00:59.094849  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.154969  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2031) took 1020 ms. Trace:
W20260709 13:00:59.152585  5845 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.002s
W20260709 13:00:59.152666  5837 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:00:59.139902  5840 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:00:59.155468  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.165625  2264 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 8.
I20260709 13:00:59.139256  5731 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:00:59.160445  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 150261us
I20260709 13:00:59.157914  1560 rpcz_store.cc:276] 0709 13:00:58.134889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.506021 (+371132us) service_pool.cc:224] Handling call
0709 13:00:58.506394 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.506615 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:58.807204 (+300589us) log.cc:844] Serialized 14 byte log entry
0709 13:00:59.149600 (+342396us) log.cc:844] Serialized 14 byte log entry
0709 13:00:59.150131 (+   531us) log.cc:844] Serialized 14 byte log entry
0709 13:00:59.150293 (+   162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.150348 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:59.152046 (+  1698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.152303 (+   257us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.154852 (+  2549us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34810,"prepare.queue_time_us":175866,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":120006,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3628,"spinlock_wait_cycles":3630464,"thread_start_us":537615,"threads_started":3,"wal-append.queue_time_us":225867}
W20260709 13:00:59.151396  5707 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.003s
I20260709 13:00:59.139940  5853 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:59.156424  5843 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.113s	user 0.000s	sys 0.002s
I20260709 13:00:59.169708  1524 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:59.154122  5673 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:59.154248  5613 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:59.174710  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.160683  5747 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:59.186201  2264 raft_consensus.cc:2376] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10. Re-sending same reply.
I20260709 13:00:59.187412  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:59.190609  5760 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:59.191100  5565 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:59.192607  5846 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:00:59.193413  5775 consensus_meta.cc:287] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.000s
I20260709 13:00:59.194617  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2208) took 1222 ms. Trace:
I20260709 13:00:59.195158  5778 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:59.195396  5827 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:59.197005  5525 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:00:59.198737  5799 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:59.199570  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:00:59.199781  5319 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.005s
I20260709 13:00:59.200973  5749 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:59.201756  5737 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.860s	user 0.007s	sys 0.003s
I20260709 13:00:59.163574  5626 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:00:59.202443  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.203176  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.206583  5792 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:59.240224  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:59.207059  5784 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:59.210489  5820 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.828s	user 0.005s	sys 0.010s
I20260709 13:00:59.210987  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:00:59.239838  5844 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:00:59.241956  5749 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:59.213346  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:59.272439  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:59.273360  1709 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:59.214907  5795 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:59.178236  5731 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.310544  5731 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.310204  5795 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:59.312891  5731 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:59.215951  1629 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:59.313105  5795 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:59.264988  5778 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.217060  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:59.215988  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:59.315050  5778 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.315761  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:59.220557  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 157304us
I20260709 13:00:59.318946  5749 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:59.320042  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.321035  5749 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.220665  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:00:59.228374  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 58795.5us
I20260709 13:00:59.322700  1560 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
W20260709 13:00:59.322988  5648 consensus_meta.cc:287] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.880s	user 0.007s	sys 0.006s
I20260709 13:00:59.235504  1706 rpcz_store.cc:276] 0709 13:00:57.972463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.083275 (+110812us) service_pool.cc:224] Handling call
0709 13:00:58.083665 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.086993 (+  3328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.087022 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.111448 (+ 24426us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.830117 (+718669us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:58.830158 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.830222 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.194430 (+364208us) raft_consensus.cc:1685] finished
0709 13:00:59.194449 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.194559 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2951,"raft.queue_time_us":3261,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":19362,"thread_start_us":661818,"threads_started":1,"wal-append.queue_time_us":970706}
I20260709 13:00:59.176065  5634 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:59.239887  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.246341  2269 raft_consensus.cc:2376] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10. Re-sending same reply.
I20260709 13:00:59.236256  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.330351  2264 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:59.173692  5707 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.261610  2270 raft_consensus.cc:2376] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9. Re-sending same reply.
I20260709 13:00:59.211759  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.245285  5565 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:59.212565  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.268868  1553 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:00:59.268733  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:59.335630  5002 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:59.335786  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 67212.5us
I20260709 13:00:59.336400  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.336689  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:59.251353  5832 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.239382  5861 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:59.273802  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:59.343102  1708 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:59.259240  5608 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:59.274152  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.309273  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:59.314544  5795 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:59.315387  1630 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:00:59.354017  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:59.327791  5648 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.220363  1633 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:00:59.355727  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:59.355939  1633 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:59.356302  1630 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:59.170449  5853 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:59.323295  1524 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:59.323783  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:59.357299  2265 raft_consensus.cc:2368] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10.
I20260709 13:00:59.357527  1560 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:00:59.230937  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.325064  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:59.358870  1627 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.241918  5775 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:59.326718   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:59.324018  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:59.309710  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:59.254724  5760 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:00:59.246001  5319 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.234385  5624 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:59.327169  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:59.378423  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 51311.3us
I20260709 13:00:59.379474  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:59.333225  2266 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:59.337275  2270 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:00:59.338177  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.381458  2264 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:59.317864  5778 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:59.340679  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:59.383136  1706 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:00:59.341727  2271 raft_consensus.cc:2410] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:59.307842  5746 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.344624  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.307890  5799 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:59.387599  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:59.389225  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:59.395871  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.397957  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.361761  5770 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.372587  5760 consensus_queue.cc:1243] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:59.344497  5565 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:59.268369  5833 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.351671  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.392153  5626 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:59.362938  1551 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:59.363703  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:59.364684  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:59.306840  5766 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 13:00:59.373077  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63465.6us
I20260709 13:00:59.428539  2236 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:59.367429  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:00:59.430817  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 63498.4us
I20260709 13:00:59.431974  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:59.400563  1633 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:59.398676  2266 raft_consensus.cc:2376] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9. Re-sending same reply.
I20260709 13:00:59.412213  1627 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:00:59.435599  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:59.373109  5608 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:59.383229  5634 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:59.447722  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:59.445729  2264 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:00:59.415618  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:59.422850  2269 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.358275  5737 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:59.350476  2267 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:00:59.449962  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:00:59.433284  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 69679.4us
I20260709 13:00:59.451465  2264 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:59.451987  1558 raft_consensus.cc:2368] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9.
I20260709 13:00:59.399088  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.435925  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:59.437433  1706 raft_consensus.cc:2410] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:59.436307  2236 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:59.454833  1627 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:59.455668  2236 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:59.366768  5861 raft_consensus.cc:697] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:59.440115  5002 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:59.413326  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:59.417929  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.458146  2263 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:59.446450  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.459267  2266 raft_consensus.cc:2410] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:00:59.448359  1560 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:59.460201  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:00:59.449261  1708 raft_consensus.cc:2410] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:59.414669  5858 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:59.421022  1709 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:00:59.462852  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:00:59.430460  5626 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.414927  5856 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:59.463959  1524 connection.cc:256] RPC call timeout handler was delayed by -1.3042252459999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
I20260709 13:00:59.349510  5832 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.399190  5778 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:59.410439  5799 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.469231  2264 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEARNER]: Advancing to term 13
I20260709 13:00:59.465973  2263 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:59.474376  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.443369  5627 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:59.443859  5736 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.443212  5822 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:59.394904  5746 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:59.442977  5831 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:59.479662  2266 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:59.447407  5634 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.495543  2271 raft_consensus.cc:2410] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:59.500308  2263 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:59.450721  5737 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:00:59.502629  2267 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:59.503077  5002 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.504094  2269 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:00:59.463701  5756 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:59.420042  5849 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:00:59.473660  5626 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.511073  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:00:59.510864  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 174276us
I20260709 13:00:59.527988  1599 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:59.511462  2264 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:00:59.512686  2266 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:59.463766  5868 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:59.484563  5858 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.505319  5856 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:59.532081  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 76516.4us
I20260709 13:00:59.529577  2264 pending_rounds.cc:85] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 6
I20260709 13:00:59.533102  2264 pending_rounds.cc:107] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:00:59.533371  2264 raft_consensus.cc:2889] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.533882  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:00:59.526788  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 56630us
I20260709 13:00:59.502054  5851 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:59.523582  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 60817.1us
I20260709 13:00:59.517663  5634 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.509513  5525 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:59.513150  5778 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:59.523357  5737 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.524188  5627 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.536630  5766 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:59.541332  5756 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.536291  5856 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.507073  5736 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.507405  5565 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.564028  5778 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:59.568226  1701 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
W20260709 13:00:59.562058  5867 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:00:59.571787  5879 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.563908  5707 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:59.515830  5608 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:59.562099  5627 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:59.567469  5856 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:59.574604  5754 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.147s	user 0.011s	sys 0.002s
I20260709 13:00:59.576557  5775 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:59.560647  5861 consensus_queue.cc:237] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:00:59.586728  5865 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:00:59.539119  5858 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:59.587281  5863 log.cc:927] Time spent T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:00:59.588846  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:00:59.589730  1704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2254) took 2162 ms (client timeout 1547 ms). Trace:
I20260709 13:00:59.568814  5525 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:00:59.609017  1704 rpcz_store.cc:269] 0709 13:00:57.427454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.452429 (+ 24975us) service_pool.cc:224] Handling call
0709 13:00:59.589553 (+2137124us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54003e12d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:00:59.589664 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947596672}
I20260709 13:00:59.613953  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:59.616876  5822 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:59.630745  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:59.631587  1626 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.625766  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:59.632908  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:59.581037  5319 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:59.591523  5849 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.585196  5879 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.644487  1599 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:00:59.645675  1599 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:59.559813  5851 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:59.605774  5707 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:00:59.644347  5775 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:59.685539  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 272349us
I20260709 13:00:59.686054  1626 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:00:59.605631  5754 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.643249  5876 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:59.689438  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:59.647132  5833 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:59.623272  5525 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:59.649120  5766 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:59.646832  5761 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:59.680616  5746 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:59.681465  5770 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:59.618077  5822 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.709542  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:00:59.685825  5799 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:00:59.708039  1599 leader_election.cc:336] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.728s (SENT)
I20260709 13:00:59.714466  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:00:59.712152  1559 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:59.585402  5853 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.713008  2268 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:00:59.713558  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.691676  5747 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:59.695071  5876 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.695407  5775 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:59.721064  1630 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:59.723594  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:59.724695  1626 raft_consensus.cc:2410] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:00:59.705788  5880 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:59.708945  5736 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:59.717056  5729 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:59.712901  5766 raft_consensus.cc:697] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:00:59.646835  5849 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:59.723353  5885 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.096s	user 0.004s	sys 0.000s
I20260709 13:00:59.725395  5853 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.683725  5778 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.723040  5761 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:59.765002  5851 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:59.766178  5882 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:00:59.740957  5892 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:59.767177  5892 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:59.732874  5754 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:00:59.733767  5874 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:00:59.734452  5775 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.721048  5747 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.772115  5747 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.771852  5626 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.722249  5876 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.776358  2270 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:59.727362  5880 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:59.734480  5858 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:59.760206  5826 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.681699  1446 maintenance_manager.cc:643] P 72b78a86b5e34075b0982caa9c5426ab: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.607s	user 0.187s	sys 0.113s Metrics: {"bytes_written":30868,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":580884,"dirs.run_cpu_time_us":396,"dirs.run_wall_time_us":16957,"drs_written":1,"lbm_read_time_us":39680,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":265246,"lbm_writes_10-100_ms":5,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":4940160,"thread_start_us":521138,"threads_started":1,"update_count":20}
I20260709 13:00:59.766443  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:00:59.786053  1626 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:59.788260  1447 maintenance_manager.cc:419] P 72b78a86b5e34075b0982caa9c5426ab: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9929 bytes on disk
I20260709 13:00:59.729429  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:59.791654  1446 maintenance_manager.cc:643] P 72b78a86b5e34075b0982caa9c5426ab: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":395,"lbm_reads_lt_1ms":4}
I20260709 13:00:59.776846  5627 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:00:59.784228  1599 leader_election.cc:336] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.592s (SENT)
I20260709 13:00:59.781396  1708 raft_consensus.cc:2410] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:59.792094  5634 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.797871  5634 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:00:59.799253  1626 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
W20260709 13:00:59.802829  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 247513us
I20260709 13:00:59.803962  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:59.805053  5851 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:59.805766  5851 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:00:59.747254  5729 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:59.819798  5729 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.820600  5626 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:00:59.817619  5756 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:59.832206  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 102845us
I20260709 13:00:59.835811  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:59.838501  1704 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:00:59.847025  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:59.848404  1704 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:00:59.849195  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.851140  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.851346  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:00:59.849749  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.853559  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:59.855530  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:00:59.858932  5892 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:59.842456  5747 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.860226  5626 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:00:59.860842  5879 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:59.861493  5880 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.867667  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:59.869355  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:59.872310  1704 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:59.876857  5756 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:59.888217  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:00:59.892261  5882 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:59.894304  5749 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:59.896591  5890 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:59.905350  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.905997  2267 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:59.906133  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.906895  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.907469  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.907505  2267 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 6.
I20260709 13:00:59.887959  5892 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.812546  5826 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.913275  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:59.915724  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.831490  5856 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.877801  5858 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:00:59.922334  1704 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:00:59.923130  5849 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:59.923539  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:00:59.902292  5882 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.925941  1704 raft_consensus.cc:2410] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:59.930068  5747 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:59.823601  5766 consensus_queue.cc:237] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.933789  1704 pending_rounds.cc:85] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 4
I20260709 13:00:59.909953  5887 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.882684  5737 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:59.934172  1704 pending_rounds.cc:107] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:00:59.934636  1704 raft_consensus.cc:2889] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:59.908339  5795 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:59.907532  5880 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.881990  5626 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.910401  5756 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:00:59.936049  5882 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:59.945644  5849 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:59.871867  5851 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:00:59.934419  5887 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:00:59.946197  5890 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:59.947317  5856 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:00:59.949003  2264 raft_consensus.cc:2410] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:59.950258  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:00:59.979516  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:00:59.983774  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:00:59.926905  5778 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:59.984320  2263 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:00:59.987632  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:00:59.955950  5849 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:00:59.988517  2269 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.989648  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:00:59.978618  5699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.504s	user 0.024s	sys 0.016s
I20260709 13:00:59.984303  5718 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:59.987720  5858 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:59.993772  5699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.528s	user 0.024s	sys 0.016s
I20260709 13:00:59.990921  5795 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:00.014418  5778 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:00.033217  5778 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.033744  5778 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:00.023380  2269 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:01:00.026232  5756 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:00.020232  5771 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 13:01:00.031637  5831 consensus_meta.cc:287] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
I20260709 13:01:00.032703  5626 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:00.035495  1673 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:00.015640  5858 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:00.050217  5737 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:00.053262  5626 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.054134  5626 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:00.060328  5795 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:00.062109  5831 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:00.116459  5900 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:01:00.119473  1704 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:00.028625  5876 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:00.049461  5858 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.063474  5890 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:00.140142  2263 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:00.046710  5849 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:00.143362  5713 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:00.145826  5890 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:00.154701  5626 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:00.164616  5848 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:01:00.164863  5627 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:00.167030  5876 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:00.149358  5718 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:01:00.160727  5849 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:00.173506  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2258) took 1529 ms. Trace:
I20260709 13:01:00.179868  1703 rpcz_store.cc:276] 0709 13:00:58.643666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.646371 (+  2705us) service_pool.cc:224] Handling call
0709 13:00:58.684216 (+ 37845us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.684506 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.684547 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:00.033554 (+1349007us) spinlock_profiling.cc:243] Waited 58.2 ms on lock 0x7b2c00057cb8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2
0709 13:01:00.033988 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:01:00.141814 (+107826us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:00.141853 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.141937 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.172425 (+ 30488us) raft_consensus.cc:1685] finished
0709 13:01:00.172446 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.173207 (+   761us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1720,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"spinlock_wait_cycles":133960064,"thread_start_us":107386,"threads_started":1,"wal-append.queue_time_us":123802}
I20260709 13:01:00.157115  5890 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:00.187072  5608 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.187745  5608 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:00.188961  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:00.189707  2263 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:00.252439  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.277124  5608 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:00.279479  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.310103  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.323596  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50795.6us
I20260709 13:01:00.179150  5882 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:00.332465  1599 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:00.309718  5795 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:00.340479  1700 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:00.340549  1599 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:00.333752  5876 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.347319  5887 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:00.355029  2263 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:00.339041  5775 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:00.360148  5887 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:00.361697  5887 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:01:00.364647  5887 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:00.360688  5907 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:01:00.370718  5775 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:00.387454  5775 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:00.389241  5832 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:00.340092  5795 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:00.387490  5908 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:00.357077  5876 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:00.405799  5795 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:00.422068  5882 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:00.423110  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2007) took 1057 ms. Trace:
I20260709 13:01:00.423496  1630 rpcz_store.cc:276] 0709 13:00:59.366284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.366416 (+   132us) service_pool.cc:224] Handling call
0709 13:00:59.366687 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.724184 (+357497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.422886 (+698702us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b540006bdd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:00.423057 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":814662528}
I20260709 13:01:00.424791  5876 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:00.424758  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:00.370189  5747 raft_consensus.cc:2764] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:01:00.431586  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 91114.5us
I20260709 13:01:00.429984  1630 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:00.433001  5913 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:00.434000  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:00.434963  5631 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:00.436616  5913 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:00.438930  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:00.437126  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:00.439641  1628 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:00.439922  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:00.440726  1630 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:00.441480  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:00.443995  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 905) took 1134 ms. Trace:
W20260709 13:01:00.444520  1600 connection.cc:256] RPC call timeout handler was delayed by -1.2192564460000312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
W20260709 13:01:00.445012  1600 connection.cc:256] RPC call timeout handler was delayed by -1.0867299139999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 13:01:00.445262  2266 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:00.445580  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:00.444361  2270 rpcz_store.cc:276] 0709 13:00:59.309144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.381094 (+ 71950us) service_pool.cc:224] Handling call
0709 13:01:00.443789 (+1062695us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400289bd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:00.443942 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872306432}
I20260709 13:01:00.447124  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:00.437446  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:00.448637  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:00.450560  1630 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:00.451232  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:00.452160  1628 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:00.437327  5858 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:00.439139  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2277) took 1225 ms. Trace:
I20260709 13:01:00.455673  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:00.456293  2263 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:00.457497  1708 rpcz_store.cc:276] 0709 13:00:59.213628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.481633 (+268005us) service_pool.cc:224] Handling call
0709 13:01:00.438943 (+957310us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5400129b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:00.439085 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583446784}
I20260709 13:01:00.447724  5747 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.454159  5913 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:00.459570  5849 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.456725  5608 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.467207  1708 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:00.462210  5769 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:00.469148  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2279) took 1209 ms. Trace:
I20260709 13:01:00.470939  1708 rpcz_store.cc:276] 0709 13:00:59.259500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.461513 (+1202013us) service_pool.cc:224] Handling call
0709 13:01:00.466770 (+  5257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.468861 (+  2091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.469083 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:00.420542  5778 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:00.469583  5913 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:00.488267  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:00.489037  2270 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.486002  5858 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:00.502647  5854 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.176s	user 0.007s	sys 0.000s
I20260709 13:01:00.504370  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2268) took 1674 ms. Trace:
I20260709 13:01:00.507591  2270 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:01:00.509876  5778 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:00.504911  1702 rpcz_store.cc:276] 0709 13:00:58.830389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.917650 (+ 87261us) service_pool.cc:224] Handling call
0709 13:00:58.918156 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.982272 (+ 64116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.982322 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.982974 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.159753 (+176779us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:59.159821 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.159917 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.450211 (+1290294us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:00.503929 (+ 53718us) raft_consensus.cc:1685] finished
0709 13:01:00.503965 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.504284 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24942,"raft.queue_time_us":53014,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":24895,"spinlock_wait_cycles":7942528,"thread_start_us":113897,"threads_started":1,"wal-append.queue_time_us":224114}
W20260709 13:01:00.530321  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 726511us
I20260709 13:01:00.510002  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:00.538940  1626 raft_consensus.cc:2368] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11.
W20260709 13:01:00.531935  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 75178.4us
I20260709 13:01:00.542883  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:00.544818  1524 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:00.546447  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:00.556456  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 100817us
I20260709 13:01:00.558370  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:00.551744  5913 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.572594  5913 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:00.576517  5913 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:00.585068  1558 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 645) took 1753 ms (client timeout 1896 ms). Trace:
W20260709 13:01:00.585587  1558 rpcz_store.cc:269] 0709 13:00:58.831670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.900774 (+ 69104us) service_pool.cc:224] Handling call
0709 13:01:00.584802 (+1684028us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54002cb854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:00.584996 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238267264}
I20260709 13:01:00.587555  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 647) took 1556 ms. Trace:
I20260709 13:01:00.587961  1558 rpcz_store.cc:276] 0709 13:00:59.031634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.586666 (+1555032us) service_pool.cc:224] Handling call
0709 13:01:00.587004 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.587219 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.587247 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:00.587293 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:00.587322 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.587379 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.587498 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:00.589592  1558 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:00.590260  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 649) took 1373 ms. Trace:
I20260709 13:01:00.590716  1558 rpcz_store.cc:276] 0709 13:00:59.216443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.588962 (+1372519us) service_pool.cc:224] Handling call
0709 13:01:00.589251 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.589919 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.590206 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:00.754853  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2210) took 2779 ms (client timeout 2043 ms). Trace:
W20260709 13:01:00.755813  1701 rpcz_store.cc:269] 0709 13:00:57.975047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.039920 (+ 64873us) service_pool.cc:224] Handling call
0709 13:01:00.753902 (+2713982us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54001fcf54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:00.754499 (+   597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3312966400}
I20260709 13:01:00.761490  1705 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 13:01:00.763211  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2225) took 1202 ms. Trace:
I20260709 13:01:00.763722  1705 rpcz_store.cc:276] 0709 13:00:59.561224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.760209 (+1198985us) service_pool.cc:224] Handling call
0709 13:01:00.760742 (+   533us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:00.762828 (+  2086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.763127 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:00.757735  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 712) took 1508 ms. Trace:
I20260709 13:01:00.765005  1704 rpcz_store.cc:276] 0709 13:00:59.248924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.036628 (+787704us) service_pool.cc:224] Handling call
0709 13:01:00.041209 (+  4581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.119977 (+ 78768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.757047 (+637070us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b54001fd954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:00.757456 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179033472}
I20260709 13:01:00.776023  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2280) took 1355 ms. Trace:
I20260709 13:01:00.776306  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2218) took 1526 ms. Trace:
I20260709 13:01:00.776813  1700 rpcz_store.cc:276] 0709 13:00:59.249575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.146189 (+896614us) service_pool.cc:224] Handling call
0709 13:01:00.148616 (+  2427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.341020 (+192404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.775797 (+434777us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54001df454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:00.776145 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440862464}
I20260709 13:01:00.776679  1701 rpcz_store.cc:276] 0709 13:00:59.420592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.757254 (+1336662us) service_pool.cc:224] Handling call
0709 13:01:00.758058 (+   804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.758695 (+   637us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:00.759655 (+   960us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.775506 (+ 15851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:00.775599 (+    93us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:00.775653 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.775728 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.775904 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":278,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":231,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":291,"thread_start_us":14432,"threads_started":1,"wal-append.queue_time_us":12660}
I20260709 13:01:00.781863  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 714) took 1521 ms. Trace:
I20260709 13:01:00.782498  1708 rpcz_store.cc:276] 0709 13:00:59.260889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.474548 (+1213659us) service_pool.cc:224] Handling call
0709 13:01:00.510878 (+ 36330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.511264 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.511298 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:00.511835 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:01:00.766042 (+254207us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:00.779475 (+ 13433us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.780376 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.780589 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.780690 (+   101us) raft_consensus.cc:1685] finished
0709 13:01:00.780707 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.781661 (+   954us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":184,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":1359,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":346,"thread_start_us":253524,"threads_started":1,"wal-append.queue_time_us":65547}
W20260709 13:01:00.794148  2268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 876) took 1731 ms (client timeout 1842 ms). Trace:
W20260709 13:01:00.794725  2268 rpcz_store.cc:269] 0709 13:00:59.062963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.063178 (+   215us) service_pool.cc:224] Handling call
0709 13:01:00.793502 (+1730324us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54005933d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:00.793789 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1485716352}
I20260709 13:01:00.880466  1556 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:01:00.884698  1557 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:00.890277  1557 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:00.887405  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2047) took 2059 ms. Trace:
I20260709 13:01:00.891326  1560 rpcz_store.cc:276] 0709 13:00:58.828234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.471924 (+643690us) service_pool.cc:224] Handling call
0709 13:00:59.472271 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.692295 (+220024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.692328 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.692379 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:59.692421 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.886854 (+1194433us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54002db9d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:00.886925 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.887188 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505569152}
I20260709 13:01:00.889958  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2200) took 1560 ms. Trace:
I20260709 13:01:00.894690  1556 rpcz_store.cc:276] 0709 13:00:59.329218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.879299 (+1550081us) service_pool.cc:224] Handling call
0709 13:01:00.880021 (+   722us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.889623 (+  9602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.889882 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:00.893985  1557 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:00.897799  1557 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.917099  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:42422 (request call id 4) took 2636 ms. Trace:
I20260709 13:01:00.922005  1633 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:00.917693  1634 rpcz_store.cc:276] 0709 13:00:58.280272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.280439 (+   167us) service_pool.cc:224] Handling call
0709 13:01:00.916369 (+2635930us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54001662d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd5735 00007f06ddfcd9fa 00007f06e2f954c9 00007f06dc511c54 00007f06dc511be2 00007f06dc511b11 00007f06dc511a8c 00007f06dc510d42 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:00.916784 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327951232}
W20260709 13:01:00.961601  1703 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.010s	sys 0.010s
W20260709 13:01:00.969264  1703 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.010s	sys 0.010s
I20260709 13:01:00.971138  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2220) took 1720 ms. Trace:
I20260709 13:01:00.971187  5626 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.972041  5626 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:00.971525  1703 rpcz_store.cc:276] 0709 13:00:59.250320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.184487 (+934167us) service_pool.cc:224] Handling call
0709 13:01:00.264344 (+ 79857us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:00.321130 (+ 56786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.321162 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:00.332185 (+ 11023us) log.cc:844] Serialized 52 byte log entry
0709 13:01:00.446880 (+114695us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:00.970302 (+523422us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.970681 (+   379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.970779 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.970850 (+    71us) raft_consensus.cc:1685] finished
0709 13:01:00.970865 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.971086 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47098,"prepare.queue_time_us":108314,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":2858,"raft.queue_time_us":50479,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10340,"thread_start_us":622657,"threads_started":2,"wal-append.queue_time_us":120964}
W20260709 13:01:00.979957  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 1.60387e+06us
I20260709 13:01:00.967897  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2279) took 1410 ms. Trace:
I20260709 13:01:00.989761  5232 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.993590  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:01.000352  5363 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.001642  1633 rpcz_store.cc:276] 0709 13:00:59.557505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.557682 (+   177us) service_pool.cc:224] Handling call
0709 13:01:00.921198 (+1363516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.967451 (+ 46253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.967725 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.020630  5363 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.022512  5232 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:01.024907  5363 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:01.025074  5232 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:01.027074  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 912) took 1109 ms. Trace:
W20260709 13:01:01.042138  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 96530.4us
I20260709 13:01:01.049839  5648 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:01.037647  2264 rpcz_store.cc:276] 0709 13:00:59.906383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.907174 (+   791us) service_pool.cc:224] Handling call
0709 13:01:01.005547 (+1098373us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b540005ee54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:01.015810 (+ 10263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79409536}
I20260709 13:01:01.057404  5626 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:01.058398  5648 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.059490  5648 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:01.061079  5896 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.118s	user 0.003s	sys 0.001s
I20260709 13:01:01.059641  2235 leader_election.cc:400] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9.
I20260709 13:01:01.061456  1557 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:01.070796  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2042) took 2243 ms. Trace:
I20260709 13:01:01.071748  1557 rpcz_store.cc:276] 0709 13:00:58.826765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.069727 (+242962us) service_pool.cc:224] Handling call
0709 13:00:59.070152 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.884449 (+1814297us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54000210a0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddf46dc0 00007f06ddfd11c0 00007f06ddfd2231 00007f06ddfced8f 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c
0709 13:01:01.064780 (+180331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.070073 (+  5293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4169900800}
W20260709 13:01:01.073289  5322 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:01:01.076040  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.077533  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.076436  5648 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:01.079663  5447 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:01.080574  5447 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:01.084121  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.085093  5363 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.085321  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.082979  5626 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:01.086918  5363 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.089011  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:01.090860  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.091104  2264 raft_consensus.cc:2410] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:01.091674  2269 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:00.551499  5884 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:01.085733  5648 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.095242  5447 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:01.095068  5648 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.095986  5363 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:01.097646  5727 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:01.099295  5648 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:01.102324  5769 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:01.113291  5769 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.116150  5769 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:01.105593  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:01.117870  1626 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.107463  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.107494  5920 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:01.109287  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 550984us
I20260709 13:01:01.109516  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.104207  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.113672  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.105185  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.116818  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:01.119277  2264 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:01.118970  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:01.119906  2269 raft_consensus.cc:2410] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:01:01.122279  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:01.122385  1628 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:01:01.124086  5920 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:01.122665  1627 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:01.130067  5920 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:01.130901  1633 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:01.130914  1626 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 7.
I20260709 13:01:01.139678  1554 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:01.140481  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2202) took 1810 ms. Trace:
I20260709 13:01:01.140813  1554 rpcz_store.cc:276] 0709 13:00:59.329825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.138736 (+1808911us) service_pool.cc:224] Handling call
0709 13:01:01.139260 (+   524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.140187 (+   927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.140401 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:01.141598  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:01.142693  2269 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:01:01.144219  1551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2194) took 2413 ms (client timeout 1568 ms). Trace:
W20260709 13:01:01.144670  1551 rpcz_store.cc:269] 0709 13:00:58.730350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.731267 (+   917us) service_pool.cc:224] Handling call
0709 13:01:01.143762 (+2412495us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b540030b954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:01.143994 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449998080}
I20260709 13:01:01.148974  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:01.150385  2264 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:01.152068  2269 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:01.154934  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.155965  2269 raft_consensus.cc:2393] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 7: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:01.156734  1626 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.158823  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:01.159731  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.160490  2264 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:01.161607  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.161875  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.162492  1703 raft_consensus.cc:2410] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:01.162669  2264 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:01.163661  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:01.164001  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:01.164594  1708 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:01.167703  5769 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:01.167950  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.168351  5769 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:01.168666  2267 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:01:01.169392  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.170603  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:01.178754  1702 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.026s	sys 0.027s
I20260709 13:01:01.178015  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:01.186755  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:01.187417  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 65432.8us
I20260709 13:01:01.188381  2268 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:01.188764  2269 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:01.189651  5913 raft_consensus.cc:1064] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 13:01:01.186945  1626 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:01.186723  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.193853  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:01.169601  5769 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:01.197365  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:01.198701  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.199630  1632 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:01.199967  1627 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:01.199892  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.200771  1701 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:01.201363  1633 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:01.201539  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 900) took 1352 ms. Trace:
I20260709 13:01:01.201757  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.201377  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.202771  1635 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.202751  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:01.203425  2271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 897) took 1998 ms (client timeout 2033 ms). Trace:
I20260709 13:01:01.204183  1708 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:01:01.204550  1633 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
W20260709 13:01:01.204682  2265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 878) took 2103 ms (client timeout 2031 ms). Trace:
I20260709 13:01:01.205240  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.205273  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.207216  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.208081  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:01.208721  2266 rpcz_store.cc:276] 0709 13:00:59.849004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.849861 (+   857us) service_pool.cc:224] Handling call
0709 13:01:00.445025 (+595164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:00.445628 (+   603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.201152 (+755524us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400289bd0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:01.201327 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367674752}
I20260709 13:01:01.212206  1626 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:01:01.209832  1708 pending_rounds.cc:85] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 6
I20260709 13:01:01.218876  2264 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:01.219096  5913 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.220219  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:01.220876  1633 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.223479  1708 pending_rounds.cc:107] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:01:01.223511  1630 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:01.224049  1708 raft_consensus.cc:2889] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:01.209511  2271 rpcz_store.cc:269] 0709 13:00:59.205211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.398857 (+193646us) service_pool.cc:224] Handling call
0709 13:01:01.203018 (+1804161us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b5400267854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:01.203243 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93468416}
W20260709 13:01:01.210883  2265 rpcz_store.cc:269] 0709 13:00:59.101651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.102303 (+   652us) service_pool.cc:224] Handling call
0709 13:01:01.204279 (+2101976us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54000dcd54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:01.204491 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528341248}
I20260709 13:01:01.224668  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.237790  1630 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:01.239346  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.242889  5832 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.239495  5920 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.245394  1635 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:01.246106  1600 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:01.260735  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.260269  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 52393us
I20260709 13:01:01.274340  5937 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.282191  1633 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:01.270522  5769 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:01.277274  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:01.283910  5769 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.287091  5769 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.298122  1599 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:01.306281  5913 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:01.319365  2234 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:01.321326  5827 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:01.323366  5876 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:01.323864  5876 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.324208  5876 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.327630  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:01.337685  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 64947.8us
W20260709 13:01:01.340780  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 125361us
I20260709 13:01:01.343348  5648 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:01.343526  5626 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:01.343402  2271 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:01.342581  5827 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:01.349586  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2043) took 2522 ms. Trace:
I20260709 13:01:01.351707  1553 rpcz_store.cc:276] 0709 13:00:58.827085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.090184 (+263099us) service_pool.cc:224] Handling call
0709 13:00:59.098749 (+  8565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.339547 (+240798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.345680 (+2006133us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400385754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:01.349055 (+  3375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390504704}
W20260709 13:01:01.355434  1555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2039) took 3048 ms (client timeout 1570 ms). Trace:
W20260709 13:01:01.356003  1555 rpcz_store.cc:269] 0709 13:00:58.307096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.330531 (+ 23435us) service_pool.cc:224] Handling call
0709 13:01:01.354862 (+3024331us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b5400182754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:01.355195 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120805760}
I20260709 13:01:01.358593  1552 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:01.359478  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2203) took 1649 ms. Trace:
I20260709 13:01:01.359897  1552 rpcz_store.cc:276] 0709 13:00:59.710349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.353282 (+1642933us) service_pool.cc:224] Handling call
0709 13:01:01.353893 (+   611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.359148 (+  5255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.359396 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:01.360459  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.351019  5827 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.363106  5713 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.363777  5713 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.380379  5447 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:01.388685  5892 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.381367  5447 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:01:01.391635  5447 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:01.387861  5626 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.388607  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2222) took 2027 ms. Trace:
I20260709 13:01:01.388065  5713 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:01.392674  5626 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.393340  5713 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:01.393532  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.393981  5713 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.395277  5626 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:01.396891  5713 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:01.399873  1674 connection.cc:256] RPC call timeout handler was delayed by -1.2820860429999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 13:01:01.400444  5713 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.401645  5713 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.402616  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.403440  1708 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:01:01.404858  1701 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:01.407763  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:01.410593  5713 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:01.415030  5773 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.415758  5773 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.416282  5870 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:01.416473  5842 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:01.418156  5913 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:01.418630  5913 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:01.420477  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:01.401762  5829 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 2.582s	user 0.000s	sys 0.015s
I20260709 13:01:00.520161  5849 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:01.420907  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:01.389555  5892 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:01.436542  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.424516  5626 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:01.441752  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.444742  5626 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.445276  5626 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.441773  1703 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:01.441931  1708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48128
I20260709 13:01:01.446908  1708 raft_consensus.cc:606] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Received request to transfer leadership
I20260709 13:01:01.419672  5913 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.442855  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.448040  5913 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.448220  1704 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:01:01.443886  5849 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:01.450089  5849 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:01.450598  5849 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.437870  2234 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:01.442667  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:01.447292  1708 raft_consensus.cc:614] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:01.392647  1702 rpcz_store.cc:276] 0709 13:00:59.361225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.529150 (+1167925us) service_pool.cc:224] Handling call
0709 13:01:00.529485 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.529711 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:01.213875 (+684164us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.315015 (+101140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.346803 (+ 31788us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:01.374848 (+ 28045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.388320 (+ 13472us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.388540 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37690,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":3297,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":7237,"thread_start_us":707450,"threads_started":2,"wal-append.queue_time_us":168837}
W20260709 13:01:01.456115  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 47021us
W20260709 13:01:01.461220  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 101167us
I20260709 13:01:01.419713  5842 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:01:01.437527  5773 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:01.381203  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e99891af85f4b10aa1cc2da6aa33082 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:01.484895  5887 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:01.449798  5762 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:01.481531  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 59139us
I20260709 13:01:01.495381  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:01.485193  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.495092  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:01.505882  2267 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.503631  5892 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:01.508302  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.508232  1704 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:01:01.508802  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 68512.4us
I20260709 13:01:01.511723  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.512073  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.512620  1700 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:01.512661  1627 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:01.515172  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.515995  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.516489  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.518574  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:01.519568  1701 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:01.519464  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:01.517660  1443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 139679us
I20260709 13:01:01.527527  1628 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:01.530124  5784 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:01.530450  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:01.530833  5784 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:01.531766  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 53981.3us
I20260709 13:01:01.532109  5784 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.510017  5887 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:01.534657  5363 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:01.535177  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.535945  1626 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:01.536320  5887 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:01.537338  1626 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:01:01.539058  5847 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 2.388s	user 0.013s	sys 0.014s
W20260709 13:01:01.536355  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.539813  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.540225  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.543080  1635 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:01.547221  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.484268  5933 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:01:01.562527  1633 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:01.520649  5827 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:01.565338  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 68951.3us
I20260709 13:01:01.566191  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:01.569808  5727 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:01.570542  5727 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:01.571527  5842 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.571754  5727 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.572283  5842 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.574190  5928 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.565655  5827 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.577379  5827 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:01.582322  5948 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:01.595436  5853 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.595558  5889 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:01.596236  5853 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.602187  2267 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
W20260709 13:01:01.608708  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.606731  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 89244.1us
I20260709 13:01:01.628378  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:01.628234  5887 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:01.629813  5928 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:01.630352  5928 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.630474  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.630767  5928 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.631197  1633 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:01.645277  1635 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:01.646517  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.647172  1635 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
W20260709 13:01:01.648689  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 116109us
I20260709 13:01:01.648948  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.649537  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:01.653144  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.656237  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:01.656399  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:01.657079  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.635813  5648 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:01:01.651261  5826 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:01.648166  5769 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.663416  5876 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.658430  5889 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:01:01.665952  5889 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:01.666379  5889 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:01.666563  5876 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:01.667420  5889 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:01.668735  5827 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.670542  2267 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:01.670874  5525 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:01.650350  5842 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:01.672861  2267 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:01:01.694425  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.674146  2265 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:01.675992  2266 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:01.687876  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:01.677994  2264 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:01.687017  1626 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:01.678648  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:01.699992  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.706306  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.707484  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.687978  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:01.691697  5868 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:01.711649  5868 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:01.712152  5853 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:01.712719  5868 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.714133  5876 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:01.714603  5876 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.714982  5876 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.687361  5773 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:01.716037  5773 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.716377  5773 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.717743  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.718412  2268 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:01.718554  2265 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:01.719617  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:01.720268  2271 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:01.671881  5849 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:01.677404  5769 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:01.723973  5928 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.724248  5773 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:01.724661  5921 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:01.726243  5842 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:01.726756  5773 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:01.726847  5842 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:01.728010  5842 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.679627  5938 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:01:01.729151  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.729810  1708 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:01.730475  5938 raft_consensus.cc:1064] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 13:01:01.730633  1707 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:01.731308  5447 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.731778  5447 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.733033  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.733618  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.734004  1703 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:01:01.732945  1708 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:01.734301  1701 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:01.738483  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:01.735782  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:01.740631  1626 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.729225  5766 raft_consensus.cc:1064] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 13:01:01.671536  5827 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:01.741788  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:01.745398  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 54652.8us
I20260709 13:01:01.724032  5849 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:01.749804  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:01.680763  5933 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:01:01.749285  1601 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:01.756973  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.760428  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.761234  5932 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.766278  5775 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:01:01.773998  5868 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:01.745886  5769 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:01:01.778440  5769 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:01.778890  5769 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:01.779950  5769 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.786439  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:01.786746  1702 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:01.746235  5921 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:01:01.733023  5938 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:01.801270  1707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 711) took 2552 ms (client timeout 2036 ms). Trace:
W20260709 13:01:01.801901  1707 rpcz_store.cc:269] 0709 13:00:59.248596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.315517 (+ 66921us) service_pool.cc:224] Handling call
0709 13:01:01.800905 (+2485388us) spinlock_profiling.cc:243] Waited 2.41 s on lock 0x7b54003afa54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:01.801172 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5551925632}
W20260709 13:01:01.808314  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.809896  5928 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:01.816278  5802 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:01.816962  5802 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:01.818127  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 917) took 1460 ms. Trace:
I20260709 13:01:01.818603  2263 rpcz_store.cc:276] 0709 13:01:00.357158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.357467 (+   309us) service_pool.cc:224] Handling call
0709 13:01:00.358298 (+   831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.457743 (+ 99445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.817649 (+1359906us) spinlock_profiling.cc:243] Waited 97.5 ms on lock 0x7b5400730fd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:01.817912 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224270592}
W20260709 13:01:01.822723  1506 auto_rebalancer.cc:893] Removing replace marker failed: Replica 4f1725fe36e349ac85405627f9c93d95 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
W20260709 13:01:01.823381  1506 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:01:01.823730  1506 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:01:01.824923  5948 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.242s	user 0.002s	sys 0.000s
W20260709 13:01:01.827121  5871 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 2.255s	user 0.007s	sys 0.000s
I20260709 13:01:01.830016  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.831354  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:01.831911  1633 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.825763  2270 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:01.844312  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:01.846343  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:01.853955  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 104278us
I20260709 13:01:01.854943  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:01:01.860941  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 111420us
I20260709 13:01:01.864373  1626 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:01.856770  5769 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.852932  5802 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:01.876154  1702 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:01.859694  5773 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:01.880630  1701 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:01:01.882534  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.884202  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:01.884691  1626 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:01.888675  1674 leader_election.cc:336] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.568s (SENT)
I20260709 13:01:01.888746  1631 raft_consensus.cc:1217] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[8.9-8.9]   Dedup: 8.9->[]
I20260709 13:01:01.889362  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:01.892676  5856 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.894120  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 821) took 2522 ms. Trace:
I20260709 13:01:01.880455  5773 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.895500  5773 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.894534  1629 rpcz_store.cc:276] 0709 13:00:59.314922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.316274 (+  1352us) service_pool.cc:224] Handling call
0709 13:00:59.316624 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:59.327978 (+ 11354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.328008 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:59.328567 (+   559us) log.cc:844] Serialized 52 byte log entry
0709 13:00:59.480268 (+151701us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:59.480306 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.480370 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.530762 (+2050392us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:01.826680 (+295918us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b24002c2028. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dad689c4 00007f06dad66acb 00007f06daf21dc9 00007f06daf21a55 00007f06daf2109d 00007f06ddb5310e 00007f06ddb6a88c 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221
0709 13:01:01.834458 (+  7778us) raft_consensus.cc:1685] finished
0709 13:01:01.834477 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.837511 (+  3034us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10926,"raft.queue_time_us":11783,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":13203,"spinlock_wait_cycles":83736192,"thread_start_us":127400,"threads_started":1,"wal-append.queue_time_us":229868}
I20260709 13:01:01.896587  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:01.897106  1629 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.898121  5802 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:01.900099  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.899981  5802 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:01.889494  1631 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:01.905982  1633 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:01.867339  5626 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.909041  2267 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:01.909919  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:01.910383  5626 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:01.866796  5870 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:01:01.911602  1702 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:01.914417  5955 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:01.915037  5955 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:01.918231  1709 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:01:01.918625  1709 pending_rounds.cc:85] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 7
I20260709 13:01:01.918829  1709 pending_rounds.cc:107] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:01.919143  1709 raft_consensus.cc:2889] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.918826  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:01.920511  5953 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:01:01.931030  1707 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:01.933436  1634 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:01.934479  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:01.935123  1633 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:01.942430  1633 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:01.946887  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:01.949381  1709 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.952750  1626 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:01.956593  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 652) took 2722 ms. Trace:
I20260709 13:01:01.957409  2271 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:01.944105  5729 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:01.966416  1702 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:01.969311  1630 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:01.970433  1626 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:01.972682  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:01.957082  1558 rpcz_store.cc:276] 0709 13:00:59.234062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.591549 (+1357487us) service_pool.cc:224] Handling call
0709 13:01:00.591913 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.955898 (+1363985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.955947 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.955991 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:01.956031 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.956154 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.956418 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1357017,"raft.queue_time_us":1363589,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144}
I20260709 13:01:01.975507  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:01.967639  5322 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.976850  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:01.978854  2268 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:01.974926  1552 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:01.973193  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:01.979664  1555 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.981469  5884 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:01.982139  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:01.968104  5729 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.988596  1552 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:02.001945  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:02.003110  5870 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:02.005214  5771 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.000589  5729 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:02.022506  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:02.053115  1701 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:01:02.053606  1701 pending_rounds.cc:85] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 6
I20260709 13:01:02.053853  1701 pending_rounds.cc:107] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:01:02.054095  1701 raft_consensus.cc:2889] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:02.056105  5920 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:02.058596  5709 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:02.059173  5709 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:02.061405  5709 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:02.064646  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2003) took 2735 ms. Trace:
I20260709 13:01:02.065068  1631 rpcz_store.cc:276] 0709 13:00:59.328868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.330431 (+  1563us) service_pool.cc:224] Handling call
0709 13:01:01.865297 (+2534866us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.901147 (+ 35850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.064462 (+163315us) spinlock_profiling.cc:243] Waited 2.5 s on lock 0x7b540006c2d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:02.064590 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5759194368}
I20260709 13:01:02.070639  1701 raft_consensus.cc:2955] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:02.073257  5802 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:02.073956  5802 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:02.076160  5802 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:02.077163  5955 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:02.086776  5929 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:01:02.089057  5967 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:02.090631  5954 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:01:02.091034  1557 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:01:02.006848  5921 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:01:02.015493  5913 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:01:01.998922  5525 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:02.094388  5525 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:01:02.086566  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:02.101176  1551 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:02.108878  1709 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:02.110502  1558 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:02.101504  2236 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:02.096761  1552 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:02.113140  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:02.115468  5861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.403s	user 0.004s	sys 0.007s
I20260709 13:01:02.115506  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:02.116025  5861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.411s	user 0.004s	sys 0.007s
I20260709 13:01:02.116618  5954 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:02.119834  1631 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:01:02.005854  5771 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:02.117297  5954 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:02.103605  5626 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:02.020654  5937 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:01:02.186354  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:02.187078  1557 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:02.188930  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:02.189694  1556 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:01:02.105262  5827 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:01:02.191514  1559 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:02.168823  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:02.168805  1552 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.006661  5322 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:02.175624  5731 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.176056  1700 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:02.176187  5707 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:02.176515  5680 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:02.181531  5771 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:02.123750  5955 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:02.096735  5928 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:01:02.183935  5959 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
W20260709 13:01:02.205972  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 179945us
I20260709 13:01:02.228504  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:02.228842  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:02.199729  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:02.231225  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.261494  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:02.266876  1555 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:02.272363  1629 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:02.267760  1554 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:02.282361  1551 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:02.283284  1556 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:02.281368  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46387.5us
I20260709 13:01:02.205019  5626 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.279668  5731 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:02.282172  5707 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:02.288739  1560 raft_consensus.cc:2410] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:02.230661  5680 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:02.258683  5827 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:02.298808  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:02.311667  1555 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.307063  1559 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:02.286851  5525 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:02.317183  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.294611  5769 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.309118  2235 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:02.329283  1559 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:02.312258  5827 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:02.336557  5868 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:02.338820  5731 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:02.339195  5322 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:02.296283  5762 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:02.339910  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:02.351646  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:02.340477  5773 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:02.341369  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2f40 after lost signal to thread 434
I20260709 13:01:02.204769  5884 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:02.345788  5876 consensus_meta.cc:287] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.003s
I20260709 13:01:02.346936  1558 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:02.303644  5626 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:02.351950  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 48158us
W20260709 13:01:02.359292  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0e60 after lost signal to thread 1492
I20260709 13:01:02.349045  5827 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.370532  1557 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:02.373441  1555 raft_consensus.cc:2410] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:02.373939  1706 raft_consensus.cc:2368] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14.
I20260709 13:01:02.395028  5680 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:02.393332  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:02.396211  5680 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.396731  2235 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:02.395542  5928 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.369213  5762 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:02.362722  5955 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:02.402385  1552 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:02.403944  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:02.410503  5973 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:01:02.404888  1702 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:01:02.351132  5769 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:02.392153  1559 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:02.427388  5974 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:02.348369  5954 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:02.427924  5773 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:02.429632  5881 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.138s	user 0.001s	sys 0.019s
I20260709 13:01:02.432057  5928 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:02.363250  5876 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:02.434599  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 124197us
I20260709 13:01:02.402844  5955 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:02.439414  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:02.444849  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:02.447178  5986 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:02.447762  5986 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:02.448217  5986 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.448504  1628 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:02.448773  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:02.449693  5802 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:02.454591  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:02.454710  1559 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.456118  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:02.461380  5928 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:02.462708  2262 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:02.463263  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:02.464282  1703 raft_consensus.cc:2410] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:01:02.465229  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:02.467113  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:02.439383  5955 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:02.465833  1703 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
W20260709 13:01:02.473268  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 1.92681e+06us
W20260709 13:01:02.506718  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 92870.1us
I20260709 13:01:02.510726  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:02.511308  2234 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:02.507647  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:02.513595  1702 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:02.473340  5631 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:02.518637  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:02.525460  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:02.528914  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1008) took 1412 ms. Trace:
I20260709 13:01:02.527441  5718 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:02.531729  5984 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:02.531924  5718 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:01:02.531930  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.529502  2270 rpcz_store.cc:276] 0709 13:01:01.116316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.116463 (+   147us) service_pool.cc:224] Handling call
0709 13:01:01.825502 (+709039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.837510 (+ 12008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.528626 (+691116us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b5400730fd0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:02.528828 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629668992}
I20260709 13:01:02.532402  5773 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:02.537039  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.537643  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.459223  5729 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:02.543982  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:02.545006  1552 raft_consensus.cc:2410] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:01:02.545851  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.547899  1552 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:02.550007  5849 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:02.551220  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:02.551558  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.551993  1552 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:02.559825  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:02.560901  1555 raft_consensus.cc:2410] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:02.515074  5680 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.569267  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:02.566390  1552 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:02.574754  1558 raft_consensus.cc:2393] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 12: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:02.541108  5631 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:02.620980  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:02.541008  5707 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:02.632768  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:02.635188  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 124948us
I20260709 13:01:02.539825  5709 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:01:02.652354  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:02.533318  5856 consensus_queue.cc:1059] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:01:02.575861  5884 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.636551  1524 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:02.660074  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:02.661084  1552 raft_consensus.cc:2410] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:02.662369  1552 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:02.663477  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:02.663724  1552 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:02.665264  1556 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:02.666332  5769 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:02.625844  5832 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.667694  1552 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:02.667209  5832 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:02.669924  5832 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:02.669788  5880 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:02.671096  5880 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:02.671916  5784 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:02.672353  5784 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:02.673575  5880 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:02.677632  5981 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.106s	user 0.000s	sys 0.002s
I20260709 13:01:02.680652  5631 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:02.578714  5991 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:02.666396  1558 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:02.561549  5718 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:02.671844  5985 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:01:02.701870  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 65409.6us
I20260709 13:01:02.704612  5709 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:02.701622  1559 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:01:02.800541  1559 pending_rounds.cc:85] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 8
I20260709 13:01:02.800848  1559 pending_rounds.cc:107] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:01:02.801096  1559 raft_consensus.cc:2889] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:02.704651  5803 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:02.578182  5680 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:02.705406  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:02.673348  5784 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:02.818186  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 112976us
I20260709 13:01:02.699867  5991 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:01:02.825181  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 428562us
I20260709 13:01:02.830785  2235 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:02.800087  5880 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:02.821925  5981 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:01:02.806192  5876 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:02.811255  5870 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.690555  5884 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:02.853432  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4fc0 after lost signal to thread 1584
W20260709 13:01:02.921792  1656 debug-util.cc:398] Leaking SignalData structure 0x7b080005b560 after lost signal to thread 1585
I20260709 13:01:02.827801  5771 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:02.918535  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 292717us
I20260709 13:01:02.817589  5773 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:02.829530  5991 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:02.825172  5913 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.923175  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 72683.2us
I20260709 13:01:02.838415  5880 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.923813  1558 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:01:02.927138  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 482365us
W20260709 13:01:02.924830  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 70997us
I20260709 13:01:02.839632  5984 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:02.976516  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 145827us
I20260709 13:01:02.927173  5880 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:02.980592  5884 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:02.981029  1555 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.919947  5784 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:02.997840  1709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.004s	sys 0.054s
I20260709 13:01:02.998320  1559 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:01:02.998317  1709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.005s	sys 0.054s
W20260709 13:01:02.996039  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 438313us
W20260709 13:01:03.005043  1707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 732) took 1204 ms (client timeout 1522 ms). Trace:
W20260709 13:01:03.008482  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e99891af85f4b10aa1cc2da6aa33082 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:03.008468  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:03.005548  1707 rpcz_store.cc:269] 0709 13:01:01.834814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.843992 (+  9178us) service_pool.cc:224] Handling call
0709 13:01:03.004836 (+1160844us) spinlock_profiling.cc:243] Waited 85.8 ms on lock 0x7b54000b7554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:03.004956 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197453696}
I20260709 13:01:03.009855  2270 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:03.047729  1555 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:02.918396  5870 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:03.077551  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.023248  5987 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:01:02.991550  5771 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:03.076408  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2302) took 1100 ms. Trace:
I20260709 13:01:03.085522  1701 rpcz_store.cc:276] 0709 13:01:01.975683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.055566 (+ 79883us) service_pool.cc:224] Handling call
0709 13:01:02.055876 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.070401 (+ 14525us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:02.262186 (+191785us) log.cc:844] Serialized 14 byte log entry
0709 13:01:02.424799 (+162613us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.425251 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.425389 (+   138us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:02.425427 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.425504 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.676591 (+251087us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:03.064042 (+387451us) raft_consensus.cc:1685] finished
0709 13:01:03.076181 (+ 12139us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.076342 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9222,"raft.queue_time_us":14043,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":207,"spinlock_wait_cycles":129363328,"thread_start_us":121714,"threads_started":1,"wal-append.queue_time_us":216342}
I20260709 13:01:03.088332  2266 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:03.062121  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63635.4us
I20260709 13:01:03.055802  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:02.977835  5913 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:03.126087  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.294850  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:03.219796  2270 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:01:03.299582  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.236132  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.015s	sys 0.034s
W20260709 13:01:03.300201  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.017s	sys 0.037s
W20260709 13:01:03.276979  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 254030us
W20260709 13:01:03.300630  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 644983us
W20260709 13:01:03.207053  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 197886us
I20260709 13:01:03.265733  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:03.090965  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:03.237162  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 258228us
W20260709 13:01:03.195919  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63341us
W20260709 13:01:03.299983  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 237847us
I20260709 13:01:03.301569  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:03.010385  5989 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:03.295960  5992 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.307s	user 0.000s	sys 0.000s
W20260709 13:01:03.300309  5626 consensus_meta.cc:287] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.908s	user 0.010s	sys 0.002s
I20260709 13:01:03.405870  1560 raft_consensus.cc:2410] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:03.306190  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:03.415591  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 114093us
I20260709 13:01:03.493673  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:03.039284  5876 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:03.191563  5707 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:03.496325  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:03.524127  1551 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:03.524672  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 67437.3us
I20260709 13:01:03.477955  5363 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:03.205790  5525 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.281s
W20260709 13:01:03.537335  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 231291us
I20260709 13:01:03.538455  1526 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:03.098868  5954 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.414s
I20260709 13:01:03.475594  5989 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:03.142910  5832 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.359s
I20260709 13:01:03.562731  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:03.581888  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:03.585059  1656 debug-util.cc:398] Leaking SignalData structure 0x7b080030f980 after lost signal to thread 1659
I20260709 13:01:03.604357  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:03.604631  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 79129us
W20260709 13:01:03.604859  1656 debug-util.cc:398] Leaking SignalData structure 0x7b080004bf60 after lost signal to thread 1733
W20260709 13:01:03.608428  1656 debug-util.cc:398] Leaking SignalData structure 0x7b080022f860 after lost signal to thread 1734
I20260709 13:01:03.605976  1560 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:01:03.482470  5626 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:03.142485  5773 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:03.612133  1558 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:03.563026  5447 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:03.613147  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 119607us
W20260709 13:01:03.615883  1656 debug-util.cc:398] Leaking SignalData structure 0x7b0800252a60 after lost signal to thread 2295
W20260709 13:01:03.616888  1656 debug-util.cc:398] Leaking SignalData structure 0x7b080022b880 after lost signal to thread 2296
I20260709 13:01:03.617847  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:03.604678  5992 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:03.623247  5870 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:03.627424  6015 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:03.481638  5771 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:03.630067  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 743) took 1277 ms. Trace:
I20260709 13:01:03.649941  1703 rpcz_store.cc:276] 0709 13:01:02.352938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.980814 (+627876us) service_pool.cc:224] Handling call
0709 13:01:02.981137 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.981451 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.981477 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.981976 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.236624 (+254648us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:03.236683 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.236792 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.629802 (+393010us) raft_consensus.cc:1685] finished
0709 13:01:03.629824 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.629979 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":253448,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":51125,"thread_start_us":254223,"threads_started":1,"wal-append.queue_time_us":646107}
I20260709 13:01:03.592779  5876 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:03.653312  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.007s
W20260709 13:01:03.655402  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.000s	sys 0.007s
W20260709 13:01:03.657068  1656 debug-util.cc:398] Leaking SignalData structure 0x7b0800355a80 after lost signal to thread 5822
I20260709 13:01:03.611802  5707 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:03.476369  5984 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:03.681330  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2310) took 1462 ms. Trace:
I20260709 13:01:03.692927  1708 rpcz_store.cc:276] 0709 13:01:02.218763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.850758 (+631995us) service_pool.cc:224] Handling call
0709 13:01:02.851401 (+   643us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:02.977404 (+126003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.989424 (+ 12020us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:03.001876 (+ 12452us) log.cc:844] Serialized 52 byte log entry
0709 13:01:03.470302 (+468426us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:03.498959 (+ 28657us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.499400 (+   441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.499503 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.680715 (+181212us) raft_consensus.cc:1685] finished
0709 13:01:03.680760 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.681241 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31559,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":441613,"raft.run_cpu_time_us":411,"raft.run_wall_time_us":72302,"thread_start_us":330851,"threads_started":1,"wal-append.queue_time_us":544249}
I20260709 13:01:03.702219  5832 consensus_queue.cc:1243] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:03.703821  5876 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:03.697577  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:03.660614  5707 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:03.666096  6010 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:03.665823  5680 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:03.716109  5955 consensus_meta.cc:287] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.207s	user 0.004s	sys 0.007s
W20260709 13:01:03.719802  6008 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:01:03.720691  5986 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.272s	user 0.011s	sys 0.000s
I20260709 13:01:03.720510  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:03.721206  6028 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:03.722642  6014 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:01:03.736032  1551 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
W20260709 13:01:03.696094  5993 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.500s	user 0.001s	sys 0.000s
I20260709 13:01:03.737970  2265 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:03.737902  1558 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:01:03.770571  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 356064us
I20260709 13:01:03.771718  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:03.779316  1629 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.000s	sys 0.013s
W20260709 13:01:03.779712  2235 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.006s	sys 0.006s
W20260709 13:01:03.781826  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 164034us
I20260709 13:01:03.724375  6010 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:03.775180  5955 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:03.830977  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2304) took 1768 ms. Trace:
I20260709 13:01:03.842900  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:03.820393  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:03.893626  2234 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:03.892897  1629 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.000s	sys 0.014s
W20260709 13:01:03.834237  1600 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.828s (SENT)
I20260709 13:01:03.905290  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:03.892614  2235 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.006s	sys 0.007s
W20260709 13:01:03.906090  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 743397us
I20260709 13:01:03.842613  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:03.896135  6024 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.840936  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2307) took 1740 ms. Trace:
I20260709 13:01:03.843382  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:03.819547  1551 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:03.902421  1709 rpcz_store.cc:276] 0709 13:01:02.062192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.122087 (+ 59895us) service_pool.cc:224] Handling call
0709 13:01:02.240593 (+118506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.303427 (+ 62834us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:02.350797 (+ 47370us) log.cc:844] Serialized 14 byte log entry
0709 13:01:03.024648 (+673851us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.025174 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.025308 (+   134us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:03.025340 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.025410 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.830674 (+805264us) raft_consensus.cc:1685] finished
0709 13:01:03.830700 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.830883 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63238,"prepare.queue_time_us":42659,"prepare.run_cpu_time_us":7899,"prepare.run_wall_time_us":17966,"raft.queue_time_us":287120,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":25899,"thread_start_us":596360,"threads_started":1,"wal-append.queue_time_us":1125500}
W20260709 13:01:03.823680  2236 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.512s (SENT)
I20260709 13:01:03.904363  2265 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
W20260709 13:01:03.843531  6009 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.369s	user 0.000s	sys 0.000s
W20260709 13:01:03.907292  2235 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.892s (SENT) [suppressed 19 similar messages]
W20260709 13:01:03.833623  1734 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:36797 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:36797 timed out after 15.000s (SENT)
W20260709 13:01:03.835091  6019 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:01:03.872697  5827 consensus_meta.cc:287] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.481s	user 0.012s	sys 0.000s
W20260709 13:01:03.842069  6007 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.596s	user 0.000s	sys 0.001s
I20260709 13:01:03.796381  5913 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:03.839900  5784 consensus_meta.cc:287] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.827s	user 0.007s	sys 0.002s
I20260709 13:01:03.815893  6028 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:03.840056  5766 raft_consensus.cc:1068] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Unable to promote non-voter 6923294c847b48ebb577e0935d316aa3: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }.
  Pending config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:03.913679  1705 rpcz_store.cc:276] 0709 13:01:02.100504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.468278 (+367774us) service_pool.cc:224] Handling call
0709 13:01:02.468657 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.469070 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.469111 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.469654 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.800665 (+331011us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:02.800709 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.800781 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.840690 (+1039909us) raft_consensus.cc:1685] finished
0709 13:01:03.840732 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.840875 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":232,"thread_start_us":330568,"threads_started":1,"wal-append.queue_time_us":594499}
I20260709 13:01:03.901064  6010 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:03.930259  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:03.790907  5363 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:03.769487  5989 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:03.931720  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 107988us
I20260709 13:01:03.975006  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:03.936757  5880 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.898s	user 0.009s	sys 0.003s
I20260709 13:01:03.978165  5880 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:03.976483  5766 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.980331  5880 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:03.980429  5766 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:03.936792  6037 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:03.938750  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 664) took 1762 ms. Trace:
I20260709 13:01:03.982704  5766 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:03.941937  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:03.833623  5626 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:03.781291  5680 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.153s
W20260709 13:01:03.872552  5991 consensus_meta.cc:287] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.878s	user 0.011s	sys 0.000s
W20260709 13:01:03.953207  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.985150  1552 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:03.975487  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:03.989216  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 190920us
I20260709 13:01:03.955686  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:03.831955  6016 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:03.870844  5888 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.132s
W20260709 13:01:03.959175  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.983958  1558 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:03.957741  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:03.993211  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.796599  5986 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:03.988510  1631 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:03.975713  6030 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.957365  6040 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.000316  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:03.982170  1553 rpcz_store.cc:276] 0709 13:01:02.176512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.187940 (+ 11428us) service_pool.cc:224] Handling call
0709 13:01:02.188349 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.505423 (+317074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.505451 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.514891 (+  9440us) log.cc:844] Serialized 26 byte log entry
0709 13:01:02.844403 (+329512us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:02.844465 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.844577 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.842744 (+998167us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:03.938429 (+ 95685us) raft_consensus.cc:1685] finished
0709 13:01:03.938452 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.938670 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":307257,"raft.queue_time_us":317033,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":12349,"spinlock_wait_cycles":14653184,"thread_start_us":282025,"threads_started":1,"wal-append.queue_time_us":682597}
I20260709 13:01:04.002774  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:04.005568  1558 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:04.005961  1552 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:04.000921  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:03.830180  5707 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:04.006600  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:04.008162  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:04.009130  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:04.011859  1551 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:04.010207  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:03.986665  5766 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:04.012826  1635 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.014899  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:04.015758  1629 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:03.975977  5955 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:04.019101  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:04.020882  1558 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:04.024700  1634 raft_consensus.cc:2410] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 11 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:01:04.026881  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 192679us
I20260709 13:01:04.027015  1558 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:04.000146  6037 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:03.999547  5784 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:03.953083  5827 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:04.032430  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:04.048251  1551 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:04.032738  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:04.037539  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:04.049222  1553 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:04.037983  1556 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:04.051781  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2309) took 1850 ms. Trace:
I20260709 13:01:04.052206  1702 rpcz_store.cc:276] 0709 13:01:02.201138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.514483 (+313345us) service_pool.cc:224] Handling call
0709 13:01:02.521535 (+  7052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.523297 (+  1762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.523342 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:02.573332 (+ 49990us) log.cc:844] Serialized 564 byte log entry
0709 13:01:02.832818 (+259486us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:02.832863 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.832943 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.841243 (+1008300us) spinlock_profiling.cc:243] Waited 9.88 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:04.051508 (+210265us) raft_consensus.cc:1685] finished
0709 13:01:04.051530 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.051725 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22733696,"thread_start_us":259177,"threads_started":1,"wal-append.queue_time_us":574338}
I20260709 13:01:04.042196  6004 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:03.993083  5991 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:04.031862  5363 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:04.057679  2267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 920) took 2378 ms (client timeout 1786 ms). Trace:
W20260709 13:01:04.058947  2267 rpcz_store.cc:269] 0709 13:01:01.679108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.707762 (+ 28654us) service_pool.cc:224] Handling call
0709 13:01:04.057451 (+2349689us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400671e54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:04.057610 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390422784}
I20260709 13:01:04.064055  2271 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:03.941373  6024 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:04.042243  5875 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:04.102519  5932 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.103212  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:04.105400  5997 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.003s	sys 0.000s
W20260709 13:01:04.110152  5997 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.004s	sys 0.000s
I20260709 13:01:04.109898  5932 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:04.110862  5997 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:04.111706  5997 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:04.112284  6013 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:01:04.112461  5932 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:04.100307  1635 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:04.074975  1552 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:04.064374  6004 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.097369  5955 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.054337  5784 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:04.020110  6040 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:04.160583  1600 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.570s (SENT)
I20260709 13:01:04.024392  6030 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:04.137667  1552 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:04.730265  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2064) took 2068 ms. Trace:
W20260709 13:01:04.755194  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.773615  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 672) took 2548 ms. Trace:
I20260709 13:01:05.625568  1552 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:05.630108  1552 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:04.469419  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 476388us
W20260709 13:01:05.637533  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 2.03373e+06us
I20260709 13:01:05.638959  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:01:04.542883  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 382335us
I20260709 13:01:04.777760  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
W20260709 13:01:04.681352  1628 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.008s	sys 0.026s
W20260709 13:01:05.745507  1674 connection.cc:256] RPC call timeout handler was delayed by -2.5526263369999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 13:01:04.676681  1631 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.007s	sys 0.010s
W20260709 13:01:05.748247  1631 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.686s	user 0.009s	sys 0.011s
I20260709 13:01:05.749090  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 849) took 1753 ms. Trace:
I20260709 13:01:04.817188  1553 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:04.558552  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.691103  2233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.013s	sys 0.013s
W20260709 13:01:04.707419  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.014s	sys 0.031s
W20260709 13:01:04.680490  2266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.022s	sys 0.022s
I20260709 13:01:04.818246  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:04.818840  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:04.582197  5626 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:05.779960  5626 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:04.115285  5707 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:04.753371  5729 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:04.687598  2268 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:04.580710  5784 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:04.686134  5856 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.885s	user 0.009s	sys 0.033s
W20260709 13:01:05.795364  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.796051  5884 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:05.796327  5856 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.094s	user 0.012s	sys 0.033s
I20260709 13:01:04.160223  5955 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:04.214278  5827 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:04.136466  5986 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:05.812680  1560 raft_consensus.cc:2410] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:04.781880  5762 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:04.795040  1706 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 738) took 2465 ms (client timeout 1512 ms). Trace:
I20260709 13:01:04.577365  5991 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:04.811791  5804 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.114652  5997 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:04.779263  6000 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.513s	user 0.006s	sys 0.012s
I20260709 13:01:04.133220  6004 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.164841  6005 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:06.080713  6005 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:05.793728  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 154931us
W20260709 13:01:05.733055  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 2.12303e+06us
I20260709 13:01:06.084597  1524 leader_election.cc:400] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11.
I20260709 13:01:06.084957  1524 leader_election.cc:403] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:06.085212  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:06.086181  1526 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:06.088903  5631 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.089394  5631 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:05.756181  1552 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.625665  1554 rpcz_store.cc:276] 0709 13:01:02.661905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.664492 (+  2587us) service_pool.cc:224] Handling call
0709 13:01:02.664763 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.685932 (+ 21169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.685975 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:02.686087 (+   112us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:02.686134 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.729941 (+2043807us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5400182254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:04.729997 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.730199 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47977728}
I20260709 13:01:06.159659  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.160243  1554 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:05.750314  1553 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:06.167222  1553 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.168248  1553 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:05.653515  1555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2053) took 3083 ms (client timeout 1652 ms). Trace:
W20260709 13:01:06.171543  1555 rpcz_store.cc:269] 0709 13:01:02.570278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.570413 (+   135us) service_pool.cc:224] Handling call
0709 13:01:05.653288 (+3082875us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400384854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:05.653434 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809869696}
I20260709 13:01:06.172552  1552 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:06.172818  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.173426  1555 raft_consensus.cc:2376] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13. Re-sending same reply.
I20260709 13:01:05.626008  1557 rpcz_store.cc:276] 0709 13:01:02.225470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.304404 (+ 78934us) service_pool.cc:224] Handling call
0709 13:01:02.359306 (+ 54902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.371110 (+ 11804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.773327 (+2402217us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b54003124d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:04.773533 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125439744}
I20260709 13:01:06.175248  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.176290  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.177255  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:05.496131  1558 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:06.179590  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2233) took 1433 ms. Trace:
I20260709 13:01:06.179903  1558 rpcz_store.cc:276] 0709 13:01:04.746557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.495576 (+749019us) service_pool.cc:224] Handling call
0709 13:01:05.495938 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.179359 (+683421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.179538 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.180830  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:05.626828  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2069) took 2624 ms. Trace:
I20260709 13:01:06.182916  1559 rpcz_store.cc:276] 0709 13:01:03.002538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.002711 (+   173us) service_pool.cc:224] Handling call
0709 13:01:03.058644 (+ 55933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.082767 (+ 24123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.082792 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.129058 (+ 46266us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.539408 (+410350us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:03.586894 (+ 47486us) log.cc:844] Serialized 14 byte log entry
0709 13:01:04.732382 (+1145488us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b180036ee60. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:01:05.616762 (+884380us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b180036ee60. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:01:05.626514 (+  9752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.626591 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.626632 (+    41us) raft_consensus.cc:1685] finished
0709 13:01:05.626643 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.626776 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63332,"prepare.queue_time_us":47016,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3400,"raft.queue_time_us":2227434,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":23369,"spinlock_wait_cycles":134126592,"thread_start_us":347258,"threads_started":2,"wal-append.queue_time_us":468735,"wal-append.run_cpu_time_us":22275,"wal-append.run_wall_time_us":1001900}
I20260709 13:01:06.185149  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:05.815043  1560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2210) took 2114 ms (client timeout 1555 ms). Trace:
W20260709 13:01:06.186648  1560 rpcz_store.cc:269] 0709 13:01:03.700795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.700982 (+   187us) service_pool.cc:224] Handling call
0709 13:01:05.814784 (+2113802us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b540030b454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:05.814970 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4667890432}
W20260709 13:01:05.858945  1581 debug-util.cc:398] Leaking SignalData structure 0x7b0800149440 after lost signal to thread 434
W20260709 13:01:06.190856  1581 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4dc0 after lost signal to thread 1492
W20260709 13:01:06.192037  1581 debug-util.cc:398] Leaking SignalData structure 0x7b0800403980 after lost signal to thread 1584
W20260709 13:01:06.192282  1581 debug-util.cc:398] Leaking SignalData structure 0x7b08000c56c0 after lost signal to thread 1585
W20260709 13:01:06.192560  1581 debug-util.cc:398] Leaking SignalData structure 0x7b0800403ac0 after lost signal to thread 1601
W20260709 13:01:05.695694  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.199540  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:05.691766  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50547.2us
W20260709 13:01:06.207190  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e99891af85f4b10aa1cc2da6aa33082 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:01:04.683429  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.006s	sys 0.047s
W20260709 13:01:06.208211  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.175s	user 0.006s	sys 0.047s
W20260709 13:01:05.745818  1628 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.746s	user 0.010s	sys 0.027s
I20260709 13:01:06.211488  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2045) took 2214 ms. Trace:
I20260709 13:01:06.211838  1628 rpcz_store.cc:276] 0709 13:01:03.997137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.998559 (+  1422us) service_pool.cc:224] Handling call
0709 13:01:03.998906 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.999131 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:03.999410 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.211154 (+2211744us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.211207 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:06.211254 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.211317 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.211436 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3784,"prepare.queue_time_us":3044,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":102259,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":2211480,"threads_started":1}
I20260709 13:01:06.213737  6043 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:06.214316  6043 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:05.749490  1631 rpcz_store.cc:276] 0709 13:01:03.995533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.002348 (+  6815us) service_pool.cc:224] Handling call
0709 13:01:04.024519 (+ 22171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.024736 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:04.061901 (+ 37165us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.748710 (+1686809us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:05.748768 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:05.748817 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.748898 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.749030 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8368,"prepare.queue_time_us":34778,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":2031,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"thread_start_us":1686380,"threads_started":1,"wal-append.queue_time_us":644351,"wal-append.run_cpu_time_us":3957,"wal-append.run_wall_time_us":1009348}
I20260709 13:01:05.643285  1627 raft_consensus.cc:606] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:06.218264  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57634 (request call id 22) took 1441 ms. Trace:
I20260709 13:01:06.218632  1627 rpcz_store.cc:276] 0709 13:01:04.777381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.777566 (+   185us) service_pool.cc:224] Handling call
0709 13:01:06.218188 (+1440622us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:05.745954  1674 connection.cc:256] RPC call timeout handler was delayed by -2.5157263369999896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
I20260709 13:01:05.767129  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:06.227015  1708 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:06.226554  1453 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 7 to 8, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:05.766104  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:06.181784  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:05.766453  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:06.232208  1709 raft_consensus.cc:2410] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:05.842600  1706 rpcz_store.cc:269] 0709 13:01:02.330056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.339434 (+  9378us) service_pool.cc:224] Handling call
0709 13:01:04.794774 (+2455340us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b540018a6d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:04.794957 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39580416}
W20260709 13:01:05.952596  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:05.753849  2233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.647s	user 0.014s	sys 0.014s
I20260709 13:01:05.775309  2263 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:05.819226  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 941) took 1720 ms. Trace:
I20260709 13:01:06.243448  2265 rpcz_store.cc:276] 0709 13:01:04.099103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.099248 (+   145us) service_pool.cc:224] Handling call
0709 13:01:04.099642 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.800990 (+1701348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:05.801020 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:05.801445 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.806843 (+  5398us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:05.806891 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.818778 (+ 11887us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b5400710f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:05.818857 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.818904 (+    47us) raft_consensus.cc:1685] finished
0709 13:01:05.818927 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.819161 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":71,"spinlock_wait_cycles":3912164096,"thread_start_us":5009,"threads_started":1,"wal-append.queue_time_us":5565}
I20260709 13:01:06.245540  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:05.766366  2266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.838s	user 0.023s	sys 0.022s
I20260709 13:01:05.804610  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 932) took 2795 ms. Trace:
W20260709 13:01:05.763713  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.768s	user 0.015s	sys 0.032s
I20260709 13:01:06.250768  5986 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:06.251263  5986 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:05.722496  2235 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.569s (SENT)
W20260709 13:01:06.255321  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 532878us
I20260709 13:01:06.255769  1629 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:05.715662  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:05.732323  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:05.579440  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 940) took 1531 ms. Trace:
I20260709 13:01:05.759541  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 927) took 3316 ms. Trace:
I20260709 13:01:06.260810  2271 rpcz_store.cc:276] 0709 13:01:02.442630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.442774 (+   144us) service_pool.cc:224] Handling call
0709 13:01:02.456615 (+ 13841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.067443 (+1610828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.759272 (+1691829us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540045c754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:05.759453 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3696622464}
I20260709 13:01:06.262140  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:05.558171  5232 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:05.686228  5363 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.290088  5232 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.290805  5363 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.293422  5363 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:05.742977  5731 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:05.649437  5769 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:06.296425  2270 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:06.296595  5769 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.299053  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 945) took 1481 ms. Trace:
I20260709 13:01:05.682670  5842 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:06.300549  5842 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:05.761986  5861 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:05.803073  5853 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:06.319094  5853 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:06.319993  5853 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.321126  5853 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.796512  5884 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.324277  5884 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:05.797554  5626 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:05.511395  5889 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:05.764274  5890 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.327368  5890 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:05.800287  5955 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:06.312114  6098 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.531008  5887 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:06.330662  6098 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.331252  5887 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.332851  6098 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:04.654299  6006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.056s	sys 0.074s
W20260709 13:01:04.599674  6010 consensus_meta.cc:287] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.000s
I20260709 13:01:05.754199  6021 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:06.342800  6021 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.345162  6021 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:04.558512  6024 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:05.802037  6026 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.349207  6026 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:01:06.351432  6026 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:04.213016  6028 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:05.685350  6015 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.011348  6016 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.360256  6016 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:04.554893  6017 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.935s	user 0.006s	sys 0.005s
W20260709 13:01:05.570598  5984 raft_consensus.cc:670] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } [suppressed 3 similar messages]
I20260709 13:01:04.633028  6030 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:06.024127  6000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.787s	user 0.007s	sys 0.012s
I20260709 13:01:04.545470  6034 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.367872  6034 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:04.214576  6037 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:04.164321  6038 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:06.395876  6038 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:04.579188  6040 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:04.548148  6053 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:01:05.792827  6075 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.794414  6080 raft_consensus.cc:2764] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:01:05.648681  6051 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:06.418947  6051 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:05.803897  2236 leader_election.cc:336] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.522s (SENT)
I20260709 13:01:06.059643  1704 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:01:06.083199  6005 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:05.564014  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:06.428367  1456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35578 (request call id 324) took 19268 ms (client timeout 15000 ms). Trace:
I20260709 13:01:06.092099  5631 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.092935  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:06.429673  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 336794us
I20260709 13:01:06.094633  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:06.115669  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.426702  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:06.434410  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 346740us
I20260709 13:01:06.124475  5525 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:06.435055  5525 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:06.140178  5771 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:06.435449  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:06.169868  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.436465  5631 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:06.436803  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:06.437429  5631 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.437850  5631 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:06.173197  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2231) took 2037 ms. Trace:
I20260709 13:01:06.438311  5631 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.438577  1552 rpcz_store.cc:276] 0709 13:01:04.136282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.137188 (+   906us) service_pool.cc:224] Handling call
0709 13:01:04.137562 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.755787 (+1618225us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b58004412d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddf2b0aa 00007f06ddfad447 00007f06ddfc5fe7 00007f06ddfc77de 00007f06ddfd1b49 00007f06ddfd2416 00007f06ddfced8f 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4
0709 13:01:06.172935 (+417148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.173144 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234056960}
I20260709 13:01:06.187683  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.440847  1560 raft_consensus.cc:2410] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:06.442005  1560 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:06.203979  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:05.815899  1556 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:01:06.444547  1556 pending_rounds.cc:85] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 6
I20260709 13:01:06.444861  1556 pending_rounds.cc:107] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:01:06.218183  5938 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.445159  1556 raft_consensus.cc:2889] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:06.445391  5938 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.446934  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2232) took 2281 ms. Trace:
I20260709 13:01:06.447916  5938 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.222878  6043 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:06.225041  1674 connection.cc:256] RPC call timeout handler was delayed by -2.4729927940000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 13:01:05.768298  1702 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:01:06.448686  1674 connection.cc:256] RPC call timeout handler was delayed by -2.4023263369999768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
W20260709 13:01:06.438378  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.450835  1674 connection.cc:256] RPC call timeout handler was delayed by -2.3415927940000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 13:01:06.231216  1558 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
W20260709 13:01:06.451251  1674 connection.cc:256] RPC call timeout handler was delayed by -2.3411263369999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 13:01:06.232070  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:05.702482  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 745) took 3258 ms. Trace:
I20260709 13:01:06.453068  1700 rpcz_store.cc:276] 0709 13:01:02.444489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.034256 (+589767us) service_pool.cc:224] Handling call
0709 13:01:03.084678 (+ 50422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.044240 (+959562us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:04.044574 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:01:04.442747 (+398173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:04.442812 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:04.442882 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.702089 (+1259207us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b54001fd954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:05.702163 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.702369 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":568,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":990,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":10527,"spinlock_wait_cycles":2206377344,"thread_start_us":375763,"threads_started":1,"wal-append.queue_time_us":619812,"wal-append.run_cpu_time_us":15656,"wal-append.run_wall_time_us":1070013}
I20260709 13:01:06.229139  1453 catalog_manager.cc:5697] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:06.456027  1453 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 10 to 12, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.236419  5997 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.447309  1556 rpcz_store.cc:276] 0709 13:01:04.165447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.814715 (+649268us) service_pool.cc:224] Handling call
0709 13:01:05.815513 (+1000798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.445669 (+630156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.446730 (+  1061us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540030b450. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:06.446871 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300942208}
I20260709 13:01:06.458339  5997 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.459486  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.460748  5997 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:06.236860  5991 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:06.461066  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.461540  5991 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.464475  5991 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:06.247515  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.247419  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.466382  2265 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:06.466498  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.467237  1556 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.249155  2268 rpcz_store.cc:276] 0709 13:01:03.011331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.011478 (+   147us) service_pool.cc:224] Handling call
0709 13:01:03.063616 (+ 52138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.789318 (+2725702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.804304 (+ 14986us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b5400672ad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:05.804533 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3734417280}
I20260709 13:01:06.253363  5986 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:06.254048  1555 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:06.257266  5856 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:06.258769  5784 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.476125  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.476579  5784 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.477373  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.259536  2269 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:06.258737  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:06.478701  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.259447  1553 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:01:06.479336  1553 pending_rounds.cc:85] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 8
I20260709 13:01:06.263460  2271 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:06.479557  5986 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:06.480311  5986 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:06.198320  1581 debug-util.cc:398] Leaking SignalData structure 0x7b0800404280 after lost signal to thread 1659
I20260709 13:01:06.270502  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:06.481650  5784 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:06.479591  1553 pending_rounds.cc:107] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:01:06.274355  1554 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:06.482635  1553 raft_consensus.cc:2889] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:06.275025  2263 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
W20260709 13:01:06.483325  2263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 943) took 1666 ms (client timeout 2035 ms). Trace:
W20260709 13:01:06.483706  2263 rpcz_store.cc:269] 0709 13:01:04.817023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.818598 (+  1575us) service_pool.cc:224] Handling call
0709 13:01:06.483250 (+1664652us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:06.479331  2235 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.607s (SENT)
I20260709 13:01:06.277112  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:06.275914  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 58153.5us
I20260709 13:01:06.260186  2264 rpcz_store.cc:276] 0709 13:01:04.055638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.061478 (+  5840us) service_pool.cc:224] Handling call
0709 13:01:04.101002 (+ 39524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.668689 (+567687us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:04.668729 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.669293 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.701986 (+ 32693us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:04.702071 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.578949 (+876878us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400465ad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:05.579007 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.579064 (+    57us) raft_consensus.cc:1685] finished
0709 13:01:05.579081 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.579364 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62850,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":685932288,"thread_start_us":164297,"threads_started":2,"wal-append.queue_time_us":36854,"wal-append.run_cpu_time_us":1754,"wal-append.run_wall_time_us":1010092}
I20260709 13:01:06.282362  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:06.157581  6004 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.289181  6092 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.295825  5731 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.488190  5731 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.488116  6092 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.489107  1705 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:06.299589  2270 rpcz_store.cc:276] 0709 13:01:04.817693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.817867 (+   174us) service_pool.cc:224] Handling call
0709 13:01:06.298824 (+1480957us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400521a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:06.298993 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199850752}
I20260709 13:01:06.294476  5232 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.308527  5842 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:06.303171  5769 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:06.313740  6100 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:06.317724  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:05.756619  5877 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:06.329527  5890 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:05.703846  5928 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.340502  6006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.237s	user 0.056s	sys 0.076s
I20260709 13:01:06.341662  5887 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:06.341902  6010 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.357406  6015 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.376986  6034 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:06.389851  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 75900.5us
I20260709 13:01:06.393512  6016 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.402899  6075 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.413995  6038 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.014008  6087 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.421368  6051 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.423324  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:06.545985  6087 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:06.426731  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 622875us
I20260709 13:01:06.548491  6087 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.550980  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 944) took 1733 ms. Trace:
I20260709 13:01:06.090338  5707 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11.
I20260709 13:01:06.435655  1524 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:06.438233  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:06.442615  1635 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.556541  1634 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:06.435705  5771 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.435530  5525 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.177738  1557 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:06.451754  1674 connection.cc:256] RPC call timeout handler was delayed by -2.2704927940000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 13:01:06.428889  1456 rpcz_store.cc:269] 0709 13:00:47.159703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.167623 (+  7920us) service_pool.cc:224] Handling call
0709 13:01:06.428087 (+19260464us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:58.478954 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:58.518190 (+ 39236us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:58.518253 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:00:58.518276 (+    23us) tablet.cc:662] Decoding operations
0709 13:00:58.612913 (+ 94637us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:58.613028 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:58.613058 (+    30us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:00:58.655563 (+ 42505us) tablet.cc:701] Row locks acquired
0709 13:00:58.699344 (+ 43781us) write_op.cc:260] PREPARE: finished
0709 13:00:58.746967 (+ 47623us) write_op.cc:270] Start()
0709 13:00:58.789416 (+ 42449us) write_op.cc:276] Timestamp: P: 1783602058722070 usec, L: 0
0709 13:00:58.789454 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:00:58.878599 (+ 89145us) log.cc:844] Serialized 5673 byte log entry
0709 13:00:59.352632 (+474033us) op_driver.cc:464] REPLICATION: finished
0709 13:00:59.539095 (+186463us) write_op.cc:301] APPLY: starting
0709 13:00:59.553035 (+ 13940us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:59.587225 (+ 34190us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:59.587367 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:00.035659 (+448292us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:00.038388 (+  2729us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=28
0709 13:01:00.038441 (+    53us) write_op.cc:312] APPLY: finished
0709 13:01:00.039007 (+   566us) log.cc:844] Serialized 188 byte log entry
0709 13:01:00.039257 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:00.039511 (+   254us) write_op.cc:454] Released schema lock
0709 13:01:00.039605 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:00.040124 (+   519us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:00.040168 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":163779,"reported_tablets":48,"spinlock_wait_cycles":22272,"child_traces":[["op",{"apply.queue_time_us":186205,"apply.run_cpu_time_us":25730,"apply.run_wall_time_us":500950,"cfile_cache_hit":26,"cfile_cache_hit_bytes":27157,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":2,"lbm_read_time_us":64434,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":4,"lbm_reads_lt_1ms":7,"num_ops":14,"prepare.queue_time_us":150325,"prepare.run_cpu_time_us":43300,"prepare.run_wall_time_us":612054,"raft.queue_time_us":157484,"raft.run_cpu_time_us":16273,"raft.run_wall_time_us":120267,"replication_time_us":560616,"thread_start_us":346210,"threads_started":4,"wal-append.queue_time_us":254609,"wal-append.run_cpu_time_us":10330,"wal-append.run_wall_time_us":2251437}]]}
I20260709 13:01:06.248657  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 938) took 2522 ms. Trace:
W20260709 13:01:06.562933  1674 connection.cc:256] RPC call timeout handler was delayed by -2.2668927940000572s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 13:01:06.457870  1453 catalog_manager.cc:5697] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 3 to 8, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193), VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194), VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195), VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:01:06.451115  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.564296  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.478615  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 219941us
I20260709 13:01:06.260172  5827 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:06.482228  1581 debug-util.cc:398] Leaking SignalData structure 0x7b080031a640 after lost signal to thread 1733
W20260709 13:01:06.482800  1554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2237) took 1735 ms (client timeout 2035 ms). Trace:
I20260709 13:01:06.573776  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:06.277019  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:06.486302  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2234) took 1739 ms. Trace:
I20260709 13:01:06.481477  5986 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:06.487386  5832 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:01:06.487309  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.491691  6092 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.477798  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:06.584142  1627 raft_consensus.cc:606] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
W20260709 13:01:06.496851  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 79879us
I20260709 13:01:06.502714  6004 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.503226  5877 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.533977  6016 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:06.589931  2235 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.892s (SENT)
W20260709 13:01:06.625941  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.626158  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:06.535116  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.426813  1704 pending_rounds.cc:85] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 9
I20260709 13:01:06.627370  1704 pending_rounds.cc:107] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 8.10
W20260709 13:01:06.428514  1551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2235) took 1681 ms (client timeout 2084 ms). Trace:
I20260709 13:01:06.505138  5928 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.553210  2262 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:06.561167  1560 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:06.553699  2267 rpcz_store.cc:276] 0709 13:01:04.817372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.817579 (+   207us) service_pool.cc:224] Handling call
0709 13:01:04.817910 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.369415 (+1551505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.369459 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.370128 (+   669us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.416481 (+ 46353us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:06.544308 (+127827us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.549939 (+  5631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.550598 (+   659us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54000dcd54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:06.550647 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.550698 (+    51us) raft_consensus.cc:1685] finished
0709 13:01:06.550779 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.550920 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":128398,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":839,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":3567271168,"thread_start_us":173374,"threads_started":2,"wal-append.queue_time_us":68414}
W20260709 13:01:06.574011  1554 rpcz_store.cc:269] 0709 13:01:04.747760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.159410 (+1411650us) service_pool.cc:224] Handling call
0709 13:01:06.482749 (+323339us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:06.631206  1551 rpcz_store.cc:269] 0709 13:01:04.747188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.563701 (+816513us) service_pool.cc:224] Handling call
0709 13:01:06.428441 (+864740us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.627640  1704 raft_consensus.cc:2889] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:06.633069  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80034.5us
W20260709 13:01:06.485996  1600 connection.cc:256] RPC call timeout handler was delayed by -1.5083756540000195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 13:01:06.575043  1674 connection.cc:256] RPC call timeout handler was delayed by -2.22099279400004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 13:01:06.573846  1581 debug-util.cc:398] Leaking SignalData structure 0x7b080005c0e0 after lost signal to thread 2295
I20260709 13:01:06.574873  1553 rpcz_store.cc:276] 0709 13:01:04.746873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.816729 (+ 69856us) service_pool.cc:224] Handling call
0709 13:01:04.817035 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.485905 (+1668870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.486208 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.563207  2266 rpcz_store.cc:276] 0709 13:01:03.726517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.726632 (+   115us) service_pool.cc:224] Handling call
0709 13:01:03.771782 (+ 45150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.781391 (+  9609us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:03.927498 (+146107us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.248298 (+2320800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.248375 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:06.248418 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.248492 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.248607 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":89105,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":229,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":682,"spinlock_wait_cycles":41728,"thread_start_us":2410178,"threads_started":2,"wal-append.queue_time_us":734478,"wal-append.run_cpu_time_us":11344,"wal-append.run_wall_time_us":1001395}
W20260709 13:01:06.634275  1600 connection.cc:256] RPC call timeout handler was delayed by -1.5040980310000123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.47340000000000004s for a response
W20260709 13:01:06.634436  1581 debug-util.cc:398] Leaking SignalData structure 0x7b08002cbf40 after lost signal to thread 2296
W20260709 13:01:06.579674  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 144109us
I20260709 13:01:06.582053  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:06.589010  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.563763  5771 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.569916  5707 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:06.531554  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:06.646576  1628 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.624763  1453 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 10 to 12, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:01:06.634451  1674 connection.cc:256] RPC call timeout handler was delayed by -2.1084927940000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 13:01:06.649279  1674 connection.cc:256] RPC call timeout handler was delayed by -2.1030927940000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 13:01:06.637334  5731 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.622622  5877 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.639160  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.618654  1635 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:06.580869  5890 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.645453  1556 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:06.666436  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.667374  1554 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:06.669495  1600 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:06.665630  5232 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:06.671519  5731 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.671114  5232 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.664458  5707 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:06.672971  5707 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.657835  5713 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.674504  5713 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.643846  6004 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.654506  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:06.655310  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 73398.8us
I20260709 13:01:06.656759  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.685921  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.686656  1555 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:06.588102  6096 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:06.591540  6051 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:01:06.659798  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.659662  1453 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:06.598018  1601 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:06.575625  5631 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.675881  2268 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:06.676777  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:06.690584  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 100694us
W20260709 13:01:06.691349  2235 leader_election.cc:336] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 2.147s (SENT)
I20260709 13:01:06.677824  1559 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:06.691525  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.663465  1557 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:06.692320  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:06.683389  1674 connection.cc:256] RPC call timeout handler was delayed by -1.8960927940000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
I20260709 13:01:06.692231  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2236) took 1944 ms. Trace:
I20260709 13:01:06.686687  1556 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:06.693425  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.680953  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.693667  1557 rpcz_store.cc:276] 0709 13:01:04.747469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.177056 (+1429587us) service_pool.cc:224] Handling call
0709 13:01:06.692172 (+515116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.689350  1453 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 7 to 8, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.690847  1554 raft_consensus.cc:2376] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14. Re-sending same reply.
I20260709 13:01:06.676604  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:06.662405  6099 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:06.679708  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.710625  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.712993  2263 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:06.717020  5631 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.717752  6024 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:06.664273  5938 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:01:06.678498  5890 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.714352  6099 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.724529  6099 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.687775  6096 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.726423  6096 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.727932  6016 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.710356  6000 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:06.729166  6075 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:06.686563  6101 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:06.729031  6000 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.730258  6092 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:06.714951  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.732255  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.669318  5856 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:06.731298  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 45018.2us
W20260709 13:01:06.735049  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.736515  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:06.738233  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:06.686218  5904 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.745317  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.745117  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:06.747061  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:06.747882  1524 connection.cc:256] RPC call timeout handler was delayed by -5.7268660400000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 13:01:06.748485  1524 connection.cc:256] RPC call timeout handler was delayed by -5.7133660400000394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 13:01:06.718200  6024 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:06.750825  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:06.691704  6005 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:06.687856  5232 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:06.761400  1674 connection.cc:256] RPC call timeout handler was delayed by -1.6662893069999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
W20260709 13:01:06.764333  1674 connection.cc:256] RPC call timeout handler was delayed by -1.6630481300000497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 13:01:06.764721  1674 connection.cc:256] RPC call timeout handler was delayed by -1.3791234770000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 13:01:06.765072  1674 connection.cc:256] RPC call timeout handler was delayed by -1.2818301430000361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 13:01:06.765427  1674 connection.cc:256] RPC call timeout handler was delayed by -1.0500927940000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30910000000000004s for a response
I20260709 13:01:06.688071  6004 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.766964  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:06.761694  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:06.768781  1524 connection.cc:256] RPC call timeout handler was delayed by -5.4910660400000211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 13:01:06.768921  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 92395.3us
W20260709 13:01:06.769304  1524 connection.cc:256] RPC call timeout handler was delayed by -5.4469660400000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:01:06.770439  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.775857  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.776582  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:06.731881  5999 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.776625  1556 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:06.731382  5804 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:06.792652  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:06.786711  1524 connection.cc:256] RPC call timeout handler was delayed by -5.3650660399999879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
W20260709 13:01:06.793648  1524 connection.cc:256] RPC call timeout handler was delayed by -5.3200660400000288s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
I20260709 13:01:06.777473  1453 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 6 to 9, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.798445  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.718273  5769 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:01:06.798847  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:06.760746  6075 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:06.801854  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.813725  1551 raft_consensus.cc:2376] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10. Re-sending same reply.
I20260709 13:01:06.798445  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:06.762429  6100 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:06.805322  1630 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:06.803866  5877 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:06.804122  5232 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.816517  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.810262  5525 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.811131  6021 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:06.755295  5784 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:01:06.805034  1524 connection.cc:256] RPC call timeout handler was delayed by -4.9132660399999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25510000000000005s for a response
W20260709 13:01:06.834817  1524 connection.cc:256] RPC call timeout handler was delayed by -4.9060660400000415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2559s for a response
W20260709 13:01:06.835265  1524 connection.cc:256] RPC call timeout handler was delayed by -4.4164660399999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3103s for a response
W20260709 13:01:06.835641  1524 connection.cc:256] RPC call timeout handler was delayed by -4.35438523199997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 13:01:06.836002  1524 connection.cc:256] RPC call timeout handler was delayed by -4.34988523200002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260709 13:01:06.836360  1524 connection.cc:256] RPC call timeout handler was delayed by -4.2850852319999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
W20260709 13:01:06.836752  1524 connection.cc:256] RPC call timeout handler was delayed by -4.1077852319999693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
W20260709 13:01:06.837123  1524 connection.cc:256] RPC call timeout handler was delayed by -3.2320852319999744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32160000000000005s for a response
I20260709 13:01:06.837281  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.775847  5832 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:06.745260  5955 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:01:06.731091  5626 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:01:06.831238  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.817133  5991 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:06.837574  1524 connection.cc:256] RPC call timeout handler was delayed by -2.8450660400000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.48490000000000005s for a response
W20260709 13:01:06.860769  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 51083us
I20260709 13:01:06.747961  5938 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:01:06.791790  6001 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.791765  5631 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:06.840233  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.840317  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:06.841797  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 100075us
I20260709 13:01:06.769150  5363 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:01:06.805701  6004 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:01:06.791352  5890 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:06.755842  5856 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.804045  5713 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.812196  5731 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.816423  5877 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:06.832374  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 234440us
I20260709 13:01:06.811617  5792 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:06.816655  6100 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.858376  1551 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:06.823750  1453 catalog_manager.cc:5697] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 6 to 9, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.858534  1552 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:06.776925  6101 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
W20260709 13:01:06.860867  1524 connection.cc:256] RPC call timeout handler was delayed by -1.8914062210000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:01:06.838828  1556 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
W20260709 13:01:06.861820  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 120530us
I20260709 13:01:06.863415  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:06.862093  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 48606.7us
W20260709 13:01:06.866372  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.856101  5832 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.867889  5762 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:06.870765  5525 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:06.874863  5928 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:06.900733  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 943) took 1183 ms. Trace:
I20260709 13:01:06.805488  5804 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.901144  2268 rpcz_store.cc:276] 0709 13:01:05.717379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.475310 (+757931us) service_pool.cc:224] Handling call
0709 13:01:06.475647 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.690470 (+214823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.900471 (+210001us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540054ea54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:06.900669 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434898688}
I20260709 13:01:06.876269  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.903021  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.846979  5232 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.831586  6075 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.860661  5991 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:06.770807  5904 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.973896  5991 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:06.974061  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 85511.2us
I20260709 13:01:06.974588  5856 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:06.975353  5904 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:06.883018  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.975631  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:06.977293  1600 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:06.881875  5771 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.830507  6024 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:06.987879  6024 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:06.991003  5804 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.899451  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.894518  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.992408  1554 raft_consensus.cc:2410] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:06.993157  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:06.993505  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:06.993984  1551 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:01:06.893890  5731 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:06.903383  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 147816us
I20260709 13:01:06.794412  5999 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.996742  5999 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:06.908578  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45261.2us
W20260709 13:01:06.909567  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 158843us
I20260709 13:01:06.899565  5792 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.001035  5792 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.900089  5832 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.908612  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.890089  5877 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:07.007543  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:07.008772  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:06.971683  6126 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.883301  6001 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.012816  6001 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.919049  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:06.973315  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 82416.6us
I20260709 13:01:06.977415  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:07.018501  2268 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.018627  1601 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:06.977905  6101 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:06.885109  5631 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:06.972800  5232 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.978979  6000 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:06.973908  6043 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:01:07.021276  5232 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:06.979997  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 69506.6us
I20260709 13:01:06.979281  6040 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:06.893837  5938 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:01:06.991120  6124 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.024204  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:07.025554  1524 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:06.890128  6100 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.998193  2235 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:07.027223  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:07.028062  5363 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:06.909871  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:07.030299  5832 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:06.998488  1674 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:07.031720  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:06.996845  5731 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:07.033072  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08001ab120 after lost signal to thread 434
W20260709 13:01:07.034529  1730 debug-util.cc:398] Leaking SignalData structure 0x7b0800194f40 after lost signal to thread 1492
I20260709 13:01:07.034724  6126 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:07.046314  6126 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.046814  6126 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:07.047281  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08002c9ac0 after lost signal to thread 1584
W20260709 13:01:07.047658  1730 debug-util.cc:398] Leaking SignalData structure 0x7b080016cd00 after lost signal to thread 1585
W20260709 13:01:07.048004  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3b00 after lost signal to thread 1601
W20260709 13:01:07.049113  1730 debug-util.cc:398] Leaking SignalData structure 0x7b0800260620 after lost signal to thread 1659
I20260709 13:01:07.035466  5827 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:07.054284  5827 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:07.054898  5827 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.021965  5232 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:07.058331  5731 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:07.058772  6075 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:07.058063  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:07.058921  5232 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.060266  6075 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.040336  5955 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:07.062064  6075 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:07.062139  5955 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.063242  5731 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:07.063618  5731 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:07.064499  5731 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 9.12, Last appended by leader: 12, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:07.017820  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 98893.5us
I20260709 13:01:07.033820  1674 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:07.045308   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000fee0 after lost signal to thread 2236
I20260709 13:01:07.034518  6000 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:07.073143  2264 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:07.073285  5999 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.073659  1524 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:07.074225  5999 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:07.074509  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:07.076238  2264 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:07.079505  2235 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:07.089071  5832 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:07.089841  5928 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:07.090322  5928 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:07.090780  5928 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.092809  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:07.097064  1555 raft_consensus.cc:2410] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:07.100070  6126 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:07.084208  6099 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.090083  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:07.073446  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:07.177148  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 103790us
I20260709 13:01:07.065861  5955 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:07.110544  1730 debug-util.cc:398] Leaking SignalData structure 0x7b0800231e20 after lost signal to thread 1733
I20260709 13:01:07.179286  1674 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:07.179751  1730 debug-util.cc:398] Leaking SignalData structure 0x7b080021aa40 after lost signal to thread 2295
W20260709 13:01:07.180223  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08003c7d40 after lost signal to thread 2296
I20260709 13:01:07.181012  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:07.181362  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed540 after lost signal to thread 6006
W20260709 13:01:07.181780  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08003f4b40 after lost signal to thread 6010
I20260709 13:01:07.104669  6021 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:07.121040  2268 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:07.186302  2264 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:07.105158  5827 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.061883  1628 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:07.165786  1453 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:01:07.174844  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 156304us
I20260709 13:01:07.193459  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:07.176506  6095 raft_consensus.cc:993] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 13:01:07.116101  6100 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:07.183437  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 93484.1us
I20260709 13:01:07.183282  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:06.884851  6096 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:07.131325  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 137192us
I20260709 13:01:07.210850  1600 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:07.182337  1730 debug-util.cc:398] Leaking SignalData structure 0x7b080033c440 after lost signal to thread 6016
I20260709 13:01:07.181725  5792 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:07.215497  1700 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:07.215939  5232 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:07.216789  5792 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:07.185411  5784 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.219668  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:07.220775  5856 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.224622  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:07.225471  2263 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:01:07.182821  6040 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:07.227629  5731 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.227990  6040 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:07.182361  5832 raft_consensus.cc:2764] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:07.214792  5890 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:07.231995  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:07.232806  1700 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.197363  6101 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:07.189317  6001 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:01:07.238338  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.241279  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.243330  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.244482  1706 raft_consensus.cc:2410] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:07.248826  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.249594  1706 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:01:07.251410  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.252811  1702 raft_consensus.cc:2410] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:07.196544  6127 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.208851  5889 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:01:07.263391  5928 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.263885  1453 catalog_manager.cc:5697] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:07.267439  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:07.290752  1702 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:01:07.212116  1730 debug-util.cc:398] Leaking SignalData structure 0x7b080036e640 after lost signal to thread 6017
I20260709 13:01:07.268883  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.269281  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.270613  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:07.297612  1707 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:07.297871  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08003f76e0 after lost signal to thread 6024
W20260709 13:01:07.272405  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.274444  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.275499  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:07.288831  2235 leader_election.cc:336] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 2.594s (SENT)
I20260709 13:01:07.299125  2263 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:07.300035  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:07.300755  2263 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:07.225687  5792 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:07.289124  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:07.303043  1701 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:07.298287  1730 debug-util.cc:398] Leaking SignalData structure 0x7b0800293e80 after lost signal to thread 6028
W20260709 13:01:07.303942  1730 debug-util.cc:398] Leaking SignalData structure 0x7b080029b1e0 after lost signal to thread 6030
W20260709 13:01:07.304289  1730 debug-util.cc:398] Leaking SignalData structure 0x7b0800220da0 after lost signal to thread 6034
W20260709 13:01:07.304558  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08003f6fe0 after lost signal to thread 6037
W20260709 13:01:07.304806  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08002552e0 after lost signal to thread 6038
W20260709 13:01:07.306358  1730 debug-util.cc:398] Leaking SignalData structure 0x7b080031b0e0 after lost signal to thread 6040
W20260709 13:01:07.306700  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9780 after lost signal to thread 6053
I20260709 13:01:07.307693  1453 catalog_manager.cc:5697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:07.310012  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:07.311106  2263 raft_consensus.cc:2410] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:07.312623  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.313304  1703 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:01:07.197698  5999 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:07.297434  1708 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:07.314201  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.105785  5877 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:07.318209  1709 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:01:07.319437  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:07.321064  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.318284  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:07.327204  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.329562  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:07.331933  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:07.307251  5792 consensus_queue.cc:1243] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:07.302790  5771 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:07.339036  1708 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:07.339308  2268 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:07.340528  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.335567  1701 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:07.342429  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.343389  1701 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:01:07.343842  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:07.345268  1709 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:01:07.345703  1709 pending_rounds.cc:85] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 8
I20260709 13:01:07.348667  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.347265  1453 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 7 to 9, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:07.345988  1709 pending_rounds.cc:107] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:01:07.352095  1709 raft_consensus.cc:2889] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:07.320622  5999 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:07.358851  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.359512  1708 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
W20260709 13:01:07.354355  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.356585  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.336587  5232 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.368639  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.368332  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.369207  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.368393  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:07.371619  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.377372  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2239) took 1570 ms. Trace:
I20260709 13:01:07.377955  1559 rpcz_store.cc:276] 0709 13:01:05.796508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.185938 (+389430us) service_pool.cc:224] Handling call
0709 13:01:07.366393 (+1180455us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400169c54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:07.366580 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456644992}
I20260709 13:01:07.348901  6043 raft_consensus.cc:1081] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Signalling peer 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 13:01:07.380118  1635 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:07.348300  6127 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.372403  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.381354  1700 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:07.385568  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.367126  5999 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.358134  6001 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:07.389879  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:07.390767  1631 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:07.364511  5928 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:07.392581  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.398934  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.400241  1559 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
W20260709 13:01:07.403383  6122 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.442s	user 0.005s	sys 0.012s
I20260709 13:01:07.404255  5877 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:07.409708  5631 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:07.412882  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:07.438757  1628 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:07.439193  1702 raft_consensus.cc:2410] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:01:07.439968  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.399202  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.386317  6098 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:07.419734  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:07.424041  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.423867  1706 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:07.426088  5827 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:07.400738  5363 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:07.427532  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:07.451119  1559 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.452188  6124 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:01:07.429035  6096 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:07.432142  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.454174  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:07.434603  1634 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:07.434784  6100 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:07.435019  2264 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:07.456550  6000 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:07.457151  6000 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.457624  6000 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:07.435221  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:07.459476  1630 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:07.435458  6126 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:07.421808  5887 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:01:07.461607  5887 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:07.462141  5887 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:07.396816  6001 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:07.464001  6001 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.444451  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.475374  6099 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:07.478648  5991 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.004s
I20260709 13:01:07.479305  5991 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.485877  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:07.486624  1551 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.489421  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.448132  1707 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:07.463359  5887 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.455299  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:07.503610  1630 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:07.525907  1559 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:01:07.527588  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:07.527978  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 72786.2us
I20260709 13:01:07.528203  2269 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.528712  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:07.532481  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.533242  1630 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:01:07.535758  2235 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:07.540668  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 49203.3us
I20260709 13:01:07.552520  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:07.552870  1705 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.553193  1559 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.554376  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.557222  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:07.558997  2264 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.559725  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.524986  6021 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:07.580219  2268 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:07.582126  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:07.635893  1559 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:07.645757  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.630043  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.555938  5877 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:07.647184  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:07.635346  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.540405  5232 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.592523  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.652650  1634 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:07.623103  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.647639  1551 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
W20260709 13:01:07.585391  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 197810us
I20260709 13:01:07.654481  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:07.540300  5363 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:07.628476  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 417725us
I20260709 13:01:07.652067  2268 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.656045  1551 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:07.654630  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:07.576785  5887 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.660189  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:07.576023  5792 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.653110  1631 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 7.
I20260709 13:01:07.661314  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:07.582072  5771 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.663946  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:07.683337  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.684444  1634 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 12: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:07.557981  5631 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.666693  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:07.690951  1551 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 7.
I20260709 13:01:07.691597  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 685) took 1221 ms. Trace:
I20260709 13:01:07.691916  1551 rpcz_store.cc:276] 0709 13:01:06.470357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.666223 (+1195866us) service_pool.cc:224] Handling call
0709 13:01:07.691532 (+ 25309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.627308  6096 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:01:07.667501  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:07.636464  5856 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:07.585777  5991 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:07.675364  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:07.683693  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:07.664217  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:07.692368  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:07.621765  6095 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:01:07.666796  1601 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:07.694849  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.696724  2235 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:07.698617  1633 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:07.658656  6034 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:07.581681  6040 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:01:07.662706  5877 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:07.722936  1703 raft_consensus.cc:2410] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 11 because replica has last-logged OpId of term: 9 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 11.
I20260709 13:01:07.685154  5363 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:07.725433  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.716217  1628 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:07.702682  1635 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:07.710603  2268 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:07.714289  1559 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:07.732703  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2084) took 1165 ms. Trace:
I20260709 13:01:07.733146  1559 rpcz_store.cc:276] 0709 13:01:06.567045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.649054 (+1082009us) service_pool.cc:224] Handling call
0709 13:01:07.732649 (+ 83595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.712800  1709 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:07.702214  1629 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:07.715292  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:07.693361  1551 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:07.731752  2263 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:07.703034  5631 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.699435  5986 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:07.745586  1559 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:07.747695  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2083) took 1181 ms. Trace:
I20260709 13:01:07.713011  6098 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:01:07.680042  5792 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.738807  6034 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:07.793112  6034 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.748121  5827 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:07.796435  5827 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:07.796886  5827 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.700618  5771 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:07.738891  5877 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.717804  6127 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:07.741437  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:07.806594  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 106390us
W20260709 13:01:07.807211  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 65849.9us
I20260709 13:01:07.807996  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:07.741081  5363 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.701836  6145 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:07.742656  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 75948us
I20260709 13:01:07.814100  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:07.743206  6028 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.735508  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 689) took 1264 ms. Trace:
W20260709 13:01:07.738799  6137 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:01:07.746433  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 54148.8us
I20260709 13:01:07.736155  1634 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:07.748258  1559 rpcz_store.cc:276] 0709 13:01:06.566721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.733969 (+1167248us) service_pool.cc:224] Handling call
0709 13:01:07.745280 (+ 11311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.747148 (+  1868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.747630 (+   482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.819447  1559 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:07.820624  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:07.751482  2264 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:07.765054  2269 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:07.701471  6142 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:07.781271  1705 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:07.830117  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:07.760691  5986 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:07.790643  6001 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:07.805042  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.840525  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.811617  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:07.815603  1551 rpcz_store.cc:276] 0709 13:01:06.471526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.692713 (+1221187us) service_pool.cc:224] Handling call
0709 13:01:07.693102 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.735144 (+ 42042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.735426 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.822683  1599 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:07.782570  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:07.830982  1554 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.788584  6092 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:07.803203  5999 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.810845  6127 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.833102  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:07.834407  6117 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:07.818136  6145 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:07.816239  6100 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:07.854826  1705 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.816432  5804 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:07.829869  6098 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:07.816140  5955 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:01:07.856820  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:07.857398  1706 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:07.830017  6142 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:07.845204  5731 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.847116  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:07.883978  1551 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:07.817022  5991 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:01:07.855626  6155 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:07.879436  1702 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:07.835052  6144 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:01:07.911778  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.875151  6100 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:07.854182  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e99891af85f4b10aa1cc2da6aa33082 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:07.857065  5771 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:07.886461  5986 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.888377  5631 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:07.889837  5792 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:07.872620  6131 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:01:07.891825  6010 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:07.860132  6145 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:07.884294  1705 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:07.894218  5731 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.902367  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:07.856753  6127 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:07.876688  6132 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:01:07.854212  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:07.916059  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 91937.8us
I20260709 13:01:07.881191  6142 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.890532  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:07.942836  1551 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:07.893877  5827 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:07.944440  1554 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:07.870527  6040 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:07.938469  1443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 84363.9us
W20260709 13:01:07.950157  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 96512.9us
I20260709 13:01:07.950212  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:07.947324  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 143852us
I20260709 13:01:07.951458  1559 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:07.956383  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:07.957108  1551 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:07.957206  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:07.955266  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:07.911970  6000 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:07.958588  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 113153us
I20260709 13:01:07.978279  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:07.977334  1673 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:07.979394  1559 raft_consensus.cc:2368] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13.
I20260709 13:01:07.953203  5792 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.995643  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:08.004173  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:07.974973  6155 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.006420  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:07.986609  6132 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.997555  5997 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:07.987006  5877 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:08.011399  6152 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:01:08.019181  5827 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:08.019893  5999 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:07.999289  6158 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:01:08.023335  1632 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:01:08.028805  6149 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:08.006100  5928 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
W20260709 13:01:08.032637  6118 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 1.173s	user 0.008s	sys 0.010s
I20260709 13:01:08.020449  6132 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:08.037289  6132 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:08.039521  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.041203  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 683) took 1571 ms. Trace:
I20260709 13:01:08.016136  5877 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.041631  1555 rpcz_store.cc:276] 0709 13:01:06.469779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.836912 (+367133us) service_pool.cc:224] Handling call
0709 13:01:08.039001 (+1202089us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54002dafd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:08.041138 (+  2137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576632064}
I20260709 13:01:08.042929  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:08.043880  1555 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:08.013824  6001 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:08.043207  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.045418  1701 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:08.043437  6132 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:01:08.046309  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:07.983678  6100 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:08.051067  1555 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:01:08.053382  5731 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:08.056228  6000 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:01:08.017284  5997 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:08.058719  6144 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:08.059123  6144 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:08.059252  5997 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:08.059978  6144 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:08.061266  6144 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.062260  6001 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:08.061357  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.067045  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 116947us
I20260709 13:01:08.067426  6147 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:08.072147  2268 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:08.072489  2264 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:08.073294  1709 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:01:08.060503  5955 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:08.052199  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.096663  1555 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:08.097992  1555 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:01:08.098385  1555 pending_rounds.cc:85] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 8
I20260709 13:01:08.098629  1555 pending_rounds.cc:107] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:01:08.098881  1555 raft_consensus.cc:2889] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:08.102617  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:08.107932  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:08.070130  6040 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:08.120641  2235 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:08.043874  5877 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:08.120771  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 703) took 1083 ms. Trace:
I20260709 13:01:08.129544  1555 rpcz_store.cc:276] 0709 13:01:07.037546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.097359 (+1059813us) service_pool.cc:224] Handling call
0709 13:01:08.097656 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.120420 (+ 22764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.120701 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.122624  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:08.119415  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 673) took 1665 ms. Trace:
I20260709 13:01:08.131759  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:08.132591  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:08.134604  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:08.135625  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:08.135813  6147 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:08.131707  5631 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.136520  5631 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:08.137157  5997 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:08.136793  6147 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:08.138731  5631 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:08.132526  1558 rpcz_store.cc:276] 0709 13:01:06.456307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.457362 (+  1055us) service_pool.cc:224] Handling call
0709 13:01:06.457742 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.556600 (+ 98858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.556632 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.562146 (+  5514us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.683301 (+121155us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:06.683353 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.841623 (+158270us) spinlock_profiling.cc:243] Waited 98.6 ms on lock 0x7b5400309dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:06.841698 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.032048 (+1190350us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:08.119158 (+ 87110us) raft_consensus.cc:1685] finished
0709 13:01:08.119196 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.119345 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268612864,"thread_start_us":103685,"threads_started":1,"wal-append.queue_time_us":201556}
I20260709 13:01:08.140365  1555 raft_consensus.cc:2368] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8.
I20260709 13:01:08.094187  5955 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:08.145386  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:08.146498  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.153349  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:08.157191  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:08.158838  1555 raft_consensus.cc:2410] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:08.163177  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.164037  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:08.164541  1555 raft_consensus.cc:2368] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8.
I20260709 13:01:08.167620  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:08.169422  1558 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:08.170925  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.145100  5997 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:08.186455  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.172331  1558 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
W20260709 13:01:08.222469  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.221807  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.226454  1558 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:08.151170  6030 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.309289  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.310065  1558 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:08.311213  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:08.311625  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:08.311889  1558 raft_consensus.cc:2376] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13. Re-sending same reply.
I20260709 13:01:08.313127  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.314014  1558 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:08.324177  5955 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:08.325035  5997 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:08.326404  1707 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:08.327420  6127 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:08.325505  5955 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.332276  1555 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:08.357172  1555 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:08.359028  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 704) took 1236 ms. Trace:
I20260709 13:01:08.359501  1558 rpcz_store.cc:276] 0709 13:01:07.079496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.314933 (+1235437us) service_pool.cc:224] Handling call
0709 13:01:08.315278 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.315484 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.315520 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.315575 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:08.315617 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.315699 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.315827 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.149737  5827 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 13:01:08.171255  5986 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:08.366125  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:08.377522  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.358168  1555 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:08.384047  1555 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:08.439864  1558 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:01:08.329993  5792 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.356077  6132 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.175462  5363 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.260s
W20260709 13:01:08.436355  1600 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 2.186s (SENT)
W20260709 13:01:08.444088  6152 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:01:08.363330  5928 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:08.174290  6165 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.281s
I20260709 13:01:08.365249  5986 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:08.452420  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.478365  5928 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:08.529495  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.482828  6170 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.317s	user 0.000s	sys 0.000s
I20260709 13:01:08.448267  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:08.554800  1551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.009s	sys 0.001s
W20260709 13:01:08.555465  1551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.009s	sys 0.002s
I20260709 13:01:08.558781  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57634 (request call id 23) took 2279 ms. Trace:
I20260709 13:01:08.560726  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2241) took 2763 ms. Trace:
I20260709 13:01:08.561241  1560 rpcz_store.cc:276] 0709 13:01:05.797091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.450061 (+652970us) service_pool.cc:224] Handling call
0709 13:01:06.450387 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.631220 (+180833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.560471 (+1929251us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400312ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:08.560663 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240861056}
I20260709 13:01:08.559350  1627 rpcz_store.cc:276] 0709 13:01:06.279083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.477625 (+198542us) service_pool.cc:224] Handling call
0709 13:01:08.558377 (+2080752us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b540029dc20. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddf4c520 00007f06ddfc9652 00007f06e2f9760a 00007f06dc51d7d4 00007f06dc51d762 00007f06dc51d691 00007f06dc51d60c 00007f06dc51c8c2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:08.558706 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114525056}
I20260709 13:01:08.587934  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.309628  6040 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:08.592022  1553 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.026s	sys 0.038s
W20260709 13:01:08.593361  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 1.50068e+06us
I20260709 13:01:08.596194  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.599188  1560 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:08.600178  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.531165  5928 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:08.533354  5986 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.600932  1560 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:01:08.596503  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 203645us
W20260709 13:01:08.602516  1553 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.026s	sys 0.038s
I20260709 13:01:08.614322  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
W20260709 13:01:08.614684  6179 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:01:08.615147  1627 raft_consensus.cc:606] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:08.616153  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.617478  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:08.618830  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2303) took 6629 ms. Trace:
I20260709 13:01:08.619326  1704 rpcz_store.cc:276] 0709 13:01:01.989210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.056966 (+ 67756us) service_pool.cc:224] Handling call
0709 13:01:02.057249 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.657648 (+4600399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.618471 (+1960823us) spinlock_profiling.cc:243] Waited 4 s on lock 0x7b5400234454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:08.618723 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9204531456}
I20260709 13:01:08.620328  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:08.622052  5631 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.627574  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 770) took 1241 ms. Trace:
I20260709 13:01:08.628144  1700 rpcz_store.cc:276] 0709 13:01:07.386229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.419365 (+ 33136us) service_pool.cc:224] Handling call
0709 13:01:08.627105 (+1207740us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b54002338a8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3dac924 00007f06e2f95227 00007f06e2f94ab8 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:08.627482 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58179456}
I20260709 13:01:08.634657  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 700) took 1598 ms. Trace:
I20260709 13:01:08.635094  1554 rpcz_store.cc:276] 0709 13:01:07.036730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.958697 (+921967us) service_pool.cc:224] Handling call
0709 13:01:07.959088 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.959538 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.959575 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:07.960011 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.005383 (+ 45372us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:08.005420 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.005499 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.634448 (+628949us) raft_consensus.cc:1685] finished
0709 13:01:08.634467 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.634587 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6646,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":45010,"threads_started":1,"wal-append.queue_time_us":159842}
I20260709 13:01:08.636595  1633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:08.636704  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.637256  1633 raft_consensus.cc:606] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:08.637367  1554 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
W20260709 13:01:08.639536  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.644452  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 476925us
I20260709 13:01:08.645035  1558 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:08.645641  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:08.647291  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:08.650211  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:08.651541  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:08.678746  2236 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:08.676584  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.684223  1558 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:08.656664  6165 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.656854  6034 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:08.677119  5827 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:08.696054  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:08.675755  5997 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.648729  1555 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:01:08.711678  1555 pending_rounds.cc:85] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 8
I20260709 13:01:08.712147  1555 pending_rounds.cc:107] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:01:08.712456  1555 raft_consensus.cc:2889] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:08.712945  1555 pending_rounds.cc:107] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:01:08.713876  1555 raft_consensus.cc:2889] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:08.715085  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 71385.9us
I20260709 13:01:08.715345  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 708) took 1269 ms. Trace:
I20260709 13:01:08.716012  1555 rpcz_store.cc:276] 0709 13:01:07.446500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.328798 (+882298us) service_pool.cc:224] Handling call
0709 13:01:08.332134 (+  3336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.714991 (+382857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.715292 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.717636  1555 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:08.719416  5997 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.722545  6016 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:08.723042  6016 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:08.723754  6121 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.842s	user 0.011s	sys 0.009s
I20260709 13:01:08.726296  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 701) took 1689 ms. Trace:
I20260709 13:01:08.729800  1630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
W20260709 13:01:08.732182  1674 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.008s	sys 0.012s
I20260709 13:01:08.741148  1630 raft_consensus.cc:606] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:08.741667  1630 raft_consensus.cc:614] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:08.735569  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 118434us
I20260709 13:01:08.710367  5827 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:08.727567  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 699) took 1691 ms. Trace:
W20260709 13:01:08.741148  1674 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.008s	sys 0.012s
W20260709 13:01:08.749550  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 600106us
I20260709 13:01:08.741211  1559 rpcz_store.cc:276] 0709 13:01:07.037021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.984908 (+947887us) service_pool.cc:224] Handling call
0709 13:01:07.999926 (+ 15018us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.000229 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.000283 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.000688 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.147977 (+147289us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:08.642575 (+494598us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.725856 (+ 83281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.725961 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.726020 (+    59us) raft_consensus.cc:1685] finished
0709 13:01:08.726056 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.726225 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":482,"prepare.queue_time_us":579905,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":36840,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":12639,"thread_start_us":710757,"threads_started":3,"wal-append.queue_time_us":120283}
I20260709 13:01:08.752817  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.724047  6016 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:08.728808  5731 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:08.753966  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:08.749068  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 70410.2us
I20260709 13:01:08.749353  1551 rpcz_store.cc:276] 0709 13:01:07.036431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.967775 (+931344us) service_pool.cc:224] Handling call
0709 13:01:07.968116 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:07.985652 (+ 17536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:07.985788 (+   136us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.000872 (+ 15084us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.555982 (+555110us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:08.710703 (+154721us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.727279 (+ 16576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.727357 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.727394 (+    37us) raft_consensus.cc:1685] finished
0709 13:01:08.727405 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.727515 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172097,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":12122,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":2606,"thread_start_us":658038,"threads_started":2,"wal-append.queue_time_us":455761}
W20260709 13:01:08.747957  6145 consensus_meta.cc:287] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.798s	user 0.009s	sys 0.004s
W20260709 13:01:08.757651  1701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.010s	sys 0.013s
I20260709 13:01:08.762125  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.763792  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:08.764338  1701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.010s	sys 0.013s
I20260709 13:01:08.762708  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:08.764997  1705 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:08.765990  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.767091  1705 raft_consensus.cc:2410] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:08.747238  5827 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.768362  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.769061  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.772980  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.748811  6127 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:08.761834  6142 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.802s	user 0.012s	sys 0.004s
I20260709 13:01:08.777395  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.778817  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.780757  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.781996  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.783417  1705 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:08.784240  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:08.784888  1705 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:08.762169  1559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:42086
I20260709 13:01:08.785887  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.785897  1559 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:08.787532  1559 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.774163  5363 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:08.785179   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:01:08.792517  6177 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.110s	user 0.003s	sys 0.000s
I20260709 13:01:08.785463  6142 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:08.794771  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.795038  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:08.795832  1709 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:08.796204  6142 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:08.796482  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:08.796738  1709 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.796895  1628 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:08.797214  1707 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.735901  6184 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:01:08.796239  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.789611  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.800091  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:08.792167   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:08.804231  1705 raft_consensus.cc:2368] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14.
I20260709 13:01:08.805871  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.807106  1700 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:08.770854  6145 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:08.799351  5363 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:08.827515  1700 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:08.831836  1709 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:08.832898  1704 raft_consensus.cc:1217] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Deduplicated request from leader. Original: 7.7->[9.8-11.9]   Dedup: 11.9->[]
I20260709 13:01:08.834160  1704 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 13:01:08.838193  1707 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:08.838148  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:08.843318  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:08.844326  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 72143.8us
I20260709 13:01:08.851415  1559 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:08.853770  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:08.854406  2264 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:08.854822  2235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.002s	sys 0.014s
W20260709 13:01:08.855149  2235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.002s	sys 0.014s
W20260709 13:01:08.855422  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 543932us
I20260709 13:01:08.823652  6015 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:08.826712  5363 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:08.872134  1600 leader_election.cc:336] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 2.583s (SENT)
I20260709 13:01:08.870512  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.873014  1600 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:08.874441  1704 raft_consensus.cc:2410] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:08.876977  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:08.876885  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:08.878250  1559 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:08.879952  2235 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:08.884013  2264 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:08.856314  6168 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:08.894274  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:08.888697  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:42086 (request call id 2099) took 1051 ms. Trace:
I20260709 13:01:08.853564  6204 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:08.826488  6195 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
W20260709 13:01:08.942557  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.942590  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.947783  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.923840  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:08.910012  1705 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:08.970119  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:08.948576  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:09.007426  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:09.075105  1700 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:09.005396  1627 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:08.967072  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 877) took 1255 ms. Trace:
I20260709 13:01:08.944236  2270 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:08.948470  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:09.076238  1707 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.075829  1628 rpcz_store.cc:276] 0709 13:01:07.711491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.732588 (+ 21097us) service_pool.cc:224] Handling call
0709 13:01:07.732916 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.797303 (+1064387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.966855 (+169552us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540034eed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:08.967007 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2446777728}
W20260709 13:01:08.945284  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.951377  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.926884  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:09.074223  1630 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:09.084905  1704 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 10: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:09.088581  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:08.948913  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.046597  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:08.897138  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:09.134122  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.911402  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2332) took 1561 ms. Trace:
W20260709 13:01:09.134480  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 88046.9us
I20260709 13:01:09.135326  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:09.134862  1706 rpcz_store.cc:276] 0709 13:01:07.350161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.447902 (+ 97741us) service_pool.cc:224] Handling call
0709 13:01:07.452471 (+  4569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.874843 (+422372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.911133 (+1036290us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54003afa54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:08.911336 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":930907392}
W20260709 13:01:08.909886  1703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 761) took 1586 ms (client timeout 1887 ms). Trace:
I20260709 13:01:09.089602  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:08.904485  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:08.929399  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2071) took 3136 ms. Trace:
I20260709 13:01:08.922395  2268 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:08.934588  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2337) took 1102 ms. Trace:
W20260709 13:01:08.933552  5877 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.794s	user 0.004s	sys 0.004s
I20260709 13:01:08.939994  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2330) took 1603 ms. Trace:
I20260709 13:01:09.090781  1700 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:08.952896  5955 consensus_meta.cc:287] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.592s	user 0.004s	sys 0.006s
I20260709 13:01:09.126379  1557 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:01:08.995036  2236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.887s (SENT) [suppressed 37 similar messages]
I20260709 13:01:08.924618  1633 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:01:09.002372  6144 consensus_meta.cc:287] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.941s	user 0.005s	sys 0.007s
I20260709 13:01:09.069953  1559 rpcz_store.cc:276] 0709 13:01:07.827448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.751839 (+924391us) service_pool.cc:224] Handling call
0709 13:01:08.878663 (+126824us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:09.155263  1526 leader_election.cc:400] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14.
I20260709 13:01:08.960588  6123 raft_consensus.cc:3055] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:01:09.155956  1703 rpcz_store.cc:269] 0709 13:01:07.323850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.340151 (+ 16301us) service_pool.cc:224] Handling call
0709 13:01:08.909632 (+1569481us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54000a78d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:08.909822 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876907392}
I20260709 13:01:09.155107  1708 rpcz_store.cc:276] 0709 13:01:07.336625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.938839 (+1602214us) service_pool.cc:224] Handling call
0709 13:01:08.939286 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.939523 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.939568 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.939628 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:08.939677 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.939757 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.939918 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:09.157109  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 187117us
I20260709 13:01:09.177369  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:09.178779  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:09.039232  6173 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:08.925269  6119 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 2.047s	user 0.009s	sys 0.031s
I20260709 13:01:09.161331  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:08.916067  6141 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.258s	user 0.011s	sys 0.019s
W20260709 13:01:08.919340  6194 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:01:08.958778  5762 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:09.160063  1552 rpcz_store.cc:276] 0709 13:01:05.792992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.439804 (+646812us) service_pool.cc:224] Handling call
0709 13:01:06.440118 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.889532 (+449414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.929094 (+2039562us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54002db9d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:08.929322 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960994560}
I20260709 13:01:09.162529  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:09.237532  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:09.238046  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 101637us
I20260709 13:01:09.238770  1635 raft_consensus.cc:2410] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:09.157290  1702 rpcz_store.cc:276] 0709 13:01:07.832334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.832509 (+   175us) service_pool.cc:224] Handling call
0709 13:01:07.851379 (+ 18870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.908423 (+ 57044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.934253 (+1025830us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b5400233f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:08.934493 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53268736}
I20260709 13:01:09.162663  6200 raft_consensus.cc:3055] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:08.927731  6099 raft_consensus.cc:3055] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:09.186679  6043 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.036928  6131 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.931200  6010 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:08.894912  6196 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:09.166241  1526 leader_election.cc:403] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:09.269891  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:09.269944  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 128988us
I20260709 13:01:09.222291  6204 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:09.082343  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.948782  5997 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.297s
I20260709 13:01:08.925418  6145 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:08.896988  6142 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:08.959728  6125 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.176337  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:09.290546  1629 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:08.955904  6198 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:08.911834  5842 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:09.181464  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:08.928336  5928 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.235396  6173 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.295948  5804 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:09.269164  5731 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.297210  5928 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:09.186326  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:09.297679  6173 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:09.186210  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:09.187862  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.186995  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:09.184881  1674 leader_election.cc:400] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8.
I20260709 13:01:09.298743  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:09.299503  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 114934us
I20260709 13:01:09.299911  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:09.301153  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:09.221611  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:09.302331  2271 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:09.303115  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:09.303838  1557 raft_consensus.cc:2376] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14. Re-sending same reply.
I20260709 13:01:09.219226  1556 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 9: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:09.136729  5889 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:09.227517  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:09.232735  1700 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:09.221072  6184 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:01:08.972564  6016 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.320022  6184 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:09.320430  6184 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:09.242151  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:09.322415  1702 raft_consensus.cc:2376] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10. Re-sending same reply.
I20260709 13:01:09.321270  6184 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.324123  1706 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 10: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:09.324527  6184 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.137413  6161 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:09.326562  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.243760  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:09.327283  1708 raft_consensus.cc:2376] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13. Re-sending same reply.
I20260709 13:01:09.329283  1708 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:09.248555  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:09.248854  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2093) took 1422 ms. Trace:
I20260709 13:01:09.331560  1708 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:01:09.331635  1560 rpcz_store.cc:276] 0709 13:01:07.826421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.607639 (+781218us) service_pool.cc:224] Handling call
0709 13:01:08.633938 (+ 26299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.634409 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.634451 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.635028 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.740326 (+105298us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:08.740384 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.740482 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.918731 (+178249us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:09.236725 (+317994us) raft_consensus.cc:1685] finished
0709 13:01:09.236754 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.248767 (+ 12013us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1873,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":27866368,"thread_start_us":104763,"threads_started":1,"wal-append.queue_time_us":155022}
W20260709 13:01:09.335681  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.335934  5631 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.336266  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 702) took 2299 ms. Trace:
I20260709 13:01:09.255100  1707 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:09.336611  1553 rpcz_store.cc:276] 0709 13:01:07.037291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.069277 (+1031986us) service_pool.cc:224] Handling call
0709 13:01:08.069633 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.070007 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:08.608102 (+538095us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.856722 (+248620us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.856887 (+   165us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.880306 (+ 23419us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.880407 (+   101us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:08.880629 (+   222us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.881251 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.881317 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.969518 (+ 88201us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b18004bb140. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2522 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:01:08.972882 (+  3364us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b18004bb140. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:01:08.980218 (+  7336us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b18004bb140. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:01:09.336040 (+355822us) raft_consensus.cc:1685] finished
0709 13:01:09.336060 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.336212 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":424,"prepare.queue_time_us":666659,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":43496,"raft.queue_time_us":114663,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":15317,"spinlock_wait_cycles":127908352,"thread_start_us":743166,"threads_started":2,"wal-append.queue_time_us":214504}
I20260709 13:01:09.247226  6099 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:09.338258  6195 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:09.247400  5769 raft_consensus.cc:993] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 13:01:09.247507  6043 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.288954  6196 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:09.352037  6145 raft_consensus.cc:1081] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 13:01:09.352322  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:09.353124  1628 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:09.352743  6196 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.353996  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:09.355490  1628 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:08.984100  5827 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.173396  6123 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:09.267637  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:09.174413  6101 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:09.167608  2264 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:09.279693  2263 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:09.162156  5877 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:09.244226  6200 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:09.297585  5731 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.298274  6126 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.136853  6004 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:09.304841  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:09.304896  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2098) took 1477 ms. Trace:
I20260709 13:01:09.375787  1555 rpcz_store.cc:276] 0709 13:01:07.827206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.729851 (+902645us) service_pool.cc:224] Handling call
0709 13:01:08.736466 (+  6615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.813591 (+ 77125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.813623 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.814093 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.077603 (+263510us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:09.150986 (+ 73383us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.221970 (+ 70984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.222080 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.304646 (+ 82566us) raft_consensus.cc:1685] finished
0709 13:01:09.304682 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.304831 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82332,"prepare.queue_time_us":141582,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":44,"raft.queue_time_us":121410,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":25813,"thread_start_us":295139,"threads_started":2,"wal-append.queue_time_us":459369}
I20260709 13:01:09.313417  1630 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:01:09.267737  6010 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:09.315148  1556 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:01:09.272171  6000 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:09.319286  1700 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:09.414984  1700 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:09.342162  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:09.417285  1635 raft_consensus.cc:2410] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:09.248494  5762 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:09.257920  6144 consensus_queue.cc:1059] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:01:09.186679  6168 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:01:09.350457  1557 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:01:09.339326  6099 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.272439  6131 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.373174  1629 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:09.301651  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:09.378621  6126 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.379129  6075 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:09.315603  5842 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.379729  5731 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:09.380021  1704 raft_consensus.cc:2368] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10.
I20260709 13:01:09.381345  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2094) took 1554 ms. Trace:
I20260709 13:01:09.396528  5827 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:09.397398  5986 consensus_meta.cc:287] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.785s	user 0.011s	sys 0.000s
I20260709 13:01:09.626773  5986 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.629595  5986 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:09.281989  6204 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.631996  6204 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:09.404019  6200 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.634178  6200 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.406591  5877 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:09.638875  5877 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:09.639500  5877 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.407126  1709 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:09.367494  6101 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.418970  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:09.642936  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 224087us
I20260709 13:01:09.643975  6101 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:09.420935  1555 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:09.645776  1555 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:09.647104  5889 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:09.430944  1556 pending_rounds.cc:85] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 7
I20260709 13:01:09.647624  1556 pending_rounds.cc:107] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:01:09.647903  1556 raft_consensus.cc:2889] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:09.416000  1700 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.307298  6125 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.650390  1700 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.652495  6125 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:09.434937  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 133382us
I20260709 13:01:09.653957  1674 leader_election.cc:400] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 7 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8.
I20260709 13:01:09.647629  5889 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:09.654878  1674 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:09.655148  5889 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:09.655999  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:09.656894  1630 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:09.435243  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:09.657701  1635 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:09.660207  6010 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.661616  6010 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.666122  1700 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:09.448021  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:09.664496  2236 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.030s	sys 0.042s
W20260709 13:01:09.668531  2236 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.031s	sys 0.042s
W20260709 13:01:09.668910  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 673935us
I20260709 13:01:09.613389  1554 rpcz_store.cc:276] 0709 13:01:07.826572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.638020 (+811448us) service_pool.cc:224] Handling call
0709 13:01:08.640592 (+  2572us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.643242 (+  2650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.643272 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.644188 (+   916us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.836341 (+192153us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:08.836376 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.836435 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.381049 (+544614us) raft_consensus.cc:1685] finished
0709 13:01:09.381080 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.381272 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2457,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":12289,"thread_start_us":127919,"threads_started":1,"wal-append.queue_time_us":594320}
I20260709 13:01:09.670934  2264 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:09.671986  1554 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:09.672267  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:09.672837  2264 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:01:09.674794  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:09.678097  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:09.684857  2268 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:09.687479  1635 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:01:09.718570  1557 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:09.723711  1551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.016s	sys 0.040s
I20260709 13:01:09.726348  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:09.717341  1600 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.025s	sys 0.029s
W20260709 13:01:09.750873  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.662585  6158 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:09.751387  1627 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.020s	sys 0.028s
W20260709 13:01:09.917953  1627 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.020s	sys 0.028s
I20260709 13:01:09.752239  2270 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:09.752471  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:09.750542  1551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.016s	sys 0.044s
I20260709 13:01:09.824970  2271 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:09.608697  6000 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:09.662614  6173 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:09.825271  1634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.010s	sys 0.048s
W20260709 13:01:09.971853  1634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.010s	sys 0.048s
W20260709 13:01:09.716133  6179 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:01:09.717123  6040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.028s	sys 0.025s
I20260709 13:01:09.835906  1557 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:01:10.028687  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.026s	sys 0.047s
I20260709 13:01:09.688740  6099 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.839421  5762 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:09.665309  6043 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:09.714336  5804 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:09.846505  1626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.015s	sys 0.028s
W20260709 13:01:10.042897  1626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.015s	sys 0.028s
I20260709 13:01:09.420352  6123 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:09.867756  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.052670  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.914790  1600 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.031s	sys 0.038s
W20260709 13:01:10.054040  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 1.15791e+06us
I20260709 13:01:09.974519  6161 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.617832  6075 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:09.825148  5792 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:01:09.917688  6158 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:10.019441  5842 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:10.027289  6126 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:10.043471  6051 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:10.029249  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.026s	sys 0.047s
W20260709 13:01:10.028749  6040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.029s	sys 0.025s
I20260709 13:01:10.032006  1557 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:01:09.717649  5904 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:10.040117  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.017s	sys 0.022s
W20260709 13:01:10.043565  1558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.037s	sys 0.038s
I20260709 13:01:09.972332  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:09.971549  6173 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:10.061314  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:10.063745  6196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.004s	sys 0.021s
W20260709 13:01:10.071682  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 812136us
I20260709 13:01:10.064385  6101 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:10.060170  5762 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:10.109030  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.006s	sys 0.021s
W20260709 13:01:10.111421  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.006s	sys 0.021s
I20260709 13:01:10.077634  5877 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:10.083400  1558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.037s	sys 0.038s
W20260709 13:01:10.078542  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.017s	sys 0.023s
I20260709 13:01:10.073697  6158 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:10.097551  1553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.014s	sys 0.014s
I20260709 13:01:10.073410  6123 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.070044  6161 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:10.135767  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.141809  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.144354  6147 raft_consensus.cc:3055] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:10.144975  6147 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:10.149681  6202 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.815s	user 0.003s	sys 0.010s
W20260709 13:01:10.114491  1706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.057s	sys 0.106s
I20260709 13:01:10.095185  6173 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:10.169354  1706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.057s	sys 0.107s
W20260709 13:01:10.117775  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 882798us
W20260709 13:01:10.122773  1553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.014s	sys 0.014s
W20260709 13:01:10.123214  1628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.013s	sys 0.014s
W20260709 13:01:10.178772  1628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.013s	sys 0.015s
W20260709 13:01:10.125094  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 63893.7us
W20260709 13:01:10.111191  5631 consensus_meta.cc:287] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.775s	user 0.012s	sys 0.000s
I20260709 13:01:10.180876  5631 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14.
W20260709 13:01:10.094487  6196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.004s	sys 0.021s
I20260709 13:01:10.182116  2269 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:10.090301  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.006s	sys 0.021s
W20260709 13:01:10.186275  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.006s	sys 0.021s
W20260709 13:01:10.186643  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 915211us
I20260709 13:01:10.188650  1526 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:10.129343  1702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.010s	sys 0.018s
W20260709 13:01:10.189579  1702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.010s	sys 0.018s
I20260709 13:01:10.100342  5762 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:10.191218  5762 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:10.108516  6040 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:10.194775  6040 raft_consensus.cc:2955] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 2 to 9, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:10.198469  6204 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:10.200350  6204 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:10.200924  6204 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:10.080952  6075 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:10.155546  6095 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:10.205036  6204 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.215397  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:10.216792  5631 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:10.219941  6131 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:10.230579  6202 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:10.232167  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2095) took 2405 ms. Trace:
I20260709 13:01:10.232643  1558 rpcz_store.cc:276] 0709 13:01:07.826728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.711912 (+885184us) service_pool.cc:224] Handling call
0709 13:01:08.712332 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.712772 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.712813 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.726924 (+ 14111us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.089714 (+362790us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:09.219388 (+129674us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.258976 (+ 39588us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b1800261640. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:01:09.335719 (+ 76743us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b1800261640. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06e1ea358f 00007f06daee2571 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd
0709 13:01:10.115833 (+780114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.115919 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.148926 (+ 33007us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:10.231888 (+ 82962us) raft_consensus.cc:1685] finished
0709 13:01:10.231917 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.232098 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65546,"prepare.queue_time_us":131625,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":26,"raft.queue_time_us":40043,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":9719,"spinlock_wait_cycles":42339840,"thread_start_us":1198605,"threads_started":2,"wal-append.queue_time_us":541498}
I20260709 13:01:10.236091  1558 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:10.236721  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 718) took 1146 ms. Trace:
I20260709 13:01:10.237011  1558 rpcz_store.cc:276] 0709 13:01:09.090721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.235210 (+1144489us) service_pool.cc:224] Handling call
0709 13:01:10.235646 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.236493 (+   847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.236672 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:10.163872  6147 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:10.168514  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.240715  6147 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:10.123088  6006 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.011s	sys 0.016s
W20260709 13:01:10.246580  6006 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.011s	sys 0.017s
W20260709 13:01:10.122284  6166 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.003s	sys 0.024s
W20260709 13:01:10.264003  1556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.007s	sys 0.033s
I20260709 13:01:10.265480   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:10.266469  1556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.007s	sys 0.033s
I20260709 13:01:10.109340  6101 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.078791  6051 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:10.268030  6166 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.003s	sys 0.025s
I20260709 13:01:10.122824  6016 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.159s
I20260709 13:01:10.122655  6125 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.159s
W20260709 13:01:10.320631  1559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.006s	sys 0.069s
W20260709 13:01:10.321416  1559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.006s	sys 0.069s
I20260709 13:01:10.333314  1552 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
W20260709 13:01:10.343276  1629 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.029s	sys 0.028s
W20260709 13:01:10.345279  1629 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.030s	sys 0.028s
I20260709 13:01:10.292114  5997 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:10.292984  6142 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.012s	sys 0.048s
W20260709 13:01:10.349885  5363 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.463s	user 0.007s	sys 0.004s
I20260709 13:01:10.348656  6131 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:10.365057  6142 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.012s	sys 0.048s
I20260709 13:01:10.388013  5784 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:10.397424  5784 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:10.361076  5997 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.368384  5363 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.357539  6125 consensus_queue.cc:1243] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:10.399019  1632 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:10.354921  5991 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:10.352005  6217 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:01:10.352612  6132 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 13:01:10.448050  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.109s	user 0.027s	sys 0.066s
W20260709 13:01:10.462726  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.027s	sys 0.067s
W20260709 13:01:10.449764  1560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.095s	user 0.014s	sys 0.051s
I20260709 13:01:10.453315  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 778) took 1277 ms. Trace:
W20260709 13:01:10.463706  1560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.014s	sys 0.052s
I20260709 13:01:10.463757  1704 rpcz_store.cc:276] 0709 13:01:09.176350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.185886 (+  9536us) service_pool.cc:224] Handling call
0709 13:01:10.451523 (+1265637us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b54003a0554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:10.453220 (+  1697us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187010304}
W20260709 13:01:10.402480  5889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.030s	sys 0.038s
I20260709 13:01:10.444777  6099 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:10.465953  1627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.008s	sys 0.008s
W20260709 13:01:10.473135  1627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.008s	sys 0.009s
I20260709 13:01:10.447728  6196 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:10.477793  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.006s	sys 0.078s
W20260709 13:01:10.479260  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.007s	sys 0.078s
W20260709 13:01:10.468029  5889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.030s	sys 0.038s
I20260709 13:01:10.484339  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:10.473866  1674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.009s	sys 0.008s
W20260709 13:01:10.485932  1674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.009s	sys 0.009s
I20260709 13:01:10.491600  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:10.482954  6004 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.494917  6004 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.491144  6164 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.497464  6164 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.498766  6155 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:10.498919  2263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 1032) took 1645 ms (client timeout 1577 ms). Trace:
I20260709 13:01:10.497915  6004 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:10.499342  2263 rpcz_store.cc:269] 0709 13:01:08.853352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.855074 (+  1722us) service_pool.cc:224] Handling call
0709 13:01:10.498747 (+1643673us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400583254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:10.498851 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667498880}
I20260709 13:01:10.468261  5631 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:10.501299  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.468508  6099 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:10.502079  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:10.487805  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.449465  6131 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:10.505550  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 779316us
I20260709 13:01:10.398684  5784 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:10.510290  6219 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:01:10.499347  6155 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:10.514430  6215 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:01:10.500732  6000 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.503002  6075 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:10.560541  6075 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.561125  6075 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.519047  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 887) took 1507 ms. Trace:
I20260709 13:01:10.562252  1632 rpcz_store.cc:276] 0709 13:01:09.011386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.011499 (+   113us) service_pool.cc:224] Handling call
0709 13:01:09.011850 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.448975 (+1437125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.518701 (+ 69726us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54001667d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:10.518969 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3177834880}
W20260709 13:01:10.520429  6010 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.858s	user 0.003s	sys 0.006s
I20260709 13:01:10.521371  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2271) took 1565 ms. Trace:
I20260709 13:01:10.564579  1552 rpcz_store.cc:276] 0709 13:01:08.955902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.237504 (+281602us) service_pool.cc:224] Handling call
0709 13:01:10.521177 (+1283673us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b5400384854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:10.521316 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891037952}
I20260709 13:01:10.566253  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:10.567147  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 886) took 1557 ms. Trace:
I20260709 13:01:10.521513  1555 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:10.522929  6230 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:01:10.504812  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 890) took 1357 ms. Trace:
I20260709 13:01:10.535167  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2346) took 1460 ms. Trace:
I20260709 13:01:10.574743  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:10.574604  1705 rpcz_store.cc:276] 0709 13:01:09.075143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.135734 (+ 60591us) service_pool.cc:224] Handling call
0709 13:01:09.136256 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.305747 (+169491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.305791 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:09.305845 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:09.305889 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.534839 (+1228950us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54000a82d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:10.534910 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.535103 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389245184}
I20260709 13:01:10.577194  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2257) took 1819 ms. Trace:
I20260709 13:01:10.578105  1709 rpcz_store.cc:276] 0709 13:01:08.757319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.834413 (+ 77094us) service_pool.cc:224] Handling call
0709 13:01:08.834720 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.642279 (+807559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.576866 (+934587us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54001fe354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:10.577118 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316064640}
W20260709 13:01:10.580482  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.026s	sys 0.043s
W20260709 13:01:10.581780  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.026s	sys 0.043s
W20260709 13:01:10.588611  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.567716  1626 rpcz_store.cc:276] 0709 13:01:09.010087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.036667 (+ 26580us) service_pool.cc:224] Handling call
0709 13:01:09.132695 (+ 96028us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:09.152794 (+ 20099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.152842 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:09.162560 (+  9718us) log.cc:844] Serialized 52 byte log entry
0709 13:01:10.043261 (+880701us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:10.043318 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.043401 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.566924 (+523523us) raft_consensus.cc:1685] finished
0709 13:01:10.566948 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.567086 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19639,"raft.queue_time_us":25738,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":13570,"thread_start_us":770805,"threads_started":1,"wal-append.queue_time_us":999711}
I20260709 13:01:10.539232  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:10.471635  6220 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:10.550761  6099 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.552799  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2092) took 1229 ms. Trace:
I20260709 13:01:10.639036  1628 rpcz_store.cc:276] 0709 13:01:09.323312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.396779 (+ 73467us) service_pool.cc:224] Handling call
0709 13:01:09.397115 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.397460 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.397490 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.397936 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.179287 (+781351us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:10.179344 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.179438 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.552569 (+373131us) raft_consensus.cc:1685] finished
0709 13:01:10.552593 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.552734 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8756,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":187,"thread_start_us":780917,"threads_started":1,"wal-append.queue_time_us":1152607}
W20260709 13:01:10.640673  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.557507  6101 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:10.557482  6000 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.558725  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:10.657864  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.567111  1552 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
W20260709 13:01:10.492208  6184 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.167s	user 0.013s	sys 0.000s
I20260709 13:01:10.621469  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:10.657848  1633 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:10.622977  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:10.553534  6051 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:10.576653  1627 rpcz_store.cc:276] 0709 13:01:09.147925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.148086 (+   161us) service_pool.cc:224] Handling call
0709 13:01:09.148466 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.148688 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:09.918488 (+769800us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.492923 (+574435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.493014 (+    91us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:10.493095 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.504589 (+ 11494us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.504742 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27729,"prepare.queue_time_us":921048,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":16920,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":31172,"thread_start_us":1301037,"threads_started":2}
I20260709 13:01:10.485288  6196 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.666827  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:10.669417  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:10.671412  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:10.672313  2270 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:10.670516  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:10.582466  5784 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.572875  6161 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:10.683353  2266 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:01:10.684111  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 145012us
I20260709 13:01:10.711745  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:10.713122  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:10.700107  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.526743  5631 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:10.716593  5631 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:10.704218  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:10.718205  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:10.682755  2271 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:10.708132  1635 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:10.722232  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:10.723847  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:10.596657  5991 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:10.725533  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.660144  6166 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:10.735893  6004 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:10.736673  6004 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:10.737227  6004 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.738883  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:10.739598  1635 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:10.741521  6000 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:10.749284  1631 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:01:10.752727  1551 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.030s	sys 0.047s
W20260709 13:01:10.753182  1551 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.030s	sys 0.047s
I20260709 13:01:10.682998  5877 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:10.725124  6200 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.090s	user 0.011s	sys 0.001s
I20260709 13:01:10.755374  2268 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:10.757529  6099 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.760226  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:10.706833  6127 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:10.760211  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2103) took 2932 ms. Trace:
I20260709 13:01:10.766904  1552 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:01:10.767409  1552 pending_rounds.cc:85] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 8
I20260709 13:01:10.767637  1552 pending_rounds.cc:107] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:01:10.767884  1552 raft_consensus.cc:2889] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:10.768657  1557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.025s	sys 0.022s
W20260709 13:01:10.769029  1557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.025s	sys 0.022s
I20260709 13:01:10.769421  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 884) took 1763 ms. Trace:
I20260709 13:01:10.765805  1551 rpcz_store.cc:276] 0709 13:01:07.828144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.761964 (+933820us) service_pool.cc:224] Handling call
0709 13:01:08.762279 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.855307 (+ 93028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.855335 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.873863 (+ 18528us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.920664 (+1046801us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:10.753631 (+832967us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.759872 (+  6241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.759954 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.759999 (+    45us) raft_consensus.cc:1685] finished
0709 13:01:10.760010 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.760156 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7778,"raft.queue_time_us":43507,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":10475,"thread_start_us":1780686,"threads_started":3,"wal-append.queue_time_us":1197888}
I20260709 13:01:10.738950  5723 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:10.750555  5631 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.737618  6004 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.730165  6161 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:10.743021  6166 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:10.769944  1634 rpcz_store.cc:276] 0709 13:01:09.006116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.006263 (+   147us) service_pool.cc:224] Handling call
0709 13:01:09.006616 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.085632 (+ 79016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.085664 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.159496 (+ 73832us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.972455 (+812959us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:09.972517 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.972625 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.513769 (+541144us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:10.758397 (+244628us) raft_consensus.cc:1685] finished
0709 13:01:10.758424 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.769322 (+ 10898us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":500,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":159,"spinlock_wait_cycles":3853184,"thread_start_us":729683,"threads_started":1,"wal-append.queue_time_us":924913}
I20260709 13:01:10.787731  1551 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:01:10.752386  6216 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:10.790184  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.790894  2235 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:10.792330  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:10.799178  6075 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:10.761543  6195 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:10.669780  6220 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.826767  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:10.828742  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.011s	sys 0.020s
W20260709 13:01:10.813758  1554 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.012s	sys 0.020s
W20260709 13:01:10.801625  5762 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.002s
W20260709 13:01:10.843029  1554 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.012s	sys 0.021s
I20260709 13:01:10.754238  5827 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 13:01:10.833150  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.011s	sys 0.020s
I20260709 13:01:10.751794  5991 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:10.837410  2236 leader_election.cc:336] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.728s (SENT)
I20260709 13:01:10.848918  2236 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:10.845029  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 741436us
I20260709 13:01:10.850943  1551 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:10.823207  5723 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:10.766072  5877 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.839259  5986 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:10.852887  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:10.866861  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.012s	sys 0.017s
W20260709 13:01:10.922036  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.012s	sys 0.018s
W20260709 13:01:10.870121  1706 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.018s	sys 0.023s
W20260709 13:01:10.923283  1706 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.018s	sys 0.023s
W20260709 13:01:10.910851  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.871387  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.011s	sys 0.019s
W20260709 13:01:10.878646  2264 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.021s	sys 0.078s
W20260709 13:01:10.924835  2264 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.172s	user 0.025s	sys 0.079s
W20260709 13:01:10.922396  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 742446us
I20260709 13:01:10.925565  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:10.852340  2236 leader_election.cc:336] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.800s (SENT)
I20260709 13:01:10.847570  5997 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:10.922590  1629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.012s	sys 0.016s
I20260709 13:01:10.809450  5631 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.926550  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:10.924260  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.013s	sys 0.026s
W20260709 13:01:10.933370  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 762125us
W20260709 13:01:10.922400  5955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.009s	sys 0.021s
I20260709 13:01:10.831023  6015 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:01:10.930907  1629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.013s	sys 0.017s
I20260709 13:01:10.824620  6161 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:10.935089  1556 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.006s	sys 0.026s
I20260709 13:01:10.934378  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:10.936570  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 786) took 1753 ms. Trace:
I20260709 13:01:10.843212  5762 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:10.936547  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 83771.5us
I20260709 13:01:10.921482  5986 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:10.937639  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 85328.2us
I20260709 13:01:10.918419  6131 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:10.957934  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:10.949676  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:10.827421  6216 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:10.932567  6184 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:10.863312  6051 consensus_queue.cc:1059] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 13:01:10.932897  6219 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:01:10.935452  6227 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
I20260709 13:01:10.960510  2265 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:10.965197  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:10.938694  5955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.010s	sys 0.021s
I20260709 13:01:10.989355  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:10.989384  2262 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:10.990005  2263 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
W20260709 13:01:10.998924  6233 log.cc:927] Time spent T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:01:11.001621  5991 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:11.005393  6216 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:11.006116  5723 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.011466  5631 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:11.015705  5762 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:10.957238  5827 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.016839  5827 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.019620  5827 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:10.957391  5986 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:11.022842  6004 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:11.025261  6161 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:10.982381  6131 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.026484  6131 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.029178  6131 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:11.031463  6040 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.004s
I20260709 13:01:11.034451  6220 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:11.046818  6239 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 13:01:11.048785  6173 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.879s	user 0.011s	sys 0.000s
I20260709 13:01:11.053786  5877 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:11.064030  2236 leader_election.cc:336] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.917s (SENT)
I20260709 13:01:11.064489  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:10.955860  6155 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:11.049265  6173 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:10.871179  6166 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:11.066615  6229 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 13:01:10.939029  6006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.008s	sys 0.032s
I20260709 13:01:10.943392  5997 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:10.942467  6223 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:10.949391  6016 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:10.957517  6095 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 13:01:11.062762  6051 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:11.067306  5955 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:11.077999  6006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.008s	sys 0.032s
I20260709 13:01:11.073346  6144 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:11.079006  6147 consensus_meta.cc:287] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.838s	user 0.004s	sys 0.008s
W20260709 13:01:11.085646  6158 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.838s	user 0.006s	sys 0.004s
I20260709 13:01:11.092314  6051 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.091682  6166 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:11.094563  6223 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:11.108368  6030 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.024s	sys 0.025s
I20260709 13:01:11.096444  6244 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:11.100798  6142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.011s	sys 0.045s
I20260709 13:01:11.120417  6244 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:10.948509  1556 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.006s	sys 0.026s
W20260709 13:01:11.178211  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.000s	sys 0.009s
W20260709 13:01:11.178516  1553 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.025s	sys 0.015s
W20260709 13:01:11.178983  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.000s	sys 0.009s
W20260709 13:01:11.179210  1553 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.025s	sys 0.015s
I20260709 13:01:11.181483  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2264) took 2390 ms. Trace:
I20260709 13:01:11.181655  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2268) took 2237 ms. Trace:
W20260709 13:01:11.181928  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.004s	sys 0.010s
W20260709 13:01:11.182574  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.004s	sys 0.010s
I20260709 13:01:11.182294  1556 rpcz_store.cc:276] 0709 13:01:08.943670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.430231 (+486561us) service_pool.cc:224] Handling call
0709 13:01:09.430684 (+   453us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:09.648841 (+218157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.648878 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:09.649532 (+   654us) log.cc:844] Serialized 52 byte log entry
0709 13:01:10.268742 (+619210us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:11.179230 (+910488us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.180459 (+  1229us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.180871 (+   412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.181033 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.181128 (+    95us) raft_consensus.cc:1685] finished
0709 13:01:11.181146 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.181445 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":844176,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":9954,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":1518799,"threads_started":2,"wal-append.queue_time_us":1092424}
I20260709 13:01:11.186157  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:11.187517  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.181689  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 679698us
I20260709 13:01:11.189821  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:11.191318  1558 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.011s	sys 0.024s
W20260709 13:01:11.191880  1558 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.011s	sys 0.024s
I20260709 13:01:11.191905  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 717) took 2101 ms. Trace:
W20260709 13:01:10.951265  1559 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.009s	sys 0.024s
W20260709 13:01:11.193794  1559 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.009s	sys 0.024s
I20260709 13:01:11.192638  1557 rpcz_store.cc:276] 0709 13:01:09.090485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.075347 (+984862us) service_pool.cc:224] Handling call
0709 13:01:10.080314 (+  4967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:10.080697 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:10.080732 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:10.081230 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.769430 (+688200us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:10.769466 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.769526 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.191242 (+421716us) raft_consensus.cc:1685] finished
0709 13:01:11.191287 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.191680 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":687786,"threads_started":1,"wal-append.queue_time_us":1006047}
I20260709 13:01:11.182148  1553 rpcz_store.cc:276] 0709 13:01:08.790914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.338634 (+547720us) service_pool.cc:224] Handling call
0709 13:01:09.338971 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.339297 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.339323 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.339777 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.172570 (+832793us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:11.179981 (+1007411us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.180591 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.180778 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.180914 (+   136us) raft_consensus.cc:1685] finished
0709 13:01:11.180949 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.181316 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":926916,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":1992,"raft.queue_time_us":2155,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":13502,"thread_start_us":1839150,"threads_started":2,"wal-append.queue_time_us":1121689}
W20260709 13:01:11.195578  1560 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.010s	sys 0.014s
W20260709 13:01:11.196130  1560 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.010s	sys 0.014s
I20260709 13:01:10.945981  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2095) took 1551 ms. Trace:
I20260709 13:01:11.198830  1629 rpcz_store.cc:276] 0709 13:01:09.394279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.436959 (+ 42680us) service_pool.cc:224] Handling call
0709 13:01:09.437261 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.437485 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:10.347142 (+909657us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.945651 (+598509us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:10.945703 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:10.945747 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.945810 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.945922 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6352,"prepare.queue_time_us":673005,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":123824,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3462,"thread_start_us":1356022,"threads_started":2,"wal-append.queue_time_us":786857}
I20260709 13:01:10.942462  1706 rpcz_store.cc:276] 0709 13:01:09.183514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.325499 (+141985us) service_pool.cc:224] Handling call
0709 13:01:09.325882 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.346735 (+ 20853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.346779 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.353758 (+  6979us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.169750 (+815992us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:10.520146 (+350396us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b48001e0258. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:01:10.927055 (+406909us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.927317 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.927411 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.927463 (+    52us) raft_consensus.cc:1685] finished
0709 13:01:10.936378 (+  8915us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.936503 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5159,"prepare.queue_time_us":383941,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":45500,"raft.queue_time_us":10569,"raft.run_cpu_time_us":27294,"raft.run_wall_time_us":1177991,"spinlock_wait_cycles":15809280,"thread_start_us":1569106,"threads_started":2,"wal-append.queue_time_us":1140661}
I20260709 13:01:11.099054  5363 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:11.203087  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.207944  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:10.983803  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:11.212471  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 490175us
I20260709 13:01:11.215757  5889 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:11.217280  5889 consensus_queue.cc:1243] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:10.987738  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:10.984856  2270 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:11.219803  5363 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.220930  5363 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.223842  5631 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:11.224768  5631 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.226711  6006 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:11.116089  6030 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.025s	sys 0.025s
I20260709 13:01:11.232980  6051 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:11.233893  6004 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.234486  6004 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:11.234710  6075 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:11.235080  6004 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:11.235816  6075 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:11.238396  6006 raft_consensus.cc:3055] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:11.239140  6006 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:11.239470  5762 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:11.240247  6075 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:11.240777  5877 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:11.241446  5877 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:11.213765  2269 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:11.241544  6075 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.242988  5889 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:01:11.243296  6075 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:11.243434  5877 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.241636  5762 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:01:11.245999  5877 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.256516  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:11.114319  6125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.016s	sys 0.040s
I20260709 13:01:11.269919  5631 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:11.270493  6125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.017s	sys 0.040s
I20260709 13:01:11.245656  5889 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.271559  5889 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.272523  6125 raft_consensus.cc:3055] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:11.273095  6125 raft_consensus.cc:740] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:11.131731  6142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.011s	sys 0.046s
I20260709 13:01:11.275756  6173 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:11.279647  6223 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.140390  6244 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:11.284416  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 334644us
I20260709 13:01:11.324306  1557 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:01:11.337601  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.339854  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.340596  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.342108  1709 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48138
I20260709 13:01:11.343107  1709 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:11.343655  1709 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.346412  6269 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.347692  6269 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:11.107919  6158 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:11.224793  5363 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:11.350906  6099 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.018s
W20260709 13:01:11.345762  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.351504  6158 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:11.267414  6161 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:01:11.348307  6204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.005s	sys 0.008s
W20260709 13:01:11.354533  6204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.005s	sys 0.009s
I20260709 13:01:11.354759  6164 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:11.352185  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.264607  1553 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:11.354689  5889 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:11.365008  6051 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:11.388641  5784 consensus_meta.cc:287] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.013s
W20260709 13:01:11.382292  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 189361us
W20260709 13:01:11.393268  6280 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:01:11.393940  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 160714us
W20260709 13:01:11.395290  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 139164us
I20260709 13:01:11.397650  6262 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:11.398308  6158 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.399290  1554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.003s	sys 0.010s
I20260709 13:01:11.407196  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:11.407558  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:11.410171  6051 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.411425  1708 raft_consensus.cc:2955] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 2 to 9, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:11.413763  1707 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:11.433485  6123 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.252s	user 0.014s	sys 0.009s
W20260709 13:01:11.434276  1554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.003s	sys 0.010s
I20260709 13:01:11.441512  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2262) took 2676 ms. Trace:
I20260709 13:01:11.455431  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 977) took 1770 ms. Trace:
I20260709 13:01:11.455935  2264 rpcz_store.cc:276] 0709 13:01:09.673868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.673992 (+   124us) service_pool.cc:224] Handling call
0709 13:01:09.674292 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.674519 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:10.925307 (+1250788us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.391242 (+465935us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:11.425861 (+ 34619us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:11.427261 (+  1400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.427375 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.443841 (+ 16466us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1452071,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":11344,"raft.run_wall_time_us":42923,"spinlock_wait_cycles":4564224,"thread_start_us":1571337,"threads_started":2,"wal-append.queue_time_us":483741}
I20260709 13:01:11.464357  6125 consensus_queue.cc:260] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.466130  6125 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.474319  6158 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:11.475587  6269 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:11.479254  6233 log.cc:927] Time spent T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:11.482194  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2104) took 2366 ms. Trace:
I20260709 13:01:11.482656  1555 rpcz_store.cc:276] 0709 13:01:09.081087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.646618 (+565531us) service_pool.cc:224] Handling call
0709 13:01:10.521325 (+874707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.567920 (+ 46595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.427435 (+859515us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b5400384850. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:11.447395 (+ 19960us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2011155840}
I20260709 13:01:11.485980  6164 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.486785  6164 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:11.491660  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.495754  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 719) took 2404 ms. Trace:
I20260709 13:01:11.496232  1558 rpcz_store.cc:276] 0709 13:01:09.090961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.320628 (+1229667us) service_pool.cc:224] Handling call
0709 13:01:10.321100 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.321353 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:11.192749 (+871396us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.385732 (+192983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:11.391606 (+  5874us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:11.431938 (+ 40332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.445097 (+ 13159us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.495687 (+ 50590us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5491,"prepare.queue_time_us":793721,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":3729,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":44514,"thread_start_us":1011414,"threads_started":2}
I20260709 13:01:11.442131  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:11.479259  2268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 972) took 1727 ms (client timeout 1944 ms). Trace:
I20260709 13:01:11.498966  1705 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
W20260709 13:01:11.503026  2268 rpcz_store.cc:269] 0709 13:01:09.751960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.752113 (+   153us) service_pool.cc:224] Handling call
0709 13:01:11.478870 (+1726757us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54005933d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:11.479074 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754176384}
I20260709 13:01:11.448947  1559 rpcz_store.cc:276] 0709 13:01:08.756057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.316187 (+560130us) service_pool.cc:224] Handling call
0709 13:01:09.323745 (+  7558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.341500 (+ 17755us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:09.359104 (+ 17604us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.350561 (+991457us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:10.352906 (+  2345us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.353106 (+   200us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:11.194560 (+841454us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.419101 (+224541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.419204 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.424489 (+  5285us) raft_consensus.cc:1685] finished
0709 13:01:11.424511 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.432549 (+  8038us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25538,"prepare.queue_time_us":802807,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":4248,"raft.queue_time_us":157837,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":5685,"thread_start_us":1964901,"threads_started":3,"wal-append.queue_time_us":1400610}
I20260709 13:01:11.442812  6262 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:11.508320  1558 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: [13.7-13.8]
I20260709 13:01:11.507719  6262 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:11.512910  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.515641  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:11.516036  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:11.516141  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:11.516578  1628 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:11.517897  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:11.518256  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:11.518976  1701 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:11.521070  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:11.522842  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:11.523629  6164 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:11.524441  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:11.525563  1700 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:11.517645  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:11.443885  1709 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.526299  1555 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:11.533987  6226 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:11.534843  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.553040  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 337563us
I20260709 13:01:11.559891  1707 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:11.560583  1709 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:11.556340  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2263) took 2780 ms. Trace:
I20260709 13:01:11.543565  6158 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:11.568802  1706 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:11.570868  6004 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.573197  6004 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:11.564975  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 202593us
I20260709 13:01:11.574311  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:11.580021  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 127175us
I20260709 13:01:11.562800  1560 rpcz_store.cc:276] 0709 13:01:08.775833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.333877 (+558044us) service_pool.cc:224] Handling call
0709 13:01:09.341717 (+  7840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.342092 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.342131 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.354789 (+ 12658us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.464236 (+1109447us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:11.196789 (+732553us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.445627 (+248838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.527266 (+ 81639us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.535929 (+  8663us) raft_consensus.cc:1685] finished
0709 13:01:11.535952 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.556269 (+ 20317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2058,"prepare.queue_time_us":675269,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":110581,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":179,"thread_start_us":2046097,"threads_started":3,"wal-append.queue_time_us":1475528}
I20260709 13:01:11.582592  6277 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:11.584156  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:11.586410  6247 raft_consensus.cc:993] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 13:01:11.587203  6247 raft_consensus.cc:1081] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 13:01:11.587705  6277 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:11.590950  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 641237us
I20260709 13:01:11.596257  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 722) took 1238 ms. Trace:
I20260709 13:01:11.596720  1556 rpcz_store.cc:276] 0709 13:01:10.357880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.188304 (+830424us) service_pool.cc:224] Handling call
0709 13:01:11.188956 (+   652us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:11.189733 (+   777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.189772 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:11.190564 (+   792us) log.cc:844] Serialized 52 byte log entry
0709 13:01:11.380555 (+189991us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:11.380618 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.380716 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.596003 (+215287us) raft_consensus.cc:1685] finished
0709 13:01:11.596025 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.596175 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51424,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":193,"thread_start_us":189473,"threads_started":1,"wal-append.queue_time_us":371636}
I20260709 13:01:11.597718  6006 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.599318  6006 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:11.589421  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:11.590374  1701 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:11.584882  5986 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.590927  6123 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:11.607079  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:11.592056  6225 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.862s	user 0.006s	sys 0.000s
I20260709 13:01:11.607623  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 896) took 1069 ms. Trace:
I20260709 13:01:11.607079  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:11.607218  6123 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:11.608054  1630 rpcz_store.cc:276] 0709 13:01:10.538480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.538705 (+   225us) service_pool.cc:224] Handling call
0709 13:01:10.539072 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:11.473193 (+934121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.473267 (+    74us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:11.473332 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:11.473372 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.607210 (+133838us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540006c7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:11.607255 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.607450 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3239,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"spinlock_wait_cycles":2058582400}
I20260709 13:01:11.608959  6123 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:11.610298  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 785) took 2427 ms. Trace:
I20260709 13:01:11.577346  1673 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:11.613005  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 50769.6us
I20260709 13:01:11.614933  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:11.615293  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 714) took 2525 ms. Trace:
I20260709 13:01:11.616263  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:11.616518  6261 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:11.617358  1629 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
W20260709 13:01:11.620203  6284 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:01:11.615168  6158 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:11.631196  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64682.9us
I20260709 13:01:11.630540  6158 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:01:11.638417  6272 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.193s	user 0.000s	sys 0.003s
I20260709 13:01:11.610963  1702 rpcz_store.cc:276] 0709 13:01:09.183229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.323249 (+140020us) service_pool.cc:224] Handling call
0709 13:01:09.323635 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:09.337537 (+ 13902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.337583 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.342384 (+  4801us) log.cc:844] Serialized 26 byte log entry
0709 13:01:10.190060 (+847676us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:10.190127 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.190814 (+   687us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b54001fe854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:10.190872 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:11.464851 (+1273979us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:11.609781 (+144930us) raft_consensus.cc:1685] finished
0709 13:01:11.609814 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.610078 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9075,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7908,"spinlock_wait_cycles":60842624,"thread_start_us":847273,"threads_started":1,"wal-append.queue_time_us":1192400}
W20260709 13:01:11.653782  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64524.1us
I20260709 13:01:11.659399  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:11.660914  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:11.663252  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:11.665184  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 83127.5us
I20260709 13:01:11.638628  6277 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.667431  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 102647us
I20260709 13:01:11.667471  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:11.673782  1630 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:11.615677  1554 rpcz_store.cc:276] 0709 13:01:09.089657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.672688 (+583031us) service_pool.cc:224] Handling call
0709 13:01:09.672924 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.085868 (+412944us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:10.843473 (+757605us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.500142 (+656669us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:11.500266 (+   124us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:11.500435 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.614994 (+114559us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400309dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:11.615046 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:11.615230 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1010587,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":32209,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":15621,"spinlock_wait_cycles":949160832,"thread_start_us":1345118,"threads_started":2,"wal-append.queue_time_us":561311}
W20260709 13:01:11.664110  2236 leader_election.cc:336] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.186s (SENT)
I20260709 13:01:11.610272  6123 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:11.674882  1560 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:11.687424  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:11.674852  6196 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:11.694506  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:11.689855  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:11.696326  1555 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:11.693967  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:11.703805  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:11.708344  5877 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:11.708427  6164 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:11.710114  5877 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.710578  5877 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:11.705914  6260 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.711026  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:11.711164  6260 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.711681  1628 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:11.713585  6260 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:11.705786  6166 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:11.715180  6166 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:11.705786  6043 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:11.716240  6043 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.716598  6043 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:11.717496  6166 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:11.714346  6161 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:11.722214  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 121983us
I20260709 13:01:11.724538  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:11.732851  1560 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:11.734928  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 49720.8us
I20260709 13:01:11.735769  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:11.738360  6166 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:11.740103  6166 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:11.741376  6125 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:11.741753  6125 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:11.742722  6125 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.723297  6158 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:11.739140  6217 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.746313  6217 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:11.746625  2234 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:11.746784  6217 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:11.747761  6266 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.249s	user 0.002s	sys 0.000s
I20260709 13:01:11.747937  6196 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:11.748425  6196 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:11.748809  6196 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:11.750455  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.750682  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:11.751557  6132 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:11.751838  2234 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:11.726227  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:11.734997  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2275) took 2462 ms. Trace:
I20260709 13:01:11.755157  1552 rpcz_store.cc:276] 0709 13:01:09.272061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.719212 (+1447151us) service_pool.cc:224] Handling call
0709 13:01:10.719568 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:10.768378 (+ 48810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.734442 (+966064us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b5400181d54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:11.734767 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107780992}
I20260709 13:01:11.756548  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:11.757217  1552 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.675264  6277 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.745841  6125 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.751917  6132 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:11.764442  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.772496  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:11.744518  1524 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:11.773910  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.780337  1560 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:11.791801  1556 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:11.793182  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:11.794440  1555 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
W20260709 13:01:11.795783  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 64447.9us
I20260709 13:01:11.775417  6132 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.777994  6260 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:11.803457  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:11.805891  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 145859us
I20260709 13:01:11.812386  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:11.795981  6261 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.812659  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:11.816000  1708 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:11.819778  1560 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.818938  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:11.820762  6240 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:11.821501  6240 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.822556  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:11.823377  1700 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:11.823838  6240 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:11.824110  6166 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.824622  6166 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:11.824949  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 128083us
I20260709 13:01:11.825357  6276 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.825939  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:11.828526  6226 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.830524  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:11.831622  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 61110.6us
I20260709 13:01:11.831745  6247 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.832432  1601 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:11.833593  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:11.834306  6040 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:11.834762  6040 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.835105  6040 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.835448  1600 leader_election.cc:400] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13.
I20260709 13:01:11.835840  1600 leader_election.cc:403] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:11.838243  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.838321  6144 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:11.839660  6144 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13.
I20260709 13:01:11.840452  6144 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:11.840801  6144 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:11.843067  6289 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:01:11.848680  6051 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:11.851192  5986 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:11.853147  6277 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:11.854538  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:11.855880  6043 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.806667  6260 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.858338  6155 raft_consensus.cc:2764] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:01:11.858502  6260 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.860802  6217 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.863597  5877 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.864847  5784 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:11.865465  5986 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:11.890355  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:11.866598  2236 leader_election.cc:336] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.213s (SENT)
I20260709 13:01:11.870184  1709 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:11.870496  6278 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:11.873581  1552 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:01:11.817435  6123 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:11.829850  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.825071  6166 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:11.876415  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 50618.8us
W20260709 13:01:11.877962  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44095.4us
I20260709 13:01:11.883183  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:11.885250  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 732) took 1102 ms. Trace:
I20260709 13:01:11.858434  6043 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:11.895975  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:11.902180  1556 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:11.908047  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:11.896627  1551 rpcz_store.cc:276] 0709 13:01:10.772773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.806836 (+ 34063us) service_pool.cc:224] Handling call
0709 13:01:11.874637 (+1067801us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b5400177d54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:11.874803 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52896640}
I20260709 13:01:11.894119  6261 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:11.908978  1708 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:11.912876  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:11.913677  1630 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:11.915004  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:11.919543  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:11.841676  6144 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:11.921969  1709 raft_consensus.cc:2410] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:11.922286  1700 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:01:11.923569  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.923967  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:11.925618  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:11.923461  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:11.927192  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:11.901407  6262 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:11.931452  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.934782  1708 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:11.937532  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:11.938138  1708 raft_consensus.cc:2376] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12. Re-sending same reply.
I20260709 13:01:11.933563  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:11.947548  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80999.2us
I20260709 13:01:11.949244  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:11.927225  6099 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:01:11.944110  6226 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.931000  6277 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 13:01:11.960618  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.961457  1708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48138
I20260709 13:01:11.961874  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:11.966053  6184 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:11.966239  6277 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:11.966710  6277 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:01:11.967407  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 54920.1us
I20260709 13:01:11.968225  1627 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:11.969481  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:11.969652  6278 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:11.970374  1627 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:11.946646  6262 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.972589  6262 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:11.973357  6226 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:11.974308  6226 raft_consensus.cc:3055] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:11.974356  6218 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:11.974803  6226 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:11.974929  6218 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:11.976130  6218 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:11.977569  6218 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:11.979867  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.980495  6244 consensus_meta.cc:287] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.002s
I20260709 13:01:11.980947  6244 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.982007  1626 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:11.970281  1600 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:11.967770  6277 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:11.969556  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:11.976023  6226 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:11.985412  1708 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:11.987349  1630 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:11.988432  1708 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.990264  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:11.991825  6075 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.992223  1524 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:11.994155  6226 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:11.995034  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e99891af85f4b10aa1cc2da6aa33082 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:11.957070  6217 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:12.000989  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:12.003492  1700 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:12.005916  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:12.015415  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:12.018383  6276 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:12.020404  6276 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:12.020530  1524 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.020710  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:12.021481  6276 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:12.022360  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.023232  6244 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:12.023664  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:12.022012  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.035108  1560 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:12.038872  1701 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:11.999068  6038 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:01:12.048321  1708 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.050205  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:12.054059  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:12.055363  6297 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:01:12.055199  6306 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:12.062513  1708 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:12.061831  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:12.041205  6277 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:12.039330  6268 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.039048  6075 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:12.064595  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.066632  1560 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:12.068372  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:12.049971  5877 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:12.044281  6125 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:12.072273  1701 raft_consensus.cc:2410] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 11 because replica has last-logged OpId of term: 9 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 11.
I20260709 13:01:12.061381  6267 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:01:12.075708  1627 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:12.075296  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.077916  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:12.078524  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:12.084933  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.090696  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:12.091496  1630 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:12.092558  6166 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:12.092983  1701 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:01:12.075454  6158 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:01:12.093515  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:12.122566  1632 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:12.096657  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:12.123581  1553 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:12.099154  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.103535  6196 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.105764  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:12.108150  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.123029  1632 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:12.125624  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.126884  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.127466  1704 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:12.128171  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:12.129092  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:12.108668  6038 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:12.109824  6043 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:12.109475  6260 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.090466  6238 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:12.112604  6298 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:01:12.114962  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50082.3us
I20260709 13:01:12.125766  1632 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.143851  1600 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:12.115661  6244 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:12.133313  1708 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:12.141999  1707 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:12.146081  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.142635  1553 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:12.147470  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.148223  1708 raft_consensus.cc:2376] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13. Re-sending same reply.
I20260709 13:01:12.150403  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.152467  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.153182  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:12.153252  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 99385.2us
I20260709 13:01:12.138686  6099 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.139178  6043 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:12.163820  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:12.170075  6291 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.340s	user 0.002s	sys 0.000s
I20260709 13:01:12.160410  6218 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:12.172988  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:12.174099  1705 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:12.177300  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:12.183447  6043 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:12.189327  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:12.190070  1559 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:12.191033  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:12.192148  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:12.193787  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.194957  6196 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:12.195228  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.196097  6306 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.196602  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.197314  6306 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.197438  6075 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:12.153035  6238 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:12.164896  1551 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:12.100422  6132 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.200579  1552 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:12.203787  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:12.208441  2263 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:12.216626  1551 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:01:12.204803  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:12.217514  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.199328  2235 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:12.226576  2264 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:01:12.200776  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 57036.2us
I20260709 13:01:12.218677  1632 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.209635  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:12.215644  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50051.1us
I20260709 13:01:12.197988  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.221019  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:12.233173  1553 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:12.235610  1559 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:01:12.214964  1558 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:12.209400  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:12.217139  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:12.204193  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:12.204401  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:12.208588  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:12.205204  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:12.236002  1559 pending_rounds.cc:85] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 10
I20260709 13:01:12.241592  1704 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 8.
I20260709 13:01:12.241555  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:12.199100  6238 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.249681  2270 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:12.251003  2262 raft_consensus.cc:2410] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:12.252561  5877 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.253183  5877 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.215425  6099 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.255342  5877 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:12.201833  6040 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:12.256764  6099 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:12.257786  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:12.258514  1558 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.259852  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:12.260540  6260 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:12.261178  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:12.264036  2271 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:12.264137  1709 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:12.217118  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:12.268740  1632 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
W20260709 13:01:12.270220  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.257611  6040 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:12.267062  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:12.264731  2268 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:12.290542  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:12.286418  6277 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:12.296474  2266 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.296658  2269 raft_consensus.cc:2410] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:01:12.297297  1628 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:12.301697  1635 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:01:12.294514  1633 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:12.303261  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:12.303902  1701 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:12.305492  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:12.306278  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:12.308833  2267 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:12.282985  1559 pending_rounds.cc:107] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:01:12.309536  1702 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.309551  1559 raft_consensus.cc:2889] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:12.312207  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:12.315089  2266 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:12.315886  6238 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.316350  1553 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:12.316493  6238 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:12.317324  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:12.317893  1553 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.325866  1553 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
W20260709 13:01:12.326071  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 84584.7us
W20260709 13:01:12.327117  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.329826  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:12.294153  6196 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.335412  1701 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:12.330268  5784 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:12.343552  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.352026  6277 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:12.352406  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:12.353394  1526 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:12.353552  6277 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:12.352053  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.354177  6277 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:12.353638  6276 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.355490  6276 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.355209  6277 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.355836  6276 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.356587  6277 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:12.331038  6166 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:12.364324  6276 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.366796  6238 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:12.367254  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:12.368633  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.389132  1558 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
W20260709 13:01:12.489810  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.447337  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 249470us
I20260709 13:01:12.452668  2269 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:12.416704  1700 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:12.443953  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:12.420452  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:12.390337  1702 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:12.507085  2262 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.332247  6040 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:12.478703  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.499305  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.508316  1601 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:12.443321  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 91370.2us
I20260709 13:01:12.511507  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:12.429386  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:12.422997  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:12.521436  2266 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:01:12.343868  5784 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.452462  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:12.527094  2265 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:12.516871  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:12.343277  6196 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.517284  6040 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.390511  6075 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.429718  6260 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.533371  5889 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:12.545029  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.445324  6238 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:12.541530  5986 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:12.550014  1631 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:12.550470  2262 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:12.551796  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:12.553386  6322 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:12.526298  5784 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:12.429186  6244 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.130s
I20260709 13:01:12.547365  6075 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.545753  6276 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:12.535377  6132 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:12.538759  6123 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:12.546274  6166 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:12.540400  6196 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.543612  6040 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:12.599574  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 52617.3us
I20260709 13:01:12.599248  6322 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:12.636480  6322 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.637727  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.639261  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:12.610090  6075 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.643235  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:12.644625  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:12.644820  6322 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:12.616782  6155 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:12.646350  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 159681us
I20260709 13:01:12.646994  6322 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:12.586275  6223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.109s	user 0.014s	sys 0.017s
I20260709 13:01:12.647682  6322 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:12.647828  6223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.170s	user 0.014s	sys 0.017s
I20260709 13:01:12.648123  1631 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:12.648375  6322 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:12.648870  6322 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:12.651286  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:12.598237  6238 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:12.654925  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:12.657325  6123 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:12.662930  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 111272us
I20260709 13:01:12.649714  6322 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:12.664343  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 241413us
I20260709 13:01:12.666771  1526 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:12.667356  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.658914  6238 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.611881  6260 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.660838  6166 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:12.678735  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:12.681174  6292 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.855s	user 0.004s	sys 0.000s
I20260709 13:01:12.682993  1556 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:01:12.681725  1524 connection.cc:256] RPC call timeout handler was delayed by -2.369046166999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 13:01:12.685773  1524 connection.cc:256] RPC call timeout handler was delayed by -2.2304461669999682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 13:01:12.686185  1524 connection.cc:256] RPC call timeout handler was delayed by -2.1224461669999641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 13:01:12.686510  1524 connection.cc:256] RPC call timeout handler was delayed by -2.0531461669999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 13:01:12.686820  1524 connection.cc:256] RPC call timeout handler was delayed by -1.8560461669999881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 13:01:12.687116  1524 connection.cc:256] RPC call timeout handler was delayed by -1.8236461669999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
I20260709 13:01:12.687438  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:12.694245  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.673101  6276 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:12.689266  1556 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:12.708981  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:12.710783  1556 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:12.682808  5889 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:12.712661  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.672851  6004 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:01:12.709652  1631 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:12.713197  1627 raft_consensus.cc:2410] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:12.674176  6123 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:12.722054  1633 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:12.724805  6144 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.730386  6006 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:12.730863  6006 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:12.731815  6006 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.732854  6006 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.733693  2235 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:12.733889  6276 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:12.735119  5986 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:12.736222  5889 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:12.734836  6276 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:12.739604  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.740906  6168 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:12.741988  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:12.744364  6168 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.748656  6260 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:12.751523  1553 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:01:12.754868  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 69551.7us
I20260709 13:01:12.755972  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:12.757423  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.764010  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:12.772295  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:12.782177  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.782884  6321 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:01:12.784168  6166 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.752296  6328 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.790374  1674 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.792011  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:12.792611  1627 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.806504  6155 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:12.806843  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 63675.3us
I20260709 13:01:12.807626  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.820199  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 907) took 1217 ms. Trace:
I20260709 13:01:12.828559  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:12.824666  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.829588  1626 rpcz_store.cc:276] 0709 13:01:11.603016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.608315 (+  5299us) service_pool.cc:224] Handling call
0709 13:01:11.608723 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:11.982416 (+373693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.819951 (+837535us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b540007f3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:12.820136 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858170240}
W20260709 13:01:12.832904  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 97371.9us
W20260709 13:01:12.822661  6287 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 1.021s	user 0.000s	sys 0.004s
W20260709 13:01:12.823832  6323 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:01:12.849362  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 54664.1us
I20260709 13:01:12.820622  6261 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:12.782192  6330 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:12.793947  6004 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.871817  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:12.854802  6125 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:12.827109  6051 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:12.881784  6051 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:12.882105  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:12.882737  6051 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:12.884191  6051 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.826439  6260 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:12.887372  2262 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:12.836046  6277 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.862776  2266 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:12.890331  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 730) took 2134 ms. Trace:
I20260709 13:01:12.890740  1557 rpcz_store.cc:276] 0709 13:01:10.756487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.377112 (+620625us) service_pool.cc:224] Handling call
0709 13:01:11.431779 (+ 54667us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:11.462680 (+ 30901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.462720 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:11.463481 (+   761us) log.cc:844] Serialized 52 byte log entry
0709 13:01:11.626886 (+163405us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:11.641845 (+ 14959us) log.cc:844] Serialized 14 byte log entry
0709 13:01:11.660434 (+ 18589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.660727 (+   293us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.808291 (+1147564us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:12.890014 (+ 81723us) raft_consensus.cc:1685] finished
0709 13:01:12.890159 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.890282 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18040,"prepare.queue_time_us":13986,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":18424,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":199,"spinlock_wait_cycles":8031616,"thread_start_us":162926,"threads_started":1,"wal-append.queue_time_us":245774}
I20260709 13:01:12.870452  6040 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:12.902063  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.908267  1628 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:12.851593  1600 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:12.866122  5986 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:12.880250  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 117109us
I20260709 13:01:12.823611  5889 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:12.827344  5784 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.860282  2265 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: [8.10-10.11]
W20260709 13:01:12.908407  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.914156  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:12.867415  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:12.835662  6327 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.914700  1708 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:12.871287  6004 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:12.916226  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 64719.7us
W20260709 13:01:12.918479  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 51195.9us
I20260709 13:01:12.916566  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:12.915386  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:12.890528  6277 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:12.809063  6328 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:12.924129  1626 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:12.925233  1554 raft_consensus.cc:2410] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 12 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:01:12.924610  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:12.928539  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:12.929864  1635 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:01:12.930613  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.930704  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 65428.2us
I20260709 13:01:12.878576  6261 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:12.932261  2267 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:12.869199  6196 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:12.944007  6309 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:12.945191  6223 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:12.946529  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:12.947129  2269 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:12.948437  2266 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:12.924906  6004 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:12.923945  6161 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:12.945452  6196 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:12.979384  1627 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:12.927425  6125 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:12.983213  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 55869.6us
I20260709 13:01:12.929877  6158 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:12.933113  6268 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:12.988570  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:13.003652  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:13.004038  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:13.006268  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:13.006816  1552 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:12.915742  5877 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:01:13.010635  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.011075  5723 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:12.931774  6123 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
W20260709 13:01:13.018404  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 67567.6us
I20260709 13:01:13.030438  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:13.008610  6321 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:01:13.002310  6158 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.040709  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:13.005278  6161 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:13.012492  5877 consensus_queue.cc:1243] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:13.046939  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:13.048357  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 97419.4us
I20260709 13:01:13.017853  6268 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:13.002779  6075 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:13.052105  6334 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:01:13.054160  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.043507  6158 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:13.062677  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 153045us
I20260709 13:01:13.066457  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:13.072956  2265 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:13.072773  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:13.073819  1558 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:13.017464  6261 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:13.048969  6244 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:01:13.074891  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 149868us
I20260709 13:01:13.082378  5723 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:01:13.090721  6320 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:13.090548  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:13.092504  6155 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:13.094394  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:13.095186  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:13.095881  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:13.096908  6161 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:13.098096  6238 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:13.101089  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.109656  1558 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:13.136660  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:13.142304  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:13.120980  6155 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.056527  5986 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:13.174099  6155 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:13.136518  5889 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:13.153110  1700 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:13.164769  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.148525  6051 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.218293  6325 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:13.221805  6155 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:13.225596  6043 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.150924  5784 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:13.152732  6196 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:13.235258  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 150664us
I20260709 13:01:13.228987  5889 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.238117  5889 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.212075  6309 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.250144  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 159702us
I20260709 13:01:13.246769  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:13.251103  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:13.269037  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 228467us
I20260709 13:01:13.152601  6268 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:13.288754  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.270370  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:13.232765  6051 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:13.295133  5877 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:13.267323  6006 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:13.295941  6155 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:13.297899  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:13.266759  5762 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:01:13.299074  6337 log.cc:927] Time spent T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:01:13.299762  6333 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:13.300472  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 49469.4us
I20260709 13:01:13.302495  1631 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:13.313027  1558 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:13.245941  5889 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:13.262183  6309 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:13.324641  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 188083us
I20260709 13:01:13.338958  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:13.341485  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.353092  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.318249  6006 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.325109  1627 pending_rounds.cc:85] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 5
I20260709 13:01:13.369890  1627 pending_rounds.cc:107] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 13:01:13.370220  1627 raft_consensus.cc:2889] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.398829  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:13.408452  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 111999us
W20260709 13:01:13.325652  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 170351us
I20260709 13:01:13.321733  6351 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:13.327020  6075 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:13.431567  6354 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:13.423062  6155 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:13.432669  6155 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:13.432739  6075 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:13.269375  5723 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:13.421551  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 52660.3us
I20260709 13:01:13.426101  6353 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:01:13.428980  6144 consensus_meta.cc:287] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.008s
W20260709 13:01:13.430147  6327 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.003s
I20260709 13:01:13.416862  6006 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:13.365767  6261 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:01:13.430327  6238 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:13.365275  6278 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
W20260709 13:01:13.437625  6352 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
W20260709 13:01:13.439677  6356 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:01:13.440649  6349 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:13.423033  6336 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:13.327236  6247 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.454483  1629 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:13.459796  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:13.442405  6217 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:13.462872  1558 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:13.443977  6354 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:13.455054  6327 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.472929  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:13.475708  1555 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:01:13.476256  1555 pending_rounds.cc:85] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 4
I20260709 13:01:13.476548  1555 pending_rounds.cc:107] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:01:13.476898  1555 raft_consensus.cc:2889] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:13.479131  6344 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.479363  6354 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:13.479656  6344 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:13.480305  6354 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:13.482039  6277 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.005s
I20260709 13:01:13.482477  6277 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:13.482818  6051 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:13.444289  6158 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:13.485327  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:13.485471  6158 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:13.470666  6217 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:13.487562  5889 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:13.487774  6327 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:13.487236  6217 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:13.488299  6327 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:13.489985  1701 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:13.495942  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:13.496744  1552 raft_consensus.cc:2393] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:13.497792  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:13.488639  6217 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:13.498499  1551 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:13.535136  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:13.518731  5986 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:13.519137  5784 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:13.540372  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 55128.2us
I20260709 13:01:13.541373  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:13.540529  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 201704us
I20260709 13:01:13.547681  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:13.433768  6155 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:13.558485  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:13.560205  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:13.562299  2236 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:13.477614  6247 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:13.566644  6345 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.566563  6343 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:13.567377  6343 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:13.567320  6345 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:13.568593  6247 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:13.569352  6238 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:13.569521  6343 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:13.570014  6238 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:13.570611  1706 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:13.570467  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:13.571022  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:13.571825  1701 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 9: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:13.572141  1705 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:13.573508  1704 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:13.572259  6238 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:13.588189  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:13.585812  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:13.590142  2262 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.570017  6345 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:13.557663  6223 raft_consensus.cc:3055] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:13.556310  5877 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.597831  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:13.576728  6196 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:13.574812  5986 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.598634  1557 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:13.610867  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:13.586807  6327 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:13.603470  2262 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:13.596870  6155 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.596181  6051 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:13.547785  6132 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:01:13.597010  6333 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.615468  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 798) took 1544 ms. Trace:
I20260709 13:01:13.597457  6223 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:13.654134  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2118) took 1726 ms. Trace:
I20260709 13:01:13.641083  1709 rpcz_store.cc:276] 0709 13:01:12.066401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.152066 (+ 85665us) service_pool.cc:224] Handling call
0709 13:01:12.242498 (+ 90432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.264539 (+ 22041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.610983 (+1346444us) spinlock_profiling.cc:243] Waited 76.1 ms on lock 0x7b540012a550. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:13.611114 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175037184}
I20260709 13:01:13.595741  6261 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:01:13.657871  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:13.613060  6196 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:13.661458  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:13.603250  5877 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:13.664316  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 102145us
I20260709 13:01:13.670431  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:13.671573  1551 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:13.673254  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:13.654670  1634 rpcz_store.cc:276] 0709 13:01:11.928040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.928193 (+   153us) service_pool.cc:224] Handling call
0709 13:01:12.796094 (+867901us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 13:01:12.796347 (+   253us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:12.858999 (+ 62652us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:13.312915 (+453916us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.549675 (+236760us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:13.593096 (+ 43421us) log.cc:844] Serialized 52 byte log entry
0709 13:01:13.593448 (+   352us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:13.611042 (+ 17594us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.611404 (+   362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.611475 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.653736 (+ 42261us) raft_consensus.cc:1685] finished
0709 13:01:13.653760 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.653926 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":530542,"prepare.queue_time_us":462555,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":73160,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":41154,"spinlock_wait_cycles":16606848,"thread_start_us":219234,"threads_started":1,"wal-append.queue_time_us":321877}
I20260709 13:01:13.676460  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:13.678217  6371 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.679159  6364 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:13.683634  5877 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:13.660512  6238 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:13.660804  6309 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:13.668566  6004 consensus_meta.cc:287] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.003s
I20260709 13:01:13.699499  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:13.704743  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:13.594309  6355 consensus_queue.cc:1175] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "87144ea1a4a14ab8b942fb426159f031" responder_term: 11 status { last_received { term: 10 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:13.712630  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:13.718384  6360 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.704457  6371 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:13.719491  6371 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:13.719923  6371 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.720296  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 996) took 1382 ms. Trace:
I20260709 13:01:13.712253  1551 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:01:13.711370  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:13.722970  1703 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:13.720739  2267 rpcz_store.cc:276] 0709 13:01:12.337604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.354147 (+ 16543us) service_pool.cc:224] Handling call
0709 13:01:12.354448 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.947179 (+592731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.720041 (+772862us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400550854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:13.720230 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328517376}
W20260709 13:01:13.740279  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.766369  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.750707  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2382) took 1206 ms. Trace:
W20260709 13:01:13.772799  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 55978.4us
I20260709 13:01:13.773948  1700 rpcz_store.cc:276] 0709 13:01:12.544513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.545002 (+   489us) service_pool.cc:224] Handling call
0709 13:01:12.550125 (+  5123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.215059 (+664934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.750422 (+535363us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b540005da54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:13.750632 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386443008}
I20260709 13:01:13.753723  6260 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.712357  6123 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:13.784873  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 496590us
W20260709 13:01:13.785712  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.714285  6261 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:13.790845  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 93077.2us
I20260709 13:01:13.733708  6040 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:13.792055  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:13.715536  6004 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:13.760577  6328 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:13.698408  6238 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:13.721141  6006 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:13.787648  6260 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:13.802830  6261 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:13.712790  6327 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:01:13.799093  1632 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:13.800968  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:13.802359  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:13.777308  6355 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:01:13.787168  6123 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.807956  1702 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:13.816586  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:13.792580  6144 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.867244  1558 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:13.867595  6144 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:13.785589  6196 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:13.870667  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:13.871249  1558 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:13.787961  6166 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.800921  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:13.872699  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:13.823406  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.873039  6166 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:13.873713  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 75180.1us
I20260709 13:01:13.874773  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:13.876341  6362 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:13.876588  6363 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.877079  6362 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:13.877215  6166 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:13.877756  6144 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:13.879388  1703 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:13.826480  1707 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:13.809551  6238 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:13.887447  5723 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:13.864706  1557 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:13.889204  6040 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:13.889642  6040 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.809685  6347 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:13.894722  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:13.892326  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:13.866406  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 58836.4us
I20260709 13:01:13.825657  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:13.924827  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:13.811015  5363 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:13.929109  5363 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:13.930557  5363 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:13.932500  5363 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.883700  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:13.934866  1630 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
W20260709 13:01:13.884296  1453 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 233) took 18243 ms (client timeout 15000 ms). Trace:
I20260709 13:01:13.884996  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:13.938174  5986 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:13.938387  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 53465us
I20260709 13:01:13.940285  5986 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:13.807662  6006 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:13.866099  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:13.928296  1628 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:13.949937  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:13.950937  2264 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:01:13.937745  1453 rpcz_store.cc:269] 0709 13:00:55.545280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.545589 (+   309us) service_pool.cc:224] Handling call
0709 13:01:13.784195 (+18238606us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:07.949297 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:08.018481 (+ 69184us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:08.018550 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:01:08.018574 (+    24us) tablet.cc:662] Decoding operations
0709 13:01:08.054987 (+ 36413us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:08.055073 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:08.055100 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:01:08.056300 (+  1200us) tablet.cc:701] Row locks acquired
0709 13:01:08.056351 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:01:08.056513 (+   162us) write_op.cc:270] Start()
0709 13:01:08.056663 (+   150us) write_op.cc:276] Timestamp: P: 1783602068056448 usec, L: 0
0709 13:01:08.056683 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:01:08.060137 (+  3454us) log.cc:844] Serialized 5196 byte log entry
0709 13:01:08.853357 (+793220us) op_driver.cc:464] REPLICATION: finished
0709 13:01:09.648371 (+795014us) write_op.cc:301] APPLY: starting
0709 13:01:09.648481 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:10.522265 (+873784us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:10.522389 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:11.277646 (+755257us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:11.353112 (+ 75466us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:01:11.353202 (+    90us) write_op.cc:312] APPLY: finished
0709 13:01:11.353968 (+   766us) log.cc:844] Serialized 121 byte log entry
0709 13:01:11.409720 (+ 55752us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:11.486945 (+ 77225us) write_op.cc:454] Released schema lock
0709 13:01:11.487071 (+   126us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:11.487785 (+   714us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:11.527440 (+ 39655us) write_op.cc:454] Released schema lock
0709 13:01:11.619166 (+ 91726us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
Metrics: {"mutex_wait_us":214460,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":794735,"apply.run_cpu_time_us":33508,"apply.run_wall_time_us":1839309,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58441,"num_ops":13,"prepare.queue_time_us":201982,"prepare.run_cpu_time_us":58507,"prepare.run_wall_time_us":273473,"raft.queue_time_us":59092,"raft.run_cpu_time_us":51834,"raft.run_wall_time_us":498563,"replication_time_us":796525,"spinlock_wait_cycles":5096320,"thread_start_us":730829,"threads_started":5,"wal-append.queue_time_us":610027,"wal-append.run_cpu_time_us":17521,"wal-append.run_wall_time_us":2437267}]]}
I20260709 13:01:13.954650  2264 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 11. Ops: []
I20260709 13:01:13.955860  2267 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:13.956136  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:13.958077  2268 raft_consensus.cc:2376] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12. Re-sending same reply.
I20260709 13:01:13.958969  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:13.962504  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:13.963086  2270 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:13.808039  6370 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:13.984679  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.003826  1557 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
W20260709 13:01:14.007865  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.011118  1633 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:13.879177  6123 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.864398  6247 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.864159  6332 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:14.011307  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:13.788676  6223 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:14.021562  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:14.022598  6382 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:01:13.890005  6040 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:13.891330  6260 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:14.035363  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:14.051826  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:14.052569  2268 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:14.013964  6347 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:14.023155  6144 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:14.058878  2269 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:14.005210  6244 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:01:14.031414  6166 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:14.067885  6309 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:14.068385  6166 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.068604  6309 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.071518  6347 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:14.072187  6099 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.072736  6099 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.041548  6332 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.075688  6099 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.077455  6332 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:14.077649  6309 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.077518  2268 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
W20260709 13:01:14.120451  6217 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.602s	user 0.001s	sys 0.010s
I20260709 13:01:14.088091  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:14.090826  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:14.091712  6144 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.023092  6363 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:01:14.108973  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:14.069036  6166 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:14.062584  1599 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.710s (SENT) [suppressed 8 similar messages]
I20260709 13:01:14.029165  6247 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.066787  6261 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:14.125982  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:14.019943  6362 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.117537  6006 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.154295  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:14.154685  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.153568  2264 raft_consensus.cc:2376] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11. Re-sending same reply.
I20260709 13:01:14.160137  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:14.163910  6223 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.165999  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:14.171595  6328 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.172860  6327 consensus_queue.cc:1243] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:01:14.174000  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 357515us
I20260709 13:01:14.086354  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:14.177731  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:14.178068  1558 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:14.189234  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:14.220577  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:14.209931  1704 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:01:14.217882  1708 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:01:14.201090  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.221217  2268 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:01:14.221789  1706 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:14.174281  6370 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:14.231830  1702 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:14.193379  6004 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:14.194454  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 131939us
W20260709 13:01:14.238360  1599 leader_election.cc:336] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.944s (SENT)
I20260709 13:01:14.238799  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:14.200067  6164 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.174724  6376 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.500s	user 0.004s	sys 0.000s
I20260709 13:01:14.175920  6360 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:14.240729  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.240209  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:14.196267  6247 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:14.249691  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.250706  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:14.259655  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:14.263661  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:14.264343  1560 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:14.242430  6396 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.282532  2236 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:14.228053  6328 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.223106  6006 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.246417  6370 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:14.264675  6132 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.286630  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:14.290542  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.269181  5986 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.264822  6359 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:01:14.256927  6164 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:14.302325  6371 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.582s	user 0.007s	sys 0.005s
I20260709 13:01:14.262431  6360 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:14.263877  6349 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:01:14.318252  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.289413  6247 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:14.328918  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.346186  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 104113us
I20260709 13:01:14.347611  1560 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:14.348675  2267 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:14.285720  6260 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:14.350666  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:14.314638  6168 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:14.312794  6393 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.358436  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:14.349704  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.359059  2267 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:14.356350  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:14.362326  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:14.363065  2264 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:14.321455  5889 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.370949  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:14.371785  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.345551  6309 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:14.349296  6132 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:14.318935  6372 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:01:14.359786  6043 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:14.287050  6396 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:14.385334  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 102868us
W20260709 13:01:14.371703  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e99891af85f4b10aa1cc2da6aa33082 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:14.375339  6217 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:14.392669  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:14.502437  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 131593us
W20260709 13:01:14.544570  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 152007us
I20260709 13:01:14.544783  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:14.549446  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:14.510269  1443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 138620us
W20260709 13:01:14.389492  6390 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 13:01:14.513777  6155 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.876s	user 0.008s	sys 0.003s
I20260709 13:01:14.388353  2270 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:14.524580  6217 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.387818  6343 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:14.381188  5889 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.517194  6144 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.512483  6043 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:14.573468  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:14.346926  6371 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.545358  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:14.379571  6247 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 13:01:14.568396  6168 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:14.568924  6395 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:01:14.512163  6355 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.502254  6402 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:14.570127  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:14.630649  6402 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.632893  6402 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.383293  6309 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:14.634759  6333 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.979s	user 0.005s	sys 0.005s
I20260709 13:01:14.635334  6333 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:14.635684  6309 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.636238  2271 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:14.637151  6328 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.640161  1628 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:14.649214  6371 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.656065  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2287) took 1087 ms. Trace:
I20260709 13:01:14.656530  1707 rpcz_store.cc:276] 0709 13:01:13.568977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.574403 (+  5426us) service_pool.cc:224] Handling call
0709 13:01:14.655825 (+1081422us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54000a78d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:14.655972 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545734528}
W20260709 13:01:14.662855  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 422279us
I20260709 13:01:14.572016  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.368002  6393 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.668156  1700 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:14.669663  2264 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:14.673389  1707 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:14.678121  2270 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:14.575484  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 221695us
W20260709 13:01:14.606572  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 61285.4us
I20260709 13:01:14.679162  1705 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:14.680052  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:14.608832  6123 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.000s
I20260709 13:01:14.609078  6196 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:14.609612  6164 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:14.612424  6040 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.559s	user 0.003s	sys 0.003s
I20260709 13:01:14.612356  6166 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:14.512784  6370 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 9.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.614077  6360 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:14.614199  6388 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
I20260709 13:01:14.614405  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:14.730252  2265 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:14.615531  6006 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.389791  6132 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.618088  6372 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:14.619330  5889 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:14.622612  6399 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
W20260709 13:01:14.568387  6400 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:01:14.595485  5762 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:14.681928  6161 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.255s	user 0.006s	sys 0.017s
I20260709 13:01:14.672857  6328 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.690430  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.746251  2267 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:14.694514  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:14.686268  6123 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:14.697800  6278 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.698486  5723 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:14.698451  2264 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:14.700488  6408 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:01:14.695854  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:14.694768  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:14.675115  6144 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:14.752246  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 57568.1us
I20260709 13:01:14.728336  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:14.674957  6155 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:01:14.741184  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:14.741423  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:14.737944  6372 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:14.741967  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.625221  6043 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.697827  6393 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:14.748795  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.747318  1556 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
W20260709 13:01:14.724746  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 60624.9us
I20260709 13:01:14.768491  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:14.769204  1555 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:14.704912  6040 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:14.752831  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.756453  1700 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:14.754889  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.753345  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:14.742702  5762 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:14.802330  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 49065.3us
I20260709 13:01:14.802539  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:14.803237  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.748471  6161 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.318s	user 0.006s	sys 0.018s
I20260709 13:01:14.788512  2265 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:14.750406  6099 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:14.809118   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:14.807729  6347 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:14.812362  6325 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:14.812767  6325 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:14.804821  5762 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.816190  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.817531  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.820154  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:14.820434  1702 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:14.820770  1709 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:14.821581  6217 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.822357  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:14.823719  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:14.825049  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:14.825683  5762 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.826972  2265 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:14.805321  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:14.806149  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.828473  2270 raft_consensus.cc:2376] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11. Re-sending same reply.
I20260709 13:01:14.751901  6328 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.758201  6410 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:14.832314  1630 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:14.834681  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:14.845432  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:14.804776  6350 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:14.755424  6278 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:14.758371  5723 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:14.762056  6144 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:14.833220  6410 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.876099  6350 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.809396  6099 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:14.891131  1700 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
W20260709 13:01:14.877466  6223 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.000s
I20260709 13:01:14.887470  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:14.897703  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 95717.9us
I20260709 13:01:14.883463  6410 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:14.891172  6418 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.908512  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.912042  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 279288us
I20260709 13:01:14.898556  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:14.913887  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:14.919269  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.920082  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:14.923563  6038 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.911012  6403 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.908052  6166 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:14.932163  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:14.932507  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:14.937785  1552 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.905236  6347 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:14.923473  6355 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.913848  6418 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:14.946360  6355 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.947782  6350 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.948390  6418 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:14.948460  6355 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.935380  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:14.950433  5762 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.951128  5762 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:14.951211  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:14.951606  5762 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.952051  5762 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:14.952980  6161 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.950474  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1053) took 1235 ms. Trace:
W20260709 13:01:14.954882  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 187768us
I20260709 13:01:14.954730  2269 rpcz_store.cc:276] 0709 13:01:13.714675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.715325 (+   650us) service_pool.cc:224] Handling call
0709 13:01:13.766849 (+ 51524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.102203 (+335354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.950269 (+848066us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400583254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:14.950420 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671201024}
I20260709 13:01:14.956481  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:14.956996  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.957654  6166 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:14.958537  6429 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:14.900267  6325 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.960129  6325 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.960736  6364 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:14.961136  6364 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:14.962169  6123 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:14.961993  6364 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.962826  6332 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.963040  6364 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.963413  6332 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.966372  6332 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:14.966689  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2112) took 3069 ms (client timeout 1701 ms). Trace:
W20260709 13:01:14.967103  1629 rpcz_store.cc:269] 0709 13:01:11.897601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.898242 (+   641us) service_pool.cc:224] Handling call
0709 13:01:14.966490 (+3068248us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400088ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:14.966605 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3513529728}
I20260709 13:01:14.963088  6099 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:14.968218  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:14.969130  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.957679  2269 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 10: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:14.970940  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.933219  1626 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:14.930895  6343 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.971485  2269 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:14.972035  6343 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.972959  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.939729  6411 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:14.974226  6411 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:14.974673  6411 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:14.975050  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.976126  2269 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:14.976325  6144 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:14.919121  6223 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.978331  6223 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.981227  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:14.982235  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47776.2us
I20260709 13:01:14.982494  6223 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.982299  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:14.983582  2269 raft_consensus.cc:2376] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12. Re-sending same reply.
I20260709 13:01:14.983834  6343 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.946354  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:14.984879  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.985381  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.989403  6396 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:14.990101  6040 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:14.957886  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:14.985411  2269 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:14.972751  1633 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:14.992498  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:14.989704  6347 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:14.994726  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:14.995671  2269 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:01:14.995812  6421 log.cc:927] Time spent T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:01:15.006196  1631 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:15.010321  1628 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:14.995869  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:14.997350  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 44627.8us
I20260709 13:01:14.991171  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:14.998713  6423 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:14.999430  6309 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:14.999918  6372 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.000221  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:15.000874  6420 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:15.000201  1601 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:15.002153  6328 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:15.047600  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47469.8us
I20260709 13:01:15.002282  6051 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:15.053325  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:15.003533  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:15.057307  1555 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:15.011426  2263 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:15.014431  1635 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:15.020330  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.024199  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:15.025050  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:15.055724  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:15.015383  6364 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:15.015339  6363 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:15.098516  2269 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:15.099587  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.020797  6402 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.100670  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:15.047236  6322 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.054128  6051 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:14.944409  6403 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:15.104051  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 79115us
I20260709 13:01:15.004346  1552 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:15.109690  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:15.035980  6370 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:15.058480  6328 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.110972  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:15.103593  6421 log.cc:927] Time spent T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:15.111722  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:15.052242  6306 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:15.098546  6364 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:15.101790  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 77668.7us
I20260709 13:01:15.038087  6355 consensus_queue.cc:1059] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:01:15.119908  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:15.129432  1628 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:15.104625  6371 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.102907  6363 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.102283  6144 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.110581  6422 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:15.112290  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:15.123571  6278 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:15.123847  5877 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:15.124827  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:15.125581  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:15.127240  2265 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:01:15.128949  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:15.129751  1708 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:15.111502  6402 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.131846  6322 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:15.135905  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:15.128635  6364 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.137506  1626 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:15.052309  6418 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:01:15.151788  6343 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:01:15.117275  6353 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.118637  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:15.154776  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:15.136198  6363 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:15.171519  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:15.144593  5877 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:15.179021  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.164476  6427 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:15.182842  2265 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:15.144721  6350 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.153038  6277 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:15.128177  6370 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.137938  6325 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:01:15.187028  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.196255  2265 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:15.128443  6306 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.189401  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.172853  6422 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.173331  6418 consensus_queue.cc:1243] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:15.191150  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.203575  1628 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
W20260709 13:01:15.208667  6435 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.075s	user 0.001s	sys 0.001s
I20260709 13:01:15.209162  6370 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.209862  6370 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:15.210493  6370 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.212702  6370 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.182396  5723 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:15.184000  6155 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.215847  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.217152  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.220419  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:15.221731  2265 raft_consensus.cc:2368] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11.
I20260709 13:01:15.226292  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.243058  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.244616  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.259891  2265 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:15.267377  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:15.170563  6416 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:01:15.268170  1626 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.271422  1555 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:15.204802  6277 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:15.272675  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:15.282755  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.284687  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.285318  2265 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:15.285362  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:15.304953  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.305866  1629 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:15.307981  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:15.281810  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 116133us
I20260709 13:01:15.315186  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2137) took 2027 ms. Trace:
I20260709 13:01:15.317226  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:15.315558  1627 rpcz_store.cc:276] 0709 13:01:13.288266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.288388 (+   122us) service_pool.cc:224] Handling call
0709 13:01:13.295309 (+  6921us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:13.379666 (+ 84357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.380212 (+   546us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:13.390350 (+ 10138us) log.cc:844] Serialized 52 byte log entry
0709 13:01:13.594617 (+204267us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:13.594654 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.308051 (+1713397us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b54001653d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:15.308118 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.308180 (+    62us) raft_consensus.cc:1685] finished
0709 13:01:15.308197 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.315138 (+  6941us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5546,"raft.queue_time_us":45814,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":3142,"spinlock_wait_cycles":67957120,"thread_start_us":144173,"threads_started":2,"wal-append.queue_time_us":256892,"wal-append.run_cpu_time_us":2248,"wal-append.run_wall_time_us":1002223}
I20260709 13:01:15.318849  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.325094  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:15.316915  6432 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:01:15.312306  6355 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.336265  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.337100  1635 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:15.323637  6161 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.347016  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.323320  6158 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:15.349503  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:15.341228  6437 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:01:15.330652  6403 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:15.369084  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.365302  6360 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:15.343202  6411 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.379766  1627 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:01:15.377462  6442 log.cc:927] Time spent T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:01:15.384203  6434 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:01:15.384651  6306 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:15.385354  6438 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:01:15.388183  6387 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.326s	user 0.002s	sys 0.000s
I20260709 13:01:15.389437  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.390810  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:15.355208  6343 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:01:15.392364  2269 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:15.366765  6402 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.393450  6402 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:15.393962  6402 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.395018  1629 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:15.379598  6360 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.414248  6360 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:15.415443  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1054) took 1646 ms. Trace:
I20260709 13:01:15.415921  2266 rpcz_store.cc:276] 0709 13:01:13.769470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.769631 (+   161us) service_pool.cc:224] Handling call
0709 13:01:13.769939 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.770237 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:13.770265 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.776783 (+  6518us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.883178 (+106395us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:13.883215 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.883272 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.387544 (+1504272us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:15.415103 (+ 27559us) raft_consensus.cc:1685] finished
0709 13:01:15.415128 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.415366 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97928064,"thread_start_us":82510,"threads_started":1,"wal-append.queue_time_us":228676}
I20260709 13:01:15.399392  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.364369  5762 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.420073  5762 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:15.422647  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.424089  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.395624  6345 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:01:15.425076  6345 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:15.425472  6345 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:15.426348  6345 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:15.427714  6345 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:15.407440  6411 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.403097  6051 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:15.444644  1626 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:15.417259  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:15.367779  6277 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.430729  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.407737  6155 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.413710  6328 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.421654  6364 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.462551  1627 raft_consensus.cc:2368] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13.
I20260709 13:01:15.462333  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:15.470158  2265 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.479578  6051 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:15.480360  6132 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:15.482366  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:15.483038  6371 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:15.483737  6155 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.484220  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:15.485419  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:15.486188  6411 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:15.486615  6411 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.486677  6247 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.487135  6411 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.489250  6364 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.490183  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:15.491312  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:15.492007  6247 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.495957  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 984) took 1546 ms. Trace:
W20260709 13:01:15.496769  6410 consensus_meta.cc:287] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.000s
I20260709 13:01:15.497265  6410 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.498286  6051 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.498903  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:15.499116  6402 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.500756  6155 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:15.501183  6155 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.505126  1599 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:15.504124  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2340) took 1474 ms. Trace:
I20260709 13:01:15.496418  2271 rpcz_store.cc:276] 0709 13:01:13.949878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.950153 (+   275us) service_pool.cc:224] Handling call
0709 13:01:13.950538 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.636688 (+686150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.495690 (+859002us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b540054ea54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:15.495891 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576519040}
I20260709 13:01:15.509716  1555 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:15.510553  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.509822  1560 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:15.511339  1554 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:15.511572  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:15.507846  1633 rpcz_store.cc:276] 0709 13:01:14.031290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.043142 (+ 11852us) service_pool.cc:224] Handling call
0709 13:01:14.972466 (+929324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.992143 (+ 19677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.503936 (+511793us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b5400088ed0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:15.504068 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2136420224}
I20260709 13:01:15.501973  6155 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:15.512549  6364 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:15.518829  6365 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:15.520272  6161 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:15.521103  1673 leader_election.cc:400] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13.
I20260709 13:01:15.526515  1673 leader_election.cc:403] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:15.507499  6326 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:15.527421  6161 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:15.527268  6364 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.528844  6453 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:15.528733  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:15.529596  6453 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:15.530560  6453 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:15.531731  6051 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:15.531889  6453 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.532608  6422 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:15.533047  6422 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.533439  6422 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.534228  5889 raft_consensus.cc:3055] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:15.534631  5889 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:15.535626  5889 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.536355  6410 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.537570  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:15.544651  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:15.547894  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.549561  6415 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.550103  6448 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.546554  6051 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:15.551123  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 996) took 1467 ms. Trace:
I20260709 13:01:15.551231  6051 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.551577  2264 rpcz_store.cc:276] 0709 13:01:14.083645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.676714 (+593069us) service_pool.cc:224] Handling call
0709 13:01:14.677711 (+   997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.750987 (+ 73276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.550909 (+799922us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b540045c754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:15.551066 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46971776}
I20260709 13:01:15.552104  6363 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.553290  6328 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:15.554131  6353 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.546741  6371 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:15.555809  6371 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.527355  6326 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.543253  5889 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.529912  6364 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.568281  6363 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:15.571213  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.576336  1626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "207df21ae856459f9637b16a0feb2796"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:15.593977  1626 raft_consensus.cc:606] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:15.594395  1626 raft_consensus.cc:614] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:15.576951  6371 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.579634  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.580468  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.596021  2265 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:15.571667  1673 leader_election.cc:400] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11.
I20260709 13:01:15.589354  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:15.596668  1673 leader_election.cc:403] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:01:15.596825  2271 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:15.561983  6347 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:15.594547  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.594897  1556 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:01:15.598556  2268 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:15.606477  1556 pending_rounds.cc:85] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 9
I20260709 13:01:15.606818  1556 pending_rounds.cc:107] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:01:15.607064  1556 raft_consensus.cc:2889] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.565429  6448 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.609887  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:15.611419  2271 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:15.612695  6453 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:15.615593  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:15.616819  6453 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:15.618446  1673 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:15.621708  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.623150  1554 raft_consensus.cc:2410] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:15.611397  6412 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Leader election lost for term 10. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11.
I20260709 13:01:15.621860  6247 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:15.624257  6453 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:15.640933  1554 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:15.637081  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:15.629608  6161 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13.
I20260709 13:01:15.621595  6411 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.644845  6453 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.651321  2271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:01:15.629180  6429 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:01:15.658334  2271 raft_consensus.cc:606] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:15.662703  2271 raft_consensus.cc:614] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:15.661109  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:15.629240  6360 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.663131  1626 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:15.636000  6345 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:01:15.671165  1633 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:15.672914  1553 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:15.691856  6360 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.691973  6348 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:15.660709  6453 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.657305  6412 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:15.695779  2271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:01:15.700333  2271 raft_consensus.cc:606] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:15.702564  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 77689.1us
I20260709 13:01:15.703545  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:15.705785  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:15.706375  1626 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:15.665798  6196 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:01:15.716351  6344 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:15.720906  1626 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:15.723104  6448 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.665150  6354 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:15.665904  6132 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:01:15.725351  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:15.739574  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:15.729532  1629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:15.703347  6412 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:15.736123  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:15.698207  6360 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:15.728798  1634 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:15.746326  6429 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:15.758698  6429 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:15.760948  6429 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:15.765973  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.766973  1555 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:15.768224  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:15.768975  1555 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:15.770598  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.740250  1629 raft_consensus.cc:606] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:15.745226  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:15.773803  1629 raft_consensus.cc:614] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:15.778134  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:15.778985  1707 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:15.781250  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:15.701442  6326 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.747829  1627 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:15.739457  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:15.748589  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.748713  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.697856  6261 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:01:15.749445  6422 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:15.794071  2267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 1000) took 1709 ms (client timeout 2180 ms). Trace:
W20260709 13:01:15.795264  2267 rpcz_store.cc:269] 0709 13:01:14.084968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.359683 (+274715us) service_pool.cc:224] Handling call
0709 13:01:15.793887 (+1434204us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54007b0f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:15.794004 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851719424}
I20260709 13:01:15.750695  6412 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.746124  6402 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:15.790813  1702 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:15.793968  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:15.750484  6448 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:15.807116  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:15.808779  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.809430  1556 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:15.812213  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 67050.2us
I20260709 13:01:15.812813  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:15.815814  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.818584  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.819211  1552 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:15.727300  6051 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:15.821955  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.825961  1555 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
W20260709 13:01:15.832258  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 143872us
I20260709 13:01:15.828382  1600 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:15.844959  2235 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:15.820310  6326 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:15.835457  6155 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.848616  6326 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:15.829226  6453 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.852758  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:15.857201  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:15.850749  6326 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:15.827589  6125 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:15.845470  6448 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:15.881433  1554 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:15.804690  6360 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:15.888831  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:15.896791  1629 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:15.874944  1707 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:15.854755  6132 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.845825  6051 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:15.872205  6306 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:15.909885  6466 raft_consensus.cc:993] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: : Instructing follower 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 13:01:15.874877  6332 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:01:15.895339  6429 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.890370  6155 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.894462  6223 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:15.905908  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 173312us
I20260709 13:01:15.910598  6466 raft_consensus.cc:1081] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Signalling peer 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 13:01:15.916085  6411 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.936720  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.931610  6260 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:01:15.932960  6051 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.942093  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.943225  1556 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
W20260709 13:01:15.944080  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2139) took 2154 ms (client timeout 2001 ms). Trace:
I20260709 13:01:15.942745  1558 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
W20260709 13:01:15.944490  1631 rpcz_store.cc:269] 0709 13:01:13.790264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.790438 (+   174us) service_pool.cc:224] Handling call
0709 13:01:15.936257 (+2145819us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400356954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:15.944019 (+  7762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2487188224}
I20260709 13:01:15.946275  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.948607  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:15.949470  1556 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:15.949597  1674 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:15.950387  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:15.950843  6155 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:15.951089  1556 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:15.951531  6155 raft_consensus.cc:697] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:15.952925  6226 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:15.957504  6226 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:15.925447  6223 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.958597  6226 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:15.959982  6226 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:15.960587  6223 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.912498  6306 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:15.962687  6461 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 13:01:15.963454  6306 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:15.963685  6155 consensus_queue.cc:237] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.953866  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:15.966295  6161 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.953375  1558 raft_consensus.cc:2368] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13.
I20260709 13:01:15.966861  6448 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.967756  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:15.968327  1558 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:15.970782  6453 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.972391  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:15.923067  6125 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:15.974686  6453 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:15.975199  6453 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.975533  6453 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:15.975598  6125 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:15.979007  6360 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:15.980037  6127 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:15.980386  1674 leader_election.cc:400] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13.
I20260709 13:01:15.980440  6127 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:15.981482  6422 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:15.981418  6127 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:15.943907  6467 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:01:15.983152  6127 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:15.996377  5877 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:15.998914  6427 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:15.999759  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2154) took 1406 ms. Trace:
I20260709 13:01:16.021099  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:15.981920  1629 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:16.008509  1702 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:01:16.014532  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.023873  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:16.014722  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 156078us
I20260709 13:01:16.024518  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.008734  1558 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:16.016274  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.033373  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.021296  1632 rpcz_store.cc:276] 0709 13:01:14.593324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.599102 (+  5778us) service_pool.cc:224] Handling call
0709 13:01:14.599437 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.808636 (+209199us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:14.888172 (+ 79536us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.020259 (+132087us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:15.020308 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:15.020360 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.849912 (+829552us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b48002610d8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:01:15.999516 (+149604us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54001662d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:15.999585 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.999703 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19947,"prepare.queue_time_us":107798,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":75,"raft.run_cpu_time_us":2978,"raft.run_wall_time_us":830064,"spinlock_wait_cycles":483597440,"thread_start_us":204163,"threads_started":2,"wal-append.queue_time_us":226106}
I20260709 13:01:16.035290  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.036113  1700 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:16.037575  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:16.038304  1558 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.040971  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.042469  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.048580  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:16.052351  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:16.033116  6427 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:16.059454  1558 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:16.032718  6309 raft_consensus.cc:2764] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:16.065549  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:16.070734  1558 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:16.075141  1705 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 9 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 13:01:16.077885  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:16.078452  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 150863us
W20260709 13:01:16.084290  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 256033us
I20260709 13:01:16.055243  6196 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.062180  5877 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:16.086975  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:16.092339  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:16.095763  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:16.096580  2269 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:16.097873  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:16.102443  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.103653  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.104707  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.105607  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.107055  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:16.108250  6347 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:16.108327  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:16.108834  6347 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:16.109519  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:16.110700  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:16.111579  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.111939  2271 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 11. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 13:01:16.114060  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:16.114308  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.115290  1708 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: [12.9-14.10]
I20260709 13:01:16.093475  6196 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.120023  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:16.123785  6196 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:16.130472  6306 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.116957  6277 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.110369  6368 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:16.139281  6412 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:16.140200  6412 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:16.140502  6412 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:16.142017  1704 raft_consensus.cc:2410] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:01:16.142465  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:16.143067  1633 raft_consensus.cc:2376] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12. Re-sending same reply.
I20260709 13:01:16.111152  6354 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:01:16.143838  6453 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.141208  6412 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.145169  6412 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.114775  2267 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:16.148456  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:16.148770  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.149300  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.150274  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.150602  1558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:44176
I20260709 13:01:16.151228  1558 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:16.151369  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:16.151655  1558 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.152935  1702 raft_consensus.cc:2410] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:16.153470  1706 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:16.153934  1708 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:16.155557  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:16.155978  1673 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:16.105690  1674 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:16.165180  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 45246.9us
I20260709 13:01:16.166635  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:16.170688  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.170076  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 64385.3us
I20260709 13:01:16.172487  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:16.181345  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:16.181504  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:16.182583  2262 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:16.184499  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:16.121618  6448 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:16.168704  5877 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:16.160531  6453 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:16.171103  6364 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.207178  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:16.207631  1708 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:16.204030  1558 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.185803  6325 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:01:16.223398  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:16.283248  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 59970.2us
I20260709 13:01:16.191458  6422 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.230039  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:16.281643  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 74570.9us
I20260709 13:01:16.188091  5889 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:16.188243  6350 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:16.187963  6306 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:16.291383  6364 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:16.292014  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2325) took 2072 ms. Trace:
I20260709 13:01:16.292392  1551 rpcz_store.cc:276] 0709 13:01:14.219849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.220331 (+   482us) service_pool.cc:224] Handling call
0709 13:01:16.291825 (+2071494us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b5400181854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:16.291953 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1822461184}
I20260709 13:01:16.293560  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:16.296784  1551 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
W20260709 13:01:16.297714  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.297530  6347 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.300745  6347 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:16.301481  5889 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:01:16.306857  6483 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.200s	user 0.003s	sys 0.000s
I20260709 13:01:16.222911  6164 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.288494  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:16.312151  1558 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:16.290350  1526 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:16.282303  6448 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.285490  6277 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.321353  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:16.337028  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:16.391618  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 54715.7us
I20260709 13:01:16.392124  6328 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.392423  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:16.393577  6326 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:16.394194  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:16.396909  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:16.397547  2267 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:16.397823  2267 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:16.303215  5889 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.399096  2267 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.400245  2267 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.311806  6350 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:16.403417  2262 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:16.319947  6164 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.395207  6371 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.399060  6326 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:16.409632  1556 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:01:16.389303  6370 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.324779  6455 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:16.411415  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 121134us
I20260709 13:01:16.410916  2267 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:16.417043  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:16.419546  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:16.398335  5877 raft_consensus.cc:697] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:16.334200  6306 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.422501  6226 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:16.418923  6277 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:16.431438  6371 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:16.437839  6478 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.259s	user 0.002s	sys 0.000s
I20260709 13:01:16.426085  6370 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:01:16.462786  6164 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:16.462967  6306 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:16.463893  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 44453.2us
I20260709 13:01:16.465942  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:16.471534  6477 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:16.471657  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 361026us
I20260709 13:01:16.473197  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:16.452643  6371 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:16.441891  6277 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:16.480769  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:16.483249  1633 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:16.497757  6277 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:16.498440  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:16.455060  6350 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.489490  6448 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:01:16.500602  1599 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 2.180s (SENT)
I20260709 13:01:16.512548  6127 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.518751  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:16.523355  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50224.4us
I20260709 13:01:16.524459  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:16.518301  6127 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:16.512550  6448 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:16.564622  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:16.572574  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:16.689718  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.671736  1600 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:16.487109  5877 consensus_queue.cc:237] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:16.673913  6127 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:16.570717  5986 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:16.504940  6422 consensus_queue.cc:1059] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:16.683761  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:16.565894  6040 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:16.541208  6371 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.522253  6164 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.686923  1628 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:16.680867  6309 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:16.691846  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.696686  1627 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:16.698868  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:16.700820  1703 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:16.713052  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:16.714563  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:16.710233  6477 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:16.720232  6362 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:16.720157  6476 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:16.707826  6465 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:16.740784  1709 raft_consensus.cc:2410] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 12 because replica has last-logged OpId of term: 9 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 11.
I20260709 13:01:16.681344  6410 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:16.741453  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:16.707890  6427 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.003s
W20260709 13:01:16.753050  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 54284.1us
I20260709 13:01:16.754369  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:16.752939  1601 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:16.758735  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:16.759591  2271 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:16.763199  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:16.765354  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:16.767664  2264 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.769403  2265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:01:16.770179  2265 raft_consensus.cc:606] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:16.772367  2270 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:01:16.775933  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 358989us
I20260709 13:01:16.708426  5784 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:16.777680  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:16.779217  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:16.710225  5986 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:16.782996  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:16.785589   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:16.797688  2271 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:16.779659  6344 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:16.786676  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:16.742278  6164 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:16.787607  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.779881  6155 raft_consensus.cc:3055] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:01:16.818909  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 64636.5us
I20260709 13:01:16.742143  6477 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:16.754223  6332 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.791911  2265 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:16.743484  6127 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.801811  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:16.825058  1703 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:16.741161  6278 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:16.807765  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 54894.9us
I20260709 13:01:16.746814  6306 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:16.798079   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:16.813324  2264 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:16.814040  6360 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:16.753304  6499 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:01:16.742065  6362 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:16.752926  6260 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:01:16.830302  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:16.832715  2271 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:16.794338  5784 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.800727  6500 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.715787  6448 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:16.838289  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 53393.1us
I20260709 13:01:16.839782  1709 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:16.775183  6465 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:16.817603  6155 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:16.824632  6477 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:16.781387  6427 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.898474  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:16.899909  6348 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.904613  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.913149  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:16.781685  6476 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.906220  6425 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:16.835541  6040 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:16.918275  6412 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.772s	user 0.013s	sys 0.000s
I20260709 13:01:16.917485  6260 raft_consensus.cc:2955] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Committing config change with OpId 13.8: config changed from index 2 to 8, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:16.838466  6479 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:01:16.924376  6348 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.920404  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:16.936010  1555 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:16.957448  1558 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:16.938648  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:16.939330  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46688.5us
I20260709 13:01:16.888413  6415 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.947818  1700 raft_consensus.cc:2410] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:16.834424  6127 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.967094  6277 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.887359  6370 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
W20260709 13:01:16.968427  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 48167.5us
I20260709 13:01:16.974413  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:16.980324  2265 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:01:16.980751  2265 pending_rounds.cc:85] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 9
I20260709 13:01:16.980993  2265 pending_rounds.cc:107] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:01:16.981277  2265 raft_consensus.cc:2889] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:16.920192  6353 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:01:16.985517  1526 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:16.985498  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:16.963987  6455 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:17.003496  1709 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
W20260709 13:01:17.004791  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.979538  6309 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:17.005589  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:16.988476  6326 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:16.943409  6425 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.985883  6365 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.977524  6350 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:16.991518  6306 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:16.975482  6410 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:01:16.971732  6125 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:01:16.910992  6362 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:16.972978  6277 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:17.039292  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:16.976478  6411 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:01:16.970700  6415 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:17.059818  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 148682us
I20260709 13:01:17.011078  6507 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:01:17.065157  6040 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:17.061194  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 148174us
I20260709 13:01:17.072221  6326 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:17.117856  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:17.049000  6365 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.039523  6346 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:17.118726  6346 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.119103  6346 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.120018  6365 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.060637  6306 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:17.077296  1560 raft_consensus.cc:2410] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:01:17.095495  6348 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.062001  6164 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.100742  6278 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:17.102293  6425 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.103916  6427 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.105137  6415 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:17.105981  6277 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.076121  6476 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.112892  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2150) took 2188 ms. Trace:
I20260709 13:01:17.115505  6499 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:17.117746  6326 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.073145  5784 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:17.097680  1555 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:17.149472  1555 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:17.152035  1555 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:17.122046  6507 consensus_queue.cc:1243] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:17.131711  6344 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:17.124720  6306 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:17.141376  1557 rpcz_store.cc:276] 0709 13:01:14.924859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.972209 (+ 47350us) service_pool.cc:224] Handling call
0709 13:01:16.299330 (+1327121us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b5800003698. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 13:01:16.299511 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.406235 (+106724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.406283 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.406337 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:16.406366 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.112675 (+706309us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540031ef54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:17.112719 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.112831 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315758720}
I20260709 13:01:17.123404  6465 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:17.146740  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 307326us
I20260709 13:01:17.135288  6519 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.164427  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:17.163345  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:17.167356  1554 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:17.173213  1709 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:17.174479  1702 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:17.192344  1554 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:17.120026  6040 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:17.201481  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:17.202450  1702 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:17.199981  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:17.204684  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:17.205621  6326 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.168848  5784 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:01:17.218365  6344 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.168962  6465 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:17.164057  6499 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.225296  6499 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.235453  6276 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:17.196866  6127 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.229209  6507 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:17.251016  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:17.251878  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:17.253582  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:17.254616  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 271804us
W20260709 13:01:17.255618  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.257969  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:17.262310  6125 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:17.191002  6519 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.224388  6477 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.249404  6465 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:17.269356  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 151667us
I20260709 13:01:17.290067  1559 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:17.255024  6411 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.263250  6332 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:17.256251  6507 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:17.297910  1629 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:17.252918  6278 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:01:17.252038  6476 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:01:17.304746  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:17.307432  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:17.308951  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:17.316815  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:17.322266  6515 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.322856  6515 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.323983  6278 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:17.324505  6278 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:17.325011  6515 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.326300  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:17.326670  6278 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.331480  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:17.332578  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:17.291744  6525 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:17.252223  6276 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:17.293524  6521 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.338289  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:17.339357  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 258255us
I20260709 13:01:17.298574  6499 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.294006  6465 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.300285  6411 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:17.341377  6277 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.371326  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:17.338968  6326 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:17.291908  6306 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:17.387782  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:17.346608  6499 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:17.403591  6402 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.346747  6521 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.344973  6525 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.385974  6277 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:17.388232  6326 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:17.493247  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 125229us
I20260709 13:01:17.367466  6507 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.427578  6360 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.449250  6370 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:17.531698  6514 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
W20260709 13:01:17.531698  6524 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.159s	user 0.005s	sys 0.012s
I20260709 13:01:17.550491  6455 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:17.553123  6127 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:17.560686  2269 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
W20260709 13:01:17.591741  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.596328  1635 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:17.601217  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:17.603447  6525 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.382126  6532 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:01:17.555456  6411 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.579773  6370 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:17.607216  6507 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:17.609566  6040 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.554265  6402 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.609297  6515 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.569485  6346 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.724637  6370 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.569912  6360 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.693852  6127 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.694762  6455 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.782855  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2194) took 1044 ms. Trace:
I20260709 13:01:17.787210  1630 rpcz_store.cc:276] 0709 13:01:16.738440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.738555 (+   115us) service_pool.cc:224] Handling call
0709 13:01:16.738818 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.742736 (+  3918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.742783 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.742840 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:16.742886 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.782609 (+1039723us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b540007ab54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:17.782668 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.782797 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8472832}
I20260709 13:01:17.796566  2262 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:17.772007  6523 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.771835  6519 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.781677  6370 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:17.786917  6465 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.721235  6515 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.812212  1551 raft_consensus.cc:2955] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Committing config change with OpId 13.8: config changed from index 2 to 8, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:17.728407  6040 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.810098  6499 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.830642  6477 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.845522  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:17.847334   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:17.863289  1700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2428) took 1712 ms (client timeout 1681 ms). Trace:
I20260709 13:01:17.842074  6548 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.842803  5889 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.827658  6370 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.855686  6127 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.852738  6346 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:17.858076  6453 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:17.858927  6555 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:17.854488  6326 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.860832  6448 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:17.861258  6361 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:17.852211  6535 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:01:17.863481  1552 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:17.863879  1700 rpcz_store.cc:269] 0709 13:01:16.150520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.151150 (+   630us) service_pool.cc:224] Handling call
0709 13:01:17.863003 (+1711853us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54000a82d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:17.863194 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829479808}
I20260709 13:01:17.812915  6523 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.876767  2270 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:17.850950  6277 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:17.884588  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.902954  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2343) took 1961 ms. Trace:
I20260709 13:01:17.903367  1556 rpcz_store.cc:276] 0709 13:01:15.941338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.092255 (+150917us) service_pool.cc:224] Handling call
0709 13:01:16.409391 (+317136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.413025 (+  3634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.902768 (+1489743us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b540030be50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:17.902902 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715059584}
I20260709 13:01:17.888034  6453 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.908808  6370 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.897354  6361 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.908540  6453 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:17.920219  6541 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:17.924561  6515 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.927394  6523 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.930145  6040 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:17.931882  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.935281  6455 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.879963  5889 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:17.938474  5889 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:17.901172  6326 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:17.939616  6326 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.887266  6561 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:17.941747  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2190) took 1235 ms. Trace:
I20260709 13:01:17.941835  6561 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:17.942713  6360 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.901719  6402 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.944696  6561 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.945142  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:17.945838  1553 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:17.946815  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:17.947386  1553 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.948298  6306 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.879997  6548 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:01:17.951354  5986 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:17.952490  6548 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.890839  6555 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:17.955780  6555 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.957314  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:17.957958  1556 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:17.959190  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:17.959738  1556 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:17.960961  6361 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:17.965257  1552 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:17.967607  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:17.968236  1552 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:17.942379  1633 rpcz_store.cc:276] 0709 13:01:16.706047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.706154 (+   107us) service_pool.cc:224] Handling call
0709 13:01:16.706405 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.796751 (+ 90346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.796783 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.796826 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:16.796864 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.941510 (+1144646us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b540006d1d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:17.941562 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.941692 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207282944}
I20260709 13:01:17.952639  5986 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:17.974305  6326 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:17.977217  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2365) took 1248 ms. Trace:
I20260709 13:01:17.977705  1628 rpcz_store.cc:276] 0709 13:01:16.728774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.729494 (+   720us) service_pool.cc:224] Handling call
0709 13:01:16.733313 (+  3819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.928369 (+195056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.928403 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.928448 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:16.928487 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.976645 (+1048158us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400355f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:17.976707 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.977146 (+   439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448131456}
W20260709 13:01:17.990979  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.994482  1553 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
W20260709 13:01:17.998207  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 143243us
I20260709 13:01:18.000795  6161 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.991307  6326 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:18.004148  6161 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.009737  6565 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:18.016741  6565 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.017678  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1078) took 1068 ms. Trace:
I20260709 13:01:18.018126  2265 rpcz_store.cc:276] 0709 13:01:16.949451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.949606 (+   155us) service_pool.cc:224] Handling call
0709 13:01:16.950013 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.986511 (+ 36498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.017369 (+1030858us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b5400598dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:18.017596 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68902272}
I20260709 13:01:18.067158  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.055979  1554 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:18.027532  6132 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:18.009821  6556 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:18.098270  2270 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:01:18.064476  6144 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:18.098851  6564 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.099239  6144 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:18.021343  6326 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.099458  6564 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.100010  1524 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:18.019510  6565 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.100978  6325 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:18.091842  6371 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:01:18.101388  6325 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.100126  6144 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.102499  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.105206  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.030385  6161 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.101754  6325 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:18.053951  6539 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 13:01:18.027595  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:18.130715  2268 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:18.089174  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.069875  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.135788  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.136371  2262 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:18.066457  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1034) took 1303 ms. Trace:
I20260709 13:01:18.072767  6521 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.138373  2269 rpcz_store.cc:276] 0709 13:01:16.762809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.762935 (+   126us) service_pool.cc:224] Handling call
0709 13:01:18.066190 (+1303255us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400030cd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:18.066371 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1247468928}
I20260709 13:01:18.139639  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.079027  6562 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.026624  6555 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:18.105782  6523 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:18.117501  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:18.119594  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.105746  5723 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:18.024290  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 798) took 1035 ms. Trace:
I20260709 13:01:18.067052  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:18.052174  6520 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.707s	user 0.002s	sys 0.000s
I20260709 13:01:18.123853  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.125449  6309 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:18.045701  6276 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.091363  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.142395  1700 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:18.127059  1556 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:18.149483  2269 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:18.150831  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:18.137607  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:18.098665  6132 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.160127  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.155957  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:18.162042  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44608.3us
I20260709 13:01:18.101689  6326 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.162521  6556 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:18.162724  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.164202  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.245178  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.246791  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:18.248183  2266 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:18.248304  1629 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:18.248975  1633 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:18.246207  1557 rpcz_store.cc:276] 0709 13:01:16.988980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.163152 (+174172us) service_pool.cc:224] Handling call
0709 13:01:17.163428 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.175742 (+ 12314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.175774 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:17.175829 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:17.175872 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.024034 (+848162us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54003098d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:18.024082 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.024227 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27849472}
I20260709 13:01:18.251621  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.252363  1633 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:18.166890  2268 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:18.256139  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.255396  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.257359  1633 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:18.256464  1632 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:18.151187  6511 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.259804  6507 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:18.260308  6507 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.262738  6425 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:18.263501  6132 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:18.263276  6425 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.249383  6168 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.265122  6168 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.267167  6168 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.267544  6507 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:18.268831  6487 log.cc:927] Time spent T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.803s	user 0.004s	sys 0.004s
I20260709 13:01:18.271349  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.265887  6425 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.273335  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.273882  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:18.274377  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.275096  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.275389  1553 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:01:18.274485  1552 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:18.271499  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2174) took 1020 ms. Trace:
I20260709 13:01:18.286165  1554 rpcz_store.cc:276] 0709 13:01:17.251548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.251675 (+   127us) service_pool.cc:224] Handling call
0709 13:01:18.271352 (+1019677us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400384d54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:18.271447 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1847871360}
I20260709 13:01:18.286643  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:18.276139  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.287381  1629 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:01:18.159603  6238 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:18.288636  6238 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.159832  6161 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:18.290316  6161 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.295846  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1035) took 1531 ms. Trace:
I20260709 13:01:18.296311  2268 rpcz_store.cc:276] 0709 13:01:16.764516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.764677 (+   161us) service_pool.cc:224] Handling call
0709 13:01:18.027468 (+1262791us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaeee 0000000000375939 00007f06e2f1e1e0 00007f06e2fe70c4 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:01:18.295791 (+268323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13021312}
I20260709 13:01:18.301714  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:18.155485  6562 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.302691  1554 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:18.303766  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 971) took 1003 ms. Trace:
I20260709 13:01:18.304157  6562 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:01:18.304155  1635 rpcz_store.cc:276] 0709 13:01:17.294978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.295173 (+   195us) service_pool.cc:224] Handling call
0709 13:01:18.298349 (+1003176us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54002fa8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:18.298481 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662841600}
I20260709 13:01:18.261421  6325 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.306324  1700 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:01:18.254009  6309 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.283326  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:18.275854  1627 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:01:18.284184  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:18.275594  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.275852  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:18.158169  6155 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.293496  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 796) took 1305 ms. Trace:
I20260709 13:01:18.294873  2235 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:18.370816  1555 rpcz_store.cc:276] 0709 13:01:16.987898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.153759 (+165861us) service_pool.cc:224] Handling call
0709 13:01:17.158889 (+  5130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.225941 (+ 67052us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.225970 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:17.226007 (+    37us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:17.226055 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.293273 (+1067218us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b54001d38d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:18.293317 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.293442 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153756928}
I20260709 13:01:18.308045  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:18.373059  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 76536.7us
I20260709 13:01:18.253412  6546 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.163599  6555 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.311512  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 794) took 1503 ms. Trace:
I20260709 13:01:18.311976  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:18.254354  5723 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.328001  6238 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:18.232431  6523 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.329001  6325 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.329411  6529 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:01:18.360430  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.341684  1706 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:18.313956  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:18.400695  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 105900us
I20260709 13:01:18.446044  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:18.458926  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.278165  6511 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.447175  1559 rpcz_store.cc:276] 0709 13:01:16.808213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.808372 (+   159us) service_pool.cc:224] Handling call
0709 13:01:16.816076 (+  7704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.290539 (+474463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.311250 (+1020711us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b540030b954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:18.311441 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089702144}
I20260709 13:01:18.460449  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:18.461361  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 322546us
W20260709 13:01:18.461701  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 147829us
I20260709 13:01:18.446921  6368 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.464952  2264 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:18.466708  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:18.453352  6155 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.460279  6553 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:18.473762  1628 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:18.472895  2235 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:18.448338  6040 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:01:18.479087  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.480008  2270 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:18.481344  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.476068  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:18.469417  6477 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:18.451216  6546 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:18.490480  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 178366us
I20260709 13:01:18.469226  6476 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:18.473757  5986 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.484242  6354 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:18.491276  6477 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.491264  6513 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:18.494400  6238 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.504179  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:18.496622  6562 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:01:18.499163  6354 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.515650  2270 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:18.503160  6477 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.488584  6553 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.503463  6476 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:18.519901  6476 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.522356  6476 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.524304  6523 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.526372  6496 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.526849  6496 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.528973  6496 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:18.529294  6564 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.529503  6496 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:18.530251  6537 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.804s	user 0.002s	sys 0.008s
I20260709 13:01:18.531641  6553 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.532428  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.506963  6418 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:18.539983  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1079) took 1220 ms. Trace:
W20260709 13:01:18.545490  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 249669us
I20260709 13:01:18.502904  6542 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:01:18.515806  6354 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.515983  6513 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:18.547372  1524 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:18.598805  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.540570  2263 rpcz_store.cc:276] 0709 13:01:17.319948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.321927 (+  1979us) service_pool.cc:224] Handling call
0709 13:01:17.322308 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:17.322667 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.322695 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:17.323258 (+   563us) log.cc:844] Serialized 52 byte log entry
0709 13:01:17.422135 (+ 98877us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:17.566135 (+144000us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.832352 (+266217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.832452 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.524995 (+692543us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:18.533581 (+  8586us) raft_consensus.cc:1685] finished
0709 13:01:18.539688 (+  6107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.539897 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40848,"raft.queue_time_us":154770,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":6476,"spinlock_wait_cycles":157923712,"thread_start_us":438334,"threads_started":3,"wal-append.queue_time_us":402742}
W20260709 13:01:18.623433  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.510120  6238 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.634824  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.635684  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.638622  1627 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:18.640681  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.537016  5889 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:18.542680  6418 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.644316  2270 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:18.631690  6309 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.652519  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.658555  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:18.659379  1555 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:18.660384  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:18.661949  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:18.662315  1552 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:18.662894  1557 raft_consensus.cc:2410] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:18.663821  1556 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:18.666265  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:18.667344  6238 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:18.656572  6455 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:18.668637  6455 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.672001  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:18.672888  1556 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
W20260709 13:01:18.693990  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.697315  6562 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:18.697849  6513 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.698290  6562 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.700453  2271 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:18.701172  6562 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.701896  6562 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:18.656839  6448 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:18.702889  6562 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.703835  6448 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.705588  6562 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:18.548491  6523 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:01:18.710074  6523 consensus_queue.cc:1243] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:18.712761  6546 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.713929  5723 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:18.714815  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 167508us
I20260709 13:01:18.715790  1524 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:18.716871  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.716961  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:18.718161  2270 raft_consensus.cc:2410] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:01:18.719223  6360 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:18.719765  6360 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.634465  6040 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:18.645823  6429 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:18.533411  6496 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.752460  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:18.658144  6511 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.651537  6418 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:18.758688  1601 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:18.720403  6325 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:18.769519  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:18.775238  1524 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:18.731595  6564 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:18.654805  5889 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.757918  6499 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:18.764124  6533 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.039s	user 0.002s	sys 0.000s
I20260709 13:01:18.727486  6360 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.759238  6309 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:18.760447  6546 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:18.789353  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:18.781466  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:18.765909  6325 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.779194  6517 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:18.779551  6556 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:18.785388  6326 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:18.758373  6429 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.766695  6511 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:18.805198  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 338552us
I20260709 13:01:18.803599  1524 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:18.784897  6564 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.800776  6371 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:18.789578  6499 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:18.814922  1600 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:18.815828  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.801311  6325 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:18.778891  6040 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.810218  6476 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.804227  6326 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:18.800946  6309 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.832197  6326 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:18.830327  6371 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:18.831018  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.834933  6371 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.835675  1627 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:01:18.837184  6371 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.821583  6511 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.834070  6309 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.839030  5889 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.840448  6517 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:18.840888  6517 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.841274  6517 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.842203  6511 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.843572  6476 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.803099  6578 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:01:18.845224  6326 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.821936  6500 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:18.847078  6500 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.847468  6500 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:18.848462  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.848807  6455 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.849110  1627 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:18.823838  6556 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:18.850394  6556 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.824404  6499 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.812680  6427 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.860749  6328 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:18.863643  6328 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:18.864264  6564 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.853384  5889 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.865134  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.864997  5889 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.865743  1627 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:18.867100  5889 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.867401  6429 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.867542  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:18.869710  6040 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.872807  6556 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.874620  6362 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:18.876170  6328 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.881667  6555 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:18.887586  6496 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:18.888320  6477 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.892408  6354 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.901746  6513 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:18.905143  6513 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:18.907176  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:18.897296  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:18.911134  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:18.912927  2268 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:18.915843  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:18.972024  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 60990.3us
I20260709 13:01:18.972893  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:18.974432  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:18.976378  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 172458us
W20260709 13:01:18.987987  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.990100  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:18.990880  1556 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.999671  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:18.975116  2262 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:18.977648  1601 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:19.009305  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 93586.4us
I20260709 13:01:19.010846  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:19.000399  2263 raft_consensus.cc:2376] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12. Re-sending same reply.
I20260709 13:01:19.017792  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:19.017695  1627 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:19.019502  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:19.013840  6348 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.059535  6348 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.060918  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:19.061343  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47700.6us
I20260709 13:01:19.062510  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:19.065546  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:19.067155  2236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.612s (SENT) [suppressed 11 similar messages]
I20260709 13:01:18.957201  6477 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:19.081085  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:18.971323  6496 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:18.974575  6521 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.127s
I20260709 13:01:19.064157  6040 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:19.108421  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.001833  6164 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:19.110522  6348 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:19.110378  6164 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.111533  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:19.112426  6164 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:19.112648  1701 raft_consensus.cc:2410] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:19.112869  1556 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:19.113853  6326 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:19.115172  5889 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:19.115633  6325 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:19.011111  6277 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:19.117421  6277 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:18.999181  6546 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:19.117841  6277 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:19.118728  6325 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:19.119089  6562 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:19.080224  6427 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:01:18.975984  6425 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:19.125433  6425 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:18.893734  6500 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:19.127738  6425 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:19.128082  6500 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:19.018416  6155 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:19.110389  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:19.131858  1709 raft_consensus.cc:2410] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:19.141655  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 804) took 1687 ms. Trace:
I20260709 13:01:19.134708  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2359) took 2198 ms. Trace:
I20260709 13:01:19.170264  1560 rpcz_store.cc:276] 0709 13:01:16.936715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.124521 (+187806us) service_pool.cc:224] Handling call
0709 13:01:17.138043 (+ 13522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.267770 (+1129727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:18.267801 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:18.267837 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:18.267866 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.134453 (+866587us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400312ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:19.134498 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.134647 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2597946752}
I20260709 13:01:19.014307  6238 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:19.020390  2271 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:19.009507  6555 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:19.165599  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.906096  6513 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.214685  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:19.215773  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:19.224819  1556 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:19.014302  6502 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:19.220116  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:19.057267  6354 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:19.014540  6565 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:19.173080  1551 rpcz_store.cc:276] 0709 13:01:17.454818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.530224 (+ 75406us) service_pool.cc:224] Handling call
0709 13:01:17.530544 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.812091 (+281547us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:17.967192 (+155101us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.287406 (+320214us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b180025fc60. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06e19c73c7 00007f06ddfd99a7 00007f06ddfe90bf 00007f06ddfe9038
0709 13:01:18.466714 (+179308us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.646968 (+180254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:18.647021 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:18.647063 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.901786 (+254723us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b48000030d8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:01:19.141333 (+239547us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400385754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:19.141392 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.141568 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":278761,"prepare.queue_time_us":335608,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":1870,"raft.queue_time_us":183987,"raft.run_cpu_time_us":9595,"raft.run_wall_time_us":664998,"spinlock_wait_cycles":686580352,"thread_start_us":375887,"threads_started":2,"wal-append.queue_time_us":120616}
I20260709 13:01:19.219619  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:19.018136  6523 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.202s
W20260709 13:01:19.250814  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 435955us
W20260709 13:01:19.262650  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 200346us
I20260709 13:01:19.263228  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:19.274767  2235 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:19.290515  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:19.292207  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:19.230397  6582 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:19.231781  6502 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:19.259298  6565 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:19.147819  6496 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.296643  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:19.272818  6238 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:19.300040  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:19.319495  1554 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:19.300828  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:19.324198  1558 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:19.319554  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:19.274417  6513 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:19.299906  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:19.319734  2271 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
W20260709 13:01:19.294348  6418 consensus_meta.cc:287] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.506s	user 0.014s	sys 0.000s
I20260709 13:01:19.328950  1552 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:19.230412  6555 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:19.349584  6511 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:19.350226  6511 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.332278  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:19.340922  6040 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.341555  1455 catalog_manager.cc:5697] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 8 to 9, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.343524  6562 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:19.346611  6578 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.319342  6565 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.361101  1560 raft_consensus.cc:2410] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:19.356875  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:19.301932  6516 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:19.282408  6155 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:01:19.368561  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:19.331681  6238 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:19.400693  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 333587us
W20260709 13:01:19.424938  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 56493.4us
I20260709 13:01:19.337001  6477 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:19.297142  6465 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:01:19.352741  6540 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:19.327898  6588 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:19.336339  6427 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:19.406925  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:19.370420  1601 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:19.440893  1557 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:19.435261  6344 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:19.414398  1554 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
W20260709 13:01:19.402818  6517 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.000s
I20260709 13:01:19.418823  1455 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:19.420895  6595 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:01:19.410908  6360 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.606s	user 0.013s	sys 0.003s
I20260709 13:01:19.308882  6582 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.361624  6418 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:19.441275  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 70973.3us
I20260709 13:01:19.305831  6502 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.383092  6040 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.434259  6238 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:19.437209  6540 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.395061  6578 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:19.462523  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:19.435487  6516 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:19.469602  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1084) took 1405 ms. Trace:
W20260709 13:01:19.444954  6499 consensus_meta.cc:287] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.582s	user 0.004s	sys 0.007s
I20260709 13:01:19.494975  2266 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:01:19.438055  6511 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:19.485848  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:19.438328  6588 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:19.489319  1629 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:19.443735  6344 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:19.496876  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:19.488785  6540 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:19.501986  2263 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:01:19.494460  2267 rpcz_store.cc:276] 0709 13:01:18.064541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.066345 (+  1804us) service_pool.cc:224] Handling call
0709 13:01:18.066655 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.267152 (+200497us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:18.982753 (+715601us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.267522 (+284769us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.267605 (+    83us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:19.267672 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.469306 (+201634us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54005933d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:19.469369 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.469533 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":740202,"prepare.queue_time_us":632963,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":126798,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":3429,"spinlock_wait_cycles":460619648,"thread_start_us":242206,"threads_started":2,"wal-append.queue_time_us":335895}
I20260709 13:01:19.506959  1627 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:01:19.441849  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e99891af85f4b10aa1cc2da6aa33082 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:19.448499  6589 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:19.508121  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.529763  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.468521  6448 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:19.513759  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:19.514839  1706 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:19.466869  6476 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:19.445370  6427 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:19.524039  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.524593  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.525640  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.532434  2234 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:19.543373  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:19.544104  2267 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:19.494555  6477 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:19.533402  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:19.533414  1629 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
W20260709 13:01:19.533946  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 250551us
I20260709 13:01:19.467907  6360 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:19.533391  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 249957us
I20260709 13:01:19.516916  6344 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.455271  6517 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.549489  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:19.549741  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:19.536393  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:19.555851  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:19.554452  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:19.510654  6588 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:19.556458  1704 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:19.558279  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:19.531450  1443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 91947.9us
I20260709 13:01:19.565091  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:19.565982  2263 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:19.560551  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:19.561527  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:19.566318  1524 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:19.567242  1627 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:19.570537  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:19.576365  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:19.553217  6553 raft_consensus.cc:2764] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:19.510679  6499 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.600312  1555 raft_consensus.cc:2393] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:19.598822  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:19.605232  1628 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:19.577978  6523 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:19.577713  6546 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:19.603096  6594 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:01:19.590590  5889 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:19.546228  6476 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.626628  1627 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:19.600386  6326 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:19.555316  6477 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.629153  1455 catalog_manager.cc:5697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:01:19.598287  6586 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:19.575455  6562 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:01:19.612242  6496 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:19.645704  1455 catalog_manager.cc:5697] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:01:19.646849  1627 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:19.621405  6546 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:19.649533  1601 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:19.650760  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 80297.7us
I20260709 13:01:19.658655  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:19.659914  1455 catalog_manager.cc:5697] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 9 to 10, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.661247  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:19.662161  1556 raft_consensus.cc:2410] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 13:01:19.661509  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 86603us
I20260709 13:01:19.613025  6277 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:19.644321  6599 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:01:19.637681  6586 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.669481  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:19.676144  1704 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:19.639487  5889 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:19.676458  1627 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:19.674170  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:19.644861  6523 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:19.658155  6589 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:19.659034  6546 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.717191  2262 pending_rounds.cc:85] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 7
I20260709 13:01:19.717564  2262 pending_rounds.cc:107] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:19.717818  2262 raft_consensus.cc:2889] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:19.720129  1627 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:19.675659  6562 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:19.722316  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:19.723436  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:19.723794  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:19.611953  6516 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.648736  6601 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:01:19.728838  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:19.729619  2267 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:19.680315  6586 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:19.733649  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 62828.8us
I20260709 13:01:19.735723  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:19.694766  6603 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.737416  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:19.703539  6496 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.807709  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:19.808017  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:19.744679  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 152919us
I20260709 13:01:19.710646  6418 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:19.690321  6155 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:01:19.820040  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:19.729897  6606 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:19.731276  6040 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:19.838799  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:19.727391  6562 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:19.845736  1556 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:19.831362  6606 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:19.855156  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:19.867925  2271 raft_consensus.cc:2410] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 12 because replica has last-logged OpId of term: 11 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 12.
I20260709 13:01:19.816123  6582 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:19.812981  6549 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:19.894227  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:19.841651  5889 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:19.902784  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:19.933499  1556 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:19.849893  6600 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:19.936182  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:19.937225  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:19.938720  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:19.939769  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:19.998910  1632 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.939980  1599 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:01:19.999379  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.000617  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:20.000958  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 326865us
I20260709 13:01:20.003003  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.004797  1631 raft_consensus.cc:2393] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:20.004691  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:19.862502  6427 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:19.907941  2271 raft_consensus.cc:2955] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 2 to 9, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:01:19.970366  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.818454  6496 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.030002  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:19.942487  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:20.005944  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.031342  1708 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:19.903198  6161 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.006819  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.040467  1707 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:20.041402  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.042616  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:20.007256  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:19.877796  6360 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:19.857975  6610 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:19.818208  6603 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.005375  1702 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:19.877076  6606 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.877403  6476 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.010250  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:19.991086  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.037900  6605 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.404s	user 0.001s	sys 0.000s
I20260709 13:01:19.905711  6549 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.032191  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.006618  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.072248  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.072310  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:20.033692  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 93812.2us
I20260709 13:01:20.050829  1700 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:20.055778  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.074951  1634 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:20.056542  1632 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:20.057863  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.077162  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.077807  1702 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
W20260709 13:01:20.024060  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 187294us
I20260709 13:01:19.952819  2263 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:20.032135  6612 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:20.054741  6362 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.180s	user 0.012s	sys 0.000s
I20260709 13:01:20.080699  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:20.032778  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 297633us
I20260709 13:01:20.081867   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:20.010388  6600 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.062513  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.080291  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.058193  6610 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:20.090833  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.078769  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.044557  6410 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:20.069628  6608 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:01:20.082130  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:20.087653  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:20.088709  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.088802  2265 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:20.091516  1703 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:20.102679  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.103339  1704 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:20.103861  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.104120  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.104764  1704 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 8.
I20260709 13:01:20.105607  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:20.107035  1707 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:20.112735  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.113654  1633 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:20.116319  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:20.015256  6562 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.123473  6499 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.124370  6562 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.080693  6477 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.100369  6610 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.100853  6410 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.135625  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:20.136101  6410 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.136533  1632 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:20.083070  6517 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.140096  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:20.144286  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.137934  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.146232  1634 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 12: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:20.088090  6277 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:20.148191  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:20.164507  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.166000  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:20.166874  1704 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.168313  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:20.156824  6565 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.731s	user 0.008s	sys 0.003s
I20260709 13:01:20.177904  1707 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:20.114838  6529 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:20.102880  6362 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:20.170302  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:20.119316  6496 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.117854  6527 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.169380  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 81804.6us
I20260709 13:01:20.180747  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.184458  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.088508  6612 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.207193  1703 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:20.216513  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:20.175382  6513 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.819s	user 0.004s	sys 0.008s
I20260709 13:01:20.219362  1634 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:20.224192  1704 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:20.230964  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:20.231714  2269 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:20.232650  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:20.232709  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 187786us
I20260709 13:01:20.175096  6517 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:20.164610  6627 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:20.243151  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.246387  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.247563  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.258373  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.248204  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.258756  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:20.259495  1556 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:20.248541  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.248828  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.249480  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.261075  1552 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:20.250427  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.251066  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:20.255082  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.261965  1560 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:20.262148  1555 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:20.255692  2267 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:20.263387  1555 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:20.266024  1552 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:20.204399  6529 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.267982  1554 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:01:20.269148  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:20.268081  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:20.278292  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:20.279224  6277 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:20.279680  6277 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:20.280109  6277 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.281546  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:20.282984  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:20.283659  2269 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.281663  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:20.284783  1634 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.274531  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:20.276043  6238 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.787s	user 0.011s	sys 0.000s
I20260709 13:01:20.185259  6565 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:20.297811  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.282195  6607 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:01:20.275524  6529 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:20.272855  6517 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:20.225080  6362 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.275904  6499 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:20.292021  6629 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:01:20.321290  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:20.316438  6612 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.317245  6565 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:20.317466  1553 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:20.333079  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.264238  6527 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.300493  6155 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:20.340761  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1051) took 1368 ms. Trace:
I20260709 13:01:20.348630  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.324265  6607 consensus_queue.cc:1243] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:20.335928  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:20.352108  1703 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:20.353305  2269 raft_consensus.cc:2410] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:20.380723  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:20.381065  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.381402  2269 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:20.382463  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:20.355309  1554 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:20.357550  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.363739  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.268086  6627 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.311534  6603 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.418422  1626 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:20.375478  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.336475  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:20.420562  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 84178.9us
I20260709 13:01:20.370869  2270 rpcz_store.cc:276] 0709 13:01:18.972305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.975451 (+  3146us) service_pool.cc:224] Handling call
0709 13:01:19.019036 (+ 43585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.133928 (+114892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.133974 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.134053 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:19.134101 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.340520 (+1206419us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540056aed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:20.340565 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.340707 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263649024}
I20260709 13:01:20.317260  6555 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:20.392213  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:20.424224  1626 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:20.413959  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.415516  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.425485  1632 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:20.308779  6238 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.341313  6326 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:20.425382  1703 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:20.370630  6155 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:20.428622  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.429253  1703 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:20.430084  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.430640  1703 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:20.431396  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.431524  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.432428  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.427487  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.433502  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.369822  6477 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:20.434738  1703 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:20.433984  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:20.437716  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45594.5us
I20260709 13:01:20.439585  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.421546  1556 raft_consensus.cc:2955] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 2 to 9, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:20.440352  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.416142  6496 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.441846  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.434736  6155 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.441296  6477 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.447077  6238 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.447749  1707 raft_consensus.cc:2368] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13.
I20260709 13:01:20.450232  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.452544  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.447871  1627 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:20.427095  6565 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:20.456341  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.434314  6326 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:20.462318  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.469148  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.461200  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.470223  1703 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:01:20.473480  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.442863  6603 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:20.453769  6546 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.001s
W20260709 13:01:20.497035  6624 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:01:20.496946  6546 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:20.454200  6540 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.923s	user 0.012s	sys 0.000s
I20260709 13:01:20.498414  6540 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.500113  6627 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:20.497355  1634 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:20.480253  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.476341  6238 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:01:20.485653  6549 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:20.491739  6502 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.986s	user 0.004s	sys 0.007s
I20260709 13:01:20.494439  6477 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.459584  6161 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:20.508200  2234 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:20.496472  6628 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:20.504107  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:20.520382  2271 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:20.506271  1632 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:20.495391  6362 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:20.459533  5889 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:20.471625  6582 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.477289  6615 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:20.461323  6565 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:20.472375  6326 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:20.501180  6603 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.524845  5723 consensus_queue.cc:1059] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:20.543071  6621 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:20.543697  5723 raft_consensus.cc:3055] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:20.544034  5723 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:20.544811  5723 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.543121  6603 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:20.548431  6277 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.527005  6410 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.550212  6499 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:20.550458  6565 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:20.550837  6499 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.553197  6499 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.529335  6144 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.555451  6527 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:20.557288  6546 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:20.467334  6496 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:01:20.519089  6610 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:20.562960  6582 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:20.563439  6582 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:20.564143  6610 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:01:20.531019  2234 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.500789  6540 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:20.535372  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.564338  6582 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:20.532619  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.566223  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:20.566813  1555 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:20.509856  6502 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.568662  6410 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.569305  6502 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.570048  1559 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:20.570168  6615 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:01:20.570888  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.571302  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 819) took 1594 ms. Trace:
I20260709 13:01:20.571102  6615 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:20.571698  1559 rpcz_store.cc:276] 0709 13:01:18.977000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.978515 (+  1515us) service_pool.cc:224] Handling call
0709 13:01:19.018926 (+ 40411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:20.570494 (+1551568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.571078 (+   584us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400309dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:20.571244 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3567058688}
I20260709 13:01:20.537124  6362 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:20.540112  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.541507  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:20.574383  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.565762  6582 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.573837  1704 raft_consensus.cc:2410] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:20.575330  1601 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:20.588303  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 48263.3us
W20260709 13:01:20.597322  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 66383.4us
W20260709 13:01:20.608114  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 342107us
I20260709 13:01:20.614653  1673 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.467929  6517 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.608057  1600 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:20.617472  1555 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:20.577032  5723 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.619207  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:20.620255  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:20.605293  6051 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:20.626212  6051 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:20.626387  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.604056  6410 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:20.609398  6511 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.625262  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.540457  6161 consensus_queue.cc:1059] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:01:20.630266  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:20.636000  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:20.630586  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:20.607563  6540 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.606796  6616 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.617478  6619 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.636165  2266 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
W20260709 13:01:20.638449  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.655151  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:20.641062  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:20.656428  2263 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.642987  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.634377  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.624158  6477 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:20.652163  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.633139  6621 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:20.661245  1705 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
W20260709 13:01:20.667275  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 196694us
I20260709 13:01:20.668411  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.670447  2263 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:20.670555  1600 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.632529  6410 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:20.639635  6589 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.674415  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:20.656163  6580 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.639627  6644 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:20.679560  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:20.664740  6238 raft_consensus.cc:3055] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:20.671656  6427 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:20.686007  6643 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:20.685838  6238 raft_consensus.cc:740] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:20.665055  6477 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:20.676756  6144 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.673332  6410 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:20.674636  6562 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.672324  6621 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:20.695237  1526 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:20.641948  6565 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.627206  6051 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.696195  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:20.692826  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 71022us
I20260709 13:01:20.696671  1551 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:20.679028  6619 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:20.696810  1555 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:20.699189  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.683949  6277 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.645370  6511 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:20.697911  6344 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.123s	user 0.003s	sys 0.009s
I20260709 13:01:20.693399  6477 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:20.706564  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:20.698964  6621 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.709344  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:20.687590  6238 consensus_queue.cc:260] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.726996  1552 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:20.708000  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.714455  6425 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:20.733865  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1059) took 1009 ms. Trace:
I20260709 13:01:20.734424  2267 rpcz_store.cc:276] 0709 13:01:19.724266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.807784 (+ 83518us) service_pool.cc:224] Handling call
0709 13:01:20.733643 (+925859us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b540054ddd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:20.733785 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1027728640}
I20260709 13:01:20.700089  6646 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 13:01:20.716710  6523 consensus_meta.cc:287] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.027s	user 0.005s	sys 0.005s
I20260709 13:01:20.708930  5784 consensus_queue.cc:1059] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:01:20.704473  6144 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.724035  6513 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:20.703635  6615 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:20.691246  6580 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.691744  6155 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.742980  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:20.721061  6603 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:20.745115  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:20.745879  6606 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.004s
I20260709 13:01:20.748032  6610 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:20.746639  6523 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:20.796159  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 53278.1us
W20260709 13:01:20.792536  6641 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:01:20.794742  6636 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:01:20.747304  6425 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:20.791823  6645 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:01:20.709721  6344 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.801077  1703 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:20.801625  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2465) took 1549 ms. Trace:
I20260709 13:01:20.801342  1708 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
W20260709 13:01:20.783332  6586 consensus_meta.cc:287] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.971s	user 0.003s	sys 0.008s
I20260709 13:01:20.810796  1706 rpcz_store.cc:276] 0709 13:01:19.252695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.256503 (+  3808us) service_pool.cc:224] Handling call
0709 13:01:20.801417 (+1544914us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400126454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:20.801561 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558780800}
I20260709 13:01:20.796386  6610 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.813228  1706 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:20.788308  6615 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:20.812831  1628 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:20.789760  6606 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.818521  1633 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:20.808130  6562 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:20.826129  6523 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:20.827935  6578 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:20.828426  6603 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:20.828580  6588 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.231s	user 0.013s	sys 0.000s
I20260709 13:01:20.829054  6588 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:20.829815  6155 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.830732  1629 raft_consensus.cc:2410] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:20.817962  6606 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.831718  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2207) took 1280 ms. Trace:
I20260709 13:01:20.832070  1629 rpcz_store.cc:276] 0709 13:01:19.551333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.554135 (+  2802us) service_pool.cc:224] Handling call
0709 13:01:20.831509 (+1277374us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400355f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:20.831638 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2929606016}
I20260709 13:01:20.833304  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:20.833458  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:20.811996  6647 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:20.834591  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:20.836640  1632 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.834756  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:20.815481  6610 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.837137  1706 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.840443  6425 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.841202  6418 raft_consensus.cc:3055] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:20.841682  6418 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:20.848003  6344 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.855154  6565 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.814996  6586 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.859833  6586 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.860512  1560 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:01:20.862857  6621 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:20.863487  6529 consensus_meta.cc:287] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.004s
I20260709 13:01:20.864316  6529 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.865512  1631 raft_consensus.cc:2368] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14.
I20260709 13:01:20.836426  6647 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:20.866758  6648 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:01:20.847347  6642 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 13:01:20.872128  6620 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.789s	user 0.007s	sys 0.000s
I20260709 13:01:20.871915  6615 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:20.818207  6326 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:20.893814  1626 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:20.894004  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1055) took 1177 ms. Trace:
W20260709 13:01:20.903026  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.876214  1632 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:20.903738  2264 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:20.905081  1701 raft_consensus.cc:1217] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.9->[12.10-15.12]   Dedup: 12.10->[13.11-15.12]
I20260709 13:01:20.915203  1701 pending_rounds.cc:85] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 10
I20260709 13:01:20.915477  1701 pending_rounds.cc:107] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:01:20.915738  1701 raft_consensus.cc:2889] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:20.910250  2262 rpcz_store.cc:276] 0709 13:01:19.716426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.716674 (+   248us) service_pool.cc:224] Handling call
0709 13:01:19.716989 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:19.726971 (+  9982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.727002 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:19.727593 (+   591us) log.cc:844] Serialized 52 byte log entry
0709 13:01:19.951033 (+223440us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:19.951096 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.951209 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:20.871523 (+920314us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:20.875601 (+  4078us) raft_consensus.cc:1685] finished
0709 13:01:20.875622 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.893903 (+ 18281us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1259,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":69527808,"thread_start_us":222962,"threads_started":1,"wal-append.queue_time_us":320560}
I20260709 13:01:20.920410  6326 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:20.922107  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:20.924724  2265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 1087) took 2838 ms (client timeout 2054 ms). Trace:
W20260709 13:01:20.925132  2265 rpcz_store.cc:269] 0709 13:01:18.065411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.091102 (+ 25691us) service_pool.cc:224] Handling call
0709 13:01:20.901773 (+2810671us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b5400267854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:20.903292 (+  1519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4242894592}
I20260709 13:01:20.926041  1526 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:20.928659  1524 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:20.923383  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:20.934464  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2198) took 1476 ms. Trace:
I20260709 13:01:20.934873  1635 rpcz_store.cc:276] 0709 13:01:19.457944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.458585 (+   641us) service_pool.cc:224] Handling call
0709 13:01:19.495461 (+ 36876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.537959 (+ 42498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.538008 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.538105 (+    97us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:19.538150 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.934240 (+1396090us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b54003381d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:20.934288 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:20.934408 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97136384}
I20260709 13:01:20.936450  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:20.937214  6502 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:20.937345  6586 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:20.937961  6586 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:20.937770  6502 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:20.938417  6586 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:20.939235  6502 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:20.925557  6326 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.941421  6326 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.942134  6277 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:20.942235  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 97834us
I20260709 13:01:20.943266  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:20.921388  6610 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:20.944512  6642 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:20.946085  6610 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:20.946041  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.849068  6655 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:01:20.949563  1524 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:20.954320  6600 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.954653  6277 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:20.955238  6277 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:20.954576  6326 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:20.956143  6277 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:20.958689  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.959448  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.960927  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:20.961681  6164 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.962374  6164 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:20.963049  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:20.963959  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:20.964655  2265 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:20.964890  6164 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:20.923810  5889 raft_consensus.cc:3055] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:20.965816  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:20.951507  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:20.952143  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.968297  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:20.952731  6602 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.304s	user 0.012s	sys 0.005s
I20260709 13:01:20.977679  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:20.978015  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:20.982095  1706 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:20.966264  5889 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:20.985191  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:20.985874  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:20.986748  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:21.001073  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.001544  2262 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
W20260709 13:01:20.988727  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.991824  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:20.993116  1703 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:21.000653  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.007213  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:21.016564  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:20.983079  6617 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.014712  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.036213  2265 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:21.039817  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2467) took 1713 ms. Trace:
I20260709 13:01:21.044050  1709 rpcz_store.cc:276] 0709 13:01:19.326947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.327188 (+   241us) service_pool.cc:224] Handling call
0709 13:01:19.366831 (+ 39643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:19.384346 (+ 17515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:19.384394 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:19.385010 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 13:01:19.554122 (+169112us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:19.554161 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.554233 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:20.885719 (+1331486us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:21.039429 (+153710us) raft_consensus.cc:1685] finished
0709 13:01:21.039473 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.039741 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17012,"raft.queue_time_us":53647,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":5668224,"thread_start_us":168629,"threads_started":1,"wal-append.queue_time_us":235175}
I20260709 13:01:21.048060  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.000728  6600 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:21.001003  6590 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:21.054389  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50400.7us
I20260709 13:01:21.010573  6155 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:21.058758  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.065524  1706 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:21.057727  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:21.067209  1526 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.068548  1526 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.040306  6610 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:21.067759  6615 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:21.073849  6615 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.070969  6410 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.074047  5889 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:21.076046  6615 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.076254  6410 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.077204  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:21.078277  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:21.079260  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:21.080258  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:21.080753  1635 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:21.084234  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:21.085970  6511 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.087157  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:21.085958  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:21.088335  6647 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.088843  1552 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.089570  6647 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.089926  6529 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.092351  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:21.093452  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:21.093725  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.094954  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.095093  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1045) took 2620 ms. Trace:
I20260709 13:01:21.095507  2264 rpcz_store.cc:276] 0709 13:01:18.474681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.474806 (+   125us) service_pool.cc:224] Handling call
0709 13:01:20.903396 (+2428590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:20.914462 (+ 11066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.094857 (+180395us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b5400267850. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:21.095004 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5585094400}
I20260709 13:01:21.096504  1552 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:21.096727  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:21.097462  1628 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.098294  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:21.102748  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.103551  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2327) took 1092 ms. Trace:
I20260709 13:01:21.104894  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:21.105489  1557 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:21.095615  1706 raft_consensus.cc:2368] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16.
I20260709 13:01:21.106869  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.103924  1702 rpcz_store.cc:276] 0709 13:01:20.010888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.746317 (+735429us) service_pool.cc:224] Handling call
0709 13:01:20.746763 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:20.813230 (+ 66467us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:20.834655 (+ 21425us) log.cc:844] Serialized 14 byte log entry
0709 13:01:20.992502 (+157847us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:21.004853 (+ 12351us) log.cc:844] Serialized 26 byte log entry
0709 13:01:21.004985 (+   132us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:21.005018 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.005078 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:21.103347 (+ 98269us) raft_consensus.cc:1685] finished
0709 13:01:21.103375 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.103495 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8800,"prepare.queue_time_us":22315,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":5256,"raft.run_cpu_time_us":9159,"raft.run_wall_time_us":34401,"thread_start_us":143424,"threads_started":2,"wal-append.queue_time_us":225946}
I20260709 13:01:21.107429  1706 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:21.107726  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.108250  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.108402  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:21.108911  1706 raft_consensus.cc:2368] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13.
I20260709 13:01:21.109169  6164 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:21.113147  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.113229  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.114001  1704 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:21.114815  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.115470  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:21.115830  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.116060  1560 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:21.052331  6565 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:21.116406  1704 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.116828  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:21.117395  1635 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:21.118532  1553 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:01:21.008983  6326 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:01:21.118602  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:21.117910  1706 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:21.119576  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:21.055341  6613 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:21.123124  1559 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:21.125206  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:21.073421  6600 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:01:21.125558  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 57080.6us
I20260709 13:01:21.114878  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.127456  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.136089  1554 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:21.138267  1554 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:21.071735  6654 consensus_queue.cc:1059] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:01:21.141983  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:21.142580  6662 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:01:21.142659  1708 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:21.143225  6164 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:21.143352  6647 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:21.141801  6477 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:21.144558  6647 raft_consensus.cc:3055] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:21.144944  6647 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:21.145737  6647 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.124979  6565 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:21.146664  6565 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:21.141739  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:21.148115  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:21.148742  1631 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.146143  6477 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:21.143615  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.150524  1702 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:21.150801  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.071519  6325 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:21.072747  6502 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:21.151924  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.151963  1708 raft_consensus.cc:2376] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14. Re-sending same reply.
I20260709 13:01:21.070129  6590 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:21.133505  5723 consensus_meta.cc:287] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.003s
I20260709 13:01:21.158969  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.166617  1708 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:21.168186  1560 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:21.169672  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:21.157694  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.171001  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.160898  1704 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 9.
I20260709 13:01:21.174335  1553 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:21.174742  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:21.174823  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 47460.5us
I20260709 13:01:21.175215  6521 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:21.175472  1704 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:01:21.175834  6521 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:21.163448  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:21.176954  1554 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:21.177219  6521 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.133903  6610 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:21.128826  6276 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:21.155900  6647 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.158380  6155 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:21.183009  6658 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:01:21.131891  6354 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:01:21.187574  1705 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:21.188957  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 844) took 1022 ms. Trace:
I20260709 13:01:21.237370  6260 raft_consensus.cc:3055] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:21.237819  6260 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:21.237735  1703 rpcz_store.cc:276] 0709 13:01:20.166800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.960908 (+794108us) service_pool.cc:224] Handling call
0709 13:01:20.992879 (+ 31971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:21.002637 (+  9758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.188717 (+186080us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b54000b7550. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:21.188888 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72848128}
I20260709 13:01:21.239475  1703 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 10. Ops: [8.10-8.10]
I20260709 13:01:21.238991  6260 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.240129  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 849) took 1034 ms. Trace:
I20260709 13:01:21.240466  1703 rpcz_store.cc:276] 0709 13:01:20.205668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.238939 (+1033271us) service_pool.cc:224] Handling call
0709 13:01:21.239268 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:21.239890 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.240081 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:21.240813  6260 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:21.241626  1703 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:21.242215  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 852) took 1005 ms. Trace:
I20260709 13:01:21.242493  1703 rpcz_store.cc:276] 0709 13:01:20.237275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.241204 (+1003929us) service_pool.cc:224] Handling call
0709 13:01:21.241453 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:21.241982 (+   529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.242169 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:21.243675  1703 raft_consensus.cc:2955] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Committing config change with OpId 13.8: config changed from index 2 to 8, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:21.247418  6646 consensus_queue.cc:1059] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:21.191538  6642 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:21.192828  1557 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:21.250984  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:21.193892  6586 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.201546  6610 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.253466  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:21.254339  1627 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:21.255069  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:21.176316  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.204449  1552 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:21.174015  6325 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:21.258481  1627 raft_consensus.cc:2410] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:21.208649  6590 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.210285  1631 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:21.259586  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:21.210978  1628 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:21.181318  6516 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:01:21.214177  6580 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.214789  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.214923  6621 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:21.215108  1554 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:21.157755  6513 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:01:21.266384  1557 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:21.215646  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 846) took 1039 ms. Trace:
I20260709 13:01:21.266829  1600 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:21.267005  1707 rpcz_store.cc:276] 0709 13:01:20.176555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.180479 (+  3924us) service_pool.cc:224] Handling call
0709 13:01:21.215449 (+1034970us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54000a82d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:21.215591 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525963520}
I20260709 13:01:21.267728  6621 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:21.268250  6621 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:21.218537  6410 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:21.269497  1559 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:21.269132  6621 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:21.269177  6410 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.270577  6586 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.272089  6410 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.220970  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:21.226786  2265 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:21.228469  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:21.274814  1551 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:21.275898  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:21.276786  1627 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.232913  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.235929  6155 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.266880  6513 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:21.282542  6513 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:21.282650  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:21.283380  6155 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.148113  6613 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.252255  1632 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:21.284006  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:21.284049  6523 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:21.284560  6523 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:21.285415  6613 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.285382  6523 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:21.250790  6642 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:21.286507  6513 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.287273  1632 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:01:21.287624  6513 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.287688  6642 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:21.288393  1632 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:21.288959  6642 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.174077  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.261241  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:21.293704  1628 raft_consensus.cc:2368] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13.
I20260709 13:01:21.257097  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 861) took 1016 ms. Trace:
I20260709 13:01:21.296547  1704 rpcz_store.cc:276] 0709 13:01:20.240583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.256226 (+1015643us) service_pool.cc:224] Handling call
0709 13:01:21.256503 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:21.256705 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:21.256741 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:21.256794 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:21.256837 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.256913 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.257033 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:21.261915  6616 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:01:21.299005  6590 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:21.299403  6590 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:21.262944  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 847) took 1081 ms. Trace:
I20260709 13:01:21.286686  6523 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.300129  1709 rpcz_store.cc:276] 0709 13:01:20.182075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.249093 (+1067018us) service_pool.cc:224] Handling call
0709 13:01:21.262344 (+ 13251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:21.262554 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:21.262591 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:21.262645 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:21.262687 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.262754 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.262882 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:21.272406  6418 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.283545  1557 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:21.306814  2234 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:21.175884  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.317390  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:21.317639  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 84840.5us
W20260709 13:01:21.319307  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 143510us
I20260709 13:01:21.319411  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.320148  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:21.321079  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.323128  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.331193  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.330219  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.322340  6597 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.340531  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:21.340226  1627 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
W20260709 13:01:21.335950  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.345662  1673 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:21.347903  2234 leader_election.cc:400] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13.
I20260709 13:01:21.348268  2234 leader_election.cc:403] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:21.323625  6051 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.359543  1706 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:21.327813  6546 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.330782  6542 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:21.366106  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:21.366519  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:21.335317  6601 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:21.339172  6586 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.368759  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:21.369174  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:21.347826  6354 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.353547  5986 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:21.323937  6516 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:01:21.382732  1632 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:21.361135  6548 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.360950  6502 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.360819  6164 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13.
I20260709 13:01:21.390465  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:21.392179  2268 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:21.364660  6542 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:21.394143  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.395427  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:21.371860  6601 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.397521  2268 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:21.398453  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:21.401116  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:21.399525  6542 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.396708  6548 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.405757  6548 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.400095  6601 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:21.414156  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.419227  1707 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:21.420514  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.422933  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.423907  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:21.425357  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.384769  6543 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.430001  1627 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:21.431221  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.431506  1631 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:01:21.431869  1631 pending_rounds.cc:85] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 10
I20260709 13:01:21.432080  1631 pending_rounds.cc:107] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:01:21.432312  1631 raft_consensus.cc:2889] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:21.433485  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.433833  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:21.435967  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:21.436947  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.334245  6590 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:21.439630  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:21.440351  1709 raft_consensus.cc:2368] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16.
I20260709 13:01:21.449905  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 851) took 1213 ms. Trace:
I20260709 13:01:21.450644  2268 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:21.455941  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.457710  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.458459  1706 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:21.450292  1705 rpcz_store.cc:276] 0709 13:01:20.236856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.679201 (+442345us) service_pool.cc:224] Handling call
0709 13:01:21.449739 (+770538us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54000b7f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:21.449849 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156544896}
I20260709 13:01:21.464387  2262 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:21.470778  6590 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:21.468683  6565 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:21.504806  6674 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.182s	user 0.002s	sys 0.000s
W20260709 13:01:21.497212  6676 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:01:21.506865  6673 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
I20260709 13:01:21.560631  1629 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:01:21.561710  1629 pending_rounds.cc:85] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 11
I20260709 13:01:21.562043  1629 pending_rounds.cc:107] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:01:21.562458  1629 raft_consensus.cc:2889] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.562916  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2221) took 1428 ms. Trace:
I20260709 13:01:21.563836  1633 rpcz_store.cc:276] 0709 13:01:20.134321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.139797 (+  5476us) service_pool.cc:224] Handling call
0709 13:01:21.562250 (+1422453us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b540006bdd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:21.562603 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558228224}
I20260709 13:01:21.566512  1630 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:21.568347  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 989) took 1226 ms. Trace:
I20260709 13:01:21.568813  1630 rpcz_store.cc:276] 0709 13:01:20.342081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.342262 (+   181us) service_pool.cc:224] Handling call
0709 13:01:21.565857 (+1223595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:21.567157 (+  1300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.568023 (+   866us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540006bdd0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:21.568245 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2813179264}
I20260709 13:01:21.571738  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:21.583245  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:21.585023  1557 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:21.585801  1551 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:21.589964  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.600060  1526 leader_election.cc:400] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16.
I20260709 13:01:21.600606  1526 leader_election.cc:403] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:01:21.607476  5889 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.609444  6260 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:21.612747  6260 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:21.619436  6155 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:21.617358  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 271694us
I20260709 13:01:21.624553  6325 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:21.626425  6277 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16.
I20260709 13:01:21.610455  6051 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:21.628997  6051 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:21.630225  6325 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:21.624068  6410 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:21.625974  6354 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:21.630432  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 59253.3us
I20260709 13:01:21.819944  2271 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:21.622802  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.820228  6588 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:21.622093  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.788055  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 842) took 1655 ms. Trace:
W20260709 13:01:21.794729  6642 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.505s	user 0.023s	sys 0.001s
I20260709 13:01:21.827003  6238 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:21.837337  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 215460us
W20260709 13:01:21.824277  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 201772us
I20260709 13:01:21.842365  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:21.843794  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:21.844110  6654 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:21.845099  1526 leader_election.cc:400] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13.
I20260709 13:01:21.845461  1526 leader_election.cc:403] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:21.846328  6613 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13.
I20260709 13:01:21.848390  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.819865  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:21.666384  6601 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.824229  6615 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:21.853876  1702 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:21.821686  1701 rpcz_store.cc:276] 0709 13:01:20.132605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.904548 (+771943us) service_pool.cc:224] Handling call
0709 13:01:20.904885 (+   337us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:20.985157 (+ 80272us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:20.985452 (+   295us) log.cc:844] Serialized 14 byte log entry
0709 13:01:21.087844 (+102392us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b180032a160. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:01:21.223596 (+135752us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b48001e0258. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:01:21.618671 (+395075us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:21.619854 (+  1183us) log.cc:844] Serialized 52 byte log entry
0709 13:01:21.620112 (+   258us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:21.620153 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.620296 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:21.787496 (+167200us) raft_consensus.cc:1685] finished
0709 13:01:21.787527 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.787770 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":244726,"prepare.queue_time_us":572,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":257985,"raft.run_cpu_time_us":8633,"raft.run_wall_time_us":402396,"spinlock_wait_cycles":34384000,"thread_start_us":456331,"threads_started":1,"wal-append.queue_time_us":510156}
I20260709 13:01:21.804464  1555 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:21.836334  6642 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:21.854334  6615 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:21.853243  6601 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.857278  6617 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.858507  6615 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.859778  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:21.861027  6654 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:21.862411  6654 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:21.857208  6513 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.569s	user 0.005s	sys 0.016s
I20260709 13:01:21.879138  6565 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:21.897853  6418 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.898413  1526 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.900138  6531 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:21.900660  6531 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:21.901494  6565 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:21.902312  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 213449us
W20260709 13:01:21.913656  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.902779  6051 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:21.903841  6325 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:21.904951  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 85343.1us
W20260709 13:01:21.920142  6542 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.012s
I20260709 13:01:21.920719  6542 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.922250  6531 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:21.924697  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 65111.6us
I20260709 13:01:21.926476  6496 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:21.905172  6276 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:21.905969  6521 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:21.911918  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:21.912535  1557 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:21.926294  6531 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:21.927038  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 857) took 1687 ms. Trace:
I20260709 13:01:21.971949  1703 rpcz_store.cc:276] 0709 13:01:20.239136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.243149 (+1004013us) service_pool.cc:224] Handling call
0709 13:01:21.243393 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:21.243571 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:21.254129 (+ 10558us) log.cc:844] Serialized 14 byte log entry
0709 13:01:21.505776 (+251647us) spinlock_profiling.cc:243] Waited 6.63 ms on lock 0x7b180043b820. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db
0709 13:01:21.506190 (+   414us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:21.593303 (+ 87113us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b180043b820. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06e19c73c7 00007f06ddfd99a7 00007f06ddfe90bf 00007f06ddfe9038
0709 13:01:21.810162 (+216859us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b180043b820. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:01:21.850691 (+ 40529us) log.cc:844] Serialized 14 byte log entry
0709 13:01:21.926372 (+ 75681us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:21.926447 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:21.926507 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.926633 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.926810 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42292,"prepare.queue_time_us":36291,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":43426,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":7468,"spinlock_wait_cycles":42805632,"thread_start_us":259569,"threads_started":2,"wal-append.queue_time_us":67951}
I20260709 13:01:21.938189  1700 raft_consensus.cc:2410] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:21.952222  6516 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:21.955391  6517 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 13:01:21.928395  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.934173  1708 raft_consensus.cc:2410] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:21.848302  6429 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:21.929891  6671 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:01:21.977000  6429 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:21.962980  6642 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:01:21.977813  6565 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:21.978339  6565 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:21.974969  6516 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.979619  6429 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:21.979343  6565 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:21.919128  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.980497  6565 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:21.980566  6516 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:21.981117  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.927184  6496 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:01:21.929558  6523 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.009s
I20260709 13:01:21.940897  6542 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:21.982590  6496 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:21.957585  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:21.905627  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:21.927078  5723 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:21.927577  6161 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 13:01:21.986914  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 81489us
I20260709 13:01:21.987440  6161 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:21.987898  6161 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:21.988319  5723 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:21.989048  5723 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:21.990489  6521 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:21.990785  6427 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:21.979497  6642 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:21.991988  6642 consensus_queue.cc:1243] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:21.991637  6521 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.992476  6601 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:21.993021  6601 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:01:21.939941  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 86648.4us
I20260709 13:01:21.994216  6601 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:21.995679  6516 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:21.997360  6260 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:21.997840  6260 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:21.998857  6517 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:21.999384  6517 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:21.999243  6260 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.000717  6260 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.000766  6517 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:21.975427  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 848) took 1789 ms. Trace:
I20260709 13:01:22.002445  6517 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:22.002249  1700 rpcz_store.cc:276] 0709 13:01:20.185992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.744735 (+558743us) service_pool.cc:224] Handling call
0709 13:01:21.975214 (+1230479us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400233f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:21.975356 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653416320}
I20260709 13:01:22.003917  6601 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:22.003880  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.997833  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:21.962111  6238 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:22.012841  1626 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:21.948331  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.017050  1601 leader_election.cc:400] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16.
I20260709 13:01:22.017390  1559 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:01:22.017520  6590 consensus_meta.cc:287] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.006s
I20260709 13:01:22.017836  6615 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.018267  6671 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:21.966195  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.023907  1631 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:22.086762  6523 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:21.976006  6276 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:22.087682  6238 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:22.095863  6276 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:22.095963  6238 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:22.097088  6238 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.098448  6238 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:22.024273  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.026082  1630 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:01:22.102429  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.027199  6589 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:22.028394  6410 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:21.964541  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:22.103305  6523 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.104357  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:21.983441  6542 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:22.105118  2262 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.104830  6523 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.107098  6523 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:22.092133  6615 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:22.104398  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.109315  1557 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:22.013794  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.077538  1601 leader_election.cc:403] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:01:22.081283  6260 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:22.081491  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:22.086580  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 88924.9us
I20260709 13:01:22.101760  2271 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:22.077282  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.086203  1553 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:22.105125  6542 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:22.118103  6542 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:22.118749  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 101910us
I20260709 13:01:22.120289  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.114594  6260 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:22.122476  6260 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.122546  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.123385  1707 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
W20260709 13:01:22.124051  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.124192  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:22.125233  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.092417  5723 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.126293  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.126642  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.127382  1702 raft_consensus.cc:2368] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14.
I20260709 13:01:22.127930  1705 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:22.128535  5723 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.126327  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.129698  1706 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:22.130298  1703 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:22.130366  6589 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:22.130802  6589 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:22.131852  6589 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.132653  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:22.133224  6589 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.133553  1629 raft_consensus.cc:2410] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:01:22.134212  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.135710  1630 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:22.137806  5889 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:22.138792  1633 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:22.139830  5889 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:22.140241  5889 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:22.141165  5889 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:22.142370  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 138610us
I20260709 13:01:22.143371  1703 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:22.143978  6542 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.146234  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.145416  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:22.147207  6642 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:22.147539  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.148396  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:22.148423  1703 raft_consensus.cc:2410] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:22.149420  1634 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:22.149780  6523 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:22.150703  6617 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:22.151113  6617 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:22.151499  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:22.151813  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 43902.1us
I20260709 13:01:22.152678  6653 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:22.153467  6653 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:22.155798  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.156105  1700 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:01:22.152086  6617 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.156463  1700 pending_rounds.cc:85] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 9
I20260709 13:01:22.156730  1700 pending_rounds.cc:107] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:01:22.156962  1700 raft_consensus.cc:2889] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:22.170392  1626 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:22.159778  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:22.161414  6542 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:22.176031  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:22.163198  2262 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:22.167425  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.179885  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:21.989274  6161 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.161448  6617 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.166473  5889 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.198355  1634 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:22.186697  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:22.175580  6427 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16.
I20260709 13:01:22.205979  1700 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:22.157008  6260 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.157071  6609 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:01:22.206612  6553 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.185494  6531 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:22.210780  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:22.216678  1709 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:22.175468  6429 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:01:22.222527  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.205235  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:22.203142  6615 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:22.226787  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.227401  1704 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
W20260709 13:01:22.234601  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.235447  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 160832us
I20260709 13:01:22.243911  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.244879  6655 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:22.245405  6655 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.245779  6655 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:22.246459  6354 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.246750  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:22.247056  6354 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.249394  6354 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:22.251065  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:22.252656  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:22.233276  6642 consensus_queue.cc:1175] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6923294c847b48ebb577e0935d316aa3" responder_term: 14 status { last_received { term: 14 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 14 index: 10 } }
W20260709 13:01:22.262300  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 90511.3us
I20260709 13:01:22.256697  6410 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.221405  6531 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.256789  6619 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.275918  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:22.279372  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:22.220536  6553 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.261570  6654 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:22.273469  6615 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:22.291419  1601 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:22.294834  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.299548  6502 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:22.300526  6161 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:22.301105  6051 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:22.301106  6606 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:22.283023  6410 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.286459  6590 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:22.318109  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47432.4us
I20260709 13:01:22.318825  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:22.320621  1599 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:22.323005  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:22.325426  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:22.328266  6616 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:22.332216  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 99231.8us
I20260709 13:01:22.317464  6615 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:22.291883  6619 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.339126  1555 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:22.325205  6260 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:22.347523  6615 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.351290  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.354146  6410 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:22.355162  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.332818  6051 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:01:22.341194  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.344575  6671 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:22.345827  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:22.347510  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:22.348960  6619 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:22.349152  1630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:22.358515  6553 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:22.395149  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:22.358779  6325 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:22.369187  6654 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.367784  6051 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.401127  6418 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:22.397761  1630 raft_consensus.cc:606] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:22.342654  6502 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:01:22.389309  6531 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:22.391702  6613 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:22.405844  6051 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:22.403034  6671 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:22.412350  6619 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:22.407929  6325 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:01:22.443739  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 98064us
W20260709 13:01:22.455641  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 52818.9us
W20260709 13:01:22.456678  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 109262us
I20260709 13:01:22.461306  5723 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:22.461992  5723 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.464273  5723 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.461007  6655 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.465019  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.465444  6276 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.466532  6655 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.467344  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:22.467646  6276 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:22.467914  1557 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:22.465946  1555 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:01:22.470990  6690 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:22.471599  5889 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.473150  5889 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.476918  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.480376  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:22.481603  1634 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:22.482931  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:22.479877  5889 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:22.483754  6655 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:22.478636  1557 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:22.486145  5723 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:22.487038  6655 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.443809  6418 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.407192  6654 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.509328  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:22.511541  1599 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:22.516093  1634 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:22.520709  6418 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.521052  1703 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:22.506976  6161 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.526983  6161 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.527356  6325 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.535844  6529 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:22.536506  6529 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:22.495085  6655 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:22.549880  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.551748  2236 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:22.551832  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.552995  1560 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
W20260709 13:01:22.558311  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 53388.2us
I20260709 13:01:22.487421  5723 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.547953  5889 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:22.587021  5889 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:22.588356  5889 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.590265  6260 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:22.590516  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.591326  1555 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:22.487425  6671 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.577273  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:22.594735  1526 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:22.596482  6565 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:22.596987  6667 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:22.597254  6565 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:22.537627  6529 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.598928  6529 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.599135  6410 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.599560  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:22.600338  1631 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:22.599907  6410 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.557555  6601 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:01:22.597836  6667 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
W20260709 13:01:22.603173  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 107184us
I20260709 13:01:22.603621  1673 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:22.605242  2236 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:22.605820  6617 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:22.606314  6617 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.606475  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:22.606791  6617 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:22.582211  6654 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:22.560487  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:22.553118  6619 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:22.638401  6410 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.643064  6655 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.646700  6655 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:22.649632  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:22.650363  1629 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:22.626711  6260 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:22.630714  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 318547us
W20260709 13:01:22.663403  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 338044us
I20260709 13:01:22.661743  1630 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
W20260709 13:01:22.666990  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 61860.2us
I20260709 13:01:22.668008  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:22.669090  6553 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:22.669625  2236 leader_election.cc:400] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14.
W20260709 13:01:22.674345  6687 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.438s	user 0.008s	sys 0.000s
I20260709 13:01:22.675905  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.676076  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.676641  1700 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:22.676709  1709 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:22.681443  6627 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.682240  6516 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.682075  6627 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.682829  6516 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.684500  6627 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:22.685001  6516 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:22.686661  5723 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.687932  1629 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:22.687691  6521 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:22.690735  1601 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:22.691769  2236 leader_election.cc:403] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:22.695642  6410 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:22.696700  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:22.693460  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:22.652457  6619 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:22.653992  6260 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:22.697901  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:22.701436  1705 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:22.704221  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:22.699770  6410 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.710384  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:22.684546  6588 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:01:22.713480  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.714686  1629 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:22.737488  6531 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14.
I20260709 13:01:22.742547  6619 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.742601  6627 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:22.744809  6627 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.747997  6627 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:22.708498  6276 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:22.706669  6616 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:22.764526  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.758342  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 161911us
I20260709 13:01:22.711148  6260 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:22.715360  6410 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:22.770902  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:22.784138  1632 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:01:22.786751  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 117285us
W20260709 13:01:22.771528  6693 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:01:22.778664  6617 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.780133  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:22.780802  6615 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.782454  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.715268  6655 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:22.782260  6276 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.709843  5723 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:22.803589  1553 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:22.788472  1674 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:22.781890  1555 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:22.802459  1557 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:22.738114  6588 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:22.824414  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.786823  6616 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.839169  1559 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:22.841727  5889 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:22.799394  6161 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.804486  6155 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.817710  6671 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:22.851203  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:22.830849  6655 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:22.804105  6697 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:22.857700  6655 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.857352  6697 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.866312  5889 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.866367  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2495) took 1428 ms. Trace:
I20260709 13:01:22.844506  6653 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:22.841768  6616 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:22.869607  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:22.843523  6654 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:22.867311  1704 rpcz_store.cc:276] 0709 13:01:21.438380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.455603 (+ 17223us) service_pool.cc:224] Handling call
0709 13:01:22.864172 (+1408569us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54001c48d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:22.866294 (+  2122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755703040}
I20260709 13:01:22.876471  6161 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:22.876991  6161 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:22.877558  6161 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.877069  6588 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.878708  6588 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:22.879268  1559 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:22.880882  6565 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:22.880824  6051 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.881608  6565 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.883697  6565 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.884950  6553 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:22.885473  6553 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.809036  6615 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.890180  6589 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:22.891155  5889 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.890146  6553 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:22.891824  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:22.892421  1557 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:22.891995  6051 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.892885  6615 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:22.893497  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 53731.2us
I20260709 13:01:22.893805  6615 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:22.893994  6238 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:22.894379  2236 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:22.847718  6429 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:22.897686  1631 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:22.898926  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:22.900123  6276 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.872421  6653 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.885417  6161 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.911545  6410 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.914289  6617 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:22.916358  6698 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:01:22.934401  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 113636us
W20260709 13:01:22.917452  6694 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.240s	user 0.001s	sys 0.001s
I20260709 13:01:22.839777  6513 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:01:22.919250  6531 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.921865  6653 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:22.923409  6654 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.855582  6155 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:22.934969  6553 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:22.945556  6155 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:22.927103  6697 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.929419  1557 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:22.930626  6429 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.948402  6429 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.860493  5723 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:22.950409  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 56112.5us
I20260709 13:01:22.950997  5723 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:22.945271  6531 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.953188  6531 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:22.942109  6667 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:01:22.934795  6051 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:01:22.940675  6276 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:01:22.896226  6671 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.961364  6161 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.963068  6671 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:22.979185  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:22.980106  1626 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:22.959250  6653 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.989718  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:22.990963  6516 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:22.991699  6516 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:22.993935  6516 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:22.993731  6531 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:01:22.999118  6260 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.000294  2262 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:22.995857  6410 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:23.005406  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.006071  2265 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:23.006583  2266 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:23.007388  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.008008  2267 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:23.008541  2268 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:23.009097  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.009827  2263 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:22.987416  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:23.017653  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 91304.1us
I20260709 13:01:23.020278  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:22.963486  6654 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:23.022256  2262 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:23.024510  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:23.025125  1557 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:23.027001  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:23.034554  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:23.037901  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 199335us
I20260709 13:01:22.987828  6276 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:01:23.040740  6696 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:23.041992  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.043370  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.043599  6654 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:23.043725  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:23.044265  6654 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.045071  1635 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:01:23.045097  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.046274  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:23.046633  1560 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 12: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:23.046808  1703 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:23.048028  2262 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:23.011618  6671 consensus_queue.cc:1059] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:01:23.050629  6276 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:23.050983  6276 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:23.051808  6276 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.052381  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.053781  6155 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:23.052446  6531 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:23.054432  6609 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.054858  6531 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.054994  6609 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.056226  6155 raft_consensus.cc:697] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:23.059098  6260 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:23.060065  6609 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:23.044461  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.057140  6531 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:23.075019  2270 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:23.081166  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.080569  1705 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:23.080780  1626 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:23.078378  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.080158  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:23.089020  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.089350  1632 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:23.093679  2263 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:23.096146  1557 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:23.035804  6161 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:23.081202  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:23.077921  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.079039  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:23.108584  1552 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:23.106763  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:23.110925  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:23.116621  1559 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:23.117121  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.118366  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:23.123490  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:23.125589  1554 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:23.125964  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:23.116482  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:23.117576  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:23.079560  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.129457  1556 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 10: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:23.080112  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.134699  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:23.125962  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.135736  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:23.080991  6429 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:23.126782  1708 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:23.137094  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:23.080154  6276 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.118468  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:23.075352  6709 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.139587  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.076386  6529 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.140192  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:23.147161  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.158001  1702 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:23.165017  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:23.165747  1702 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:23.167448  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.168207  2266 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:23.149008  1706 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.078923  6708 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:01:23.158547  1705 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:23.116811  6502 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:23.136883  6161 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.184358  2265 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:23.141443  6429 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:23.147768  6590 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:01:23.157229  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:23.060904  6616 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.058735  6155 consensus_queue.cc:237] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.199827  1704 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:23.153155  6410 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:23.172967  1703 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:23.207389  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:23.160092  2268 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:23.161293  1560 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
I20260709 13:01:23.180197  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:23.162675  2267 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:23.162377  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63307.6us
I20260709 13:01:23.163986  1626 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 8.
I20260709 13:01:23.182521  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:23.162168  1700 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:23.161847  2270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:01:23.210835  2270 raft_consensus.cc:606] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:23.151458  6531 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.211323  2270 raft_consensus.cc:614] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:23.140079  6513 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:23.190346  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.142769  6615 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.198683  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.198912  1632 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:23.204212  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:23.207037  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:23.203797  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 78041.6us
I20260709 13:01:23.215078  2262 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:23.226470  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.214928  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:23.215531  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.215986  6410 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:23.216104  6616 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:23.161648  6529 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.216463  6513 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.219444  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:23.227540  2265 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:23.208293  1709 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:23.162355  6654 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:23.162851  6671 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.224156  1630 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:01:23.151901  6701 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:01:23.241393  1708 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:01:23.236943  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.229252  6410 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:23.223711  6502 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.256438  1631 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:23.265136  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.265980  2265 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:23.269328  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:23.270052  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.270221  5889 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:23.261983  1633 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:23.179327  6709 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.278465  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.284005  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:23.226328  6531 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.291653  1599 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:23.276553  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 153169us
I20260709 13:01:23.298091  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:23.300596  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:23.263561  6627 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.314471  6553 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:23.320909  6715 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:23.302520  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:23.335676  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.343116  1706 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:23.302920  6655 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:23.349339  2270 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:23.303134  6708 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:23.366897  1559 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:23.340008  6502 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:23.368256  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 98965.1us
I20260709 13:01:23.369844  1560 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:23.357560  6655 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.377326  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.368462  6606 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.340281  6627 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.378968  6655 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.382537  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:23.382936  6161 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:23.383430  6724 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:23.384430  6716 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:01:23.403578  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 112050us
I20260709 13:01:23.404397  1599 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:23.405664  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:01:23.389933  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 106039us
I20260709 13:01:23.408362  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:23.408555  6588 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:23.396659  1706 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:23.408964  6588 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.408834  6720 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:23.409423  6588 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:23.409849  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:23.410099  6720 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:23.410487  1706 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:23.410518  6720 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:23.411615  6720 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.412381  6517 raft_consensus.cc:993] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 13:01:23.398536  1709 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:23.399256  1700 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:23.402911  6724 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.386832  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:23.412894  6517 raft_consensus.cc:1081] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Signalling peer 87144ea1a4a14ab8b942fb426159f031 to start an election
I20260709 13:01:23.426087  6720 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:23.426638  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.426944  6719 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:01:23.428491  6713 log.cc:927] Time spent T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:01:23.428583  1702 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.394904  6502 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:23.430825  6709 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:23.432735  6627 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:23.433252  2268 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:23.408566  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:23.424162  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:23.448632  1702 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:23.451315  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:23.462082  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:23.437664  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 70975.1us
I20260709 13:01:23.374246  6708 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.378630  6667 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:23.494083  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.494999  2266 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
W20260709 13:01:23.501073  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 95513.3us
I20260709 13:01:23.501940  6529 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:23.502686  6529 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:23.503937  6529 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:23.504374  6529 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:23.430845  6502 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.509073  6721 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:01:23.510248  6718 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:01:23.510839  6721 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:23.511662  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.512560  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:23.513881  6616 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:23.514412  6616 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:23.514847  6616 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.518219  1560 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 12: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:23.520684  6708 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:23.522710  6667 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.495409  6513 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:23.529551  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.530391  1557 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:23.470216  6427 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:23.531312  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.531517  6427 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:23.492120  6627 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:23.532017  6427 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.532456  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.530414  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.533064  1557 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:23.512881  6531 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:23.531908  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.534116  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.534869  1555 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
W20260709 13:01:23.548223  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 97035.9us
I20260709 13:01:23.554162  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.525717  6667 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:23.554194  6619 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:01:23.556583  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.553963  6260 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:23.560599  2266 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:23.562315  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:23.564064  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.566299  2267 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:23.576548  6606 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.578168  1707 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:23.579209  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.579843  1560 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:23.580605  6260 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:23.582301  6732 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:23.584522  6732 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:23.584939  6732 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:23.579743  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:23.588074  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:23.589044  6627 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.590548  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:23.589834  6627 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:23.591467  6627 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.591873  6627 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.595958  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:23.599083  2235 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:23.611883  1552 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:23.626904  1558 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:23.626820  6655 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.594660  6732 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.634522  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:23.635331  6732 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.635814  6729 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:23.636261  6729 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.636399  6513 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:23.636694  6729 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.636919  6513 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.638262  6731 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:23.638824  6731 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.639259  6731 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.640905  6531 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.641481  6531 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.643761  6730 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:23.644503  6730 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.505336  6529 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.654910  6161 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:23.655637  6161 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.631803  6667 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.632017  6260 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.549147  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:23.673314  1700 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:23.654690  6735 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:01:23.729405  6730 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:23.730515  2264 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:23.636247  6655 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:23.754307  2264 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:23.745653  6427 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.756807  6427 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:23.760802  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.727707  6616 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.760617  6655 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.772248  6655 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.774969  6655 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:23.777407  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.778187  2264 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:23.728448  6588 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.775043  6724 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:23.786787  6731 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.791298  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:23.791887  1552 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.794780  6513 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:23.782047  6260 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:23.801875  6531 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:23.814247  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 265274us
I20260709 13:01:23.815297  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:23.814822  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:23.816388  1703 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:23.810909  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.825832  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:23.823442  1554 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:23.830233  1552 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:23.838382  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:23.838464  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:23.841355  6565 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:23.842319  1704 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:23.843291  1453 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 8 to 12, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.846827  6708 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:23.847519  1630 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:23.849181  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.849759  2271 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:23.850422  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.851018  1635 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:23.852370  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.852406  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:23.853982  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.829914  6732 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:23.829711  6161 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:23.860419  6565 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:23.867391  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.901432  6745 raft_consensus.cc:2764] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:23.839347  6724 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:01:23.901875  1556 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:23.902004  6671 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.903053  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.904757  1557 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:01:23.916203  1557 pending_rounds.cc:85] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 7
I20260709 13:01:23.916461  1557 pending_rounds.cc:107] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:01:23.916811  1557 raft_consensus.cc:2889] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:23.854185  6731 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:23.831861  6260 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:01:23.848345  6276 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:23.914332  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:23.915082  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 62760.7us
I20260709 13:01:23.859704  6732 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:23.859826  6531 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:23.911399  6565 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.921690  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:23.935088  1551 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.918974  6513 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:23.912622  6735 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.926777  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:23.924420  1556 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 9.
W20260709 13:01:23.937112  6737 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:23.938489  1630 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:01:23.940224  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 109435us
I20260709 13:01:23.940958  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.940527  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:23.930433  6732 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:23.943711  2236 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:23.944447  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.945036  1632 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:23.945225  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:23.947013  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.943936  1557 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:23.948050  6553 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:23.950723  2236 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:23.951632  1557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f"
dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:42086
I20260709 13:01:23.951705  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.952289  1557 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.952622  1626 raft_consensus.cc:2410] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:23.947247  6565 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:23.952662  1557 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.959185  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.924731  6671 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.963214  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:23.961917  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:23.960907  1557 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.943363  6513 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:23.968415  1627 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:01:23.966060  6565 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:01:23.946452  6749 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:23.949115  6516 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:23.949745  6724 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:23.961359  6531 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:23.976272  1630 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:23.936389  6627 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.974711  1557 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:23.969702  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:23.964205  6721 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.983377  6429 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.984855  6429 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.987200  6588 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:23.989239  6553 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:23.989727  6553 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:23.970173  6745 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:23.962814  6708 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:01:23.975834  6724 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.006150  6748 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:24.006695  6748 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.007053  6748 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.977367  6531 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:23.948594  6735 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.975447  6749 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:24.010394  6531 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:24.018205  6513 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.993186  6721 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:23.994855  6745 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:23.997730  6588 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.011655  6724 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.025975  6553 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.068545  6732 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:23.992379  6565 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:01:24.077163  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:24.078636  6553 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:24.026629  6742 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:01:24.027710  6410 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.084795  6410 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.085374  6732 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.087253  1554 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:24.088418  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:24.089003  1560 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:24.096942  6653 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:24.098125  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:24.029608  6627 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.037276  6745 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:24.043578  2234 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:24.047643  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:24.054239  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.055181  1627 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:24.105201  1601 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:24.058466  1626 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:24.106391  1601 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:24.101804  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 58315us
I20260709 13:01:24.063340  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:24.056301  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:24.059345  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:24.109526  1631 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.060446  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:24.140039  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 174610us
I20260709 13:01:24.142270  1629 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:24.143249  1633 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:24.147310  1551 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:24.046434  1453 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 2 to 9, term changed from 10 to 13, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to <none>, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 13 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:24.119191  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:24.059470  6747 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:24.037395  6721 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.050181  6613 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:24.162086  2234 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:24.048365  6051 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:24.176313  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 217726us
I20260709 13:01:24.057008  6735 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.144832  6606 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:24.141809  6627 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:24.051345  6615 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:24.058606  6671 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:24.155917  6590 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:24.177441  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:24.178823  1631 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:24.162292  1560 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:24.163295  6521 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:24.038635  6588 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.175984  6613 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:01:24.229532  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 52226.6us
I20260709 13:01:24.233106  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:24.234481  6276 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:24.234891  6276 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:24.235283  6276 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:24.207124  6615 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:24.238132  6671 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:24.238494  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:24.238166  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:24.238902  6615 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.239869  1632 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:24.240159  6615 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.238660  6671 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.240680  6671 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:24.238914  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:24.206786  6627 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:24.241986  1631 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:24.242304  6627 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:24.244156  6749 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.245193  6749 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:24.245568  6276 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.248672  6276 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:24.248517  6671 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.249286  6627 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.203254  6051 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.251232  6671 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:24.251988  6051 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.209843  6721 consensus_queue.cc:1059] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:01:24.253285  6531 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.254338  1635 raft_consensus.cc:3055] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:24.254688  1635 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:24.255935  6531 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.256824  6667 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:24.256076  1635 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.258864  1635 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.257941  6667 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:24.260063  6667 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:24.260011  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:24.260990  6667 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.259112  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:24.260937  6276 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.261518  6723 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:01:24.264688  6667 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:24.261634  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:24.270861  6723 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.271597  6723 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:24.271870  6516 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:24.272742  6735 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:24.274268  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:24.277064  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:24.277664  1631 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:24.279871  6724 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.282470  1552 raft_consensus.cc:2368] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13.
I20260709 13:01:24.226876  6521 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.283294  6521 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.285151  6616 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:24.283411  6627 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.285846  6529 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.295162  1631 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
W20260709 13:01:24.241847  6743 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.431s	user 0.000s	sys 0.001s
I20260709 13:01:24.296355  1600 leader_election.cc:400] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13.
I20260709 13:01:24.296949  1635 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:24.298408  1600 leader_election.cc:403] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:01:24.209268  6720 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:24.302673  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:24.299858  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:24.305473  1627 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:24.226354  6606 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:24.227896  6619 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:24.297712  6719 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:24.309962  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:24.281987  6724 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:24.299690  6721 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:01:24.299120  6590 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:24.312026  6616 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:24.347405  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.336510  6723 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:24.337284  6667 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:24.307722  6720 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:24.354429  6729 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.717s	user 0.008s	sys 0.009s
I20260709 13:01:24.367861  2263 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:24.363745  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 159751us
I20260709 13:01:24.315125  6619 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.377460  2268 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:01:24.377873  2268 pending_rounds.cc:85] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 9
I20260709 13:01:24.378383  2268 pending_rounds.cc:107] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:01:24.378675  2268 raft_consensus.cc:2889] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:24.379381  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:24.381058  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:24.381672  1560 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:24.381969  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:24.382735  2270 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:24.386150  6606 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.386775  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:24.387305  1559 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:24.393287  6745 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.394256  6590 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:24.394999  6750 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.441s	user 0.000s	sys 0.001s
I20260709 13:01:24.376730  6729 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.397423  6720 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.398114  6759 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:24.399783  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:24.400072  6667 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:01:24.401532  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 490223us
I20260709 13:01:24.438814  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:24.405826  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.406334  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:24.407071  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:24.441629  1705 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:24.407764  6619 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.411399  1560 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:24.411787  1559 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:24.418819  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:24.421679  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49974.3us
I20260709 13:01:24.363905  6731 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.427603  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:24.446137  1551 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 12: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:24.432402  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:24.433094  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:24.432448  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:24.447463  2270 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:24.423714  6655 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.449263  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:24.452476  1554 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:24.456112  6627 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.455816  6521 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.456897  6723 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:24.425729  6653 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:24.457284  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.459157  6655 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.460155  6730 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:24.460788  6730 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:24.461575  6655 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:24.463951  2266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e325950f4164ab99442980dc2c53386"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:01:24.456651  6627 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.464586  2266 raft_consensus.cc:606] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:24.464977  2266 raft_consensus.cc:614] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:24.466198  6627 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:24.467913  2268 raft_consensus.cc:2368] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13.
I20260709 13:01:24.446885  1707 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:24.470153  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:24.500202  1709 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:24.502399  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:24.505764  1630 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:24.508030  2262 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:24.510375  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:24.515108  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.515210  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:24.526865  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:24.457355  6723 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:24.457599  6653 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.499266  6615 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.372697  6613 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.501302  6655 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:24.555387  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.529502  6627 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:24.438853  6759 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.461809  6730 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.502197  6731 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.513128  6748 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.614437  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:24.615288  2266 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:24.616451  2267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:01:24.617229  2267 raft_consensus.cc:606] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:24.617624  2267 raft_consensus.cc:614] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:24.618453  1599 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:24.618767  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.621323  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:24.574373  6615 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.622702  1557 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:24.621300  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:24.576818  6655 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.625458  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:24.625783  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:24.627302  1704 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:24.627841  2265 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:24.605978  6588 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:24.613046  6627 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:24.631493  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:24.631718  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:24.632301  1551 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:24.636263  6627 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.637811  6615 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.643822  1629 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
W20260709 13:01:24.649642  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 148772us
I20260709 13:01:24.622891  6410 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:24.589702  6667 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:24.656867  6765 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:01:24.676221  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:24.687449  1629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:24.688155  1629 raft_consensus.cc:606] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:24.688520  1629 raft_consensus.cc:614] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:24.639413  6588 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.698525  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:24.697770  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 44130us
I20260709 13:01:24.667171  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:24.709399  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:24.696919  6521 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.710016  1707 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:24.651945  6161 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:24.711894  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:24.709002  1633 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:24.715986  1674 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:24.707760  2262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1084) took 1454 ms (client timeout 1887 ms). Trace:
I20260709 13:01:24.670460  6616 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13.
I20260709 13:01:24.712590  6529 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:24.706300  6757 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 13:01:24.717262  2262 rpcz_store.cc:269] 0709 13:01:23.237037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.241299 (+  4262us) service_pool.cc:224] Handling call
0709 13:01:24.047501 (+806202us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:01:24.691387 (+643886us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b5400550854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:24.691508 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966022400}
I20260709 13:01:24.722263  1601 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:24.726843  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:24.718708   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:24.705636  6609 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:01:24.765731  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 70406.9us
I20260709 13:01:24.711436  6745 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:24.778281  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 51558.8us
W20260709 13:01:24.778805  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.779131  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:24.771135  2270 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:24.770953  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:24.784969  1552 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:24.689565  6429 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.765576  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:24.772316  6774 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:24.768553  6696 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.705310  6155 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:01:24.774159  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:24.719579  6653 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:24.717368  6729 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:24.786393  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:24.789474  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:24.807855  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:24.790051  1554 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:24.792341  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:24.793886  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:24.874922  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:24.801780  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:24.803699  1631 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
W20260709 13:01:24.773198  6773 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.115s	user 0.002s	sys 0.004s
I20260709 13:01:24.868369  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:24.886005  2267 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:24.872160  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:24.872283  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:24.786926  6776 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:24.872561  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 93522.7us
I20260709 13:01:24.783627  6529 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:24.873733  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:24.752437  6161 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.725951  6521 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:01:24.794667  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:24.904026  1560 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.878125  1703 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.876062  2269 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:01:24.876963  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 84733.6us
I20260709 13:01:24.874636  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:24.719695  6588 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:24.876169  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 154023us
I20260709 13:01:24.874871  2268 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:24.882491  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:24.883335  2266 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:24.883352  2234 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:24.914366  1707 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 9.
I20260709 13:01:24.915227  2234 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:24.793502  6749 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:24.887183  2270 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:24.888692  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:24.713192  6775 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
W20260709 13:01:24.922528  6771 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:01:24.924242  6772 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:01:24.918346  6642 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:24.930554  6642 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.932675  6642 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:24.933199  2267 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:24.934294  6748 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.935111  2263 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:24.809203  6696 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.804719  6429 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.936880  6588 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:24.937750  6429 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.884250  6731 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.889569  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:24.938235  6759 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.938669  6767 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:24.887410  6729 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:24.890965  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:24.889278  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:24.891515  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:24.894465  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:24.940410  1702 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:24.941759  1560 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:24.942335  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:24.942957  1552 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:24.890569  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:24.899261  1559 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:24.796134  6609 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:24.796293  6774 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:24.902379  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:24.805202  6744 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:24.872797  6238 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:24.946427  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 52040.8us
I20260709 13:01:24.947058  1709 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:24.921047  1601 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:24.901446  6590 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:24.946305  1627 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:24.874352  6782 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:24.947780  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:24.956920  1706 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:24.892982  6776 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.948405  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:24.900592  6655 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:01:24.948866  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2431) took 1048 ms. Trace:
I20260709 13:01:24.960172  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:24.965823  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:24.971637  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.969955  1551 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:24.983003  1703 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:24.984625  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:24.985637  1703 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:24.987102  1709 raft_consensus.cc:2410] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:01:24.946350  6732 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:24.946606  6744 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.995918  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:24.996876  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:24.948258  6609 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:24.997522  1703 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.951385  6429 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:24.948932  6590 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:24.951565  6642 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:25.016551  6642 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.018896  6642 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:25.003304  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:25.019564  1709 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:24.969561  1553 rpcz_store.cc:276] 0709 13:01:23.900437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.916894 (+ 16457us) service_pool.cc:224] Handling call
0709 13:01:23.925382 (+  8488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.054738 (+129356us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:24.054769 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.055275 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:01:24.328144 (+272869us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:24.328203 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.464418 (+136215us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540020add4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:24.464472 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.939561 (+475089us) raft_consensus.cc:1685] finished
0709 13:01:24.939589 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.948804 (+  9215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39696,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":296640896,"thread_start_us":272418,"threads_started":1,"wal-append.queue_time_us":380905}
I20260709 13:01:24.974440  6588 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:24.968175  6155 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:25.001735  6609 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:25.000226  6744 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:25.039750  6696 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:24.998281  6720 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.040764  6720 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.042958  6720 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:25.045243  6723 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.000s
I20260709 13:01:24.939622  6729 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.047765  6729 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:24.996275  6782 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:01:25.049063  1455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35556 (request call id 319) took 32931 ms (client timeout 15000 ms). Trace:
I20260709 13:01:24.951653  6238 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:24.946702  6749 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:24.968771  6776 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:25.063589  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 69792us
I20260709 13:01:25.065297  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:25.059794  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:25.065922  1557 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:25.050546   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:25.025830  6590 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:25.065789  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:25.070647  1704 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:25.050262  1453 catalog_manager.cc:5697] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 6 to 11, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:25.068030  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:25.075481  6749 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:25.051990  6732 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:25.073591  1600 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:25.045709  6723 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:25.080147  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:25.009639  1702 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:25.086223  1453 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 9 to 11, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:25.080282  1673 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:25.081086  1706 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:25.010846  6775 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:25.063376  6553 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.077242  6588 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:25.079401  6521 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:25.085253  6720 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:25.085775  6155 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:25.087011  6774 raft_consensus.cc:2764] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:01:25.069919  6642 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:01:25.105286  6785 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:25.123724  1453 catalog_manager.cc:5697] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 5 to 11, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:01:25.126371  6238 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:25.134688  6502 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.124446  6723 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:25.109694  6696 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:25.146144  6696 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.145794  6502 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.146714  6696 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:25.149593  6502 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:25.110719  6521 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.049614  6782 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:25.155083  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 65616.5us
I20260709 13:01:25.112722  6588 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:25.163765  1704 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:25.163879  1703 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:25.156196  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:25.106832  6653 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:01:25.109165  6553 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.162393  1453 catalog_manager.cc:5697] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:01:25.173707  1709 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:25.175660  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:25.176067  1673 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:25.177215  1701 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:25.156126  6521 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:25.183651  1703 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:25.184839  1453 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 12 to 14, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.152854  6775 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:01:25.136803  6155 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:25.170972  6619 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.179373  6238 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:25.174249  6529 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.186683  6730 raft_consensus.cc:2764] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:25.200192  1703 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:25.209944  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:25.228686  2236 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:25.215029  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:25.230492  1559 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:25.232605  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:25.188954  1453 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:25.178157  6784 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.233842  6784 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:25.234550  6788 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:25.235234  6642 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:25.236091  6784 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:25.237881  6513 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:25.175019  6732 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.238266  6588 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:25.219455  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:25.239073  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:25.239445  1553 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:25.183776  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:25.240198  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:25.240389  1709 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:25.222824  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:25.241268  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:25.241454  1551 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
W20260709 13:01:25.049481  1455 rpcz_store.cc:269] 0709 13:00:52.117519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.117761 (+   242us) service_pool.cc:224] Handling call
0709 13:01:25.048826 (+32931065us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:20.542169 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:20.560035 (+ 17866us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:20.560099 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:01:20.560119 (+    20us) tablet.cc:662] Decoding operations
0709 13:01:20.560813 (+   694us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:20.560918 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:20.560944 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:01:20.561586 (+   642us) tablet.cc:701] Row locks acquired
0709 13:01:20.561662 (+    76us) write_op.cc:260] PREPARE: finished
0709 13:01:20.561827 (+   165us) write_op.cc:270] Start()
0709 13:01:20.561989 (+   162us) write_op.cc:276] Timestamp: P: 1783602080561761 usec, L: 0
0709 13:01:20.575994 (+ 14005us) op_driver.cc:348] REPLICATION: starting
0709 13:01:20.679180 (+103186us) log.cc:844] Serialized 2089 byte log entry
0709 13:01:21.379313 (+700133us) op_driver.cc:464] REPLICATION: finished
0709 13:01:21.497856 (+118543us) write_op.cc:301] APPLY: starting
0709 13:01:21.497984 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:21.807873 (+309889us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:21.808077 (+   204us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:22.011189 (+203112us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:22.011612 (+   423us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:01:22.011689 (+    77us) write_op.cc:312] APPLY: finished
0709 13:01:22.012201 (+   512us) log.cc:844] Serialized 57 byte log entry
0709 13:01:22.013934 (+  1733us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.014144 (+   210us) write_op.cc:454] Released schema lock
0709 13:01:22.014201 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:22.085516 (+ 71315us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.085548 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":698074,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":114132,"apply.run_cpu_time_us":14481,"apply.run_wall_time_us":577688,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25017,"num_ops":5,"prepare.queue_time_us":210577,"prepare.run_cpu_time_us":32229,"prepare.run_wall_time_us":271746,"raft.queue_time_us":467092,"raft.run_cpu_time_us":11193,"raft.run_wall_time_us":166031,"replication_time_us":779095,"thread_start_us":557815,"threads_started":4,"wal-append.queue_time_us":121568,"wal-append.run_cpu_time_us":69880,"wal-append.run_wall_time_us":2211890}]]}
I20260709 13:01:25.243335  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:25.247583  1709 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: [8.10-10.11]
I20260709 13:01:25.248865  1453 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 7 to 10, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:01:25.249567  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 64299.1us
I20260709 13:01:25.265233  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:25.273067  1703 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
W20260709 13:01:25.259158  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46394.7us
I20260709 13:01:25.249796  6516 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:25.433337  6516 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:25.434363  6516 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.242241  6745 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:25.284910  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:25.438303  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 153528us
W20260709 13:01:25.290009  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.291460  6653 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:25.248448  6513 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:25.292497  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:25.442878  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:25.443801  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 151438us
I20260709 13:01:25.444038  1703 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:25.444155  1551 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:25.299324  1453 catalog_manager.cc:5697] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 3 to 9, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.296253  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:25.395588  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:25.227377  6619 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.279464  6238 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.152s
I20260709 13:01:25.422346  6627 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.423467  6766 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.295397  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:25.461045  6791 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:25.465564  6553 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:25.466935  6155 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:25.469725  2271 raft_consensus.cc:2410] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:25.445151  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:25.403685  6671 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.445494  2268 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:25.241597  6529 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.448844  6794 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:25.444734  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:25.444676  6588 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:25.447212  6709 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:25.474982  1453 catalog_manager.cc:5697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 10 to 14, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.477283  6723 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:25.479452  1703 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:25.486109  6671 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.449157  6513 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:25.491930  6770 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.704s	user 0.009s	sys 0.013s
I20260709 13:01:25.479718  6238 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:25.508584  6161 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:25.510324  6723 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:25.511889  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:25.471235  6653 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.494779  1453 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.530258  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.525480  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.525741  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.487555  6709 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:25.524840  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.522475  6238 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:25.538451  6709 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:25.538687  1627 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:25.531840  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:25.532805  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:25.540038  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.540621  1627 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:25.541101  1633 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:25.472133  6766 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.542956  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.544474  6238 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.547751  1599 leader_election.cc:400] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13.
I20260709 13:01:25.548612  1599 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:25.548027  1453 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 9 to 12, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:25.469213  6627 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.549935  1453 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 9 to 12, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:25.550570  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:25.551169  1628 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:25.553041  6627 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:25.554811  6804 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:25.554226  6513 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.555334  6804 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:25.556336  6804 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.549747  6616 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.558936  6616 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.558869  1453 catalog_manager.cc:5697] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 9 to 12, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.561777  6616 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:25.562517  6785 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:25.563479  1702 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:25.565765  1628 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:25.560714  1453 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 8 to 10, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.567965  1453 catalog_manager.cc:5697] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 6 to 9, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 9 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:25.569829  1453 catalog_manager.cc:5697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 7 to 12, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.572196  1453 catalog_manager.cc:5697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:01:25.576695  6671 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:25.573765  1453 catalog_manager.cc:5697] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:25.578163  6723 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.578764  1453 catalog_manager.cc:5697] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 9 to 11, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.582621  6529 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:25.584314  1626 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:25.583839  1453 catalog_manager.cc:5697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 7 to 10, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.594619  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:25.599114  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.489966  6588 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:25.539355  6609 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 13:01:25.616602  1626 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
W20260709 13:01:25.620090  6744 consensus_meta.cc:287] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.001s
I20260709 13:01:25.601076  6671 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.622013  2267 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:25.620570  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.603727  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.610538  1453 catalog_manager.cc:5697] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 6 to 11, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.600835  6238 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:25.602962  1703 raft_consensus.cc:2410] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:01:25.643375  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:25.601951  6806 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:25.658193  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.669004  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 119635us
I20260709 13:01:25.600574  6696 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.647004  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:25.542528  6653 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:25.686266  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:25.699482  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:25.694430  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 47529.5us
I20260709 13:01:25.701825  1673 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:25.683485  6642 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:25.705221  6642 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.705600  6642 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:25.711588  6653 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:25.622478  6609 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.715793  6609 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:25.716447  1709 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:01:25.715682  6642 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.717325  6766 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:25.719534  1554 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:25.721684  1700 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:25.740059  6642 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:25.620553  6744 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:25.621340  6671 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.765427  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.768671  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:25.769409  1635 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:25.772022  1630 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:25.720674  6794 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.720317  6785 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:25.778275  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 59155.4us
I20260709 13:01:25.785552  1635 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:25.697510  1453 catalog_manager.cc:5697] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:01:25.795470  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:25.747524  6565 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:25.748579  6609 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:25.770941  6723 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:01:25.799944  1453 catalog_manager.cc:5697] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 1 to 8, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:25.764642  6806 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.763482  6155 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:01:25.772310  6619 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:25.776871  6653 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:25.744007  6521 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:25.788125  6785 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:25.835789  6766 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.836395  6766 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.815454  6818 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:25.837527  6818 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:25.838402  6766 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:25.838467  6818 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:25.839450  6778 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.969s	user 0.006s	sys 0.009s
I20260709 13:01:25.841760  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1097) took 1475 ms. Trace:
I20260709 13:01:25.842427  6723 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:25.844034  6671 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:25.844058  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.844594  6671 raft_consensus.cc:3055] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:25.844985  6671 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:25.845010  1626 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:25.845933  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.846683  1627 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:25.845999  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:25.850862  6696 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:25.835599  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.851820  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:25.853137  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:25.853926  1552 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:25.855115  1560 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:25.856551  6806 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:25.858292  6744 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:25.858436  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:25.859077  2266 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:25.859879  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:25.860613  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:25.861107  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:25.861174  2266 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:25.861804  6732 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.862354  6732 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.862982  6731 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.863454  6731 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.864315  6732 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:25.864112  6531 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:25.864938  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:25.865077  1700 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:25.861181  6749 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.790973  6794 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.865935  6731 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:25.894897  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:25.885653  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:25.900679  1629 raft_consensus.cc:2368] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14.
I20260709 13:01:25.945050  6731 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:25.956633  6410 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:01:25.868379  6590 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.778s	user 0.007s	sys 0.005s
I20260709 13:01:25.868808  6810 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:01:25.922144  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:25.962779  6590 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:25.814011  6565 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:25.851796  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:25.964673  1632 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:25.898830  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:25.845853  6671 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.900245  6521 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:25.867245  6588 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:25.962780  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 903) took 1087 ms. Trace:
I20260709 13:01:25.961321  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:25.964036  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 906) took 1087 ms. Trace:
W20260709 13:01:25.943686  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 75602.8us
I20260709 13:01:25.890420  2263 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:25.957260  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:26.008178  6613 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.000219  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 902) took 1124 ms. Trace:
I20260709 13:01:25.974092  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:25.979795  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:25.990473  6724 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:25.945952  6775 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:25.945399  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:26.010979  1708 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:26.012022  1560 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:25.943240  6155 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:25.983521  6590 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:26.012764  6155 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:25.982894  6589 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:25.936241  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:26.014880  1551 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.014601  6589 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.007700  1703 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:25.874768  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:25.961171  1552 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:01:26.015734  6410 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:25.880662  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:26.017769  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:26.017912  6697 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:25.891928  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:25.961357  6794 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:26.018419  6777 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:25.958460  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:26.020370  2268 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:26.009989  2267 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.020596  2266 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:25.895746  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:26.018589  1701 rpcz_store.cc:276] 0709 13:01:24.875533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.937872 (+ 62339us) service_pool.cc:224] Handling call
0709 13:01:24.938349 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.183546 (+245197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.962560 (+779014us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540018a6d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:25.962727 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":548924672}
I20260709 13:01:26.029152  1703 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:26.029224  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:26.011523  6775 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:25.883803  1633 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:26.030157  6777 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:26.030715  6777 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:26.031258  6777 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:26.029826  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:26.031999  1701 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:25.963876  2271 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:26.032945  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:25.872570  6627 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:26.022840  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2545) took 1041 ms. Trace:
I20260709 13:01:26.033485  1701 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.021291  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:26.023939  6815 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:01:26.033648  1706 rpcz_store.cc:276] 0709 13:01:24.981553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.996644 (+ 15091us) service_pool.cc:224] Handling call
0709 13:01:26.022667 (+1026023us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b54003e12d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:26.022783 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192167808}
I20260709 13:01:26.015962  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:26.035100  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:26.036506  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:26.036785  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:26.037040  1706 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 9.
I20260709 13:01:26.037691  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:26.004750  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:26.037827  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:26.038699  1709 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:26.038647  6794 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:26.039237  1706 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:26.039482  6794 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:26.039711  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:26.040360  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:26.020689  6812 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.163s	user 0.003s	sys 0.000s
I20260709 13:01:26.042047  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:26.044538  6749 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.043134  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:25.870752  6776 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.792s	user 0.007s	sys 0.004s
I20260709 13:01:26.044983  1706 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:26.046591  6776 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:26.047911  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:26.008646  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:25.842125  2264 rpcz_store.cc:276] 0709 13:01:24.366638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.366767 (+   129us) service_pool.cc:224] Handling call
0709 13:01:24.381528 (+ 14761us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.428639 (+ 47111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.428677 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.463340 (+ 34663us) log.cc:844] Serialized 26 byte log entry
0709 13:01:24.635138 (+171798us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:24.687182 (+ 52044us) log.cc:844] Serialized 14 byte log entry
0709 13:01:24.689094 (+  1912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.689164 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.492125 (+802961us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b1800348160. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:01:25.838894 (+346769us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:25.841531 (+  2637us) raft_consensus.cc:1685] finished
0709 13:01:25.841551 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.841680 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58662,"prepare.queue_time_us":62307,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":54069,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":8519,"spinlock_wait_cycles":37212160,"thread_start_us":171384,"threads_started":1,"wal-append.queue_time_us":250698}
I20260709 13:01:25.890209  6653 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:26.039918  6794 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:26.068995  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 83044.2us
W20260709 13:01:26.072480  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 231519us
I20260709 13:01:26.090834  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:26.091638  6723 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:01:26.070111  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 195454us
I20260709 13:01:26.093181  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:26.093398  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:26.094049  6767 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:26.088035  1559 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:25.873135  1628 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:26.008873  1707 rpcz_store.cc:276] 0709 13:01:24.875292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.915024 (+ 39732us) service_pool.cc:224] Handling call
0709 13:01:24.933457 (+ 18433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.933663 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:25.108324 (+174661us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.999467 (+891143us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b1800206920. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06e19c73c7 00007f06ddfd99a7 00007f06ddfe90bf 00007f06ddfe9038
0709 13:01:25.999662 (+   195us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.999852 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.999903 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:25.999949 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.000019 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.000131 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":771034,"prepare.queue_time_us":1067571,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":10915,"raft.queue_time_us":199,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":169,"spinlock_wait_cycles":22799360,"thread_start_us":242653,"threads_started":2,"wal-append.queue_time_us":112717}
I20260709 13:01:26.072582  1673 leader_election.cc:400] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14.
I20260709 13:01:26.098376  1673 leader_election.cc:403] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:26.100806  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:26.101641  1632 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:25.960078  6731 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:25.873497  6720 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.754s	user 0.007s	sys 0.005s
I20260709 13:01:26.049836  6627 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:25.890808  6785 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:25.938350  6817 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.820127  1453 catalog_manager.cc:5697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 6 to 13, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.028812  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:26.051179  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:26.045811  1705 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:25.964634  6565 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:26.012193  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 901) took 1137 ms (client timeout 1503 ms). Trace:
I20260709 13:01:25.963408  1702 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:26.011250  6724 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:26.128798  1708 rpcz_store.cc:269] 0709 13:01:24.874838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.874969 (+   131us) service_pool.cc:224] Handling call
0709 13:01:25.979656 (+1104687us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b58001b3398. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaeee 0000000000375939 00007f06e2f1e1e0 00007f06e2fe70c4 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:01:26.012133 (+ 32477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5659776}
W20260709 13:01:26.063057  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 157035us
I20260709 13:01:26.010315  1704 rpcz_store.cc:276] 0709 13:01:24.876393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.082197 (+205804us) service_pool.cc:224] Handling call
0709 13:01:25.089929 (+  7732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.164210 (+ 74281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.963174 (+798964us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b54000b6b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:25.963871 (+   697us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b54000b6b50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:25.963984 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161419904}
I20260709 13:01:26.065399  2270 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:26.065874  6730 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:26.068053  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 187540us
I20260709 13:01:25.991195  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:26.102236  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:26.049542  6776 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:26.075022  6589 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:26.095749  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:26.107322  1703 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:26.073143  6671 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:26.131544  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:26.133001  1526 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:26.105265  1560 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:26.108094  1552 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:26.115600  1551 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:26.111457  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:26.127969  1705 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:26.061841  6521 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:26.120088  2271 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:26.116276  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:26.139700  1632 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:26.122241  1706 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:26.106325  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:26.141005  1703 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:26.088797  1701 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:26.151885  1673 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:26.131258  1453 catalog_manager.cc:5697] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 3 to 11, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:01:26.112434  2267 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:26.142092  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:26.082224  6775 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:26.075376  6749 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:26.147855  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:26.074193  6709 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:26.104859  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.172881  1453 catalog_manager.cc:5697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.123239  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 898) took 1249 ms. Trace:
I20260709 13:01:26.174475  1700 rpcz_store.cc:276] 0709 13:01:24.873961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.874279 (+   318us) service_pool.cc:224] Handling call
0709 13:01:26.122856 (+1248577us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54001def54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:26.123168 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797666304}
I20260709 13:01:26.151049  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:26.156143  1702 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:26.157454  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:26.158509  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:26.178635  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:26.148413  6589 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:26.179632  6589 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.180037  6589 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:26.143095  6601 raft_consensus.cc:2764] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:01:26.131319  6720 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:26.184465  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:26.170567  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:26.170864  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:26.178920  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:26.119215  6653 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:26.167490  1553 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:26.160727  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:26.111629  6238 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:01:26.183292  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:26.165638  2236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.503s (SENT) [suppressed 31 similar messages]
I20260709 13:01:26.182436  1599 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:26.157935  6774 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14.
I20260709 13:01:26.106019  6723 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.124s
I20260709 13:01:26.167933  6155 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:26.118809  6777 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.234745  1633 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:26.234201  1453 catalog_manager.cc:5697] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 11 to 14, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.222631  6784 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:26.236490  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 140821us
I20260709 13:01:26.196909  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:26.225634  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:26.282900  1555 raft_consensus.cc:2368] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13.
I20260709 13:01:26.239841  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:26.234485  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:26.284353  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 99166.7us
I20260709 13:01:26.183023  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:26.286365  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 103417us
I20260709 13:01:26.287181  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:26.233434  6794 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:26.226199   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:26.248850  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 66515.8us
I20260709 13:01:26.292165  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:26.147593  6820 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:26.115899  6799 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.070s
W20260709 13:01:26.251127  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 67912.7us
I20260709 13:01:26.246866  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:26.253675  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.258788  1631 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:26.167128  6790 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:26.146803  6642 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:01:26.263984  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:26.267936  1629 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:26.268437  1552 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:26.183753  6749 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.184067  6767 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:26.222793  6744 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:01:26.131002  6817 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.180267  6764 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:26.166543  6609 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:26.274495  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 139707us
I20260709 13:01:26.293052  6723 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.235637  1559 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:26.279258  1556 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:26.236236  6619 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:26.247064  6782 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:26.134258  6429 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:01:26.285243  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:26.332593  6721 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:26.334180  6529 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:26.304977  6799 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:26.305931  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:26.305308  6809 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:26.310516  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2403) took 1101 ms. Trace:
I20260709 13:01:26.317233  6790 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:26.318949  6709 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:26.295593  6155 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:01:26.320657  6794 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:26.348459  6766 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:01:26.401655  6794 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:26.323431  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:26.372421  6696 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:01:26.339421  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 173805us
W20260709 13:01:26.340809  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.281747  6784 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.427716  1552 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:26.428007  6784 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.428843  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:26.429351  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:26.429440  6790 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.420967  6653 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:26.431208  6697 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:26.431591  6697 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:26.225914  6730 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:26.295590  6606 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:26.432819  6606 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:26.428948  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:26.433310  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 136170us
I20260709 13:01:26.433779  6606 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.434966  1601 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:26.358377  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:26.317010  6785 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.437258  1559 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:26.280377  6667 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:01:26.360670  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:26.443506  1700 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:26.264849  6720 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:26.323935  6767 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:26.367383  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 82248us
I20260709 13:01:26.367691  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:26.306530  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:26.370262  1706 rpcz_store.cc:276] 0709 13:01:25.208962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.116347 (+907385us) service_pool.cc:224] Handling call
0709 13:01:26.121753 (+  5406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.151467 (+ 29714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.310255 (+158788us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b54001ac2d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:26.310437 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11663232}
I20260709 13:01:26.367489  6721 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.317010  6589 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:26.399423  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 93560.2us
I20260709 13:01:26.465381  1705 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:26.321389  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:26.473873  1560 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.401989  6766 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:26.272372  6627 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.410542  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:26.411684  6724 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:26.360791  6723 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.415086  6410 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.438750  6794 raft_consensus.cc:697] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:26.416391  6502 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.194006  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:26.463104  6720 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.430064  2264 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:26.350857  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:26.519678  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 168890us
I20260709 13:01:26.437958  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:26.428755  6824 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:26.453223  1552 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:26.462999  1703 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:26.464627  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:26.473269  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:26.484071  6766 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:26.488227  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:26.527204  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 62674.3us
I20260709 13:01:26.527451  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:26.488660  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:26.528434  1526 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:26.497052  6731 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:26.533537  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44959.6us
I20260709 13:01:26.534348  1674 leader_election.cc:400] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13.
I20260709 13:01:26.492223  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:26.534682  1674 leader_election.cc:403] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:01:26.495278  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:26.493487  1709 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:26.536347  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:26.362104  6810 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.416147  6749 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:26.442535  6730 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:26.369764  6799 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:26.370102  6809 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:26.462116  6655 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:26.513058  1558 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:26.426507  2270 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:26.473672  6767 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.463083  6619 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:26.483491  6721 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.518595  1630 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:26.375303  6776 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:01:26.472535  6696 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:26.525871  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 52667.8us
I20260709 13:01:26.356305  6609 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.454905  6051 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:01:26.523696  1557 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:26.534195  1526 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:26.595315  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 61212us
I20260709 13:01:26.514494  6744 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.482154  1560 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:26.543540  1633 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:26.545014  2264 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:26.521914  6720 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.548369  1635 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:26.559644  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:26.523856  6838 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:26.537232  6818 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:26.537338  6806 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:26.556471  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:26.536803  6724 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:26.566323  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 140789us
I20260709 13:01:26.538774  6161 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:26.546403  6238 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13.
I20260709 13:01:26.517531  6502 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:26.557675  6809 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:26.581921  6759 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:26.590485  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:26.592599  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 106455us
I20260709 13:01:26.575074  6655 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.553077  6731 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:01:26.606840  1551 raft_consensus.cc:2410] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:01:26.579339  6613 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.554788  6553 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:01:26.627890  1635 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 13:01:26.649987  1627 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:26.559815  6817 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:26.633754  2235 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:26.631549  6671 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:26.552251  6810 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.623947  6838 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:26.589675  6799 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:26.632859  6806 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:26.632467  6818 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:26.624590  6744 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:26.656168  1554 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:01:26.703634  1554 pending_rounds.cc:85] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 6
I20260709 13:01:26.703889  1554 pending_rounds.cc:107] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:01:26.704139  1554 raft_consensus.cc:2889] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:26.580842  6766 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:26.705945  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 138867us
W20260709 13:01:26.706818  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 166994us
I20260709 13:01:26.591107  6794 consensus_queue.cc:237] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.685684  6806 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.679275  6838 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.702884  6785 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:26.743441  1674 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:26.741557  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:26.702234  6818 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:26.741559  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 144991us
I20260709 13:01:26.654587  6613 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:26.676085  6161 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:01:26.739810  6766 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:26.774962  1703 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:26.704413  6799 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:26.644439  6730 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:26.778168  1700 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:26.740325  6589 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:26.780259  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:26.787317  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:26.788599  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:26.749042  6410 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:26.680171  6696 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:26.790724  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:26.792680  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:26.796413  1703 raft_consensus.cc:2376] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13. Re-sending same reply.
I20260709 13:01:26.796708  1708 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:26.765602  6840 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.793761  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:26.796442  1700 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:26.743799  6701 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:01:26.744160  6817 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:01:26.798920  1673 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:26.800328  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:26.800624  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 97635.3us
I20260709 13:01:26.782312  6709 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:26.808663  1627 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:26.785398  6723 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:26.813457  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 163290us
I20260709 13:01:26.816461  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:26.817478  2236 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:26.818243  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:26.825712  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.822576  6619 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:26.828930  6855 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.829576  6855 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:26.831735  6855 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:26.832594  6841 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.833105  6849 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:26.846889  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:26.850181  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 216553us
I20260709 13:01:26.850483  1707 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:26.818473  6731 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:26.833289  6841 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.879009  6744 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:26.881080  6859 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:26.882607  6619 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:26.887827  6841 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:26.892241  6839 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:01:26.896389  6854 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:26.897471  6854 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:26.906643  6161 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.907483  6161 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:26.910518  6810 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:26.833956  6849 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.911558  6849 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:26.803324  6671 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:01:26.831732  6613 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:26.846444  6842 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 13:01:26.922605  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 71723us
I20260709 13:01:26.929771  2235 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:26.874881  6238 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:26.875116  6764 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:26.875375  6609 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:26.916057  6627 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:26.955533  2235 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:26.918442  6849 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:26.803918  6840 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:26.966138  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 154386us
I20260709 13:01:26.968003  6841 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:26.955451  6238 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.957418  6764 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:26.966735  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 147997us
I20260709 13:01:26.963267  6627 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.962764  6609 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:26.981088  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 147376us
I20260709 13:01:26.977953  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:26.984175  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:26.984934  2263 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:26.980436  6238 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:26.986547  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 183975us
I20260709 13:01:26.991819  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:26.993330  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:26.993497  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:26.996856  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:26.981936  6764 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:26.985276  6627 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.954169  6720 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.006678  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.009697  2267 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:26.990769  6731 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:27.006613  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.012375  1552 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:27.018625  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:27.020686  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:27.022822  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:27.023826  1631 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:27.024837  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:27.070154  6848 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:01:27.030514  6817 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:27.085421  6872 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.127s
I20260709 13:01:27.012997  6161 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.087889  6840 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.088865  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.070604  6847 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:01:27.089694  1632 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:27.023839  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:26.987475  6609 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.087630  6863 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:27.125325  6876 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.080051  6697 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.084967  6844 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:27.228346  2264 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:01:27.136262  6857 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:27.138123  6809 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:27.026678  6613 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:27.135550  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.074582  6877 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 13:01:27.153287  6767 consensus_meta.cc:287] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.000s
I20260709 13:01:27.133940  6818 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:27.145776  6838 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.082913  6873 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:01:27.024603  6642 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.011642  6667 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.117s
I20260709 13:01:27.201431  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2551) took 1230 ms. Trace:
I20260709 13:01:27.238246  6857 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.250255  1709 rpcz_store.cc:276] 0709 13:01:25.971407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.039484 (+ 68077us) service_pool.cc:224] Handling call
0709 13:01:27.155092 (+1115608us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54001bdad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:27.201350 (+ 46258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041971072}
I20260709 13:01:27.202323  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 1119) took 1306 ms. Trace:
I20260709 13:01:27.251515  2269 rpcz_store.cc:276] 0709 13:01:25.895925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.898462 (+  2537us) service_pool.cc:224] Handling call
0709 13:01:27.155775 (+1257313us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54005933d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:27.202248 (+ 46473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1931727104}
I20260709 13:01:27.252130  6857 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.213541  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:27.252434  6784 consensus_meta.cc:287] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.006s
I20260709 13:01:27.219106  1628 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:27.252912  6784 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:27.222540  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 198798us
I20260709 13:01:27.254277  6642 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.255136  6667 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:27.255592  6667 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:27.256425  6667 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.256798  6851 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:27.257048  6642 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.257737  6667 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:27.257889  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.258751  2271 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:27.136353  6870 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.231769  2264 pending_rounds.cc:85] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 10
I20260709 13:01:27.235610  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.261075  2264 pending_rounds.cc:107] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:01:27.209182  2263 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:27.228226  6874 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:27.216622  6817 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.261400  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:27.261394  2264 raft_consensus.cc:2889] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:27.261576  2263 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:27.220732  6238 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.266482  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:27.273180  1628 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:27.253921  6809 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.284830  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.287400  2268 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:27.264358  2263 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.288884  2263 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:27.289777  6881 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:27.290814  6846 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:27.291083  6721 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.709s	user 0.008s	sys 0.005s
I20260709 13:01:27.291539  6721 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:27.297138  6609 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.300091  6759 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:27.300788  6759 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:27.302304  1634 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:27.303992  6721 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.289944  6238 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.305104  6818 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:27.306828  6838 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.307417  6701 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:27.282388  6642 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:27.311422  6806 consensus_meta.cc:287] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.005s
I20260709 13:01:27.311496  6784 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.243286  6767 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.239614  6844 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.328382  6767 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.308096  6720 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.270665  6870 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.330240  2265 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:27.270463  6817 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:27.314865  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:27.332667  2264 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:27.333174  6627 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.325850  6642 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.334789  6642 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:27.291463  6846 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.322574  6764 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.323670  2263 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:01:27.234575  6876 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:27.329264  6844 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.339184  2263 pending_rounds.cc:85] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 10
I20260709 13:01:27.339599  2263 pending_rounds.cc:107] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:01:27.339987  2263 raft_consensus.cc:2889] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:27.341168  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 74654.7us
I20260709 13:01:27.342307  2235 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:27.350333  6876 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.351271  6872 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:27.353029  6877 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:27.354012  6784 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:27.355563  6846 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:27.356388  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:27.356900  2266 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:27.357210  2268 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:27.359093  6851 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:27.359196  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.331959  6870 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.359732  6851 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:27.388401  6851 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.335376  6806 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.399580  6873 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.400381  6873 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.404837  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:27.407614  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:27.408497  2263 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.416924  2264 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:27.357791  6764 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.430147  6873 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.447675  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:27.450148  6777 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.452008  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2560) took 1008 ms. Trace:
I20260709 13:01:27.452471  1701 rpcz_store.cc:276] 0709 13:01:26.443379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.444578 (+  1199us) service_pool.cc:224] Handling call
0709 13:01:26.444961 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.626356 (+181395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.626405 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:26.626465 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:26.626507 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.451726 (+825219us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54003afa54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:27.451779 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.451944 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416606976}
I20260709 13:01:27.460839  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 918) took 1100 ms. Trace:
I20260709 13:01:27.461336  1702 rpcz_store.cc:276] 0709 13:01:26.359988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.368270 (+  8282us) service_pool.cc:224] Handling call
0709 13:01:27.460582 (+1092312us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b5400233f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:27.460758 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1760187264}
I20260709 13:01:27.323572  6161 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:01:27.424685  1599 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:27.476497  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:27.499099  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 74544.6us
I20260709 13:01:27.510811  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.514110  2263 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:27.515600  1673 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:01:27.485129  6835 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.861s	user 0.000s	sys 0.002s
I20260709 13:01:27.523132  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.479142  6809 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.479128  6653 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:27.504933  6847 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:27.445516  6817 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.528415  2263 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:27.528589  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:27.529944  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.478919  6797 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:27.469993  6502 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:27.504133  6565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.022s	sys 0.051s
I20260709 13:01:27.534474  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.582194  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.582644  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:27.525759  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.492235  6627 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.516569  6819 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.548699  6887 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:27.526124  6774 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:27.555289  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.598366  2267 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:27.541685  6653 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:27.542150  6809 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.560353  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 1068) took 1366 ms. Trace:
I20260709 13:01:27.516498  6777 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.561661  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:27.527087  6806 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.590096  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:27.591581  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:27.581058  6797 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:27.564473  6847 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:27.527627  6820 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:01:27.596081  2271 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:27.518953  6642 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:27.608269  6775 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:01:27.589035  6565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.193s	user 0.022s	sys 0.051s
I20260709 13:01:27.557928  6655 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.608362  1632 rpcz_store.cc:276] 0709 13:01:26.193586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.193723 (+   137us) service_pool.cc:224] Handling call
0709 13:01:27.560044 (+1366321us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54003372d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:27.560238 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323084672}
I20260709 13:01:27.567066  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:27.617974  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.597883  6502 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.625581  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:27.564213  6846 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:27.601589  2263 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:27.619185  6851 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:27.620249  6774 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:27.640235  1559 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:27.597740  6819 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:27.648502  1560 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:27.608572  6887 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.619976  6777 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.662673  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1096) took 1758 ms. Trace:
I20260709 13:01:27.663321  2262 rpcz_store.cc:276] 0709 13:01:25.904637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.035248 (+130611us) service_pool.cc:224] Handling call
0709 13:01:26.035539 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:26.035985 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:26.115065 (+ 79080us) log.cc:844] Serialized 14 byte log entry
0709 13:01:26.423469 (+308404us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:26.424027 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:01:26.424209 (+   182us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:26.424439 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 13:01:26.424651 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.424712 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:27.484229 (+1059517us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:27.662450 (+178221us) raft_consensus.cc:1685] finished
0709 13:01:27.662478 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.662617 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3,"prepare.queue_time_us":45416,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":1509,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":3401,"spinlock_wait_cycles":8750976,"thread_start_us":386619,"threads_started":2,"wal-append.queue_time_us":420974}
I20260709 13:01:27.662628  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2275) took 1810 ms. Trace:
I20260709 13:01:27.654256  6790 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.643096  6846 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.665777  1554 rpcz_store.cc:276] 0709 13:01:25.848962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.851096 (+  2134us) service_pool.cc:224] Handling call
0709 13:01:25.851364 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.705224 (+853860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.659193 (+953969us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b5400178254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:27.659457 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850064768}
I20260709 13:01:27.670183  1557 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:27.671051  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:27.671775  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:27.637220  6775 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.674825  6809 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.657585  6847 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.689980  6887 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:27.690933  6836 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.145s	user 0.003s	sys 0.000s
I20260709 13:01:27.691711  6775 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.693718  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:27.694535  2262 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:27.675915  6731 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:27.643510  6502 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.693744  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2462) took 1206 ms. Trace:
I20260709 13:01:27.695153  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.695611  1559 rpcz_store.cc:276] 0709 13:01:26.487003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.487144 (+   141us) service_pool.cc:224] Handling call
0709 13:01:26.492799 (+  5655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.642833 (+1150034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.693541 (+ 50708us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540020add4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:27.693690 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2638637312}
I20260709 13:01:27.697353  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:27.697662  6502 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.698045  1708 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:27.698297  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:27.708345  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:27.708900  1632 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:01:27.699173  6882 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.387s	user 0.002s	sys 0.000s
I20260709 13:01:27.699450  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:27.699738  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:27.700742  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:27.714082  1705 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:27.701081  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:27.714593  1701 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:27.701663  6161 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:27.703822  1707 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:27.705022  6627 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:27.710379  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.717417  2271 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:27.712929  1630 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:27.700742  1702 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:01:27.719455  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.650365  6797 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:27.721275  6502 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.721354  6820 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.722254  6820 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.722164  6502 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.724457  6820 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.725910  6502 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.726339  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.727087  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:27.727421  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.727818  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:27.728215  2262 raft_consensus.cc:2410] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:27.728225  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:27.729318  1627 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:27.721025  6797 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:27.729389  1628 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:27.731215  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.732214  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.732735  1554 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:27.733490  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:27.734141  1630 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:27.734562  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:27.738768  6749 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:27.739173  6749 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:27.739562  6749 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:27.681154  6774 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.713762  6838 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.744412  6838 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.677947  6790 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.746584  6838 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.747998  6790 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.750584  6777 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.751577  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:27.753424  6819 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.753151  1627 raft_consensus.cc:1217] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 13.7->[14.8-16.9]   Dedup: 16.9->[]
I20260709 13:01:27.780097  1627 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 13:01:27.780295  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:27.759384  1551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 887) took 1602 ms (client timeout 1891 ms). Trace:
I20260709 13:01:27.759776  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:27.782706  1560 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.783103  1554 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:27.747627  6759 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.761976  2264 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:27.742511  2234 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:27.788575  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46152.4us
I20260709 13:01:27.753448  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2450) took 1224 ms. Trace:
I20260709 13:01:27.784180  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:27.781697  1551 rpcz_store.cc:269] 0709 13:01:26.157094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.157222 (+   128us) service_pool.cc:224] Handling call
0709 13:01:27.759144 (+1601922us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54003ea8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:27.759299 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":985493376}
I20260709 13:01:27.695310  6731 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:27.926499  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.797701  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.789556  1634 rpcz_store.cc:276] 0709 13:01:26.528693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.528813 (+   120us) service_pool.cc:224] Handling call
0709 13:01:26.529140 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.302778 (+773638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.753206 (+450428us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54003377d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:27.753395 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777625984}
I20260709 13:01:27.865514  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.684566  6817 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:27.928095  1554 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:27.929975  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.934222  2265 raft_consensus.cc:2393] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:27.936920  1701 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
W20260709 13:01:27.940064  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.959534  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:27.959885  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.966610  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.967348  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:27.968475  1559 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:27.786662  6873 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.783191  6161 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:27.782896  6784 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.188s
I20260709 13:01:27.998868  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2295) took 1417 ms. Trace:
I20260709 13:01:27.978611  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:27.980929  6874 consensus_queue.cc:1059] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:01:28.006580  6874 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:28.006907  6874 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:28.003499  1626 rpcz_store.cc:276] 0709 13:01:26.581404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.598511 (+ 17107us) service_pool.cc:224] Handling call
0709 13:01:26.598971 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:26.772495 (+173524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.772547 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:26.779390 (+  6843us) log.cc:844] Serialized 26 byte log entry
0709 13:01:26.919153 (+139763us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:26.919206 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.158236 (+239030us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b180036c4c0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2557 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:01:27.998460 (+840224us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400338bd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:27.998535 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:27.998599 (+    64us) raft_consensus.cc:1685] finished
0709 13:01:27.998619 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:27.998792 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24570,"raft.queue_time_us":43970,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5774,"spinlock_wait_cycles":346135552,"thread_start_us":115850,"threads_started":1,"wal-append.queue_time_us":213477}
I20260709 13:01:27.925057  6777 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:28.023092  1553 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:28.023682  1560 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
W20260709 13:01:27.979662  6894 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
W20260709 13:01:27.982322  6899 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:01:27.961772  6790 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:27.964097  6819 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:27.960815  6521 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.972714  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:28.089358  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 116735us
I20260709 13:01:28.090294  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:28.090454  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:27.998808  6782 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:27.997674  6850 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:27.971505  6775 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:27.995338  6846 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:27.996143  6642 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:27.997550  6653 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:27.978576  6845 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:27.923975  6590 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:01:28.007700  6874 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:27.978336  6238 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:01:28.087694  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.992455  6759 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:28.039950  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:28.092113  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:28.093097  1631 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:28.186569  6782 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.180269  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:28.225250  1626 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
W20260709 13:01:28.184149  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 92656.5us
I20260709 13:01:28.190976  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:28.032833  6881 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:28.198267  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:28.228210  1632 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:28.198160  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:27.979225  6797 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.020722  6873 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:28.084069  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:27.980602  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:01:28.238466  1443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 258003us
I20260709 13:01:28.202358  6775 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:28.239677  6873 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:28.174015  6819 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:28.241118  6775 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:28.017647  6161 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:28.095993  1674 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:28.242177  6819 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:28.242897  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 147015us
I20260709 13:01:28.227483  6845 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:28.243932  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:28.178785  6849 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:28.202176  6667 consensus_queue.cc:1059] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:01:28.246224  6849 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:28.229144  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:28.246459  6565 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.247040  6849 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:28.246531  6667 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:28.247566  6849 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.247124  6565 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:28.247913  6667 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:28.248684  6653 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:28.248942  6667 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:28.235857  6721 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:28.250167  6721 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:28.251477  6161 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:28.252386  6721 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:28.192379  6817 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:28.253087  6817 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:28.183580  6521 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:28.249465  1552 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:01:28.255251  6817 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:28.256048  6521 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:28.256916  1552 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:28.091877  6790 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:28.235687  6797 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:28.248018  6849 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:28.249621  6565 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:28.261675  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:28.278635  1703 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:28.263234  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:28.279639  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:28.249449  6874 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:28.218845  6854 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:28.229262  1635 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:28.264617  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:28.284446  1704 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:28.285537  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:28.227545  6782 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:28.289898  2235 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.016s	sys 0.031s
W20260709 13:01:28.290266  2235 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.016s	sys 0.031s
W20260709 13:01:28.276609  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 47964.1us
I20260709 13:01:28.209012  6850 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:28.279728  1706 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:28.281414  6845 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:28.282114  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:28.286818  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:28.266383  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:28.294435  1707 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:28.288338  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.290858  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:28.291447  1703 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:28.295552  1708 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.296236  1704 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
W20260709 13:01:28.267699  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:28.298446  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:28.288857  6857 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.005s	sys 0.040s
W20260709 13:01:28.300391  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 539160us
I20260709 13:01:28.309234  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:28.231009  6238 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:28.334384  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:28.335490  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:28.348392  1702 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:28.264860  6838 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:28.368405  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:28.258716  6881 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:28.351438  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:28.359040  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 607616us
I20260709 13:01:28.302867  6667 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:28.371436  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:28.299576  6857 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.005s	sys 0.041s
I20260709 13:01:28.265007  6749 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:28.374786  6759 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:28.372484  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:28.375948  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:28.382273  6774 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:28.328692  6775 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.387976  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:28.395977  1626 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:28.394203  1633 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:28.406807  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:28.414810  6873 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:28.348490  6521 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
W20260709 13:01:28.435974  6901 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:01:28.438584  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:28.429067  6896 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.171s	user 0.001s	sys 0.001s
I20260709 13:01:28.445673  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:28.462256  1702 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:28.483148  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 49609.6us
I20260709 13:01:28.433137  6565 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:01:28.442534  6902 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.202s	user 0.000s	sys 0.003s
I20260709 13:01:28.499414  1708 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:28.444559  6847 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:28.427553  6775 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:28.506313  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:28.520473  1708 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:28.489161  6565 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:01:28.534157  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.543704  6565 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:28.554734  2234 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:28.554759  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1113) took 1233 ms. Trace:
I20260709 13:01:28.556180  2270 rpcz_store.cc:276] 0709 13:01:27.321684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.488464 (+166780us) service_pool.cc:224] Handling call
0709 13:01:27.488899 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.499985 (+ 11086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.500030 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.500592 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:01:27.651863 (+151271us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:27.651911 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.652326 (+   415us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.554567 (+902241us) raft_consensus.cc:1685] finished
0709 13:01:28.554588 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.554705 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22489,"raft.queue_time_us":21350,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6899,"thread_start_us":111519,"threads_started":1,"wal-append.queue_time_us":659673}
I20260709 13:01:28.460393  6850 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:28.601729  6790 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:28.608268  6846 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:28.635689  6909 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.649959  6846 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.656102  6238 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:28.692190  6905 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.307s	user 0.001s	sys 0.001s
I20260709 13:01:28.686843  6846 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:28.703811  6906 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:01:28.744262  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 919) took 1012 ms. Trace:
I20260709 13:01:28.744726  1551 rpcz_store.cc:276] 0709 13:01:27.732073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.241296 (+509223us) service_pool.cc:224] Handling call
0709 13:01:28.241622 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.291420 (+ 49798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.291466 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:28.291536 (+    70us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:28.291581 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.743984 (+452403us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b5400182254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:28.744028 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.744205 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114022144}
W20260709 13:01:28.749372  6884 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.446s	user 0.004s	sys 0.000s
I20260709 13:01:28.704932  6238 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:28.771222  6913 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:01:28.772482  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:28.726605  6749 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:28.773275  1703 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:28.800004  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:28.681717  6909 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:28.816242  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:28.824651  1701 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:28.774731  6238 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:28.819077  6627 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:28.843351  6627 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:28.846293  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2465) took 1338 ms. Trace:
I20260709 13:01:28.848882  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2566) took 1152 ms. Trace:
I20260709 13:01:28.849285  1709 rpcz_store.cc:276] 0709 13:01:27.696238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.701610 (+  5372us) service_pool.cc:224] Handling call
0709 13:01:27.701973 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.702363 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.702398 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.702845 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.031651 (+328806us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:28.031738 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.031844 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.848637 (+816793us) raft_consensus.cc:1685] finished
0709 13:01:28.848669 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.848826 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1366,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":328386,"threads_started":1,"wal-append.queue_time_us":626623}
I20260709 13:01:28.846766  1555 rpcz_store.cc:276] 0709 13:01:27.508006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.508196 (+   190us) service_pool.cc:224] Handling call
0709 13:01:27.525816 (+ 17620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.665779 (+139963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.665811 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.679014 (+ 13203us) log.cc:844] Serialized 26 byte log entry
0709 13:01:28.000005 (+320991us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b48000030d8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:01:28.032094 (+ 32089us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:28.032145 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.731131 (+698986us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400182c54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:28.731214 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.846049 (+114835us) raft_consensus.cc:1685] finished
0709 13:01:28.846072 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.846225 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7139,"raft.queue_time_us":7598,"raft.run_cpu_time_us":2321,"raft.run_wall_time_us":328416,"spinlock_wait_cycles":311387136,"thread_start_us":271618,"threads_started":1,"wal-append.queue_time_us":579304}
I20260709 13:01:28.867784  6887 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:28.871277  6887 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:28.872973  6918 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:28.873641  6918 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:28.878978  6904 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.374s	user 0.002s	sys 0.000s
W20260709 13:01:28.891362  6889 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 1.305s	user 0.024s	sys 0.015s
I20260709 13:01:28.865340  6797 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:28.938194  6870 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:28.939113  6870 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:28.947474  6790 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.953373  6790 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:29.012669  6838 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:29.013491  6838 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:28.817446  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:29.078171  1560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.023s	sys 0.015s
W20260709 13:01:29.078786  1560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.023s	sys 0.015s
W20260709 13:01:29.087568  1707 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.793s	user 0.015s	sys 0.000s
W20260709 13:01:29.088047  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 491926us
I20260709 13:01:29.088223  1707 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
W20260709 13:01:29.089301  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.089448  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:29.071818  1700 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
W20260709 13:01:29.106067  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.109117  1626 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:29.130101  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:29.133759  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:29.146541  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:29.135212  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:29.147981  1557 raft_consensus.cc:2410] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:01:29.138149  1552 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:29.148226  1707 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:29.149051  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:29.149652  1707 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
W20260709 13:01:29.158762  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.184520  1701 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
W20260709 13:01:29.200500  2235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.009s	sys 0.075s
W20260709 13:01:29.201920  2235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.009s	sys 0.075s
I20260709 13:01:29.203837  1707 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:29.203294  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 875223us
I20260709 13:01:29.208539  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:29.211143  1555 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:01:29.221374  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.022s	sys 0.061s
W20260709 13:01:29.221753  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.022s	sys 0.061s
W20260709 13:01:29.221808  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 132987us
W20260709 13:01:29.222106  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 851394us
W20260709 13:01:29.223054  1702 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.741s	user 0.004s	sys 0.004s
I20260709 13:01:29.223512  1702 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:29.225055  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:29.217322  6671 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.027s	sys 0.055s
I20260709 13:01:29.198953  6697 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:29.155256  6553 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:29.242000  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.008s	sys 0.011s
W20260709 13:01:29.242336  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.008s	sys 0.011s
W20260709 13:01:29.242614  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 859194us
I20260709 13:01:29.244237  1703 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:29.246222  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:29.248946  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:29.266700  2270 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.267302  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:29.250674  1707 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:29.252043  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:29.252774  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 339467us
I20260709 13:01:29.230698  6784 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.271857  2266 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:29.272161  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:29.274472  1708 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:01:29.253047  6671 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.027s	sys 0.055s
I20260709 13:01:29.259752  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:29.255048  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:29.282286  1633 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:29.282763  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:29.241736  6161 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.010s	sys 0.009s
W20260709 13:01:29.284646  6613 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.010s	sys 0.013s
I20260709 13:01:29.273144  1709 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:01:29.224463  6655 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.041s	sys 0.046s
I20260709 13:01:29.271620   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:29.241881  6857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.009s	sys 0.009s
I20260709 13:01:29.276446  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:29.305765  6857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.009s	sys 0.010s
W20260709 13:01:29.245432  6845 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.007s	sys 0.011s
I20260709 13:01:29.277621  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:29.280009  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:29.271130  1705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.011s	sys 0.012s
W20260709 13:01:29.284927  6161 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.011s	sys 0.009s
W20260709 13:01:29.307765  6845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.008s	sys 0.011s
I20260709 13:01:29.286736  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:29.290355  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:29.271417  6521 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.007s	sys 0.015s
W20260709 13:01:29.309245  6521 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.007s	sys 0.015s
I20260709 13:01:29.295449  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:29.307390  1705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.011s	sys 0.012s
W20260709 13:01:29.258467  6817 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.018s	sys 0.029s
I20260709 13:01:29.307375  1635 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.311220  1701 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:29.314142  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:29.333595  1701 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:29.334327  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:29.335942  1552 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:29.292402  6613 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.010s	sys 0.013s
I20260709 13:01:29.337024  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:29.338505  1558 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:29.340030  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:29.340667  1551 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:29.343251  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:29.343251  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:29.342000  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:29.345672  1703 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
W20260709 13:01:29.318845  6655 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.042s	sys 0.046s
I20260709 13:01:29.291469  6155 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:29.342437  6731 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.373s	user 0.032s	sys 0.026s
I20260709 13:01:29.264602  6553 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:29.333217  6817 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.018s	sys 0.030s
I20260709 13:01:29.357643  6627 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:29.319952  6775 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:29.351016  6881 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:29.289211  6864 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:01:29.370754  2270 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:29.285781  6784 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:29.339788  6870 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:29.381430  1635 raft_consensus.cc:2410] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:29.343459  6923 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:29.348577  6909 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:29.389183  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:29.363570  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2417) took 1081 ms. Trace:
I20260709 13:01:29.447408  1709 rpcz_store.cc:276] 0709 13:01:28.282434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.870018 (+587584us) service_pool.cc:224] Handling call
0709 13:01:29.272909 (+402891us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.291904 (+ 18995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.363370 (+ 71466us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54001ac2d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:29.363509 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808620928}
I20260709 13:01:29.391832  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:29.350289  6810 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:29.350634  6927 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:29.395004  1674 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:29.371783  6818 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:29.393777  6238 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:01:29.399078  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:29.355697  6887 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:29.352923  6918 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:29.448601  1558 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:29.384719  6924 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.366232  6155 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:29.458434  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 69333.8us
I20260709 13:01:29.469602  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:29.458786  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 63907.5us
I20260709 13:01:29.394361  6790 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:29.446414  6671 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:29.462292  1635 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:29.471513  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:29.373755  6731 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:29.461163  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:29.463032  6881 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:29.455075  6838 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:29.455610  6749 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:29.479316  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:29.482193  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:29.464172  6797 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:29.472481  6844 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:29.473663  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:29.479753  1627 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:29.470077  6238 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:29.458848  6810 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:29.489017  2263 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:29.485304  6565 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:29.481545  6671 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:29.496721  6671 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:29.481099  6790 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.499202  2236 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:29.465840  6818 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:29.502166  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:29.502421  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:29.505133  6810 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:29.463392  6927 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:29.509819  6931 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:01:29.501539  6930 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:01:29.484419  6749 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:29.498306  6844 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:29.498447  6910 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:29.476598  6924 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:29.459631  6923 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:29.635270  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 301360us
W20260709 13:01:29.635798  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 426747us
I20260709 13:01:29.635879  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:29.640158  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 417449us
W20260709 13:01:29.568205  6849 consensus_meta.cc:287] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.237s	user 0.017s	sys 0.002s
I20260709 13:01:29.506400  6887 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:29.527431  6238 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:29.488993  6797 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:29.653148  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 382422us
W20260709 13:01:29.642799  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 420114us
I20260709 13:01:29.659680  1601 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:29.625326  6844 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:29.631714  6937 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.507189  6790 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:29.657599  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:29.695405  2270 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:29.695596  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 57168.2us
I20260709 13:01:29.650897  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:01:29.718349  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 58750.7us
I20260709 13:01:29.721385  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:29.691612  6947 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:01:29.719863  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 60689.7us
I20260709 13:01:29.663015  6887 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:29.692576  6844 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:29.735262  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.735316  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 84518.1us
I20260709 13:01:29.689306  6671 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.724934  6553 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:29.754482  6671 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:29.757336  6671 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:29.765095  6924 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:29.724750  6920 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:29.650627  6849 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:29.741734  6870 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:01:29.741729  6939 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:29.742434  6521 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:29.692314  6940 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:29.745394  6887 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:29.747201  6956 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:01:29.748761  6923 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:29.750988  6925 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:29.653712  6910 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:01:29.789917  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:29.789705  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 306458us
I20260709 13:01:29.733366  6917 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 13:01:29.777456  6850 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.003s	sys 0.033s
I20260709 13:01:29.721203  6838 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:01:29.931196  1704 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:01:29.795810  6913 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:29.801312  6671 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:29.719817  6943 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:01:29.732584  6613 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:29.785079  6946 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:29.963394  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 242081us
W20260709 13:01:29.958004  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 315825us
I20260709 13:01:29.790678  6521 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:01:29.969343  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 179541us
I20260709 13:01:29.716780  6937 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:29.738927  6619 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.205s
I20260709 13:01:29.950420  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 914) took 2219 ms. Trace:
W20260709 13:01:29.983968  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 326442us
I20260709 13:01:29.803296  6784 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:29.945029  6806 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:30.014205  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:30.022668  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 324911us
I20260709 13:01:29.943157  6155 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:30.025974  1633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.012s	sys 0.005s
W20260709 13:01:29.974792  6850 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.004s	sys 0.033s
I20260709 13:01:30.030812  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 930) took 1770 ms. Trace:
I20260709 13:01:30.177861  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 937) took 1910 ms. Trace:
I20260709 13:01:30.181098  1704 rpcz_store.cc:276] 0709 13:01:28.267657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.297899 (+ 30242us) service_pool.cc:224] Handling call
0709 13:01:28.298278 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.974525 (+1676247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.177498 (+202973us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54000a6ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:30.177777 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3754901760}
I20260709 13:01:30.141831  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:30.155074  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 140986us
I20260709 13:01:30.183723  1674 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:30.183807  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:30.013371  6931 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:01:30.035900  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 339499us
I20260709 13:01:30.195144  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:29.985432  6925 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:30.021966  6642 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:29.929531  6939 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:29.986394  6161 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 13:01:30.063278  6874 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.776s	user 0.010s	sys 0.010s
I20260709 13:01:30.064042  6927 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:30.180184  1705 rpcz_store.cc:276] 0709 13:01:28.260405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.261143 (+   738us) service_pool.cc:224] Handling call
0709 13:01:28.261604 (+   461us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:28.284799 (+ 23195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.284851 (+    52us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:28.293391 (+  8540us) log.cc:844] Serialized 78 byte log entry
0709 13:01:29.310174 (+1016783us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:29.722153 (+411979us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.723128 (+   975us) log.cc:844] Serialized 14 byte log entry
0709 13:01:30.030450 (+307322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.030545 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.030601 (+    56us) raft_consensus.cc:1685] finished
0709 13:01:30.030615 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.030755 (+   140us) inbound_call.cc:177] Queueing success response
0709 13:01:30.066365 (+ 35610us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b48001e0258. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
Metrics: {"mutex_wait_us":9464,"prepare.queue_time_us":449728,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":132937,"raft.run_cpu_time_us":3734,"raft.run_wall_time_us":308891,"spinlock_wait_cycles":32680192,"thread_start_us":1638168,"threads_started":3,"wal-append.queue_time_us":929978}
I20260709 13:01:29.944294  6940 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.054667  6818 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:30.075184  6846 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.309s	user 0.001s	sys 0.015s
W20260709 13:01:30.093354  6782 consensus_meta.cc:287] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.791s	user 0.016s	sys 0.006s
I20260709 13:01:29.697503  6749 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.134609  6521 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:30.126281  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:30.201505  6938 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.239282  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 113092us
I20260709 13:01:30.125380  6790 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.198441  6976 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:30.139771  1560 rpcz_store.cc:276] 0709 13:01:27.730859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.033373 (+302514us) service_pool.cc:224] Handling call
0709 13:01:28.033856 (+   483us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:28.042128 (+  8272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.042273 (+   145us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:28.202228 (+159955us) log.cc:844] Serialized 52 byte log entry
0709 13:01:29.079291 (+877063us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:29.642496 (+563205us) log.cc:844] Serialized 14 byte log entry
0709 13:01:29.950081 (+307585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.950163 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.950206 (+    43us) raft_consensus.cc:1685] finished
0709 13:01:29.950222 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.950356 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47724,"prepare.queue_time_us":230299,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":54824,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":77832,"thread_start_us":1500244,"threads_started":3,"wal-append.queue_time_us":747017}
I20260709 13:01:30.177500  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:30.206377  6850 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:30.203058  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 76794.7us
I20260709 13:01:30.066749  6873 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:30.212268  6909 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.198923  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:30.154493  6857 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:30.251097  6857 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.231293  6846 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.253237  6857 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:30.253901  6925 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.254588  6846 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:30.238907  6818 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:01:30.257301  6697 consensus_meta.cc:287] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.010s	user 0.007s	sys 0.002s
I20260709 13:01:30.258111  1556 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:30.140750  6671 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.234800  6874 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:30.136322  6946 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:30.222905  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 499846us
I20260709 13:01:30.143754  6613 consensus_queue.cc:1059] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:01:30.203246  6777 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.109712  6797 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.210428  6784 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:01:30.201354  6864 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.200287  6849 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.117497  6731 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:30.136497  6565 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.641s	user 0.005s	sys 0.005s
W20260709 13:01:30.186313  1633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.016s	sys 0.010s
W20260709 13:01:30.244807  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 102002us
I20260709 13:01:30.201159  6965 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:30.206920  6973 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:30.247962  1524 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:30.298154  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 50268.2us
I20260709 13:01:30.231458  6782 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.263334  2266 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:01:30.249817  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 50978.4us
I20260709 13:01:30.316217  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:30.264979  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.266389  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.318250  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.319311  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.267082  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:30.267895  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:30.320328  1628 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:30.270259  1601 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:30.271209  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 93810.9us
W20260709 13:01:30.272169  6667 consensus_meta.cc:287] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.876s	user 0.020s	sys 0.002s
I20260709 13:01:30.269645  6909 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.273310  6671 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.273260  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.273996  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:30.324373  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 127963us
W20260709 13:01:30.292757  6962 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:01:30.274868  6810 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:30.276297  6946 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.277297  6553 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:30.278420  6940 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.279774  6939 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.245328  6976 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:30.245500  6759 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:30.357200  6759 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.357627  6759 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:30.287774  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.362545  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.363754  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.365300  6923 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:30.362617  1627 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:30.269268  6851 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.366127  6958 log.cc:927] Time spent T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:01:30.321671  6565 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.366540  6851 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.367081  6565 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.319967  6973 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.369249  6565 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:30.323655  6806 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:01:30.369840  6973 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:30.295282  6864 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.303381  1555 raft_consensus.cc:2410] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:30.305114  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:30.307163  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.284592  6161 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:30.323563  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.375196  1634 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:30.270193  6790 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:30.274585  6937 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:30.293207  6975 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:01:30.291734  6945 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:01:30.325086  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:30.326157  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 55982.8us
I20260709 13:01:30.330452  6924 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:30.283322  6967 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:30.330765  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:30.332710  1635 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:30.355144  6972 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:30.247735  6938 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.319850  6613 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:30.356180  1706 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:30.356638  6976 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:30.284578  6777 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.290369  6981 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:30.379807  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2313) took 1246 ms. Trace:
I20260709 13:01:30.381096  1628 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:30.446398  1559 rpcz_store.cc:276] 0709 13:01:29.132931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.133051 (+   120us) service_pool.cc:224] Handling call
0709 13:01:29.156875 (+ 23824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.403564 (+246689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.403616 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:29.446635 (+ 43019us) log.cc:844] Serialized 26 byte log entry
0709 13:01:29.772697 (+326062us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b18004b32e0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:01:30.176859 (+404162us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:30.176903 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.176976 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.372678 (+195702us) raft_consensus.cc:1685] finished
0709 13:01:30.372711 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.379727 (+  7016us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":305657,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":5378,"spinlock_wait_cycles":3155712,"thread_start_us":650180,"threads_started":2,"wal-append.queue_time_us":823636}
I20260709 13:01:30.447870  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:30.381928  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 76933.5us
W20260709 13:01:30.448534  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 122435us
I20260709 13:01:30.345669  6553 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:30.422825  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:30.330142  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.425180  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2580) took 2050 ms. Trace:
I20260709 13:01:30.452124  1707 rpcz_store.cc:276] 0709 13:01:28.374473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.268406 (+893933us) service_pool.cc:224] Handling call
0709 13:01:29.268681 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.268998 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.269026 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:29.277140 (+  8114us) log.cc:844] Serialized 26 byte log entry
0709 13:01:29.692621 (+415481us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:29.692678 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.692748 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.424887 (+732139us) raft_consensus.cc:1685] finished
0709 13:01:30.424916 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.425099 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":482,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":15300,"thread_start_us":378775,"threads_started":1,"wal-append.queue_time_us":653303}
I20260709 13:01:30.453228  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:30.454501  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:30.455232  2262 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:30.455964  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:30.456499  2262 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:30.458891  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:30.346213  6953 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:01:30.379050  6940 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:30.381114  6939 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.429966  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 104965us
I20260709 13:01:30.466089  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.466526  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:30.467059  1705 raft_consensus.cc:2376] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11. Re-sending same reply.
I20260709 13:01:30.467353  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.290591  6838 raft_consensus.cc:3055] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:30.468001  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:30.468247  6838 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:30.469156  6838 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.470115  6777 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:30.470331  6838 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.471442  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:30.337380  6671 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:30.444197  6973 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:30.475720  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:30.383224  6806 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:30.474476  6954 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:30.433084  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 102400us
I20260709 13:01:30.479122  6810 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:30.436349  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:30.484170  2262 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:30.438417  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:30.379279  6790 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:30.485385  6790 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.436713  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:30.372593  6864 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:30.442781  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:30.429149  6238 consensus_meta.cc:287] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.769s	user 0.011s	sys 0.000s
I20260709 13:01:30.491768  6238 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:30.491989  6938 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:30.383023  6565 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:30.439337  6967 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.492614  6565 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.494360  6967 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:30.495033  2267 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:30.498567  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.500177  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:30.501317  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:30.501929  1700 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:30.449239  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:30.449486  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.502820  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:30.502848  1628 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:30.337188  6818 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:01:30.504554  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:30.504853  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:30.505187  1703 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:30.441969  6985 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:30.432794  6161 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:30.461210  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:30.460423  6784 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:30.462769  6979 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:01:30.445716  6613 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:30.464203  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.473111  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:30.365793  6923 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:30.475482  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:30.473762  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:30.476321  1708 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:30.477013  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:30.477756  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:30.505914  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:30.506950  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:30.525717  2264 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:30.528219  6806 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:30.528837  6521 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.531953  6967 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:30.533612  6777 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:30.534040  6777 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:30.532248  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:30.536022  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 86857.4us
I20260709 13:01:30.560081  1526 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:30.511113  6985 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.515347  6161 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.561220  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:30.511974  6238 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.537660  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 62237.8us
I20260709 13:01:30.562381  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:30.556886  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 95746.5us
W20260709 13:01:30.564627  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 90937.4us
I20260709 13:01:30.562314  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:30.567421  6937 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:30.516563  6950 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.558727  6965 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:30.498277  6671 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.546936  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:30.560835  6697 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:30.573853  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:30.565478  6844 consensus_meta.cc:287] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.001s
I20260709 13:01:30.579895  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1148) took 1508 ms. Trace:
I20260709 13:01:30.583451  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:30.590368  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:30.590998  1631 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:30.591637  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:30.592298  1702 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:30.578900  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:30.536375  6613 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:30.476531  6939 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.511068  6973 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.607540  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:30.538380  6784 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:30.567824  6731 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:30.534955  6777 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.569537  6161 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:30.572664  6927 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:30.502225  6940 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.575196  6971 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.603972  6986 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:30.569039  6985 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:30.589612  2268 rpcz_store.cc:276] 0709 13:01:29.071037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.071211 (+   174us) service_pool.cc:224] Handling call
0709 13:01:29.098294 (+ 27083us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.198103 (+ 99809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.198139 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:29.221298 (+ 23159us) log.cc:844] Serialized 26 byte log entry
0709 13:01:29.638594 (+417296us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:29.638635 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.638710 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.579599 (+940889us) raft_consensus.cc:1685] finished
0709 13:01:30.579632 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.579816 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":198,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":57096,"thread_start_us":366229,"threads_started":1,"wal-append.queue_time_us":728302}
I20260709 13:01:30.594401  6697 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.614550  6965 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:30.615475  6983 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.558837  6969 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:01:30.603720  6619 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:30.619644  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:30.572893  6918 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:01:30.586315  6988 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:30.619644  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:30.599870  6849 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:30.578925  6924 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:01:30.577750  6238 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.598667  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:30.605574  6782 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.626916  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:30.633261  6697 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:30.603538  6989 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:30.600824  6844 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.620538  6961 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.704823  6961 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.707050  6961 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.579502  6553 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.585932  6950 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.711735  6976 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.712342  6950 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.631399  6777 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:30.693545  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 73985.9us
I20260709 13:01:30.713449  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:30.696624  6965 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:30.699745  6944 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.634414  6983 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.655005  6849 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:30.717144  6238 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:30.730914  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:30.687012  6619 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:30.697088  6991 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:01:30.582762  6954 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:01:30.627655  6987 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:30.685591  6990 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:01:30.700865  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 102267us
I20260709 13:01:30.612879  6923 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.685369  6937 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:30.704264  6940 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.737488  6983 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:30.746834  2270 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:30.718859  6994 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:01:30.718015  6759 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.713975  6976 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:30.729084  6849 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.729522  6918 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:30.747642  6986 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:30.746076  6988 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:30.716183  6671 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.734588  6965 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:30.771404  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 177334us
I20260709 13:01:30.630905  6971 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.728739  6613 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.810261  2236 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:01:30.791033  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 171472us
I20260709 13:01:30.746140  6238 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:30.718642  6784 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.818913  1526 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:30.786803  6918 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:30.820587  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:30.788820  6965 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.846648  2264 raft_consensus.cc:2410] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:30.786608  6954 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:01:30.854018  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:30.820312  6671 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:30.716605  6944 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.822798  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:30.868520  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 45799.6us
I20260709 13:01:30.842396  6749 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.783742  6986 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.870182  6940 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:30.820403  6238 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.870587  7001 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:30.822510  6999 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:30.872160  2236 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:30.825295  6973 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:30.840705  6851 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:30.880182  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 131318us
I20260709 13:01:30.780403  6731 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:30.852617  6965 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:30.879290  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.887069  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:30.887686  2265 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:30.874622  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 143790us
I20260709 13:01:30.889504  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:30.890131  1702 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:30.845453  6924 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:01:30.823768  6790 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.873932  6940 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:30.896881  7000 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:30.876768  6777 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:30.879755  6521 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.891535  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:30.825126  6619 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.898730  6529 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:30.900717  6944 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:30.901479  6731 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:30.902638  6963 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.852s	user 0.000s	sys 0.003s
I20260709 13:01:30.881000  7001 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:30.903643  2265 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:30.940641  7001 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:30.921871  6940 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:30.939854  6759 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:30.926975  6529 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:30.888425  6918 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:30.944623  6529 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.946277  6529 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.947180  6845 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:30.947628  6845 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:30.948447  6845 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:30.950632  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:30.913596  6909 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:30.953647  1551 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:30.922096  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:30.899520  6238 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:30.909821  6988 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:30.932600  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:30.938316  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.010469  1702 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:30.939373  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:30.939716  6671 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:30.939114  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:30.944157  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2487) took 1546 ms. Trace:
I20260709 13:01:31.063002  1555 rpcz_store.cc:276] 0709 13:01:29.398609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.398836 (+   227us) service_pool.cc:224] Handling call
0709 13:01:30.943963 (+1545127us) spinlock_profiling.cc:243] Waited 841 ms on lock 0x7b5400177854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:30.944103 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1933987200}
I20260709 13:01:30.911206  6917 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:30.877446  6999 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:30.954998  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:30.907960  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1125) took 1405 ms. Trace:
I20260709 13:01:31.010576  1557 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:30.939093  7004 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:30.949828  6845 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:30.955724  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:30.931066  6870 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:31.097292  1554 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:31.098263  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2321) took 1798 ms. Trace:
I20260709 13:01:31.095666  2266 rpcz_store.cc:276] 0709 13:01:29.502066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.502196 (+   130us) service_pool.cc:224] Handling call
0709 13:01:30.907694 (+1405498us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54007b02d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:30.907872 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1747206912}
W20260709 13:01:31.101986  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 146347us
W20260709 13:01:31.093425  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 212198us
W20260709 13:01:31.103261  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 148341us
I20260709 13:01:31.107050  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:31.063508  6937 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:31.108390  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:31.110884  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.115847  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.117364  1701 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:31.117717  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1158) took 1358 ms. Trace:
I20260709 13:01:31.118700  1708 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:31.118299  2270 rpcz_store.cc:276] 0709 13:01:29.759392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.759578 (+   186us) service_pool.cc:224] Handling call
0709 13:01:29.759922 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.770981 (+1011059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.117396 (+346415us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b5400692dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:31.117640 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269299584}
I20260709 13:01:31.128692  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.087982  6917 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:31.129523  1703 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:31.105751  1633 rpcz_store.cc:276] 0709 13:01:29.300349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.300466 (+   117us) service_pool.cc:224] Handling call
0709 13:01:29.300745 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.462190 (+161445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.462219 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:29.466294 (+  4075us) log.cc:844] Serialized 26 byte log entry
0709 13:01:30.295772 (+829478us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:30.295817 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.092851 (+797034us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540006d1d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:31.092929 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:31.093007 (+    78us) raft_consensus.cc:1685] finished
0709 13:01:31.093026 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:31.098208 (+  5182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":498,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":6479,"spinlock_wait_cycles":370501888,"thread_start_us":811561,"threads_started":1,"wal-append.queue_time_us":669088}
I20260709 13:01:31.142491  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.097821  6999 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.144531  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:31.137452  2267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:01:31.146941  2267 raft_consensus.cc:606] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:31.108950  6238 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:31.114758  6759 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:31.105510  6870 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:31.112411  6838 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:31.134377  6925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.012s	sys 0.047s
I20260709 13:01:31.094780  6671 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.167354  1557 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:31.129026  6851 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:31.161985  6925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.012s	sys 0.047s
I20260709 13:01:31.164543  6870 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:31.160902  6613 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:31.104888  7004 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.190920  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.206373  6849 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.165621  6238 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:31.223706  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:31.223196  6238 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.224331  1708 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:31.256500  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.257462  1707 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:31.189217  7007 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.249925  1601 connection.cc:256] RPC call timeout handler was delayed by -1.045319951999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
I20260709 13:01:31.274724  1708 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:31.275490  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.278993  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:31.271179  6985 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.002s
I20260709 13:01:31.298760  1708 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:31.300603  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:31.271332  6986 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:31.302342  1601 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:31.302695  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.311133  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:31.301218  6697 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.001s
I20260709 13:01:31.298965  6529 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:31.320281  1557 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:31.296617  6918 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:01:31.273976  7007 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:31.305176  6806 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:31.301311  6790 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:31.335153  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.336707  6999 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.393446  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:31.331979  1706 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2574) took 3024 ms (client timeout 2080 ms). Trace:
W20260709 13:01:31.394315  1706 rpcz_store.cc:269] 0709 13:01:28.307907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.339458 (+ 31551us) service_pool.cc:224] Handling call
0709 13:01:31.331745 (+2992287us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54003f3254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:31.331877 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4451408768}
I20260709 13:01:31.329486  6965 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:31.304093  6985 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.363775  2270 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:31.296912  6521 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:01:31.388140  1558 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:31.436138  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.410450  1559 raft_consensus.cc:2368] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15.
I20260709 13:01:31.405004  1709 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:31.440768  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:31.396379  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:31.442821  1557 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.323658  7005 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:31.387022  6806 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:31.392947  6999 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:31.449831  6565 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:31.407941  6965 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:31.412295  6943 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:01:31.456773  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.424152  7007 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:31.423923  6940 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:31.425508  6161 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.801s	user 0.008s	sys 0.003s
I20260709 13:01:31.355422  6697 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.427029  7004 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:31.404523  6985 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:31.429404  6917 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.489212  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:31.432367  7001 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.425730  6671 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:31.412773  6613 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.448886  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:31.449245  6849 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:31.449725  6806 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:31.398871  7013 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:31.414680  7009 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:01:31.415931  6989 consensus_queue.cc:1175] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f1725fe36e349ac85405627f9c93d95" responder_term: 17 status { last_received { term: 16 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:31.464425  1633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:31.517972  1633 raft_consensus.cc:606] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:31.518402  1633 raft_consensus.cc:614] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:31.519340  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:31.520514  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.521101  1633 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:31.508793  6613 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.523420  6940 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:31.464839  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.524658  1558 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:31.524868  1630 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:31.521857  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.466076  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.526971  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.527673  1631 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:31.528577  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.467473  6918 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.467926  1626 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:31.470818  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.533216  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:31.533335  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.534154  1628 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:31.472098  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.473323  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.535835  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:31.473753  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.536502  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.475061  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:31.481848  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.493324  1552 raft_consensus.cc:2368] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 10. Current term is 11.
I20260709 13:01:31.537406  1632 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:31.495134  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.539630  1626 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:31.501005  2268 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:31.540364  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:31.541672  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.543097  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.543825  1552 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:31.544799  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:31.545455  1552 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.546875  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:31.547488  6697 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:31.547668  1630 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:31.550864  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:31.551612  6857 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:31.551846  1628 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:31.552095  6857 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:31.553134  6857 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.554615  6942 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:31.555794  6942 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:31.556203  6942 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:31.556577  6942 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.558961  6613 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:31.513885  7013 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:31.560062  7013 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:31.562306  7017 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:31.498781  6161 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:31.563446  7007 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:31.563872  7007 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:31.564730  7007 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:31.565204  6161 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:31.539680  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:31.567459  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:31.567827  2270 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:31.503814  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.478663  7006 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:31.511144  1560 raft_consensus.cc:2368] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:01:31.512899  1557 raft_consensus.cc:2410] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:31.464457  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:31.571350  2265 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:31.529253  1631 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
W20260709 13:01:31.572160  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 205230us
I20260709 13:01:31.573268  1630 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:31.574698  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.575735  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:31.578260  1632 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:31.579334  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.581452  1631 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:31.570293  7006 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:31.583276  7006 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.584347  1552 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:31.584666  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.585255  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.585542  1708 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:31.586264  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.587296  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.588804  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:31.589232  6971 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:31.589622  1552 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:31.582265  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 903) took 4586 ms. Trace:
I20260709 13:01:31.590178  1556 rpcz_store.cc:276] 0709 13:01:26.991058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.991184 (+   126us) service_pool.cc:224] Handling call
0709 13:01:26.999980 (+  8796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.258454 (+3258474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.577130 (+1318676us) spinlock_profiling.cc:243] Waited 3.26 s on lock 0x7b54001ff4d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:31.577294 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7492914048}
I20260709 13:01:31.595047  6844 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:31.598331  6987 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:31.598618  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.598839  6987 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:31.599439  1556 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:31.598546  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.600191  1552 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:31.600018  6987 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:31.600737  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:31.601148  6987 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.601414  1556 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:31.603781  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:31.604717  1552 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:31.609606  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.613337  1555 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:31.584710  7006 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:31.612247  1601 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 2.080s (SENT) [suppressed 6 similar messages]
I20260709 13:01:31.629871  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:31.630487  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.635123  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:31.636320  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:31.639096  6939 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:31.647490  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:31.648056  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:31.648618  1631 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:31.650990  1556 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:31.655052  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:31.611917  6161 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.658550  1674 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:31.566530  6918 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:31.715382  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 56919.6us
I20260709 13:01:31.651690  6910 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:31.719512  6910 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:31.719936  6910 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.649219  6967 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:31.653025  6961 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:31.726784  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.722321  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:31.727691  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:31.728063  1627 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:31.652449  6642 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:31.749003  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.756484  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.759351  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.651533  6927 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:01:31.764890  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.764801  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.765885  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.768477  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.772632  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.773689  1630 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:01:31.780763  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 253569us
I20260709 13:01:31.731385  6961 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:31.742188  6950 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:31.712503  6161 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:31.783538  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 202934us
I20260709 13:01:31.787833  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:31.790654  1706 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:31.788177  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.760566  6881 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:31.793958  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.797358  1703 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:01:31.796798  1599 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:31.801966  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:31.786201  7024 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:31.760993  6978 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:01:31.743461  6967 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.805680  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:31.789961  6961 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.809904  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:31.797729  6881 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.829499  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:31.830868  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:31.831740  1700 raft_consensus.cc:2368] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15.
I20260709 13:01:31.832605  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.834496  1706 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:31.836171  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.836773  1706 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:31.806456  7024 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:31.859517  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.826247  6881 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:31.866389  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:31.867357  1700 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:31.867702  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.868304  1705 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:31.869485  1705 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:31.850389  6870 consensus_meta.cc:287] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.002s
I20260709 13:01:31.886474  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:31.887267  6846 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.890332  7006 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:31.895292  6806 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:31.896490  1628 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18. Ops: []
W20260709 13:01:31.898478  7022 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:01:31.899003  7024 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:31.900336  7024 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:31.887830  6846 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.893774  6918 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:31.886330  7002 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:31.908193  7002 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.804227  7027 consensus_queue.cc:1059] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:01:31.910429  7002 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:31.912388  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:31.924816  2234 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:31.913210  1558 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:31.926278  6864 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:31.926960  6864 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:31.913756  6846 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:31.918558  6161 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:31.920526  6967 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:31.939719  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2322) took 1002 ms. Trace:
I20260709 13:01:31.940488  1559 rpcz_store.cc:276] 0709 13:01:30.937318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.938882 (+  1564us) service_pool.cc:224] Handling call
0709 13:01:31.921982 (+983100us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54003d86d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:31.931760 (+  9778us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798671616}
I20260709 13:01:31.920727  1631 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:31.921854  7013 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:31.988972  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 951) took 1489 ms. Trace:
I20260709 13:01:31.989441  1709 rpcz_store.cc:276] 0709 13:01:30.499574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.501921 (+  2347us) service_pool.cc:224] Handling call
0709 13:01:31.988735 (+1486814us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400376ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:31.988910 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020291968}
I20260709 13:01:31.994824  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:31.878407  6619 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:01:31.923106  6870 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:31.923470  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:31.946238  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:32.017045  1708 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:31.949887  2234 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:31.952334  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 155756us
W20260709 13:01:31.953883  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 341683us
I20260709 13:01:31.954279  1559 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:01:32.019100  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.958410  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.980986  1700 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:32.007225  1707 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:31.964054  1627 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:32.021163  1709 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:01:32.021166  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 71385.4us
I20260709 13:01:32.018505  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:32.023375  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:32.023726  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:32.024991  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:32.025548  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:32.027112  2264 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:32.029186  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.029991  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 233285us
I20260709 13:01:32.031020  2268 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:32.027212  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:32.031911  2266 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:32.031986  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:32.091106  1635 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:32.063181  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:32.136605  2265 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:32.136999  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:32.143522  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:32.151969  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:32.154644  2264 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:32.027494  6967 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:32.149276  6987 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.548s	user 0.014s	sys 0.000s
I20260709 13:01:32.137957  7027 raft_consensus.cc:2764] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:32.178925  7013 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:32.223913  6961 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:32.280191  7053 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:32.326963  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2496) took 1071 ms. Trace:
I20260709 13:01:32.328130  1556 rpcz_store.cc:276] 0709 13:01:31.255746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.747552 (+491806us) service_pool.cc:224] Handling call
0709 13:01:31.747998 (+   446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:31.754392 (+  6394us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:31.754436 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:31.755202 (+   766us) log.cc:844] Serialized 52 byte log entry
0709 13:01:31.984196 (+228994us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:31.984252 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.984344 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:32.325835 (+341491us) raft_consensus.cc:1685] finished
0709 13:01:32.325938 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.326538 (+   600us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5830,"raft.queue_time_us":7009,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":6125,"thread_start_us":187950,"threads_started":1,"wal-append.queue_time_us":494037}
W20260709 13:01:32.335534  1629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.005s	sys 0.021s
W20260709 13:01:32.336285  1629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.006s	sys 0.022s
W20260709 13:01:32.355438  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.358999  1704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.041s	sys 0.050s
W20260709 13:01:32.359537  1704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.042s	sys 0.051s
I20260709 13:01:32.360705  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:32.362901  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:32.362931  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:32.364096  1708 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:32.364593  1709 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
W20260709 13:01:32.375115  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.376714  2264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:01:32.378082  2264 raft_consensus.cc:606] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:32.378664  2264 raft_consensus.cc:614] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:32.378388  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:32.415162  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2323) took 1477 ms. Trace:
I20260709 13:01:32.416159  6553 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.420030  6870 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:32.421799  6806 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:32.423659  6870 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:32.429214  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:32.430200  2266 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:01:32.431934  6870 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:32.435405  6967 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.415846  1560 rpcz_store.cc:276] 0709 13:01:30.937628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.939183 (+  1555us) service_pool.cc:224] Handling call
0709 13:01:32.414507 (+1475324us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54003124d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:32.414847 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148508032}
I20260709 13:01:32.436581  6967 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.442127  6925 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.442412  7043 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.443107  6925 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:32.443411  7043 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.444890  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2492) took 1287 ms. Trace:
W20260709 13:01:32.447083  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.447255  6870 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.448151  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2498) took 1148 ms. Trace:
I20260709 13:01:32.448516  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 928) took 1063 ms. Trace:
I20260709 13:01:32.449739  6925 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:32.450207  6671 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.451251  6671 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.449105  1558 rpcz_store.cc:276] 0709 13:01:31.385113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.926801 (+541688us) service_pool.cc:224] Handling call
0709 13:01:31.927068 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.927252 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:31.927571 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 13:01:31.953340 (+ 25769us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b1800403840. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f23a 00007f06ddfd9a2a
0709 13:01:32.447671 (+494331us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.447789 (+   118us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:32.447948 (+   159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.448038 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.448297 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":485748,"prepare.queue_time_us":2506,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":66,"spinlock_wait_cycles":4477184,"thread_start_us":8055,"threads_started":1,"wal-append.queue_time_us":221386}
I20260709 13:01:32.453774  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:32.448495  6870 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.454967  1553 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:32.449770  6667 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.456501  1705 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:32.456229  6667 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:32.458244  6910 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.002s
I20260709 13:01:32.458863  6910 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:32.460378  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:32.460665  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:32.461413  6667 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:32.461643  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:32.462226  7002 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:32.459483  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:32.462885  7002 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.463419  7002 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:32.449206  6613 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.464264  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:32.445322  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:32.464388  6613 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.465626  6987 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:32.466581  6987 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:32.467022  6987 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:32.467479  6987 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:32.470260  6967 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:32.462585  2270 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:32.456745  6961 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:32.462384  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:32.474239  1560 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:32.448666  1555 rpcz_store.cc:276] 0709 13:01:31.299468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.895378 (+595910us) service_pool.cc:224] Handling call
0709 13:01:31.895669 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.895849 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:31.896191 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.447383 (+551192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.447496 (+   113us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:32.447593 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.447696 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.447941 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121545,"prepare.queue_time_us":610,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"thread_start_us":428838,"threads_started":1,"wal-append.queue_time_us":287284}
I20260709 13:01:32.490878  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2330) took 1023 ms. Trace:
I20260709 13:01:32.491415  1629 rpcz_store.cc:276] 0709 13:01:31.467251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.467978 (+   727us) service_pool.cc:224] Handling call
0709 13:01:31.468354 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.468614 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:31.656544 (+187930us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.482227 (+825683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.490372 (+  8145us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:32.490492 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.490608 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.490795 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":337390,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":88494,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":294,"thread_start_us":937072,"threads_started":3,"wal-append.queue_time_us":519132}
I20260709 13:01:32.498502  6983 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:32.498996  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 57279.5us
I20260709 13:01:32.500204  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:32.502573  6976 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:32.502741  6910 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:32.503073  6976 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:32.503652  6976 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:32.507113  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:32.508217  1700 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
W20260709 13:01:32.507251  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 48133.7us
I20260709 13:01:32.477599  7043 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:32.509738  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:32.509924  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:32.519487  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:32.522110  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 439773us
I20260709 13:01:32.524937  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:32.525460  1634 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:32.535758  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:32.537029  6966 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:32.447089  1552 rpcz_store.cc:276] 0709 13:01:31.157581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.640094 (+482513us) service_pool.cc:224] Handling call
0709 13:01:31.640364 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.640545 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:31.640837 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 13:01:31.807359 (+166522us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.218886 (+411527us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b18002a9ca0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1
0709 13:01:32.413919 (+195033us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b18002a9ca0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:01:32.444151 (+ 30232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.444300 (+   149us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:32.444407 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.444518 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.444708 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":630513,"prepare.queue_time_us":2154,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":654069,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":15855,"spinlock_wait_cycles":24058752,"thread_start_us":155045,"threads_started":1,"wal-append.queue_time_us":250874}
I20260709 13:01:32.530139  6667 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:32.549705  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2329) took 1485 ms. Trace:
I20260709 13:01:32.552922  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:32.571839  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:32.550549  6671 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:32.580803  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 202830us
I20260709 13:01:32.560104  6613 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:32.588069  1629 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:32.551440  1551 rpcz_store.cc:276] 0709 13:01:31.062750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.062917 (+   167us) service_pool.cc:224] Handling call
0709 13:01:31.063281 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.088363 (+ 25082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.088402 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:31.089711 (+  1309us) log.cc:844] Serialized 26 byte log entry
0709 13:01:32.014712 (+925001us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b1800394c60. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:01:32.520837 (+506125us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:32.523074 (+  2237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.528628 (+  5554us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:32.528670 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:32.528680 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.547792 (+ 19112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24618,"raft.queue_time_us":25424,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4830,"spinlock_wait_cycles":12109184,"thread_start_us":496319,"threads_started":1,"wal-append.queue_time_us":1386640}
W20260709 13:01:32.593595  6942 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.036s	user 0.011s	sys 0.005s
W20260709 13:01:32.594386  1635 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.010s
I20260709 13:01:32.601058  2235 leader_election.cc:400] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 10. Current term is 11.
I20260709 13:01:32.601473  2235 leader_election.cc:403] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:01:32.602880  2264 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:01:32.603891  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.612946  2263 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:32.615389  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2502) took 1102 ms. Trace:
I20260709 13:01:32.615885  1628 rpcz_store.cc:276] 0709 13:01:31.512457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.553779 (+ 41322us) service_pool.cc:224] Handling call
0709 13:01:31.561110 (+  7331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.896901 (+335791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.614884 (+717983us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54002fa3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:32.615179 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770909568}
W20260709 13:01:32.618188  6881 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.008s
I20260709 13:01:32.618708  6881 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.622221  6944 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 10. Current term is 11.
I20260709 13:01:32.623522  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2327) took 1670 ms. Trace:
I20260709 13:01:32.624090  6923 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:32.624042  1554 rpcz_store.cc:276] 0709 13:01:30.952596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.954288 (+  1692us) service_pool.cc:224] Handling call
0709 13:01:30.954560 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.105726 (+151166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.622945 (+1517219us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400385754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:32.623303 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322764672}
I20260709 13:01:32.630942  2264 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:01:32.632875  2266 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:01:32.636279  6844 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:32.644088  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:32.644518  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:32.642325  6942 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:32.647888  6942 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:32.650525  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:32.651608  1627 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:32.652565  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:32.653568  1634 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:32.636858  1526 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:32.589644  6671 raft_consensus.cc:2764] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:32.670858  1524 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:32.679518  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:32.680789  1708 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:32.681615  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:32.681898  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:32.682942  1703 raft_consensus.cc:2368] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15.
I20260709 13:01:32.686192  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:32.688763  6918 raft_consensus.cc:3055] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:32.689412  6918 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:32.690349  6986 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.690742  6918 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.692099  6918 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:32.681785  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:32.674204  1635 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:32.693825  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:32.694730  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:32.697098  7001 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:32.697721  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:32.701318  7001 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:32.706892  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 123681us
I20260709 13:01:32.709200  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:32.710175  6671 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.710325  6565 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:32.711248  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 113765us
I20260709 13:01:32.711305  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:32.712905  1700 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:32.713150  6881 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:32.715909  6671 consensus_queue.cc:1059] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:32.717101  6565 raft_consensus.cc:3055] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:32.712808  6966 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:32.717541  6565 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:32.699262  1707 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:32.718781  6565 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.691044  6986 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.720410  2268 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:32.720556  1631 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:32.693967  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:32.722707  6987 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.726481  6987 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:32.727252  6986 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:32.717792  6966 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:01:32.729038  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.698515  1633 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:01:32.729545  7029 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.907s	user 0.012s	sys 0.012s
I20260709 13:01:32.712661  1703 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:32.733315  6918 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:32.740427  1629 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:01:32.748318  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:32.749010  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 78341.8us
I20260709 13:01:32.633740  7002 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.760773  2234 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:32.761119  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:32.762009  6986 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.763105  7002 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:32.764645  2234 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:32.766317  6967 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:32.766053  6918 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.768494  6918 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:32.770805  6966 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:32.797358  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 196530us
I20260709 13:01:32.798194  6565 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:32.798516  2235 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:32.800307  2235 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:32.801502  7000 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:32.806416  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 97419.1us
I20260709 13:01:32.807439  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:32.811082  6976 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.813341  6976 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:32.814335  7002 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:32.814791  7002 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:32.815181  7002 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:32.820320  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:32.820746  1703 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:32.824082  1601 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:32.825426  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 65768.9us
I20260709 13:01:32.827039  1601 leader_election.cc:400] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15.
I20260709 13:01:32.827361  1601 leader_election.cc:403] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:01:32.827840  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 81783.9us
W20260709 13:01:32.830346  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.830442  6818 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:32.831200  6818 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:32.831718  7000 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:32.833055  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:32.774400  7044 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.606s	user 0.003s	sys 0.011s
I20260709 13:01:32.834591  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:32.834995  1705 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:32.836027  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:32.836694  1702 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:32.838104  6870 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:32.838804  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2504) took 1325 ms. Trace:
I20260709 13:01:32.839257  1635 rpcz_store.cc:276] 0709 13:01:31.512951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.567177 (+ 54226us) service_pool.cc:224] Handling call
0709 13:01:32.838556 (+1271379us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b540034dfd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:32.838725 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1202918784}
I20260709 13:01:32.840384  6917 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:32.843451  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:01:32.847672  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50629us
I20260709 13:01:32.833745  6818 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:32.849880  1702 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:32.852237  6161 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:32.851627  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.854087  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:32.857020  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:32.858644  6671 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.859266  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:32.849277  6870 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:32.857125  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:32.875245  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:32.853253  6918 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15.
I20260709 13:01:32.885028  1635 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:32.853107  6613 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:32.886269  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:32.888796  1633 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:32.846578  6987 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.878109  6870 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.878717  6161 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 15 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:32.901448  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:32.903200  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:32.903682  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:32.880774  6667 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:32.905941  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:32.904518  1551 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:32.910897  1635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:32.854007  6976 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:01:32.913738  1556 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.914985  7034 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:32.915282  2234 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:32.915671  7069 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:01:32.916208  6918 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:32.916980  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:32.918197  6859 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:32.932580  6859 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:32.933861  6859 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.934418  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:32.937147  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:32.919696  1705 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:32.917860  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 115981us
W20260709 13:01:32.923223  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 115957us
I20260709 13:01:32.901558  6870 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.928903  7070 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:01:32.929102  7024 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:01:32.938205  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:32.938242  6959 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:32.918392  7007 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:32.939030  6161 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:32.943672  6671 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:32.949373  7059 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:01:32.926693  6818 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.954759  6938 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:32.899518  6521 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.926568  6857 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.957324  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:32.962711  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 45846us
I20260709 13:01:32.963449  2235 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:32.963681  7006 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:32.964200  6954 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:01:32.966467  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:32.967448  7043 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:32.969512  1635 raft_consensus.cc:606] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:32.900970  6967 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:01:32.997538  1556 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:32.998104  1629 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:33.000936  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:32.973779  6959 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.004558  6910 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:32.928568  6987 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.026484  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:32.938247  6613 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:33.039816  1635 raft_consensus.cc:614] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:33.009552  6925 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:33.009095  7006 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.046439  1551 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:33.013849  6938 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:33.063396  6521 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:33.012600  7043 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:33.040319  6721 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:33.057586  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:33.052625  6818 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:33.070122  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 168316us
W20260709 13:01:33.076071  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 109726us
W20260709 13:01:33.076175  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 139246us
I20260709 13:01:33.079341  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:33.082291  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:33.080139  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 116869us
I20260709 13:01:33.083225  1553 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:33.081811  1559 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:01:33.082517  1633 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
W20260709 13:01:33.088605  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 181536us
I20260709 13:01:33.082535  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:33.087378  6697 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.109452  6697 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:33.087072  6923 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:33.087210  7069 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:33.112772  7069 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:33.080948  6810 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:33.114132  6810 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.115193  7069 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.087726  6942 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:33.116227  6942 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:33.116747  2270 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:33.118449  1554 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:01:33.119810  2235 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:33.121899  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:33.122298  6986 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:33.106247  1559 pending_rounds.cc:85] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 6
W20260709 13:01:33.132560  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 273387us
I20260709 13:01:33.056519  7006 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:33.101799  7043 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:33.128163  1559 pending_rounds.cc:107] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:01:33.141840  1709 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:33.141856  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:33.093719  6613 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.091219  7000 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:33.142127  1559 raft_consensus.cc:2889] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:33.139328  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:33.138311  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:33.065972  6521 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.075378  6881 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:33.091456  6671 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:33.086647  7024 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:33.153200  6721 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:33.092274  6938 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.185477  1555 raft_consensus.cc:2368] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15.
I20260709 13:01:33.159418  6818 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:33.159994  7081 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.192317  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:33.192966  7081 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:33.194774  6942 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.195436  7081 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.123234  6986 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:01:33.195879  7005 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.196589  7005 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:33.197203  1706 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:33.160378  7002 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.162048  6966 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:33.162968  6697 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.164247  6987 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:33.150046  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:33.130571  6810 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:33.177335  2265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:01:33.224707  2265 raft_consensus.cc:606] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:33.225111  2265 raft_consensus.cc:614] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:33.226183  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 60275.3us
I20260709 13:01:33.178364  1551 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:33.103271  6870 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.166172  1628 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:01:33.186993  1600 leader_election.cc:400] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:01:33.148118  7000 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:33.228477  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 78592us
I20260709 13:01:33.230463  1600 leader_election.cc:403] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:01:33.253517  1599 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:33.251796  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 961) took 1359 ms. Trace:
I20260709 13:01:33.259941  1706 rpcz_store.cc:276] 0709 13:01:31.869639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.870860 (+  1221us) service_pool.cc:224] Handling call
0709 13:01:33.204810 (+1333950us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000b7054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:33.228624 (+ 23814us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2941976960}
W20260709 13:01:33.274556  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 133015us
W20260709 13:01:33.279785  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 275533us
W20260709 13:01:33.302364  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 58187.7us
I20260709 13:01:33.305951  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:33.315829  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:33.264003  6697 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:33.318463  6697 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:33.318953  6697 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:33.319856  7000 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.321168  7000 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.318645  6927 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.095s
W20260709 13:01:33.326529  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.212131  7024 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:33.376971  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.394937  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:33.344910  7069 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:33.407588  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 48488.6us
I20260709 13:01:33.373968  6987 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.335173  6857 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
W20260709 13:01:33.416204  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 172380us
I20260709 13:01:33.424533  6954 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:33.424917  7075 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:33.404596  6985 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:33.407989  7059 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.440304  1526 leader_election.cc:400] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15.
I20260709 13:01:33.440701  1526 leader_election.cc:403] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:01:33.425341  6954 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.442595  6721 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:33.443292  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 277483us
I20260709 13:01:33.443619  6954 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:33.444279  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:33.445411  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:33.446239  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 146505us
I20260709 13:01:33.446957  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:33.447844  7061 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:01:33.448074  1524 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:33.448835  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:33.449134  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:33.449672  1558 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:33.450428  6671 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:33.450601  6161 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:33.450898  6671 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.451238  6161 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:33.451385  6671 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.452291  6161 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:33.454226  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.454495  7081 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:33.455030  7081 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:33.455240  7024 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.456133  6925 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:33.456096  7081 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.456795  6925 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:33.458418  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:33.459389  1559 raft_consensus.cc:2410] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:33.460157  6565 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:33.460520  6870 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.460750  6565 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:33.462597  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 91982us
I20260709 13:01:33.462898  6565 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.463524  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:33.474470  6985 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:33.475183  6985 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:33.476068  6959 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:33.476599  7006 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.477321  6985 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:33.477769  1627 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:33.425659  6942 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:33.445958  6946 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:33.529394  1601 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:33.519696  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:33.542610  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 92596.3us
W20260709 13:01:33.487715  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 356024us
W20260709 13:01:33.483279  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 48298.4us
I20260709 13:01:33.552961  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:33.487435  7083 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:33.483659  7082 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:33.505296  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:33.495352  7034 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.499853  6961 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:33.568007  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:33.476639  6959 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:33.573212  6959 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.564189  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:33.576457  6959 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:33.577790  6521 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:33.578398  6521 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.578719  6521 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.486446  7002 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:33.583380  1702 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:33.479506  6859 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:33.489761  6565 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15.
I20260709 13:01:33.543282  6946 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:33.504379  7006 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:33.592199  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:33.594550  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:33.596191  6870 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:33.477948  6985 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:33.559541  6810 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:33.558730  7070 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:33.480333  7043 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:33.648614  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 78888.1us
I20260709 13:01:33.581264  2235 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:01:33.742710  1704 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.042s	sys 0.082s
I20260709 13:01:33.639669  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:33.743336  1704 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.043s	sys 0.082s
I20260709 13:01:33.478171  7059 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.749616  6910 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:33.785635  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:33.740803  6946 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.457981  6925 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 7, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:33.559801  6697 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:33.790630  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 344638us
I20260709 13:01:33.774966   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:33.798406  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:33.640434  7024 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:33.798975  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:33.814689  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:33.814081  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:33.803557  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:33.804565  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:33.807857  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.775923  6954 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.817098  1633 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:01:33.810711  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 170472us
I20260709 13:01:33.810704  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:33.814081  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:33.815026  1634 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:01:33.819941  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:33.636744  6942 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.786787  7001 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:33.819167  2264 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:01:33.834254  1600 leader_election.cc:400] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15.
I20260709 13:01:33.820703  1632 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:33.822198  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:33.791226  7005 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.596915  7087 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.251s
I20260709 13:01:33.842276  7013 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:33.842684  7035 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:33.843447  6961 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.863957  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:33.843410  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 380031us
I20260709 13:01:33.777341  7034 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:33.845618  6972 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:33.847971  7006 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:33.848572  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:33.781248  6870 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.854178  6954 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.645421  7082 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.742455  6859 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.839958  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:33.858491  7062 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:33.852628  2268 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:01:33.868878  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 288742us
I20260709 13:01:33.785553  6985 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.833237  7001 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:33.883517  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.862934  7013 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:33.896817  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:33.896790  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 302628us
I20260709 13:01:33.900017  1707 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:33.901528  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:33.862444  7035 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:33.832515  7070 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.870867  6927 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:01:33.903620  7001 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:33.933087  2264 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:33.907955  1704 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:33.940577  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:33.941442  2265 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:33.868628  6961 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:33.966782  6859 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.972059  6985 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:33.972162  6954 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:33.973002  7013 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:33.974463  7101 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:01:33.979914  2267 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:01:33.982185  7034 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.969810  6870 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:33.972909  6987 consensus_meta.cc:287] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
I20260709 13:01:33.984572  6987 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:33.986208  6846 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.019s	sys 0.028s
W20260709 13:01:33.986720  6846 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.019s	sys 0.028s
I20260709 13:01:33.990495  1707 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:33.992413  2265 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:33.989538  6946 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:33.994138  1701 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:33.995532  7070 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:33.959846  7089 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:33.998855  6946 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.004464  7000 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:34.007167  7035 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.009213  7035 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:33.966842  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:34.032421  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 65660.2us
I20260709 13:01:34.033461  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:34.043488  1707 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:34.027715  6966 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:34.055941  1635 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:34.032124  7043 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:34.053396  6671 consensus_meta.cc:287] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.003s
I20260709 13:01:34.038689  7061 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.061368  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.061019  7080 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:34.067593  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.051753  6870 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:34.043221  6986 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:34.055452  7059 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.083626  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.084509  1707 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
W20260709 13:01:34.086411  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 152763us
I20260709 13:01:34.059386  6697 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.068202  6923 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:34.073756  7108 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.089155  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.052206  6565 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:34.073879  6942 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.066751  6721 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:34.067768  7069 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.078317  7080 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:34.090446  6923 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:34.123633  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:34.126894  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:34.074148  6966 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.076858  6671 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.081103  6521 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.079952  7061 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.096426  6870 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:34.130875  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.133738  1553 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:34.133927  7061 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.134131  6870 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.135010  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.093994  6987 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:34.136046  6521 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:34.081087  6859 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:01:34.139384  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.139642  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.140285  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.140564  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.139506  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.143265  1551 raft_consensus.cc:2368] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15.
I20260709 13:01:34.142997  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:34.142366  1560 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:34.146414  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.128813  7082 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.131953  6810 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:34.149101  1552 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:34.152323  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:34.152947  1560 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:34.152210  1557 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:34.126112  6565 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.142549  6987 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:34.158314  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.130759  7069 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:34.167975  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 304121us
I20260709 13:01:34.169385  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.170063  1552 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
W20260709 13:01:34.172871  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 68305.9us
I20260709 13:01:34.173806  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:34.158087  7080 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.175719  7080 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.175987  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:34.177269  1673 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:34.177995  7110 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:34.179376  7110 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:34.179728  7098 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:34.182447  7097 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:01:34.147907  6697 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:34.170313  6810 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.173393  6923 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.142686  6721 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.184078  1554 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:34.186595  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.186983  6923 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:34.190232  1630 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:34.197353  6917 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:34.198096  6917 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.198583  6697 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:34.199039  6697 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:34.199463  6671 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.141395  7108 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.199913  6697 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.201182  6697 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:34.201253  2234 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:34.156840  6961 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:34.202292  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.202909  1552 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:34.204809  6859 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:34.204963  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.205279  6859 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:34.205720  6859 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.206511  6987 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.209342  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:34.210093  1634 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 10.
I20260709 13:01:34.156808  6986 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:34.211396  6986 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.205719  1552 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:34.215438  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.222579  6966 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.224206  6810 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.224486  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.225250  1556 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:34.226408  6986 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:34.227130  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:34.227711  1632 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:34.228608  6565 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:34.229410  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:34.229975  1554 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:34.231613  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 54402.1us
W20260709 13:01:34.232470  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46887.2us
I20260709 13:01:34.233355  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.235909  6966 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:34.239581  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.240317  7108 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.240968  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.242941  1556 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:34.243831  7013 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.253878  6986 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:34.254858  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.257688  1560 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:34.254194  6721 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:34.254555  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 1120) took 1176 ms (client timeout 1541 ms). Trace:
I20260709 13:01:34.260448  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:34.261679  2265 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:34.258560  6986 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:34.258754  1627 rpcz_store.cc:269] 0709 13:01:33.078220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.081920 (+  3700us) service_pool.cc:224] Handling call
0709 13:01:34.254327 (+1172407us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b540007f3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:34.254501 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855662848}
W20260709 13:01:34.262972  7120 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:01:34.263661  7089 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:34.264142  7089 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:34.264236  6986 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:34.231179  6917 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.264775  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.265792  6917 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:34.266466  6917 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:34.266887  6917 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:34.272773  7122 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:01:34.264278  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:34.275718  6859 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.275714  2270 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:34.278228  6859 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:34.276346  1556 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:34.282989  1600 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:34.284798  1600 leader_election.cc:400] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15.
I20260709 13:01:34.287691  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.288120  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:34.288528  1556 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:34.253803  1554 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:34.278064  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:34.305133  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.265784  6721 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:34.305039  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.314582  2268 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:34.314893  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:34.310947  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.316300  1600 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:34.314956  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.310015  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.317976  1705 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:34.319923  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.320580  1700 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:34.322254  1600 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.323190  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.309434  7035 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:34.302336  6859 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:34.324973  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:34.325101  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 90857.2us
I20260709 13:01:34.329931  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.302362  6966 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:34.327061  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:34.324172  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.331202  1709 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
W20260709 13:01:34.334923  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.322391  6942 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:34.336596  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:34.333773  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:34.327733  7034 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:34.341279  1627 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.342391  6818 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:34.342352  6859 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.345712  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:34.341056  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.325860  6521 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:34.327569  7061 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:34.348569  1626 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:34.353200  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:34.355551  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.356493  1600 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.359171  7001 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.359953  7007 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:34.360219  7059 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:34.360494  7007 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:34.360658  7059 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.361102  7059 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:34.347905  7126 raft_consensus.cc:2764] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:34.359519  7118 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:34.336566  7087 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:34.357476  6818 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:34.363312  2265 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:34.346895  6942 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:34.357726  6985 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:01:34.366694  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.367287  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:34.363121  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:34.364073  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 49396.2us
I20260709 13:01:34.376462  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:34.379223  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.346128  7035 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:34.370643  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.352842  6857 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:01:34.346875  7034 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:34.404075  7034 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.375782  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.331099  6721 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.379551  1709 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.358047  7061 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.352542  6521 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:34.391168  7124 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:34.391916  1706 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:34.395112  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47769.4us
I20260709 13:01:34.398262  1551 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:34.399075  7104 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:34.398311  7069 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:34.400311  6925 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:34.368755  6565 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:34.345564  6161 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:01:34.414866  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:34.416672  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:34.425599  6565 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:34.381068  7118 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:34.388106  7035 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:34.420850  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:34.378090  6942 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.369290  7087 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:34.419116  7124 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.434767  7124 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:34.423676  7091 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:34.424206  6966 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.418133  2270 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:34.361569  7007 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.414469  7061 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.411947  6967 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:34.432760  6565 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.434145  7098 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:34.419600  6521 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.423031  7104 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:34.458218  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.459197  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:34.441493  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.425760  6857 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:34.450378  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.452311  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:34.464854  1554 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.450835  6161 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:34.432075  1627 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:34.454516  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.466856  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:34.440042  7035 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:34.439327  7087 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.467964  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.468531  1557 raft_consensus.cc:2410] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:34.432996  6917 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.469298  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.453008  6967 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:34.475848  1552 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:01:34.457463  1601 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.472658  1558 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:34.459143  7013 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:34.456189  7098 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:34.423684  6818 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.490756  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.463660  7104 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:34.459029  6721 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:34.468099  7123 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:34.489672  1559 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:34.465720  6857 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:34.491691  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:34.468938  6161 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:34.503034  1524 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.499578  1554 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:34.485101  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.483621  6967 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.488436  7013 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:34.506693  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 85917.5us
I20260709 13:01:34.497946  6954 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:34.511709  7082 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:34.512475  7098 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:34.514322  7133 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:01:34.505697  6161 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:34.500061  6697 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:34.500519  7080 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:34.528729  7000 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.530797  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.525748  7013 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:34.507001  6671 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:34.561707  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:34.528204  6954 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.459610  7118 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.566134  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:34.491693  7089 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.531770  7082 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:34.573271  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 115892us
I20260709 13:01:34.550702  6697 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:34.564113  7132 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:01:34.551503  6923 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:34.572877  6954 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:34.583541  7082 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.565711  7091 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:34.573513  6959 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:34.576592  7098 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:34.592837  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46557.8us
I20260709 13:01:34.579020  6917 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:34.590183  6697 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:34.620986  2234 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:34.622332   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:34.622295  6881 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:34.589577  7138 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:34.569190  7123 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:34.570740  7000 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.600792  6959 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:34.600931  7091 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:34.623466  6881 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:34.639918  6881 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.648025  7043 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:34.648902  7043 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.651618  7043 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:34.633510  6959 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:34.656765  7034 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.633725  7091 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:34.626282  7138 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:34.604853  6923 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.670455  7138 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:34.672551  6923 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:34.678656  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 50436.5us
W20260709 13:01:34.664429  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 84236.1us
I20260709 13:01:34.631752  6870 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:34.828425  1709 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
W20260709 13:01:34.802654  7131 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:01:34.832931  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:34.842607  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:34.844653  1627 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:34.845690  7034 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.850960  1704 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:34.853003  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:34.853510  1700 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
W20260709 13:01:34.855654  7140 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 13:01:34.855948  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.859112  7089 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:34.861110  6859 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:34.838975  6870 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.863726  6859 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:34.864336  6870 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:34.865789  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:34.867139  7136 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.867074  1631 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:34.867628  6954 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.850304  7035 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.872051  6565 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.873564  7035 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.848189  6959 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.875340  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:34.899861  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:34.878340  7013 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.864429  6859 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.888556  6565 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:34.892192  7091 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.854808  7124 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.894451  6966 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:34.895154  6667 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:34.898603  6987 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:34.913317  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 288818us
I20260709 13:01:34.951110  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.946735  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.951617  1555 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:34.951939  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.963198  1558 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:34.951088  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:34.951843  6161 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.963289  1551 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:34.877722  7138 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.948477  7035 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:34.831104  6942 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:34.979969  1557 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:01:34.980528  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.981918  6161 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:34.983196  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:34.983851  1555 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:34.984047  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.988571  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:34.989205  1551 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:34.990119  1626 raft_consensus.cc:2393] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:34.822275  7123 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:34.867664  7136 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.006345  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:35.005615  1631 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:34.976550  6954 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.011391  7089 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:35.014230  7150 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.014856  7150 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.021126  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:35.023526  7139 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:01:34.966843  6667 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.013582  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:34.953583  7104 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.053231  1553 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
W20260709 13:01:34.990072  7061 consensus_meta.cc:287] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
W20260709 13:01:35.061602  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 65404.1us
W20260709 13:01:35.059309  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.008s	sys 0.023s
W20260709 13:01:35.064075  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.009s	sys 0.024s
I20260709 13:01:35.077368  7126 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:35.078372  7126 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:35.080101  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 125385us
I20260709 13:01:35.084331  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:35.085647  6565 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:35.089212  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:35.089576  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:35.089443  6565 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:34.967605  7007 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
W20260709 13:01:35.104504  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 91025.6us
I20260709 13:01:35.129215  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.968048  6987 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.138950  6818 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:34.972993  7034 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:01:35.140862  7091 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.141135  7136 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.144200  7126 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.146307  7000 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.147452  6870 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.147994  7000 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.148070  6870 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.148974  7000 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.151194  7138 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.154685  7013 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.159934  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:35.049841  7035 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:35.168588  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 46272.6us
I20260709 13:01:35.206781  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:34.974308  6966 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.214545  1560 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:35.122459  6959 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.219130  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.221567  1631 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:35.224134  1707 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:35.226888  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.227775  1707 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:35.220772  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:35.230957  1553 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:35.233796  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.237792  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.240587  1707 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:35.244635  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.246732  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.248700  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.250972  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:35.251689  1554 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:35.213989  7098 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.603s	user 0.000s	sys 0.010s
W20260709 13:01:35.215890  6521 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.739s	user 0.011s	sys 0.000s
I20260709 13:01:35.262579  1705 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:35.257681  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:35.263878  7087 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.775s	user 0.004s	sys 0.007s
I20260709 13:01:35.257022  1706 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:35.258173  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:35.267777  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.213631  7091 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.293298  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.273226  1551 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:35.285108  1703 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:35.286506  1708 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:35.268821  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:35.135280  7061 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.296507  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:35.206539  7136 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:35.287703  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.320716  1702 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:35.296651  1631 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:35.222615  6846 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:35.285221  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:35.323900  2268 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:35.305759  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:35.306176  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:35.296542  7082 consensus_meta.cc:287] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.009s
I20260709 13:01:35.308032  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:35.309072  1626 raft_consensus.cc:2368] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14.
I20260709 13:01:35.313108  1628 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:35.318050  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:35.319034  7160 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.325219  2266 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
W20260709 13:01:35.337352  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.214895  7035 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.351333  2235 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:35.340644  1560 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:35.326782  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:35.327407  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:35.351894  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:35.290212  7059 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.923s	user 0.011s	sys 0.000s
I20260709 13:01:35.258814  7126 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:01:35.386134  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:35.391513  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:35.387132  2270 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:35.383262  1554 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:35.393854  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:35.394904  1629 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:35.370095  1555 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:35.397774  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:35.381922  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:35.400583  2266 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:35.381539  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.369752  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:35.399924  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:35.423127  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:35.290458  6521 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.424346  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:35.427022  1631 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:35.410810  1702 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:35.410329  1630 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:35.431737  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:35.432525  1551 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.434398  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:35.434501  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:35.435173  2263 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:35.435344  2236 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:35.436180  2264 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:35.392716  7059 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.370977  6810 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.438704  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.438933  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:35.445634  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.422884  1600 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:35.446837  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:35.424458  6967 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.878s	user 0.010s	sys 0.001s
I20260709 13:01:35.441630  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:35.450120  1632 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:35.457413  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:35.460556  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:35.463814  1554 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:35.469944  1551 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:35.360939  7091 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.480156  1705 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:35.476796  1631 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:01:35.465974  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:35.479753  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:35.499305  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:35.429294  6859 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:35.500182  1634 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:35.350373  7082 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.326730  6846 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.297169  7087 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.385486  7136 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.510905  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:35.520008  1709 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:35.470623  7118 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.498275  6818 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:35.505229  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:35.506438  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 155193us
I20260709 13:01:35.532681  1555 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:35.506835  1706 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:01:35.507206  1630 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:35.533475  1706 pending_rounds.cc:85] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 9
I20260709 13:01:35.533769  1706 pending_rounds.cc:107] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:01:35.534018  1706 raft_consensus.cc:2889] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:35.534524  1632 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:35.472852  6697 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.843s	user 0.011s	sys 0.000s
I20260709 13:01:35.543174  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:35.504652  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:35.528666  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:35.530840  7153 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:35.506837  7043 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:35.559011  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:35.432101  7152 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.145s
I20260709 13:01:35.549239  1709 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:35.461180  6810 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.550616  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:35.462898  6967 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.559571  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:35.524945  7000 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.546277  1554 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:35.561875  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:35.568946  1555 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:35.579170  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:35.369966  7160 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:35.569598  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 214593us
I20260709 13:01:35.588012  2263 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:35.555540  6987 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.551039  7104 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.558549  7043 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:35.571938  7124 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.539311  7118 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:35.599013  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 48439.3us
I20260709 13:01:35.573067  7153 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:35.597227  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:35.598248  7034 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:35.544898  6697 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.608394  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:35.610282  2235 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:35.625228  1559 raft_consensus.cc:2368] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14.
I20260709 13:01:35.603905  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:35.613206  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:35.625785  1551 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:35.625960  1632 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:35.585973  6966 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:35.626368  1552 consensus_meta.cc:287] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.604s	user 0.018s	sys 0.000s
I20260709 13:01:35.625231  1555 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:35.626814  1552 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:35.623062  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:35.607517  7043 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:35.609793  7000 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:35.635078  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:35.609300  7159 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:35.613793  6881 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:35.637987  1552 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
W20260709 13:01:35.642900  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 63832.5us
W20260709 13:01:35.644158  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 133365us
I20260709 13:01:35.626645  7149 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:35.643900  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:35.654482  1555 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:35.601333  7152 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:01:35.624354  6987 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:35.650789  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 215514us
W20260709 13:01:35.657847  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47668.3us
I20260709 13:01:35.659176  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:35.629360  7104 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:35.636830  7034 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:35.677380  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:35.678684  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:35.679330  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:35.683692  1552 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:35.684731  1555 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:35.690476  7173 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:35.691121  7164 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 13:01:35.691965  7171 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:35.693198  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:35.693998  1555 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:35.691092  7173 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:35.695488  7173 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:35.706802  7161 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:01:35.709030  1635 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:35.646835  7158 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:35.711716  7082 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.628890  7163 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.222s
I20260709 13:01:35.654086  7035 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.716292  7175 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:35.680212  7169 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:35.716892  7175 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:35.717609  7169 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:35.718041  7169 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:35.718043  7175 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.719399  7169 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.720880  6697 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.643882  6818 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:35.721449  7175 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.722406  7091 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.722851  7150 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.723665  6967 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.672523  7001 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.724812  7153 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.725596  7013 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:35.726011  7013 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:35.726876  7013 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.730190  7087 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.731858  6870 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:35.732609  7136 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.695503  7157 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:35.733717  7157 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:35.735034  7143 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.697s	user 0.007s	sys 0.000s
I20260709 13:01:35.734719  7157 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.736276  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2532) took 1261 ms. Trace:
I20260709 13:01:35.736641  1556 rpcz_store.cc:276] 0709 13:01:34.474509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.474655 (+   146us) service_pool.cc:224] Handling call
0709 13:01:34.474946 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.499275 (+ 24329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.499305 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.528827 (+ 29522us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.697357 (+168530us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:34.697414 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.697523 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:35.734327 (+1036804us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:35.735957 (+  1630us) raft_consensus.cc:1685] finished
0709 13:01:35.735984 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.736214 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37617,"raft.queue_time_us":13012,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5798,"spinlock_wait_cycles":5654912,"thread_start_us":121403,"threads_started":1,"wal-append.queue_time_us":413752}
I20260709 13:01:35.730132  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 1217) took 1420 ms. Trace:
I20260709 13:01:35.741508  2265 rpcz_store.cc:276] 0709 13:01:34.311278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.314627 (+  3349us) service_pool.cc:224] Handling call
0709 13:01:35.729915 (+1415288us) spinlock_profiling.cc:243] Waited 47.5 ms on lock 0x7b5400598dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:35.730053 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109135232}
I20260709 13:01:35.729166  1551 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:35.648362  6881 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.747812  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:35.748862  1556 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:35.747943  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:35.747623  6881 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:35.767894  6857 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.769203  6857 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:35.775331  7170 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
I20260709 13:01:35.688292  7059 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.788338  1552 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:35.687872  7104 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:35.789909  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:35.797546  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 176990us
I20260709 13:01:35.801406  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:35.810649  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.815045  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:35.816339  1556 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:35.788630  7013 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:35.788208  7035 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:35.825820  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 166746us
I20260709 13:01:35.656057  7159 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.832834  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:35.838490  7159 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.839701  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:35.840667  7175 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:35.840924  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.841167  7175 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:35.841679  7175 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.841709  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:35.844444  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:35.846623  7151 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:35.847383  7151 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:35.850139  6870 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:35.850548  7178 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:35.850696  7061 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.851111  7178 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.854482  7178 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:35.854628  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2374) took 1305 ms. Trace:
I20260709 13:01:35.855111  1559 rpcz_store.cc:276] 0709 13:01:34.549623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.549798 (+   175us) service_pool.cc:224] Handling call
0709 13:01:35.854439 (+1304641us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540030b454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:35.854564 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2415208832}
I20260709 13:01:35.856396  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:35.856822  1600 leader_election.cc:400] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14.
I20260709 13:01:35.857220  1600 leader_election.cc:403] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:01:35.857527  7151 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:35.858301  7035 raft_consensus.cc:697] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:35.856468  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:35.859114  6667 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.814217  7059 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:35.814558  6987 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:35.847414  7152 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:01:35.861347  7034 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.815908  7123 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:35.863754  7146 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:35.867002  7059 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:35.868039  7059 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.868559  6810 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:35.865103  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.871963  1704 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:35.870695  7178 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:35.881292  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:35.781064  6818 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.886724  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.888931  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:35.890622  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:35.892040  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:35.893847  1630 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 11: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:35.894366  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:35.891893  6810 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.896904  2265 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:35.898591  1632 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:35.899111  2265 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:35.901178  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:35.882617  7178 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.873529  7123 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.902961  1551 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:35.967752  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 953) took 1014 ms. Trace:
I20260709 13:01:35.901453  1556 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:35.871893  6938 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:01:35.892923  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:35.942236  1632 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:35.945006  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:35.883152  6927 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.952049  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:35.972084  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 121834us
I20260709 13:01:35.962409  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:35.972965  2263 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:35.859449  7035 consensus_queue.cc:237] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.974382  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:35.975360  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.975692  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 82880.6us
I20260709 13:01:35.976450  1599 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:35.964021  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:35.968163  1551 rpcz_store.cc:276] 0709 13:01:34.953348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.879646 (+926298us) service_pool.cc:224] Handling call
0709 13:01:35.902771 (+ 23125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.967500 (+ 64729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.967698 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:35.941147  1555 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:35.975970  2235 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.716s (SENT)
I20260709 13:01:35.978714  2235 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:35.983156  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:35.985687  1559 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:35.987896  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:35.993654  1599 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:35.990353  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:35.944482  6810 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.979993  7159 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:35.892458  7104 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:36.001212  1555 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:36.003883  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:36.004331  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:36.005208  7181 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:01:36.005254  1551 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:35.978830  6927 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:36.008355  7183 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:01:36.016980  7146 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14.
I20260709 13:01:36.018641  7123 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:35.995752  6721 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:36.000679  7174 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:36.062528  7174 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:36.062976  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:36.063570  7174 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:35.985234  7061 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:35.971575  7175 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:36.071898  7175 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:36.072665  7152 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:36.073191  7152 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:36.075433  7152 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:36.075904  7152 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:36.076370  7152 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:35.995415  7186 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 13:01:36.081554  7172 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 13:01:36.032121  1555 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:36.035542  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 62790us
I20260709 13:01:36.049825  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:36.054176  1551 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:35.990144  7153 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:36.098534  1551 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:35.986645  7188 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:36.095212  2271 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:36.107617  1554 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:36.027110  7159 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.101248  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:36.111989  1630 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:36.115743  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:36.117981  2263 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:36.120872  1633 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:36.122313  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:36.133536  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:36.055806  7087 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:01:36.151757  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:36.151379  1554 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:36.154950  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:36.118181  7159 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:36.131206  7123 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:36.175390  1629 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:36.132795  6959 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:36.194849  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:36.160966  7091 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:36.162695  7152 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:36.163091  6521 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:36.151854  7186 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 13:01:36.198801  1453 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35578 (request call id 325) took 20011 ms (client timeout 15000 ms). Trace:
I20260709 13:01:36.184087  7123 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:36.187906  7118 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:36.199728  7162 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.105s
I20260709 13:01:36.199862  7142 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:01:36.206501  6959 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:36.208655  6917 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:01:36.120564  6881 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:36.205700  2264 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:36.197943  6818 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:36.240175  7123 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:36.272174  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 111927us
W20260709 13:01:36.275869  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.295240  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:36.242058  7091 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.299723  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:36.300840  1700 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:36.323777  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:36.313462  7104 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.335917  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:36.294191  7061 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:36.294673  6857 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:36.250145  7195 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:01:36.276556  7174 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:36.299854  7178 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:01:36.368130  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:36.334638  6818 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:36.368911  2267 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:36.344789  7104 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:36.382635  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 159808us
I20260709 13:01:36.391316  7177 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:36.392237  7177 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.392738  7177 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:36.393333  2262 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:36.393764  2262 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:36.394578  2262 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:36.395562  2262 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:36.368994  7174 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:36.395196  7177 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:36.426014  1626 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:36.426415  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 946) took 1524 ms. Trace:
I20260709 13:01:36.387135  7178 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:01:36.432617  2262 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:36.431242  1557 rpcz_store.cc:276] 0709 13:01:34.901805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.901927 (+   122us) service_pool.cc:224] Handling call
0709 13:01:36.426198 (+1524271us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x7b5400385754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:36.426349 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18598656}
I20260709 13:01:36.436290  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:36.368572  6857 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:36.363030  7091 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:36.429667  6810 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:36.447763  2269 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:36.474908  7104 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:36.475225  6881 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:36.437948  7177 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:36.487883  7198 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:01:36.488397  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.489078  7202 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:01:36.454720  7043 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.798s	user 0.012s	sys 0.001s
W20260709 13:01:36.498801  7197 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 13:01:36.499663  7201 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:01:36.504758  7196 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:01:36.494652  7174 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:36.387269  7203 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:01:36.504568  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:36.491887  7204 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:36.492023  7178 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:36.528657  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:36.227880  1453 rpcz_store.cc:269] 0709 13:01:16.098081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.117716 (+ 19635us) service_pool.cc:224] Handling call
0709 13:01:36.093465 (+19975749us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:26.902533 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:26.903377 (+   844us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:26.903439 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:01:26.903466 (+    27us) tablet.cc:662] Decoding operations
0709 13:01:26.954864 (+ 51398us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:26.970078 (+ 15214us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:26.971208 (+  1130us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:01:27.231738 (+260530us) tablet.cc:701] Row locks acquired
0709 13:01:27.242552 (+ 10814us) write_op.cc:260] PREPARE: finished
0709 13:01:27.258208 (+ 15656us) write_op.cc:270] Start()
0709 13:01:27.258361 (+   153us) write_op.cc:276] Timestamp: P: 1783602087258130 usec, L: 0
0709 13:01:27.258379 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:01:27.277809 (+ 19430us) log.cc:844] Serialized 11478 byte log entry
0709 13:01:28.437335 (+1159526us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:29.478990 (+1041655us) op_driver.cc:464] REPLICATION: finished
0709 13:01:30.066775 (+587785us) write_op.cc:301] APPLY: starting
0709 13:01:30.066898 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:30.704856 (+637958us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:30.704888 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:30.915699 (+210811us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b180014bf00. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2522 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:01:31.434771 (+519072us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:31.435138 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:01:31.435190 (+    52us) write_op.cc:312] APPLY: finished
0709 13:01:31.435719 (+   529us) log.cc:844] Serialized 252 byte log entry
0709 13:01:31.482781 (+ 47062us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:31.483108 (+   327us) write_op.cc:454] Released schema lock
0709 13:01:31.483209 (+   101us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:31.483722 (+   513us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:31.483755 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2168790,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":585629,"apply.run_cpu_time_us":58540,"apply.run_wall_time_us":1416917,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125289,"num_ops":29,"prepare.queue_time_us":370878,"prepare.run_cpu_time_us":86839,"prepare.run_wall_time_us":637801,"raft.queue_time_us":509607,"raft.run_cpu_time_us":148183,"raft.run_wall_time_us":508133,"replication_time_us":2206783,"spinlock_wait_cycles":17784960,"thread_start_us":1385288,"threads_started":5,"wal-append.queue_time_us":355090,"wal-append.run_cpu_time_us":90194,"wal-append.run_wall_time_us":3741460}]]}
I20260709 13:01:36.534826  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:36.512089  7177 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:36.538725  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1143) took 2011 ms. Trace:
W20260709 13:01:36.538962  1560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 949) took 1634 ms (client timeout 2133 ms). Trace:
I20260709 13:01:36.539187  1627 rpcz_store.cc:276] 0709 13:01:34.527786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.546286 (+ 18500us) service_pool.cc:224] Handling call
0709 13:01:34.546697 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.845059 (+298362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.538456 (+1693397us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b540034d5d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:36.538658 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684892032}
W20260709 13:01:36.539391  1560 rpcz_store.cc:269] 0709 13:01:34.904615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.904722 (+   107us) service_pool.cc:224] Handling call
0709 13:01:36.538792 (+1634070us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400311ad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:36.538909 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576462592}
I20260709 13:01:36.540992  1555 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:36.517526  6959 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:36.522918  7174 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:36.544770  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:36.546370  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:36.512979  7043 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:36.549952  1557 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:36.516294  7213 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:01:36.556151  1703 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:36.533397  7178 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:36.535272  7204 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:36.567157  1560 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:36.521032  7104 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:36.575977  7098 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.171s	user 0.016s	sys 0.029s
I20260709 13:01:36.582574  2267 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:36.584234  7098 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.017s	sys 0.030s
I20260709 13:01:36.582780  1560 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:36.572227  7214 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:36.606648   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:36.616817  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2475) took 1230 ms. Trace:
I20260709 13:01:36.582886  6923 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:36.617439  1709 rpcz_store.cc:276] 0709 13:01:35.386426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.387311 (+   885us) service_pool.cc:224] Handling call
0709 13:01:36.616563 (+1229252us) spinlock_profiling.cc:243] Waited 93.5 ms on lock 0x7b54001fde54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:36.616735 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215036800}
W20260709 13:01:36.621268  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 116847us
I20260709 13:01:36.622978  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:36.583817  7211 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.604045  7203 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:36.598462  7213 consensus_queue.cc:1243] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:36.625519  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:36.633633  1674 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:36.634282  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:36.638346  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:36.638984  7177 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:36.620833  6923 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:36.649398  1702 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:36.583925  7104 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:36.626546  7211 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:36.829473  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:36.830296  1702 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:36.830523  7211 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:36.632754  7220 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.832187  7220 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:36.834271  1706 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
W20260709 13:01:36.838212  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 204683us
I20260709 13:01:36.839192  7204 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:36.839798  7204 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:36.840130  7204 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:36.642714  7013 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.811s	user 0.006s	sys 0.007s
W20260709 13:01:36.840742  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.840375  7098 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:36.841431  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:36.840430  7204 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:36.840472  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 215081us
I20260709 13:01:36.850500  1702 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:36.902136  7148 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:36.920778  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:36.920644  7157 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.621591  7214 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:36.937925  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 81838.5us
I20260709 13:01:36.969508  7213 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:36.940855  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:36.972443  1702 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:01:36.938771  7177 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:01:36.920476  7087 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.947484  7214 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:36.953042  7123 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.000s
I20260709 13:01:36.942898  6857 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:36.957260  7159 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.785s	user 0.005s	sys 0.004s
W20260709 13:01:36.959254  6818 consensus_meta.cc:287] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 13:01:37.013773  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2542) took 1159 ms. Trace:
I20260709 13:01:36.960930  7091 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:36.941352  7013 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.943811  6923 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:36.963872  7104 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:36.964469  7220 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:36.973278  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:37.009047  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.936729  7148 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:36.933578  7157 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.014235  1559 rpcz_store.cc:276] 0709 13:01:35.854262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.856183 (+  1921us) service_pool.cc:224] Handling call
0709 13:01:37.013601 (+1157418us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540031ea54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:37.013718 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290515840}
I20260709 13:01:37.010058  7222 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:01:37.025621  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.041079  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:37.041493  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:37.025900  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 52626.4us
I20260709 13:01:37.045253  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:37.052405  1702 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:01:37.014365  7174 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:37.059324  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.019023  7043 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:37.018596  6818 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:37.061306  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:37.069980  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:37.073628  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:37.076431  2269 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 19: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:37.075292  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:37.078256  1702 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:37.079617  2262 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:37.080986  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:37.039036  7222 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:37.014111  7087 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.071198  6923 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:37.058218  6942 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:37.020325  7214 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:01:37.097046  6942 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:37.097414  7214 raft_consensus.cc:3055] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:37.097885  7214 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:37.097589  6942 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:37.098728  7214 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:37.099705  7214 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.058290  7213 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:37.020157  6857 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:01:37.058780  7104 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:37.017081  7123 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:37.105140  7123 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:37.106554  1554 raft_consensus.cc:2393] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 15: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:37.019541  7159 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.109115  7159 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:37.085495  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:37.081030  1454 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 8 to 11, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:01:37.088371  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.114734  1630 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:37.088445  7148 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.071552  7174 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.096290  7087 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:37.112911  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:37.123426  2264 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:37.121032  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.126088  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:37.126753  7174 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:37.127334  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:37.127693  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.128482  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:37.128813  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:37.129149  1707 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:37.129343  1630 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:37.130616  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:37.131253  2269 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:37.131321  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1003) took 1178 ms. Trace:
I20260709 13:01:37.132162  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:37.105706  7123 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.134369  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:37.134374  7123 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.135771  2266 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:37.099709  6942 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:37.140528  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2480) took 1706 ms. Trace:
I20260709 13:01:37.140934  1700 rpcz_store.cc:276] 0709 13:01:35.434423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.446974 (+ 12551us) service_pool.cc:224] Handling call
0709 13:01:36.221200 (+774226us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b58001b3398. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 13:01:36.221415 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.320892 (+ 99477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.140317 (+819425us) spinlock_profiling.cc:243] Waited 76.4 ms on lock 0x7b54001ad6d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:37.140470 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178448512}
I20260709 13:01:37.141402  1632 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:37.142480  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.142762  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:37.143642  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.144652  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.145047  6846 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:37.143746  1626 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:37.148550  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:37.155786  1709 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:37.131860  1708 rpcz_store.cc:276] 0709 13:01:35.953020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.953173 (+   153us) service_pool.cc:224] Handling call
0709 13:01:35.964619 (+ 11446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.987733 (+ 23114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.987772 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:36.031051 (+ 43279us) log.cc:844] Serialized 26 byte log entry
0709 13:01:36.157463 (+126412us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:37.130631 (+973168us) log.cc:844] Serialized 14 byte log entry
0709 13:01:37.130898 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.131000 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.131068 (+    68us) raft_consensus.cc:1685] finished
0709 13:01:37.131086 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.131232 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":972787,"prepare.queue_time_us":976710,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":10609,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":2260,"thread_start_us":64695,"threads_started":1,"wal-append.queue_time_us":140399}
I20260709 13:01:37.058425  7013 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.152572  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.157979  1454 catalog_manager.cc:5697] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 9 to 12, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:37.168054  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.129876  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:37.164675  1630 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:37.164975  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.170636  1634 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:37.171921  1635 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:37.173309  1635 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:37.176781  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.176990  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.177582  1630 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:37.178357  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:37.180087  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:37.164690  7155 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 1.552s	user 0.010s	sys 0.011s
I20260709 13:01:37.182068  2264 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:01:37.192741  7223 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:01:37.194454  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.196731  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:37.197707  1701 raft_consensus.cc:2410] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 17 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:01:37.174700  7173 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:37.198776  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.198959  7173 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.200610  1701 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:37.201150  7173 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:37.203364  1703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2473) took 1905 ms (client timeout 1723 ms). Trace:
W20260709 13:01:37.203913  1703 rpcz_store.cc:269] 0709 13:01:35.298164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.298567 (+   403us) service_pool.cc:224] Handling call
0709 13:01:37.203148 (+1904581us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b540018a6d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:37.203281 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053545728}
I20260709 13:01:37.205552  1703 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:37.207204  1705 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:37.207441  1454 catalog_manager.cc:5697] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.208851  1705 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:37.210273  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:37.164686  7188 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:01:37.187282  1632 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:37.217818  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.220842  1702 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:37.226323  1635 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:37.238682  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:37.245679  6927 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:37.249370  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.249879  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.251662  7213 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:01:37.251964  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39441 timed out after 1.540s (SENT) [suppressed 11 similar messages]
I20260709 13:01:37.252306  7213 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.253671  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2396) took 1049 ms. Trace:
I20260709 13:01:37.253767  1557 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:37.254125  1554 rpcz_store.cc:276] 0709 13:01:36.204575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.250536 (+ 45961us) service_pool.cc:224] Handling call
0709 13:01:37.253468 (+1002932us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b54002db9d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:37.253619 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808294272}
I20260709 13:01:37.258955  7213 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:37.257453  7178 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.260118  7178 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:37.263135  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 950) took 2358 ms. Trace:
I20260709 13:01:37.263688  1558 rpcz_store.cc:276] 0709 13:01:34.905004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.973657 (+ 68653us) service_pool.cc:224] Handling call
0709 13:01:34.980744 (+  7087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.990269 (+  9525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.990300 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.014500 (+ 24200us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.262811 (+248311us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:35.428050 (+165239us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.428515 (+   465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.428583 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.133628 (+1705045us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:37.262753 (+129125us) raft_consensus.cc:1685] finished
0709 13:01:37.262870 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.263039 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":259892,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":278,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":9660,"spinlock_wait_cycles":18275072,"thread_start_us":372118,"threads_started":2,"wal-append.queue_time_us":545182}
I20260709 13:01:37.267571  7169 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.272518  7195 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:37.273015  7195 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:37.275079  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:37.276026  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2393) took 1629 ms. Trace:
I20260709 13:01:37.276432  1552 rpcz_store.cc:276] 0709 13:01:35.646698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.274761 (+1628063us) service_pool.cc:224] Handling call
0709 13:01:37.275957 (+  1196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.277922  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.278647  7160 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:37.270408  1454 catalog_manager.cc:5697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:37.279603  7013 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:37.284615  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.285076  7157 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:37.299762  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:37.302489  1632 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:37.302389  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.303891  1628 raft_consensus.cc:2393] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:37.303992  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:37.307753  1628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2362) took 1916 ms (client timeout 2160 ms). Trace:
W20260709 13:01:37.308288  1628 rpcz_store.cc:269] 0709 13:01:35.391407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.391569 (+   162us) service_pool.cc:224] Handling call
0709 13:01:37.302250 (+1910681us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:01:37.307678 (+  5428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8620928}
I20260709 13:01:37.314311  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.293479  1454 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 15, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:37.355077  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.315267  1635 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:37.378389  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2367) took 1916 ms. Trace:
I20260709 13:01:37.378989  1631 rpcz_store.cc:276] 0709 13:01:35.462280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.492164 (+ 29884us) service_pool.cc:224] Handling call
0709 13:01:35.492462 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.605088 (+112626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.605121 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.622082 (+ 16961us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.903268 (+281186us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:35.903331 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.301757 (+1398426us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540035be54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:37.301815 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.301877 (+    62us) raft_consensus.cc:1685] finished
0709 13:01:37.301888 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.378299 (+ 76411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9001,"raft.queue_time_us":14784,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9205,"spinlock_wait_cycles":237290368,"thread_start_us":243757,"threads_started":1,"wal-append.queue_time_us":369852,"wal-append.run_cpu_time_us":1498,"wal-append.run_wall_time_us":1001685}
I20260709 13:01:37.383152  1635 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:37.386312  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:37.387401  7013 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:37.388067  7013 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:37.388363  1601 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:37.183926  7222 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.400492  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2545) took 1443 ms. Trace:
I20260709 13:01:37.401122  1557 rpcz_store.cc:276] 0709 13:01:35.957055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.551851 (+594796us) service_pool.cc:224] Handling call
0709 13:01:37.253594 (+701743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.254218 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.400199 (+145981us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54002db9d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:37.400408 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613090048}
W20260709 13:01:37.402499  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2537) took 1514 ms (client timeout 1960 ms). Trace:
W20260709 13:01:37.410763  1629 rpcz_store.cc:269] 0709 13:01:35.888262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.888756 (+   494us) service_pool.cc:224] Handling call
0709 13:01:37.402286 (+1513530us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54002fadd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:37.402428 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488614144}
W20260709 13:01:37.403725  7199 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.972s	user 0.007s	sys 0.010s
I20260709 13:01:37.405546  6565 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.406535  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:37.416674  1635 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:37.406289  1454 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 10 to 11, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:37.407193  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:37.288944  7195 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:37.394979  7221 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.409776  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:37.415107  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 385688us
I20260709 13:01:37.423956  1628 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:37.420774  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:37.427008  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:37.389309  7013 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:37.420080  1601 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:37.434707  1454 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:37.440737  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:37.441712  1704 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:37.411149  7157 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
W20260709 13:01:37.452828  7204 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.000s
I20260709 13:01:37.454265  7142 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.422330  6942 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:37.487147  1454 catalog_manager.cc:5697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 8 to 11, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.483549  7204 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:37.496552  7204 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:37.499432  1454 catalog_manager.cc:5697] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 7 to 11, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:37.438107  7138 raft_consensus.cc:3055] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:01:37.465667  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.466113  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.415144  6987 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.471465  7195 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:37.508968  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:37.468613  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:37.454705  6927 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:37.482946  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 428021us
I20260709 13:01:37.431630  7222 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:37.416167  7123 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:37.453680  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:37.504223  1700 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:37.444947  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:37.516032  1454 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 10 to 14, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.433686  7221 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:37.432760  6565 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:37.502573  7157 consensus_queue.cc:1243] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:37.520368  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 966) took 2205 ms. Trace:
I20260709 13:01:37.520942  1555 rpcz_store.cc:276] 0709 13:01:35.315134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.082655 (+767521us) service_pool.cc:224] Handling call
0709 13:01:36.540645 (+457990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.541397 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.520097 (+978700us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b5400311ad0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:37.520292 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1052687104}
W20260709 13:01:37.507799  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 305004us
I20260709 13:01:37.505003  7138 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:37.523716  1525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.023s	sys 0.061s
W20260709 13:01:37.524286  1525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.023s	sys 0.061s
I20260709 13:01:37.525439  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:37.531535  1454 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:37.558809  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:37.559724  1555 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:37.562680  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:37.563832  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:37.564455  1552 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:37.565579  1554 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:37.569612  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:37.515483  7204 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:37.554878  1454 catalog_manager.cc:5697] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:37.572980  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:37.573973  1702 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:37.533931  7000 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.837s	user 0.017s	sys 0.051s
I20260709 13:01:37.519946  7123 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.578732  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:37.584234  1705 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 19: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:37.585001  1555 raft_consensus.cc:2410] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:37.511700  6987 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:37.586668  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 334727us
I20260709 13:01:37.588912  7178 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:37.515159  6927 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:37.580613  7000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.900s	user 0.018s	sys 0.051s
I20260709 13:01:37.595566  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:37.598301  1454 catalog_manager.cc:5697] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 7 to 10, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:37.607298  1702 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:37.594238  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:37.618593  1673 leader_election.cc:400] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14.
I20260709 13:01:37.619235  1673 leader_election.cc:403] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:37.642177  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2375) took 2515 ms. Trace:
I20260709 13:01:37.647876  1556 rpcz_store.cc:276] 0709 13:01:35.126708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.980047 (+853339us) service_pool.cc:224] Handling call
0709 13:01:37.013995 (+1033948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.014188 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.014212 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:37.014258 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:37.014290 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.014338 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.642007 (+627669us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540031ea50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:37.642124 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377191808}
I20260709 13:01:37.648439  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:37.647264  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:37.651347  1705 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:37.656543  1555 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:01:37.609458  7000 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:37.583328  7204 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.608551  7228 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.658305  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2655) took 1015 ms. Trace:
I20260709 13:01:37.703733  1706 rpcz_store.cc:276] 0709 13:01:36.624577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.627215 (+  2638us) service_pool.cc:224] Handling call
0709 13:01:37.640239 (+1013024us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400387cd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:37.640389 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449070464}
I20260709 13:01:37.590065  7123 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.699535  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:37.695956  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.708058  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:37.716446  1555 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:37.710577  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:37.719393  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:37.638759  7220 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14.
I20260709 13:01:37.647099  7193 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.660584  7229 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:37.726709  1558 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:01:37.661055  7043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.002s	sys 0.012s
I20260709 13:01:37.638520  7188 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:01:37.728703  1554 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:37.747201  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 339679us
I20260709 13:01:37.725284  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:37.727061  7104 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:01:37.737962  7226 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:37.702766  7178 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:37.727366  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:37.744560  1555 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:37.752990  1552 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:37.711998  1454 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 2 to 8, term changed from 11 to 15, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:37.745478  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 318589us
I20260709 13:01:37.754437  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:37.750489  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 234682us
W20260709 13:01:37.755659  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 302049us
W20260709 13:01:37.758249  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.754009  1454 catalog_manager.cc:5697] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 7 to 12, leader changed from <none> to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:37.757586  1599 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:37.747169  7043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.003s	sys 0.013s
I20260709 13:01:37.761430  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:37.764206  1454 catalog_manager.cc:5697] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.738643  7013 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.744365  7069 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:37.771953  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:37.705137  7224 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:01:37.723465  7211 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:37.775744  2263 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:37.647275  7138 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.757984  6846 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:37.723726  7228 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.781004  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:37.787549  1552 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:01:37.785506  2267 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:37.765525  7104 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:37.771623  7178 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:37.791523  1554 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:37.758206  7193 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.804596  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:37.785094  7138 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:37.821848  7142 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:37.843909  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1007) took 1215 ms. Trace:
I20260709 13:01:37.783995  6846 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:37.906422  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 396979us
I20260709 13:01:37.818578  7159 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:01:37.911137  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.845170  6938 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:37.892444  1553 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:37.791663  1454 catalog_manager.cc:5697] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 5 to 8, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.845551  7178 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:37.914601  1454 catalog_manager.cc:5697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 9 to 13, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:37.877988  6565 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:37.901018  7220 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:37.903555  7123 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:37.878636  7243 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.892839  7000 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.789062  7188 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:37.890486  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2654) took 1268 ms. Trace:
I20260709 13:01:37.877063  7214 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:37.877391  7157 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:37.915544  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:37.879269  7233 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:37.933722  6987 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:37.914391  6938 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:37.907425  2235 connection.cc:256] RPC call timeout handler was delayed by -1.048537060000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260709 13:01:37.968341  2235 leader_election.cc:336] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.904s (SENT)
I20260709 13:01:37.938382  1709 rpcz_store.cc:276] 0709 13:01:36.622608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.622730 (+   122us) service_pool.cc:224] Handling call
0709 13:01:37.807183 (+1184453us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54000b7f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:37.890413 (+ 83230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120000896}
W20260709 13:01:37.939913  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0223724730000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 13:01:37.941085  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:37.913810  7227 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:37.982592  7233 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:37.983971  7233 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.985867  6938 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:37.986814  7239 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:01:37.987747  6938 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:37.955256  1454 catalog_manager.cc:5697] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 4 to 11, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.991186  1454 catalog_manager.cc:5697] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.896998  1701 rpcz_store.cc:276] 0709 13:01:36.628290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.201354 (+573064us) service_pool.cc:224] Handling call
0709 13:01:37.201639 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.211045 (+  9406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.211079 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.211573 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.571290 (+359717us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:37.571371 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.571466 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.843705 (+272239us) raft_consensus.cc:1685] finished
0709 13:01:37.843724 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.843850 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9044,"raft.queue_time_us":13473,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":56799,"thread_start_us":359309,"threads_started":1,"wal-append.queue_time_us":552036}
I20260709 13:01:37.913321  6927 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:37.980947  7178 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:37.995738  7178 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:38.000746  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.001230  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.003037  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:38.003764  1557 raft_consensus.cc:2376] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14. Re-sending same reply.
I20260709 13:01:38.005365  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:38.006345  1557 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:01:38.007187  7245 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:01:38.008488  7204 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:38.011473  7013 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.012589  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.014266  6987 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.993461  1454 catalog_manager.cc:5697] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.015041  6987 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.020287  1558 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:38.023445  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:37.915539  7242 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:01:37.933590  6565 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:37.975169  7230 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:37.976970  7159 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:37.977694  7235 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:37.941009  7221 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:37.921820  7220 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:01:38.072682  7222 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.000s
I20260709 13:01:37.940297  7123 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.056603  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:38.074127  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.065872  6565 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.076628  6565 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:38.059162  2235 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.974s (SENT)
W20260709 13:01:37.963706  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 48234.7us
I20260709 13:01:37.958271  7157 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:38.066745  1554 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:38.067408  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:38.083267  1553 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:38.069731  7235 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.070469  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1227) took 1029 ms. Trace:
I20260709 13:01:38.065796  7159 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:38.072194  7220 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:37.940071  7214 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:38.087011  1704 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:38.063782  7148 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:38.118582  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:38.123308  1700 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:38.089813  1526 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:38.077204  7069 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:37.957492  7243 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.097379  1703 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:38.143680  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:38.144591  1702 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:01:38.098110  7228 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:38.060814  7160 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.104423  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:38.110136  7159 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:38.100585  6565 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:38.116611  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:38.117960  1707 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:38.119145  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:37.957849  7188 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.091025  2271 rpcz_store.cc:276] 0709 13:01:37.041031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.046193 (+  5162us) service_pool.cc:224] Handling call
0709 13:01:37.046621 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.047068 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.047109 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.058987 (+ 11878us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.571782 (+512795us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:37.571825 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.571899 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.070252 (+498353us) raft_consensus.cc:1685] finished
0709 13:01:38.070273 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.070411 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47292,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":484247,"threads_started":1,"wal-append.queue_time_us":706408}
I20260709 13:01:38.129653  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:38.154142  1706 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:38.131985  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:38.155195  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:38.113996  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.102725  7123 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.060384  7087 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.150996  1701 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:38.121729  6938 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.152300  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 431623us
I20260709 13:01:38.152823  1705 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:01:38.129014  7069 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:38.172322  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.180208  1553 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:38.129026  7246 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:38.054574  6846 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.131052  7220 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:38.170557  6565 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.151350  7228 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:38.205431  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:38.206097  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.207136  1554 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:01:38.210330  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 455975us
W20260709 13:01:38.213680  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 436912us
I20260709 13:01:38.216084  6565 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:38.183825  7232 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 13:01:38.212273  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 454812us
I20260709 13:01:38.176344  7224 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.226389  1674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.022s	sys 0.047s
W20260709 13:01:38.227479  1674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.022s	sys 0.048s
I20260709 13:01:38.130772  7148 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.231326  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:38.181456  7255 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.220003  1599 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:38.095897  2235 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:38.184718  7246 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.223115  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:38.229452  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:38.228535  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 511207us
I20260709 13:01:38.211695  7248 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:38.213011  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 513602us
I20260709 13:01:38.234201  6565 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:38.211247  7124 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.007s	sys 0.032s
I20260709 13:01:38.152222  7160 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.242164  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:38.173671  7087 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:38.218568  1627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.012s	sys 0.030s
I20260709 13:01:38.218181  6859 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.174722  6938 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.174486  7123 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:38.247320  1627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.013s	sys 0.030s
I20260709 13:01:38.250494  6565 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:38.261154  6565 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:38.226105  6846 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:38.232906  7193 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:38.253607  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:38.228093  7256 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:38.257560  6923 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:01:38.264860  7235 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:38.249166  7124 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.008s	sys 0.032s
I20260709 13:01:38.269274  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:38.270242  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 174447us
I20260709 13:01:38.265538  6923 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:01:38.222002  7227 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:01:38.279443  7262 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:01:38.279862  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.280910  7013 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:38.281656  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1148) took 1167 ms. Trace:
I20260709 13:01:38.297755  1627 rpcz_store.cc:276] 0709 13:01:37.112659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.122933 (+ 10274us) service_pool.cc:224] Handling call
0709 13:01:37.124732 (+  1799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.124940 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:37.523721 (+398781us) log.cc:844] Serialized 14 byte log entry
0709 13:01:38.280192 (+756471us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.280246 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:38.280303 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.280365 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.280486 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19675,"prepare.queue_time_us":13812,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":1133806,"threads_started":2}
I20260709 13:01:38.282552  6565 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.184054  7214 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:38.259472  7244 raft_consensus.cc:2764] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:01:38.246076  7043 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.250110  7237 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:38.175783  7157 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.244621  7246 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:38.276036  7255 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:38.232460  7224 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:38.319326  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 61460.7us
W20260709 13:01:38.332973  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 113094us
W20260709 13:01:38.325088  1555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.033s	sys 0.035s
W20260709 13:01:38.327414  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.012s	sys 0.016s
W20260709 13:01:38.341470  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.012s	sys 0.016s
W20260709 13:01:38.342164  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 570307us
I20260709 13:01:38.343183  2234 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:38.334824  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:38.344033  1555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.033s	sys 0.036s
I20260709 13:01:38.258821  7222 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.064s
W20260709 13:01:38.333644  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47812.5us
I20260709 13:01:38.345824  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:38.349236  1674 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:38.297400  7262 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:38.310201  7013 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:38.354502  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.358610  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:38.359452  2270 raft_consensus.cc:2410] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:01:38.360119  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:38.360718  2263 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:38.360783  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.358016  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:38.363622  2268 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:38.364430  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:38.365821  1557 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:38.298631  7260 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:38.368851  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:38.374181  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:38.375010  2269 raft_consensus.cc:2410] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:01:38.330861  6987 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:38.341854  7174 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:38.377782  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:38.300935  7235 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:01:38.362222  7043 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:38.389159  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:38.362646  7250 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:38.383385  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:38.352636  7262 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:38.373262  7272 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.362849  7013 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:38.356534  7204 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:38.351137  7257 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:38.400282  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:38.400921  1626 raft_consensus.cc:2376] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12. Re-sending same reply.
I20260709 13:01:38.385703  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:38.402591  1631 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:38.366487  7157 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:38.382076  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:38.378722  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:38.391187  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.370581  6846 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.375877  7219 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:38.371630  6818 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:38.392712  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:38.392828  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 58098.5us
I20260709 13:01:38.395545  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:38.396118  7195 consensus_meta.cc:287] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.883s	user 0.009s	sys 0.002s
I20260709 13:01:38.396271  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:38.396776  7043 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:38.500303  1628 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:38.410305  1630 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:01:38.385775  6927 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.412518  7257 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.366592  6959 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 13:01:38.450491  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.450533  1626 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:38.385913  7253 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
W20260709 13:01:38.476864  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.477957  1632 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
W20260709 13:01:38.451593  7138 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.003s
I20260709 13:01:38.397866  7252 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:38.404991  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:38.518800  2269 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:38.472635  7193 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.331920  7237 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.388269  7174 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:38.506556  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 264230us
I20260709 13:01:38.528234  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:38.509773  1631 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
W20260709 13:01:38.514724  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 291705us
I20260709 13:01:38.516029   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:38.530995  7174 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:38.449187  7188 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:38.521294  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 67887us
I20260709 13:01:38.522405  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:38.523953  1634 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:01:38.533922  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:38.526278  7123 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:38.472488  6818 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:38.534891  6818 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:38.538497  7204 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:38.539577  7204 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:38.541656  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.542492  2270 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:38.482158  7260 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:38.518785  7169 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.251s	user 0.009s	sys 0.006s
W20260709 13:01:38.564654  2235 leader_election.cc:336] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.901s (SENT)
I20260709 13:01:38.568229  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:38.454891  6846 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.506098  7257 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:38.416445  7272 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:38.574939  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:38.587323  2269 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
W20260709 13:01:38.603473  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.604631  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:38.584475  7254 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 13:01:38.568889  6938 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:38.606067  7269 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:38.597038  7233 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:38.629227  7233 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.610088  7256 consensus_queue.cc:1059] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:38.631831  7256 raft_consensus.cc:3055] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:38.632200  7256 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:38.632507  7276 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.633009  7276 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.633071  7256 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:38.635365  7276 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:38.635632  7272 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:38.635852  7276 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:38.607137  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:38.607167  1526 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:38.585470  7236 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.639165  1557 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:01:38.640905  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.620754  1708 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:38.641373  7259 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:38.624008  1554 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:01:38.642199  1554 pending_rounds.cc:85] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 10
I20260709 13:01:38.642491  1554 pending_rounds.cc:107] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:01:38.642771  1554 raft_consensus.cc:2889] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.571730  7195 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:38.645327  7195 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.646201  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:38.646569  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:38.571452  7148 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:38.574200  7226 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:38.647549  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:38.626344  7142 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:38.627705  7251 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:38.609002  7104 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:38.648479  7142 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.660508  7104 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:38.661019  7142 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:38.652647  1704 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:38.653784  1701 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:38.656543  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.648030  7226 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:38.628389  7178 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.665791  7226 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.628768  7269 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.667164  7269 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:38.668401  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:38.629509  7222 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:38.674418  7222 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:38.677242  7222 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:38.544530  7252 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.680030  7252 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:38.679889  7142 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:38.681315  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.617202  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.682600  7142 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:38.647416  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:38.683954  1702 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:38.648370  1706 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:38.687287  7233 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:38.627938  6846 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:38.661846  7104 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:38.691399  7104 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:38.557847  7193 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.588349  7173 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.584331  7087 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:38.706862  1709 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:38.600258  7169 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:38.696606  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 59269.1us
I20260709 13:01:38.698551  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:38.701170  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.702991  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.717760  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:38.718022  1554 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:38.647581  7195 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:38.640661  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:38.704174  7256 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:38.741291  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 100720us
I20260709 13:01:38.742874  1703 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:38.636407  7276 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.696388  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.723066  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:38.727597  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 105416us
I20260709 13:01:38.726128  1558 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:38.699103  7124 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:38.745065  7124 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:38.745520  7124 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:38.743607  1526 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:38.722138  7222 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:38.750921  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 52620.9us
I20260709 13:01:38.751698  1526 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:38.756573  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:38.757020  1526 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:38.753100  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:38.767947  1560 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:38.706317  7236 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.766371  7261 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:38.724234  7224 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:38.711582  7220 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.774207  7219 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.741223  7169 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.758972  7087 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:38.776813  7169 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:38.743821  7178 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:38.570339  7260 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.741225  6987 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.778577  2263 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:38.780591  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:38.742905  7274 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:38.611902  7043 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:38.810117  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 55320us
I20260709 13:01:38.758324  7174 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:38.711340  7173 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.822963  2235 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:38.814011  7157 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 13:01:38.815016  7277 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
W20260709 13:01:38.815749  7284 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:01:38.815662  7262 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.811488  1601 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:38.790987  7219 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.742542  6942 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
W20260709 13:01:38.814311  7279 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:01:38.791210  6927 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:38.829875  7292 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:38.839994  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.843710  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.909530  7174 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:38.911367  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 88506.1us
I20260709 13:01:38.807122  7123 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:38.952968  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.927587  7148 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:01:38.916970  7275 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:01:38.806336  6987 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:38.919516  7214 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:38.779098  7259 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:01:38.817883  7269 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.778807  7253 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
W20260709 13:01:38.907068  2236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.002s	sys 0.006s
I20260709 13:01:38.774222  7220 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.908710  7142 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:01:38.907485  7000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.000s	sys 0.008s
W20260709 13:01:38.931813  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 120409us
I20260709 13:01:38.759969  7237 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:38.864205  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.930712  7265 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.450s	user 0.000s	sys 0.007s
I20260709 13:01:38.808115  7178 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:38.941629  7159 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.772s	user 0.007s	sys 0.004s
I20260709 13:01:38.925238  7204 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.951855  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.953660  1635 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:38.915656  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 135142us
I20260709 13:01:38.830156  7258 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
W20260709 13:01:39.009349  7280 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 13:01:38.953222  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 479560us
I20260709 13:01:39.010471  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1178) took 1237 ms. Trace:
I20260709 13:01:39.010869  2268 rpcz_store.cc:276] 0709 13:01:37.772877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.773027 (+   150us) service_pool.cc:224] Handling call
0709 13:01:37.782009 (+  8982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.364101 (+582092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.010221 (+646120us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b5400404054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:39.010398 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336707968}
I20260709 13:01:39.012028  7159 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:39.012852  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:38.988334  2236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.007s	sys 0.010s
W20260709 13:01:39.014228  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 652971us
I20260709 13:01:39.014354  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.013974  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.962319  7243 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:38.949054  7235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.039s
I20260709 13:01:38.940438  7286 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:38.946411  7219 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.027365  7286 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.027819  7286 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.028010  7178 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.028903  7219 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.029827  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:39.030433  2264 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:39.030974  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:39.032477  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.950979  6927 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.042375  6927 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:39.043164  7260 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.049258  1560 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
W20260709 13:01:38.958781  7250 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.001s
I20260709 13:01:39.054373  7250 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:38.995918  7000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.001s	sys 0.008s
I20260709 13:01:39.020797  7204 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.005825  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2401) took 1236 ms. Trace:
I20260709 13:01:39.055891  1556 rpcz_store.cc:276] 0709 13:01:37.769404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.769512 (+   108us) service_pool.cc:224] Handling call
0709 13:01:37.769797 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.222104 (+452307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.222137 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.222575 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.351053 (+128478us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:38.351106 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.351207 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.005568 (+654361us) raft_consensus.cc:1685] finished
0709 13:01:39.005595 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.005754 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":197136,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":42693,"thread_start_us":518915,"threads_started":2,"wal-append.queue_time_us":252470}
I20260709 13:01:39.056898  7204 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.057796  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.990206  7123 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:39.008226  1557 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:38.811654  7069 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:38.958280  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:38.963935  7262 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.023746  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.025820  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:38.954083  7174 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.033480  7193 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.034559  6942 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:39.035302  7258 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:01:39.040602  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.041518  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:38.999804  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.070711  1552 raft_consensus.cc:2376] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13. Re-sending same reply.
I20260709 13:01:39.070956  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.071897  1556 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:01:39.050711  7281 log.cc:927] Time spent T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:39.051931  7276 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.052898  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:39.006796  1673 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.059139  2268 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:01:38.960659  7248 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.000s
I20260709 13:01:39.060084  2264 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:39.060436  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:39.003842  7013 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
I20260709 13:01:39.063331  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.064657  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:39.026646  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:39.065871  2270 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:39.066880  2263 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:01:39.096977  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 90272.2us
I20260709 13:01:39.067078  2271 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:39.098701  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.096726  1553 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:39.100062  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.097878  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:39.101155  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 101438us
W20260709 13:01:39.048910  7235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.009s	sys 0.039s
I20260709 13:01:39.104730  1631 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:39.014246  7159 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:39.067988  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.100503  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:39.070632  1554 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:39.071707  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.050673  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.109059  2267 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
W20260709 13:01:39.063333  6818 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.002s
I20260709 13:01:39.054659  6987 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:39.111318  7290 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.105511  7193 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:39.111927  7290 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:39.112378  6818 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.102469  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.105338  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:39.106428  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.114848  1630 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:39.111146  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.115444  2271 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:39.108201  2235 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.118347  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:39.119971  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.121217  1633 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:39.121141  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.127466  2266 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:39.131376  7159 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:39.132915  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.134465  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.135156  1631 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:39.137820  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.139012  2235 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.103236  7248 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:39.069007  7124 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.141450  1706 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:39.068117  6927 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:39.144752  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:39.145889  1706 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:39.143154  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:39.148590  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:39.149117  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.149293  1706 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:39.190507  6818 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.105515  7013 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:39.121868  7250 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:39.145679  7235 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:39.279155  1701 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:39.127074  7260 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:39.279148  1551 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:39.280040  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.131165  7307 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.143988  7219 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.138415  7238 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:39.143754  7244 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:39.140477  7262 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:39.116080  7204 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:01:39.144217  7178 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:39.286015  2265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1155) took 3321 ms (client timeout 2038 ms). Trace:
I20260709 13:01:39.290880  7290 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:39.285629  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:39.305718  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.317571  1700 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:39.285629  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:39.292007  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.285720  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:39.293282  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.298213  2266 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
W20260709 13:01:39.289098  7246 consensus_meta.cc:287] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.924s	user 0.006s	sys 0.016s
I20260709 13:01:39.303182  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.282902  7274 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:39.297284  7256 consensus_meta.cc:287] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.013s
I20260709 13:01:39.285051  7148 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:39.309978  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:39.381491  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.283185  6987 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:39.316015  2265 rpcz_store.cc:269] 0709 13:01:35.959141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.963770 (+  4629us) service_pool.cc:224] Handling call
0709 13:01:39.188622 (+3224852us) spinlock_profiling.cc:243] Waited 3.08 s on lock 0x7b540005ee54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:39.280638 (+ 92016us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7079337856}
I20260709 13:01:39.282493  7302 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:39.282939  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 133931us
I20260709 13:01:39.316679  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.289965  7276 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:39.323465  7178 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:39.323024  7246 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.306903  7219 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.299983  7269 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.327431  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.329468  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:39.330448  7236 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:39.340654  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:39.341019  7308 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
I20260709 13:01:39.299297  7159 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:39.303637  7253 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:01:39.344178  1551 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
W20260709 13:01:39.318252  7283 log.cc:927] Time spent T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 13:01:39.346097  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:39.348294  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.348800  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.349304  7262 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.349994  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:39.330509  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.418979  1556 raft_consensus.cc:2368] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15.
I20260709 13:01:39.420008  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.351372  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:39.352838  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:39.422617  1634 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.422824  1632 raft_consensus.cc:2376] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15. Re-sending same reply.
I20260709 13:01:39.355863  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:39.359004  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:39.403882  7250 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:39.352452  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.354676  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.147680  7123 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:39.368758  7238 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:39.373234  1706 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:01:39.368788  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:39.307256  7260 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:39.383942  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.318710  7220 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.314607  7124 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.407698  7276 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.379220  7272 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:39.405471  1633 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:39.409042  6987 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:39.395040  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:39.408039  2266 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.313478  7286 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.371865  7274 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.534556  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:39.535254  1634 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:39.408783  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:39.409879  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 102578us
I20260709 13:01:39.414253  1552 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:39.414378  1704 raft_consensus.cc:2410] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:01:39.414278  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 66069us
I20260709 13:01:39.537123  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.416456  2236 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:39.421712  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:39.439311  7257 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.833s	user 0.011s	sys 0.000s
W20260709 13:01:39.333786  7264 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.874s	user 0.001s	sys 0.002s
W20260709 13:01:39.428781  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 69880us
I20260709 13:01:39.428262  1635 raft_consensus.cc:2376] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14. Re-sending same reply.
I20260709 13:01:39.434315  7250 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:39.433432  1557 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:39.414657  7269 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:39.400169  2235 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:39.442662  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.362424  7228 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:39.431494  7159 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.586102  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:39.425721  7262 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.431830  7226 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:39.445278  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:39.475083  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:39.450799  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.457034  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2402) took 1686 ms. Trace:
I20260709 13:01:39.426482  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:39.539408  2264 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:01:39.554495  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.439031  7193 raft_consensus.cc:2764] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:01:39.544355  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:39.586206  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 186180us
I20260709 13:01:39.587342  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:39.666702  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 79470.2us
I20260709 13:01:39.667568  1555 rpcz_store.cc:276] 0709 13:01:37.770572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.770706 (+   134us) service_pool.cc:224] Handling call
0709 13:01:37.771081 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.345002 (+573921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.345058 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.366104 (+ 21046us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.501845 (+135741us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:38.502074 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.502334 (+   260us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:39.456807 (+954473us) raft_consensus.cc:1685] finished
0709 13:01:39.456833 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.456972 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":242670,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":682927,"threads_started":2,"wal-append.queue_time_us":479125}
I20260709 13:01:39.672389  1706 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
W20260709 13:01:39.544272  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 127935us
I20260709 13:01:39.585274  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:39.453433  7306 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.187s	user 0.005s	sys 0.008s
I20260709 13:01:39.458252  7178 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:39.674233  1559 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:39.553927  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:39.674733  1704 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:39.555768  7238 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:39.466593  7276 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.467939  7160 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:39.460106  7307 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:39.474437  6927 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:39.682133  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.737123  2263 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:39.737831  1554 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:39.684571  7220 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:39.580614  2265 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:39.470714  7173 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:39.459502  7246 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.534099  7124 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:39.670842  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.542649  7274 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:39.695195  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 141378us
I20260709 13:01:39.676029  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.722370  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.725920  7256 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:39.724855  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:39.729836  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:39.681382  6846 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:39.776126  6846 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:39.776531  6846 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.587348  7257 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.776919  6987 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:39.745833  7260 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.778925  7257 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:39.779527  7257 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.774398  7124 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.741107  7276 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.782346  7276 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:39.774747  7307 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.784415  7307 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:39.786775  1705 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 17: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:39.543962  7179 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:39.438922  7290 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.685092  7043 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:39.735560  2266 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:39.754487  7220 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:39.801251  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:39.694181  7236 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.663559  7287 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.150s
I20260709 13:01:39.542953  7272 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.756670  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:39.691980  7178 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.662850  7269 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:39.771745  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 49488.1us
I20260709 13:01:39.553763  7227 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.771937  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.818480  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.772271  7173 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:39.838469  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:39.839502  1702 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:39.840111  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:39.774885  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 85941.1us
W20260709 13:01:39.787098  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 57355.6us
I20260709 13:01:39.685001  7270 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.686630  7228 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.809976  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:39.736579  6859 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:01:39.816403  7256 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:39.815174  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:39.936666  1553 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:39.936553  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.818866  1560 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:39.937347  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.851642  1634 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:01:39.938175  1630 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:39.938835  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.939229  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.939287  1560 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:39.940063  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.940725  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.941332  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.855420  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:39.845386  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:39.844045  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:39.815567  7221 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:39.807447  7220 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:39.928625  1554 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:39.810997  7179 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.775163  1559 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:39.792543  6927 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:01:39.810828  1700 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:39.966603  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:39.967499  1700 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:39.968479  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:39.941620  1627 raft_consensus.cc:2368] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15.
I20260709 13:01:39.944000  1628 raft_consensus.cc:2368] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 15. Current term is 16.
W20260709 13:01:39.944891  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 99615.1us
W20260709 13:01:39.945222  1673 leader_election.cc:336] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Timed out: RequestConsensusVote RPC to 127.0.107.194:39441 timed out after 1.540s (SENT)
I20260709 13:01:39.795847  7043 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:39.854784  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.937361  1633 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 10.
I20260709 13:01:39.787397  7257 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:39.957762  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 140271us
I20260709 13:01:39.986485  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:39.819738  7332 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.795572  6846 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:39.811681  7246 consensus_queue.cc:1059] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 13:01:40.013581  1553 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:39.858814  7173 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.972317  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:39.973709  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 129745us
W20260709 13:01:39.974438  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 160136us
I20260709 13:01:39.841885  7261 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:39.858669  7160 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:39.981045  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.983810  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:39.819370  7178 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:39.984972  7043 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.815936  7236 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.035966  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:39.939523  7256 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.003078  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.969702  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:39.953958  7221 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.812372  7290 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.008100  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.015312  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:39.927810  7238 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:01:39.972601  7287 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:39.995875  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.021977  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.025195  1630 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:01:40.023491  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 78312.7us
I20260709 13:01:39.988134  7315 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:39.859269  7227 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.013633  6987 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:39.982263  7179 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.077561  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:40.034165  7325 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:40.078387  1700 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:39.934228  7270 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.017763  7159 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.099120  7287 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.079276  7256 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:40.093321  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 57448.4us
I20260709 13:01:40.023809  7173 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:40.097788  1634 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:40.024338  7160 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:40.076085  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.109362  7320 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:40.005033  7226 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:01:40.076606  6927 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:40.085355  7221 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.116953  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:40.121265  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:40.151510  1700 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:40.013230  7332 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.025089  7274 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:40.072970  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 226523us
I20260709 13:01:40.132974  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:40.036660  7261 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.137207  7336 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.124037  6987 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:40.192973  1702 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:40.140923  7287 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:40.185828  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:40.207159  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 1013) took 1561 ms. Trace:
I20260709 13:01:40.207198  1703 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
W20260709 13:01:40.149791  7316 log.cc:927] Time spent T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 13:01:40.207753  1705 rpcz_store.cc:276] 0709 13:01:38.646210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.646341 (+   131us) service_pool.cc:224] Handling call
0709 13:01:40.206960 (+1560619us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400376ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:40.207103 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2620815616}
I20260709 13:01:40.213891  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:40.163193  1633 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:40.181515  1555 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:40.147737  7160 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:40.213769  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:40.216785  1705 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:40.217613  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:40.219413  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:40.227782  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2484) took 2953 ms (client timeout 1615 ms). Trace:
W20260709 13:01:40.228333  1708 rpcz_store.cc:269] 0709 13:01:37.259005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.299480 (+ 40475us) service_pool.cc:224] Handling call
0709 13:01:40.212475 (+2912995us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54000a7dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:40.212564 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2798157184}
W20260709 13:01:40.176282  7333 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:40.141901  7262 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.257007  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:40.195858  7214 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.199s	user 0.012s	sys 0.000s
I20260709 13:01:40.176489  7274 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.179677  7243 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:01:40.232702  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 129793us
I20260709 13:01:40.234500  2234 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:40.165305  1628 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:01:40.212002  7159 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.239383  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:40.258049  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:40.176911  7319 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:01:40.256404  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:40.289973  1708 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:40.260977  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:40.181226  7307 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:40.197785  7269 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:40.183287  7272 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.182708  7320 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:40.217936  7313 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.411s	user 0.001s	sys 0.000s
I20260709 13:01:40.143896  7315 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:40.317121  7315 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.318418  7013 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:40.217245  7336 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.192689  7332 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:40.322155  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 1216) took 1299 ms. Trace:
I20260709 13:01:40.322472  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:40.322568  2268 rpcz_store.cc:276] 0709 13:01:39.022779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.022923 (+   144us) service_pool.cc:224] Handling call
0709 13:01:40.321943 (+1299020us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b540039d854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:40.322098 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62646016}
I20260709 13:01:40.323166  7336 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.323405  2263 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:40.202212  7124 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.185048  7257 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.237353  1700 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:40.328151  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:40.285547  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:40.334692  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49218.2us
I20260709 13:01:40.335585  1673 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:40.284096  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49685.9us
W20260709 13:01:40.292876  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 176045us
I20260709 13:01:40.281364  1633 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:01:40.295921  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:40.337054  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:40.257122  7238 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:40.310074  7308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.010s
I20260709 13:01:40.263657  7292 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.176544  7276 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:40.163008  6927 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.293547  7337 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:40.328284  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.330529  1559 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:01:40.333719  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:40.309542  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:40.341463  1673 leader_election.cc:400] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15.
I20260709 13:01:40.385758  1673 leader_election.cc:403] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:40.385169  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2557) took 1247 ms. Trace:
I20260709 13:01:40.365747  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:40.348575  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.388448  1553 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:01:40.346014  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:40.366935  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:40.342231  7308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.006s	sys 0.010s
I20260709 13:01:40.387027  1631 rpcz_store.cc:276] 0709 13:01:39.137297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.137450 (+   153us) service_pool.cc:224] Handling call
0709 13:01:39.279649 (+142199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.279857 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:39.435659 (+155802us) log.cc:844] Serialized 14 byte log entry
0709 13:01:40.332754 (+897095us) log.cc:844] Serialized 14 byte log entry
0709 13:01:40.384677 (+ 51923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.384753 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:40.384814 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.384905 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.385080 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109778,"prepare.queue_time_us":247958,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":114739,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6689,"spinlock_wait_cycles":40260480,"thread_start_us":995783,"threads_started":4,"wal-append.queue_time_us":361602}
I20260709 13:01:40.399009  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2696) took 1109 ms. Trace:
I20260709 13:01:40.398386  2271 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:40.345439  1709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2675) took 2265 ms (client timeout 1963 ms). Trace:
I20260709 13:01:40.403903  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:40.402698  1700 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:40.404492  1560 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:40.406068  1701 rpcz_store.cc:276] 0709 13:01:39.290048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.316358 (+ 26310us) service_pool.cc:224] Handling call
0709 13:01:39.362883 (+ 46525us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.364313 (+  1430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.364363 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:39.366194 (+  1831us) log.cc:844] Serialized 26 byte log entry
0709 13:01:39.522657 (+156463us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:39.522715 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.522811 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.398813 (+876002us) raft_consensus.cc:1685] finished
0709 13:01:40.398834 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.398953 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":887,"raft.queue_time_us":2002,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":12611,"thread_start_us":113462,"threads_started":1,"wal-append.queue_time_us":388152}
I20260709 13:01:40.407390  1559 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
W20260709 13:01:40.407145  1709 rpcz_store.cc:269] 0709 13:01:38.080060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.080933 (+   873us) service_pool.cc:224] Handling call
0709 13:01:40.345174 (+2264241us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54003afa54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:40.345353 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275637120}
I20260709 13:01:40.292021  7159 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:40.398109  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 56810.1us
I20260709 13:01:40.404795  1703 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:40.410879  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 82843us
I20260709 13:01:40.411295  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:40.344026  6971 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:40.338577  7272 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.413038  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:40.343591  7332 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:40.412773  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:40.420542  2268 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:01:40.346573  7257 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:40.384878  6859 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:40.420900  1673 leader_election.cc:400] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 15. Current term is 16.
I20260709 13:01:40.416316  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:40.435722  1599 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:40.398502  7178 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:40.475250  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2685) took 1334 ms. Trace:
I20260709 13:01:40.476419  1673 leader_election.cc:403] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:01:40.475620  2263 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
W20260709 13:01:40.480186  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 68994.7us
W20260709 13:01:40.477882  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 57198.4us
I20260709 13:01:40.481279  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:40.408458  7331 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15.
I20260709 13:01:40.484130  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:40.484843  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2424) took 1439 ms. Trace:
I20260709 13:01:40.476401  1707 rpcz_store.cc:276] 0709 13:01:39.140444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.140582 (+   138us) service_pool.cc:224] Handling call
0709 13:01:39.280951 (+140369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:39.285167 (+  4216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.285197 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:39.292866 (+  7669us) log.cc:844] Serialized 52 byte log entry
0709 13:01:39.437144 (+144278us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:39.437208 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.437291 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.474926 (+1037635us) raft_consensus.cc:1685] finished
0709 13:01:40.474956 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.475158 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3696,"raft.queue_time_us":3837,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":6131,"thread_start_us":114482,"threads_started":1,"wal-append.queue_time_us":411311}
I20260709 13:01:40.410059  7124 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:40.410502  7236 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:40.414918  7329 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:40.436219  7332 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.502889  1703 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:40.485216  1558 rpcz_store.cc:276] 0709 13:01:39.045197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.103667 (+ 58470us) service_pool.cc:224] Handling call
0709 13:01:39.103894 (+   227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:39.106171 (+  2277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:39.106203 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:39.149382 (+ 43179us) log.cc:844] Serialized 26 byte log entry
0709 13:01:39.425058 (+275676us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:39.425118 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.425209 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.484628 (+1059419us) raft_consensus.cc:1685] finished
0709 13:01:40.484648 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.484778 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1966,"raft.queue_time_us":2119,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":116573,"threads_started":1,"wal-append.queue_time_us":451413}
W20260709 13:01:40.498605  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 283068us
I20260709 13:01:40.503597  1701 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:40.474749  7214 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:40.414815  7290 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:40.489384  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:40.500377  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 64744.9us
I20260709 13:01:40.365461  7292 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.518054  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:40.483503  7227 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:40.512682  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:40.490233  7269 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:40.506953  1599 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:40.522393  1558 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:40.339018  6987 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.496608  7228 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.522261  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:40.483632  7344 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:01:40.475600  7272 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.532732  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:40.533031  1707 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:40.502444  7270 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:40.504858  7332 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:40.533427  2268 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:01:40.493464  7178 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:01:40.512646  7214 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:40.517359  7315 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:40.521924  7179 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.503237  7124 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.528286  7307 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:40.542166  1626 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:40.534162  7336 raft_consensus.cc:2764] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:01:40.552498  7179 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:40.555357  7356 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.086s	user 0.000s	sys 0.006s
I20260709 13:01:40.557252  7286 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.537511  7329 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:40.612609  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 73501.4us
I20260709 13:01:40.578441  1705 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:40.537441  7290 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.490415  7320 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.545434  7307 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.540206  7214 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:40.613669  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:40.597616  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 237129us
I20260709 13:01:40.540584  7261 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.593273  7317 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.624547  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:40.606540  7179 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.632764  2271 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:40.626770  7138 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:40.559019  7221 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.594287  7315 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:40.621006  7307 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:40.618261  7260 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 15. Current term is 16.
I20260709 13:01:40.632702  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.642978  7257 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:40.646646  7353 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:01:40.638104  6859 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.653743  1634 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:40.619324  7290 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.657718  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.660290  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:40.674734  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 189644us
I20260709 13:01:40.632203  7329 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:40.677111  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.659317  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:40.679054  1632 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
W20260709 13:01:40.680419  7351 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:01:40.681114  7364 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:01:40.674403  6859 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:40.682571  7357 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:40.683661  7282 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:40.684922  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1022) took 1339 ms. Trace:
I20260709 13:01:40.685245  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1001) took 1018 ms. Trace:
W20260709 13:01:40.703481  2269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 1241) took 2170 ms (client timeout 2190 ms). Trace:
I20260709 13:01:40.685777  1559 rpcz_store.cc:276] 0709 13:01:39.666995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.408027 (+741032us) service_pool.cc:224] Handling call
0709 13:01:40.408307 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.412063 (+  3756us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:40.412096 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.434545 (+ 22449us) log.cc:844] Serialized 26 byte log entry
0709 13:01:40.596977 (+162432us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:40.597037 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.597117 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.684906 (+ 87789us) raft_consensus.cc:1685] finished
0709 13:01:40.684935 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.685189 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3906,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":21883,"thread_start_us":82333,"threads_started":1,"wal-append.queue_time_us":140243}
I20260709 13:01:40.692047  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.706552  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:40.679124  7173 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.006s
I20260709 13:01:40.707998  2262 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:40.706835  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.692369  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:40.703919  2269 rpcz_store.cc:269] 0709 13:01:38.533452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.533586 (+   134us) service_pool.cc:224] Handling call
0709 13:01:40.703289 (+2169703us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b5400269154. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:40.703418 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97957248}
I20260709 13:01:40.708666  1633 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
W20260709 13:01:40.675091  7220 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.003s
I20260709 13:01:40.685338  1701 rpcz_store.cc:276] 0709 13:01:39.345334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.500789 (+1155455us) service_pool.cc:224] Handling call
0709 13:01:40.503430 (+  2641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.503972 (+   542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.684710 (+180738us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b54000b7050. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:40.684861 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5357952}
I20260709 13:01:40.709470  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:40.710548  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:40.712241  1632 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:40.713742  7227 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:40.710424  7220 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.714308  7227 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:40.714685  7227 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.716043  7220 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.657825  7257 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.723388  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.725814  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:40.727355  1631 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
W20260709 13:01:40.709164  7043 consensus_meta.cc:287] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.002s
I20260709 13:01:40.631528  7317 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.742934  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:40.744289  7315 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.747520  7290 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:40.747751  7221 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.748049  7329 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.748474  7174 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:40.750836  7366 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:01:40.694480  7159 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.725003  7173 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.755234  7069 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:40.720616  7235 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:40.727835  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:40.726122  7353 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:40.708148  7178 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:40.768517  2268 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:40.774281  7272 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:40.775115  7124 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:40.775238  7250 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.109s	user 0.007s	sys 0.004s
W20260709 13:01:40.822638  2235 leader_election.cc:336] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 2.041s (SENT)
W20260709 13:01:40.772943  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 80248.4us
I20260709 13:01:40.779825  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2432) took 1051 ms. Trace:
W20260709 13:01:40.813503  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 85726.3us
I20260709 13:01:40.824848  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:40.793475  7160 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 13:01:40.815358  7159 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:40.824146  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2498) took 1399 ms. Trace:
W20260709 13:01:40.834141  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.824542  1560 rpcz_store.cc:276] 0709 13:01:39.728629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.417043 (+688414us) service_pool.cc:224] Handling call
0709 13:01:40.417478 (+   435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:40.475625 (+ 58147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.475662 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:40.480504 (+  4842us) log.cc:844] Serialized 52 byte log entry
0709 13:01:40.594402 (+113898us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:40.594456 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.594543 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.779529 (+184986us) raft_consensus.cc:1685] finished
0709 13:01:40.779557 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.779750 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57690,"raft.queue_time_us":62032,"spinlock_wait_cycles":17750784,"thread_start_us":80053,"threads_started":1,"wal-append.queue_time_us":170263}
I20260709 13:01:40.757859  7227 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.836284  2264 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:40.832644  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:40.833457  1701 rpcz_store.cc:276] 0709 13:01:39.424316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.710042 (+1285726us) service_pool.cc:224] Handling call
0709 13:01:40.710338 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.823725 (+113387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.823758 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.823866 (+   108us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:40.823910 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.823973 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.824091 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101221,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":1705,"thread_start_us":111721,"threads_started":1}
W20260709 13:01:40.816071  7256 consensus_meta.cc:287] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.663s	user 0.010s	sys 0.000s
I20260709 13:01:40.837354  1600 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:40.812144  7235 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.770325  7043 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.835705  7160 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.844905  7380 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:40.843299  1701 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:40.856701  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2499) took 1427 ms. Trace:
I20260709 13:01:40.840101  7272 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:40.857468  1701 rpcz_store.cc:276] 0709 13:01:39.429573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.842127 (+1412554us) service_pool.cc:224] Handling call
0709 13:01:40.842402 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.854195 (+ 11793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.856633 (+  2438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.877909  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:40.847894  7174 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:40.836756  7250 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.851166  7335 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:40.850652  7235 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:40.848079  7159 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:40.898826  7159 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.883155  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:40.823136  7178 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:40.877444  7380 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.888324  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:40.895850  7307 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:40.902992  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 123361us
I20260709 13:01:40.902645  1701 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:01:40.850383  7256 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:40.911892  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:40.912834  1701 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:40.874938  7272 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.909399  1557 raft_consensus.cc:2410] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
W20260709 13:01:40.908767  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 53867.5us
I20260709 13:01:40.880599  7174 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.914158  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:40.887075  7335 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.919219  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:40.917574  1701 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:40.924257  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:40.880924  7251 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:01:40.918551  7174 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.917240  7272 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:40.933965  1701 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:40.916793  7160 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:40.920586  7335 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:40.938522  7377 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:01:40.929533  7227 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.943929  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1198) took 1528 ms. Trace:
I20260709 13:01:40.946357  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2697) took 1405 ms. Trace:
I20260709 13:01:40.947434  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2501) took 1506 ms. Trace:
I20260709 13:01:40.956640  1701 rpcz_store.cc:276] 0709 13:01:39.440676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.933393 (+1492717us) service_pool.cc:224] Handling call
0709 13:01:40.933739 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.947237 (+ 13498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.947394 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.956558  1708 rpcz_store.cc:276] 0709 13:01:39.537075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.941263 (+1404188us) service_pool.cc:224] Handling call
0709 13:01:40.941597 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.941769 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.941791 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.941832 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:40.941862 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.941911 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.942012 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.941489  7214 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:40.935094  7287 consensus_meta.cc:287] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.706s	user 0.011s	sys 0.000s
I20260709 13:01:40.959350  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2698) took 1422 ms. Trace:
I20260709 13:01:40.928828  7372 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:40.970002  2268 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:40.978348  1701 rpcz_store.cc:276] 0709 13:01:39.537376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.957662 (+1420286us) service_pool.cc:224] Handling call
0709 13:01:40.957977 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.958906 (+   929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.958945 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.958997 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:40.959042 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.959117 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.959281 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:40.980548  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:40.950439  7370 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:40.955376  2267 rpcz_store.cc:276] 0709 13:01:39.415375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.687887 (+272512us) service_pool.cc:224] Handling call
0709 13:01:39.688224 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.162338 (+474114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.162382 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.174964 (+ 12582us) log.cc:844] Serialized 26 byte log entry
0709 13:01:40.291586 (+116622us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:40.291621 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.943577 (+651956us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400404054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:40.943625 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.943672 (+    47us) raft_consensus.cc:1685] finished
0709 13:01:40.943685 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.943872 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13650,"raft.queue_time_us":15931,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":16370,"spinlock_wait_cycles":1057996544,"thread_start_us":116260,"threads_started":1,"wal-append.queue_time_us":127986}
I20260709 13:01:40.983237  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:40.971627  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:40.984967  1551 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:40.987186  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:40.946470  7257 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.991026  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:40.991789  2267 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:01:40.997965  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:40.999675  1701 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:41.001766  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:41.002429  2268 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:40.964211  7173 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:40.964864  7380 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:40.958447  7384 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:01:41.017254  1701 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:40.986303  7370 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:40.970635  7317 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:41.000624  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:41.039481  7227 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:41.040022  7227 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.040421  7227 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:41.014357  7214 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.048343  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2497) took 1630 ms. Trace:
I20260709 13:01:41.050841  1705 rpcz_store.cc:276] 0709 13:01:39.418112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.621314 (+1203202us) service_pool.cc:224] Handling call
0709 13:01:40.621638 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.622010 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:40.694343 (+ 72333us) log.cc:844] Serialized 14 byte log entry
0709 13:01:40.771155 (+ 76812us) log.cc:844] Serialized 14 byte log entry
0709 13:01:40.838641 (+ 67486us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.850948 (+ 12307us) log.cc:844] Serialized 26 byte log entry
0709 13:01:40.851216 (+   268us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:41.027259 (+176043us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.047918 (+ 20659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.048003 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.048058 (+    55us) raft_consensus.cc:1685] finished
0709 13:01:41.048073 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.048266 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25270,"prepare.queue_time_us":142181,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":1305,"raft.queue_time_us":116836,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":28639,"spinlock_wait_cycles":7445632,"thread_start_us":325194,"threads_started":4,"wal-append.queue_time_us":86543}
I20260709 13:01:40.981281  7287 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:41.049654  7332 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
W20260709 13:01:41.065265  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 148729us
I20260709 13:01:41.049151  7043 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.067369  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:41.073442  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:41.076212  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:41.077348  1629 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:41.078851  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:41.074196  7381 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:41.078528  7013 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.082986  7381 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:41.083091  6961 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:41.083492  7381 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:41.083642  6961 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:41.084587  6961 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:41.087738  1702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2500) took 1655 ms (client timeout 2070 ms). Trace:
W20260709 13:01:41.088158  1702 rpcz_store.cc:269] 0709 13:01:39.432725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.020163 (+587438us) service_pool.cc:224] Handling call
0709 13:01:41.087568 (+1067405us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b5400129b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:41.087681 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169700736}
I20260709 13:01:41.089360  1702 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:41.092798  7043 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:41.094714  7330 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.236s	user 0.002s	sys 0.000s
I20260709 13:01:41.101025  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:41.074615  7374 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:01:41.078229  7307 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.109668  7242 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:41.110121  7242 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:41.110581  7381 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.110958  7242 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.112026  7242 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:41.112865  7381 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.083225  7013 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.125967  7220 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:41.071188  7178 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:01:41.076670  7256 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.144510  2265 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:41.160502  7000 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:41.005359  7372 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:41.162822  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1225) took 2137 ms. Trace:
I20260709 13:01:41.068537  7332 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:41.168002  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 54054.6us
I20260709 13:01:41.171968  1703 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:41.171588  7332 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.173101  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:41.175793  7219 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.178114  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1250) took 1372 ms. Trace:
I20260709 13:01:41.178511  2264 rpcz_store.cc:276] 0709 13:01:39.806016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.806219 (+   203us) service_pool.cc:224] Handling call
0709 13:01:39.818959 (+ 12740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.836681 (+1017722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.177835 (+341154us) spinlock_profiling.cc:243] Waited 994 ms on lock 0x7b5400730fd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:41.178017 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2285238528}
I20260709 13:01:41.179441  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:41.179634  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:41.180569  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:41.180685  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:41.181316  2264 raft_consensus.cc:2368] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13.
I20260709 13:01:41.181614  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:41.182394  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:41.182884  1555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 994) took 1518 ms (client timeout 1611 ms). Trace:
I20260709 13:01:41.183436  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:41.183269  1555 rpcz_store.cc:269] 0709 13:01:39.664820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.670157 (+  5337us) service_pool.cc:224] Handling call
0709 13:01:41.182712 (+1512555us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b5400181854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:41.182834 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956636544}
I20260709 13:01:41.184518  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:41.185091  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:41.186273  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:41.187026  2264 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:41.195808  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:41.116462  7370 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.198274  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:41.198988  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:41.201624  1633 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:41.163933  2270 rpcz_store.cc:276] 0709 13:01:39.024866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.098540 (+ 73674us) service_pool.cc:224] Handling call
0709 13:01:39.098818 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.099009 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:39.120549 (+ 21540us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.115003 (+1994454us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b1800377920. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f23a 00007f06ddfd9a2a
0709 13:01:41.160168 (+ 45165us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.160249 (+    81us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:41.160307 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.162593 (+  2286us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.162751 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21397,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3767,"raft.queue_time_us":98,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":19774848,"thread_start_us":44540,"threads_started":1,"wal-append.queue_time_us":2039038}
I20260709 13:01:41.202935  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:41.203567  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:41.191826  7235 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.138419  7334 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:01:41.192948  1556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 992) took 2119 ms (client timeout 2041 ms). Trace:
I20260709 13:01:41.200734  7372 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:41.200181  1553 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:41.201428  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:41.200137  1628 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:41.185487  7227 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:41.204368  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 723195us
I20260709 13:01:41.204540  7390 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:41.204612  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:41.139432  7174 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:41.187723  7250 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:41.186540  7292 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:41.122735  6961 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:41.207700  1556 rpcz_store.cc:269] 0709 13:01:39.073217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.076041 (+  2824us) service_pool.cc:224] Handling call
0709 13:01:41.192694 (+2116653us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b540030aa54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:41.192853 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689670912}
I20260709 13:01:41.234382  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:41.234655  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:41.208701  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 997) took 1542 ms. Trace:
I20260709 13:01:41.235638  1704 raft_consensus.cc:2410] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:01:41.191015  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:41.237929  2235 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:41.189834  7272 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.198834  7370 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:41.215184  1601 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:41.236966  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.235564  1554 rpcz_store.cc:276] 0709 13:01:39.665813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.033365 (+367552us) service_pool.cc:224] Handling call
0709 13:01:40.088986 (+ 55621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.286636 (+197650us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:40.286946 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 13:01:40.439692 (+152746us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.479151 (+ 39459us) log.cc:844] Serialized 26 byte log entry
0709 13:01:40.479292 (+   141us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:40.479515 (+   223us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.203617 (+724102us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b180048da20. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:01:41.203793 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.203873 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.208483 (+  4610us) raft_consensus.cc:1685] finished
0709 13:01:41.208508 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.208646 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":739634,"prepare.queue_time_us":256,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":91,"raft.queue_time_us":876633,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":12265,"spinlock_wait_cycles":7076992,"thread_start_us":315150,"threads_started":2,"wal-append.queue_time_us":227809}
I20260709 13:01:41.247582  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:41.248485  1704 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:41.240761  2267 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:41.254240  1601 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:41.240518  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:41.213306  7334 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:41.243328  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:41.259270  1634 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:01:41.260155  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:41.214169  7269 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:41.216629  7229 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:41.249645  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:41.261920  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:41.267971  7362 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:41.269768  1704 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.266796  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:41.245682  7390 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.278906  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:41.243963  7347 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:41.261063  7069 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:41.278658  7138 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:41.282300  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:41.260907  7364 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:41.292497  1709 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
W20260709 13:01:41.296191  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 77236.6us
I20260709 13:01:41.299024  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:41.300885  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:41.302155  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:41.303035  1709 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:41.305727  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:41.283339  7069 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.307298  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:41.327462  2270 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:41.323289  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:41.323778  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:41.328517  1628 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.280833  7390 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:41.330225  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:41.330825  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:41.294538  7347 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:41.273084  7229 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:41.304735  7287 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:41.308626  7377 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:41.329707  7069 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:41.350445  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 69334.8us
I20260709 13:01:41.364084  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:41.336167  7238 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:41.369297  2270 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:41.333649  6923 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:41.379761  6927 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.382673  7174 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:41.335925  7255 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:41.385406  1601 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:41.393873  1709 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:41.394461  1709 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:41.336413  7347 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:41.353359  7282 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:41.395553  1709 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:41.411378  1709 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:41.300477  7334 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:41.415711  2270 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:41.388852  7174 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:41.388281  7255 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:41.408370  7278 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:41.383638  7238 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.421264  7255 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.391103  7335 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:41.423270  7227 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:41.419996  7235 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:41.351413  7269 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:41.455374  1633 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:41.458067  7242 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.459786  7242 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.474900  1709 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:01:41.475492  1709 pending_rounds.cc:85] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 10
I20260709 13:01:41.475857  1709 pending_rounds.cc:107] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:01:41.476184  1709 raft_consensus.cc:2889] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:41.478399  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:41.482774  1709 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:41.486249  7395 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.157s	user 0.003s	sys 0.000s
I20260709 13:01:41.487262  7238 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:41.466009  7235 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:41.488051  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1031) took 1300 ms. Trace:
I20260709 13:01:41.488260  7235 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.488428  1701 rpcz_store.cc:276] 0709 13:01:40.187899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.023704 (+835805us) service_pool.cc:224] Handling call
0709 13:01:41.056326 (+ 32622us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:41.059766 (+  3440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.059812 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:41.060553 (+   741us) log.cc:844] Serialized 52 byte log entry
0709 13:01:41.198570 (+138017us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:41.198610 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.198674 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.485630 (+286956us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:41.487773 (+  2143us) raft_consensus.cc:1685] finished
0709 13:01:41.487791 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.487996 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":148284,"raft.queue_time_us":4022,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":63060,"spinlock_wait_cycles":5235968,"thread_start_us":116139,"threads_started":1,"wal-append.queue_time_us":202153}
I20260709 13:01:41.489673  7282 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:41.490279  7282 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:41.458096  7398 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:01:41.497373  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1179) took 1410 ms. Trace:
I20260709 13:01:41.497948  1635 rpcz_store.cc:276] 0709 13:01:40.086990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.201084 (+114094us) service_pool.cc:224] Handling call
0709 13:01:40.201460 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.201844 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.201870 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.202386 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.199131 (+996745us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b18003f1d80. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:01:41.351912 (+152781us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:41.351966 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.352062 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.496933 (+144871us) raft_consensus.cc:1685] finished
0709 13:01:41.496985 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.497293 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23516,"raft.queue_time_us":744,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":10895,"spinlock_wait_cycles":5759744,"thread_start_us":152041,"threads_started":1,"wal-append.queue_time_us":1186216}
I20260709 13:01:41.509464  1704 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:41.509958  1709 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:41.477049  7272 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.449607  7362 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:41.517320  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:41.518996  2270 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:41.528573  1628 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
W20260709 13:01:41.531755  7394 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:41.517652  7242 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:41.537969  7335 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:41.544214  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.490943  7235 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:41.556995  7229 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:41.575546  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:41.576284  2265 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:41.576395  2270 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:41.549223  7362 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.584259  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.584849  1557 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:41.586730  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.587292  1560 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:41.589200  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.589747  1559 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.591514  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.592839  2265 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
W20260709 13:01:41.607175  7373 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.893s	user 0.002s	sys 0.000s
I20260709 13:01:41.616183  1559 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:41.581693  7069 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:41.621587  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.622303  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0739742519999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
W20260709 13:01:41.622850  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0514742519999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:01:41.623224  1526 connection.cc:256] RPC call timeout handler was delayed by -1.0415742519999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260709 13:01:41.628014  1560 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:41.629194  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.630686  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:41.631045  1526 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:41.631572  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.632416  1555 raft_consensus.cc:2410] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:01:41.632422  1559 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 16. Ops: []
I20260709 13:01:41.621605  7340 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.581043  7390 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.644706  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.646929  1630 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:41.635215  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.636803  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:41.650112  1526 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:41.628042  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.642373  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.651273  1552 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.643360  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.652138  1555 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:41.652926  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.653694  1555 raft_consensus.cc:2410] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:01:41.644398  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.654045  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:41.637599  6971 raft_consensus.cc:2764] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:01:41.648881  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:41.643919  7261 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:41.655997  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:41.676349  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.739392  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 83512.5us
I20260709 13:01:41.654891  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.704516  1557 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
W20260709 13:01:41.704032  1626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2566) took 1378 ms (client timeout 1550 ms). Trace:
W20260709 13:01:41.741601  1626 rpcz_store.cc:269] 0709 13:01:40.325454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.330309 (+  4855us) service_pool.cc:224] Handling call
0709 13:01:41.703831 (+1373522us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540018ecd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:41.703970 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352468864}
I20260709 13:01:41.742565  7123 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:41.725965  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1033) took 1476 ms. Trace:
W20260709 13:01:41.748939  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 137853us
I20260709 13:01:41.666811  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.752942  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:41.725037  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 88348.1us
I20260709 13:01:41.756805  1560 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:41.757776  1551 raft_consensus.cc:2410] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:01:41.666901  6923 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:41.744495  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 999) took 2078 ms. Trace:
I20260709 13:01:41.672250  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:41.740446  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 94544.6us
I20260709 13:01:41.744505  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.749271  1707 rpcz_store.cc:276] 0709 13:01:40.249954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.081447 (+831493us) service_pool.cc:224] Handling call
0709 13:01:41.081703 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:41.192889 (+111186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.192925 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:41.193392 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.295902 (+102510us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:41.306513 (+ 10611us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.306772 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.306843 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.707618 (+400775us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b1800126f40. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1
0709 13:01:41.708654 (+  1036us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b1800126f40. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:01:41.725694 (+ 17040us) raft_consensus.cc:1685] finished
0709 13:01:41.725724 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.725892 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70390,"prepare.queue_time_us":190,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":3658,"raft.queue_time_us":86624,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":5062,"spinlock_wait_cycles":36550144,"thread_start_us":102109,"threads_started":1,"wal-append.queue_time_us":137154}
I20260709 13:01:41.764753  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.766170  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.727348  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2414) took 1637 ms. Trace:
I20260709 13:01:41.757699  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.758069  1526 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:41.655536  7259 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:41.644193  7269 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:41.771140  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:41.771955  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:41.626853  6987 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:41.726334  6846 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:41.763702  1555 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:41.766960  1627 rpcz_store.cc:276] 0709 13:01:40.089854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.212286 (+122432us) service_pool.cc:224] Handling call
0709 13:01:40.212564 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.413252 (+200688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.413283 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.413322 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:40.413350 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.727049 (+1313699us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400165dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:41.727114 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.727276 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461127552}
I20260709 13:01:41.768414  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.763684  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:41.785844  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:41.785768  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.769272  1674 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:41.763185  1553 rpcz_store.cc:276] 0709 13:01:39.666428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.403333 (+736905us) service_pool.cc:224] Handling call
0709 13:01:41.199999 (+796666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.213822 (+ 13823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.744290 (+530468us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b540030aa50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:41.744440 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831687936}
I20260709 13:01:41.786993  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.787281  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.787860  1553 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:41.787985  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.758656  1552 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:41.773653  1599 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:41.778792  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.770848  7364 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:01:41.747491  7335 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:41.779851  7390 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.780339  7256 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:41.780005  7269 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.783933  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.784533  1626 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:41.666303  7340 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.738699  7261 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.755477  7179 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:41.703097  7282 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.670748  7124 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:41.670857  7148 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:41.847059  7384 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:41.831579  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:41.799070  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:41.885799  1627 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:41.881184  1558 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.852871  6846 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:41.790650  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.881228  7248 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:01:41.887979  6846 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:41.888211  1551 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:41.889200  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.767890  7173 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:01:41.831849  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:41.794430  7290 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:41.854786  1600 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:41.781281  7259 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:41.901197  1627 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:41.790894  1707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:48630
I20260709 13:01:41.902134  1707 raft_consensus.cc:606] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:41.902526  1707 raft_consensus.cc:614] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:41.903155  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:41.875861  7282 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.916392  6859 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:41.927903  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:41.928741  1631 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:41.901715  7259 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:41.930473  7259 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:41.930399  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:41.931458  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:41.931746  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:41.932230  1635 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:41.932785  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:41.899952  7290 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:41.936123  7290 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.938094  1627 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:01:41.934337  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:41.940727  1631 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:41.942087  1558 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:41.942858  7287 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:41.943394  7287 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:41.946054  7287 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:41.946713  7013 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.784857  7250 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:01:41.763868  6923 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:41.948293  6923 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:41.887552  7335 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:41.860944  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:41.955111  2263 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:41.955559  7335 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:41.956372  7173 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:41.956771  7173 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:41.862682  6961 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.862933  7414 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:01:41.800375  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:41.847307  7327 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:41.831276  7377 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:41.767674  7235 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:01:41.794215  7370 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:41.888911  6846 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.879546  1559 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:41.988157  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:41.854624  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.832154  7255 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:41.891706  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 59946.3us
W20260709 13:01:41.890110  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 58633.1us
I20260709 13:01:41.889549  7261 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.893188  7159 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:41.869985  1553 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:41.963276  6961 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.020385  6961 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:42.022177  7370 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:41.899935  7415 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:01:42.023200  7405 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:42.023787  7405 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.023218  7370 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:42.024174  7405 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.024362  7124 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.883304  7359 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.334s	user 0.003s	sys 0.000s
I20260709 13:01:41.900609  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 1240) took 1220 ms. Trace:
I20260709 13:01:42.025645  2267 rpcz_store.cc:276] 0709 13:01:40.680026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.997702 (+317676us) service_pool.cc:224] Handling call
0709 13:01:41.900339 (+902637us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400416754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:41.900529 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544028032}
I20260709 13:01:42.026794  7406 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:41.883953  7069 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:41.907153  7340 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.896869  7325 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:41.907769  7307 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:41.990751  7392 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:42.029016  7325 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.036698  7392 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.036963  7325 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:42.037194  7392 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:42.037343  6846 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:42.038916  7173 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.040529  7173 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:42.028913  7282 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:01:41.909508  7269 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:41.882645  7347 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:41.954443  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2699) took 2416 ms. Trace:
I20260709 13:01:42.043642  1708 rpcz_store.cc:276] 0709 13:01:39.537632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.958004 (+1420372us) service_pool.cc:224] Handling call
0709 13:01:41.090227 (+132223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:41.124566 (+ 34339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.124600 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:41.125073 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.305246 (+180173us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:41.305287 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.305352 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:41.496672 (+191320us) raft_consensus.cc:1685] finished
0709 13:01:41.496711 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.954199 (+457488us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400129b50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:41.954387 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33944,"raft.queue_time_us":34128,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":17510,"spinlock_wait_cycles":287345408,"thread_start_us":102526,"threads_started":1,"wal-append.queue_time_us":255150}
I20260709 13:01:41.767974  7123 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.051285  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2705) took 1851 ms. Trace:
I20260709 13:01:42.051934  1705 rpcz_store.cc:276] 0709 13:01:40.200076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.071257 (+871181us) service_pool.cc:224] Handling call
0709 13:01:41.071496 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.199586 (+128090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.199617 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.199661 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:41.199701 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.051003 (+851302us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001accd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:42.051062 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.051217 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294116096}
I20260709 13:01:41.962808  2263 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
W20260709 13:01:41.985118  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 184829us
I20260709 13:01:41.997962  1673 leader_election.cc:400] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13.
I20260709 13:01:41.963482  7327 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:42.018517  1634 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:42.024928  7124 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.064265  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1219) took 3028 ms. Trace:
I20260709 13:01:42.064715  2262 rpcz_store.cc:276] 0709 13:01:39.023636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.023754 (+   118us) service_pool.cc:224] Handling call
0709 13:01:40.704593 (+1680839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:40.708381 (+  3788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.051277 (+1342896us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400269150. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:42.051560 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3865277824}
I20260709 13:01:41.795042  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:41.798404  6987 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.029742  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:42.032514  1628 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:42.033792  1559 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:01:42.024128  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:42.047953  1551 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:42.054896  1673 leader_election.cc:403] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:42.071640  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 73886.2us
I20260709 13:01:42.073621  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:42.060391  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 54446.3us
I20260709 13:01:42.055670  1674 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:42.067652  7124 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:42.079802  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50166.9us
W20260709 13:01:42.087113  2271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 1232) took 1873 ms (client timeout 1848 ms). Trace:
I20260709 13:01:42.088032  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1027) took 2702 ms. Trace:
W20260709 13:01:42.142781  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 87204.2us
W20260709 13:01:42.144925  2271 rpcz_store.cc:269] 0709 13:01:40.215081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.257757 (+ 42676us) service_pool.cc:224] Handling call
0709 13:01:42.086871 (+1829114us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400289bd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:42.087034 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259392384}
W20260709 13:01:42.107296  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 83229.6us
I20260709 13:01:42.145608  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:42.146942  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2395) took 3707 ms (client timeout 1540 ms). Trace:
W20260709 13:01:42.147341  1629 rpcz_store.cc:269] 0709 13:01:38.381715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.381853 (+   138us) service_pool.cc:224] Handling call
0709 13:01:42.088655 (+3706802us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b5400079754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:42.088786 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5997828992}
W20260709 13:01:42.146221  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.143208  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:42.162642  1555 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:01:42.164074  1555 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:42.078971  6961 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:42.168068  6987 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:42.079038  6818 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13.
I20260709 13:01:42.170192  7260 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:42.171317  1556 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:42.172693  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:42.174556  7384 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:42.106352  7069 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:42.175398  7384 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:42.176235  6961 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:42.176884  6961 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:42.177887  6961 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.179481  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.181201  1705 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:42.183411  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:42.184245  1705 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:42.185503  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:42.187600  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.188509  1708 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:01:42.189697  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.066406  7327 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:42.192245  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:42.192765  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 48060.4us
I20260709 13:01:42.192173  7255 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:42.068203  7235 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:42.194823  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.146560  1703 rpcz_store.cc:276] 0709 13:01:39.385307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.504566 (+1119259us) service_pool.cc:224] Handling call
0709 13:01:40.504817 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.172388 (+667571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.087804 (+915416us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54000b7554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:42.087977 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534036224}
I20260709 13:01:42.180086  7238 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:42.197017  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.197276  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:42.200587  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.064545  7123 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:42.203428  1599 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:42.105782  7307 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:42.212201  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.208415  1554 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:42.204816  7238 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:42.212105  1599 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:42.220546  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:42.221500  2262 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:42.224592  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:42.216315  7013 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:42.230166  2236 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:42.231859  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:42.198621  7235 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:42.179880  7287 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:01:42.252440  1560 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:42.224247  7160 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.058s	sys 0.049s
I20260709 13:01:42.232254  7000 consensus_queue.cc:1059] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:01:42.214164  7278 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:42.254349  1707 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:42.258805  1706 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:01:42.197412  6942 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:01:42.231796  6971 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:42.234133  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:42.262833  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:42.275502  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:42.280375  1700 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:42.264338  1705 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:01:42.269536  1560 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:42.249121  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.272684  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:42.276055  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.287000  1704 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:42.291182  1700 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:42.225162  7256 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:42.304225  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:42.304652  7410 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:42.305140  7410 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.305490  7410 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:42.306066  1700 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:42.216511  7238 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.313409  1553 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:42.314790  1553 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:01:42.261508  7406 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:42.261291  7160 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.058s	sys 0.050s
W20260709 13:01:42.301882  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 67896.6us
I20260709 13:01:42.215106  6923 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.239064  6846 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:42.300980  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:42.335626  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:42.303690  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:42.336637  1705 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:42.338137  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.001s	sys 0.024s
W20260709 13:01:42.339880  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.001s	sys 0.024s
I20260709 13:01:42.236406  7258 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:01:42.304071  7364 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:42.341904  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 560607us
I20260709 13:01:42.354785  1703 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:01:42.355713  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:42.356081  1702 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:42.303392  7069 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:42.301640  7278 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:42.345749  1705 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:42.347530  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.369359  1700 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:42.273411  7390 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.361219  1557 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:01:42.349318  7341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.011s	sys 0.013s
I20260709 13:01:42.369468  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:42.370909  7278 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:42.347971  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.002s	sys 0.032s
I20260709 13:01:42.352363  7242 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:42.349928  7419 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:42.381285  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:42.386317  1700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:48630
I20260709 13:01:42.397481  1700 raft_consensus.cc:606] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:42.389694  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 231006us
I20260709 13:01:42.391144  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:42.382961  7159 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:42.398895  1526 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:42.399900  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:42.401290  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:42.359759  7069 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:42.388537  7341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.011s	sys 0.014s
I20260709 13:01:42.397981  1700 raft_consensus.cc:614] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:42.353245  6846 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.381062  7347 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:42.411761  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:42.396569  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.002s	sys 0.032s
I20260709 13:01:42.420511  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:42.421658  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:42.422631  1633 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:42.423666  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:42.414613  1526 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:42.433876  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.435134  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.436426  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.437131  1705 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:42.438417  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.440747  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.399258  7159 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:42.346977  7235 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.402967  7228 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.410550  7255 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:42.447547  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:42.402385  7420 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:42.350456  7307 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:42.418391  7340 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:42.389240  7390 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:42.452418  1700 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:42.453673  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:42.474094  1634 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:42.447417  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:42.474926  1627 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:42.386818  7406 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:01:42.386714  7364 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:01:42.389707  7013 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:01:42.418917  7173 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:42.487471  6846 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:42.392999  7256 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.488018  7173 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:42.488891  7173 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.416136  7124 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:42.462599  1702 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:42.494287  6818 raft_consensus.cc:3055] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:42.494792  6818 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:42.442592  7123 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:42.457010  7159 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:42.479823  7397 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.053s	user 0.004s	sys 0.000s
I20260709 13:01:42.482779  6923 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:42.487028  7334 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:42.464020  7250 consensus_queue.cc:1175] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f1725fe36e349ac85405627f9c93d95" responder_term: 15 status { last_received { term: 13 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:42.464561  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:42.533237  1630 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:42.455189  7160 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:42.425359  7269 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:01:42.499130  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 356043us
I20260709 13:01:42.462790  7255 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:42.462977  7347 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:42.508437  1701 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:42.461323  7420 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:42.485914  6971 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:42.466560  7228 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:42.534665  7259 consensus_meta.cc:287] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.604s	user 0.001s	sys 0.009s
I20260709 13:01:42.625473  1705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:48630
I20260709 13:01:42.626330  1705 raft_consensus.cc:606] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:42.626756  1705 raft_consensus.cc:614] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:42.578498  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.621181  7347 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:01:42.637005  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.638613  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:42.649581  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:42.534910  7364 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:42.542217  7255 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:42.664634  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.704336  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.476392  7069 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.732678  2266 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:42.743930  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1239) took 2104 ms. Trace:
I20260709 13:01:42.744879  2268 rpcz_store.cc:276] 0709 13:01:40.639422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.025020 (+385598us) service_pool.cc:224] Handling call
0709 13:01:41.025303 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:41.025686 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.025715 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:41.187342 (+161627us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b2c00096928. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2
0709 13:01:41.187783 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.304914 (+117131us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:41.304985 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.305061 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:42.479260 (+1174199us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:42.743697 (+264437us) raft_consensus.cc:1685] finished
0709 13:01:42.743723 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.743868 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":15125,"spinlock_wait_cycles":13945856,"thread_start_us":116821,"threads_started":1,"wal-append.queue_time_us":222774}
I20260709 13:01:42.620143  7420 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:42.748672  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 110181us
I20260709 13:01:42.754639  1673 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:42.753774  6961 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:42.655947  7290 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
W20260709 13:01:42.779410  7428 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:01:42.652637  7259 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.731218  7364 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.772791  7069 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.816954  2263 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:42.652222  6818 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:42.817636  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.006s	sys 0.027s
W20260709 13:01:42.825811  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.006s	sys 0.027s
I20260709 13:01:42.812171  6961 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.819629  7390 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:42.818831  7362 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.017s	sys 0.059s
W20260709 13:01:42.847067  7362 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.017s	sys 0.060s
I20260709 13:01:42.852807  7148 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:42.853462  7148 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:42.854543  7148 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:42.855695  7423 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.430s	user 0.006s	sys 0.003s
I20260709 13:01:42.856240  7148 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:42.833297  6971 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.858053  6971 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.860966  6971 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:42.868129  7259 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:42.869112  7402 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:42.869683  7402 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:42.870791  7402 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.881103  7228 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:42.884924  6859 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:42.885524  6859 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:42.886621  6859 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:42.889642  7327 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.687s	user 0.004s	sys 0.004s
I20260709 13:01:42.805482  7347 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.830945  7431 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:42.833266  6961 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:42.907642  7431 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.905241  7327 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:42.979106  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.009s
W20260709 13:01:43.063856  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.006s	sys 0.010s
I20260709 13:01:43.063911  1702 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:43.064312  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2604) took 1367 ms. Trace:
I20260709 13:01:43.064493  1702 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:01:43.065138  1524 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.597s (SENT) [suppressed 25 similar messages]
W20260709 13:01:42.979430  1555 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.004s	sys 0.042s
W20260709 13:01:43.066322  1555 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.004s	sys 0.042s
I20260709 13:01:43.066903  1552 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:01:42.980762  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.982730  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.006s	sys 0.010s
I20260709 13:01:42.982872  1554 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:43.067873  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.006s	sys 0.010s
I20260709 13:01:43.068536  1702 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:42.983392  1556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.003s	sys 0.010s
W20260709 13:01:43.070267  1556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.004s	sys 0.011s
I20260709 13:01:43.070436  1702 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:42.983871  1558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.011s	sys 0.014s
I20260709 13:01:43.071908  6565 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:43.072149  1558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.012s	sys 0.014s
I20260709 13:01:43.071931  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2463) took 1282 ms. Trace:
I20260709 13:01:43.072530  7282 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:43.064754  1560 rpcz_store.cc:276] 0709 13:01:41.697439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.767515 (+ 70076us) service_pool.cc:224] Handling call
0709 13:01:43.063976 (+1296461us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b5400373054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:43.064150 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073517824}
W20260709 13:01:42.994670  1704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.018s	sys 0.036s
W20260709 13:01:43.075573  1704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.019s	sys 0.036s
I20260709 13:01:43.005578  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:43.073030  1556 rpcz_store.cc:276] 0709 13:01:41.789683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.172880 (+383197us) service_pool.cc:224] Handling call
0709 13:01:42.173130 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.173299 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:42.474124 (+300825us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.071116 (+596992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.071224 (+   108us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:43.071371 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.071524 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.071781 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":583620,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":3281,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":299,"thread_start_us":894988,"threads_started":2,"wal-append.queue_time_us":469194}
I20260709 13:01:43.073596  7282 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.005596  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:43.080711  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:43.007755  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:43.082221  2269 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:43.082347  7282 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:43.008172  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:43.083309  2270 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:43.083376  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 1192) took 1155 ms. Trace:
I20260709 13:01:43.009716  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:43.012686  1709 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:43.083884  1628 rpcz_store.cc:276] 0709 13:01:41.927923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.932572 (+  4649us) service_pool.cc:224] Handling call
0709 13:01:43.082871 (+1150299us) spinlock_profiling.cc:243] Waited 97.1 ms on lock 0x7b5400165dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:43.083097 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223349120}
I20260709 13:01:43.016145  1705 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:43.085048  7327 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:43.017258  6961 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:43.020129  7000 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:43.086306  7000 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.088438  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2469) took 1190 ms. Trace:
I20260709 13:01:43.088973  1551 rpcz_store.cc:276] 0709 13:01:41.897595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.902916 (+  5321us) service_pool.cc:224] Handling call
0709 13:01:43.087874 (+1184958us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001d38d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:43.088193 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330758400}
I20260709 13:01:43.089433  7000 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:43.024454  6846 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:43.090785  6846 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.099974  6846 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:43.103686  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.103597  7341 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:43.104530  7341 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:42.942122  7392 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.904s	user 0.013s	sys 0.000s
I20260709 13:01:43.137645  7364 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:43.137317  7392 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.044880  7179 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.049451  6971 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:43.056875  7325 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.019s	user 0.007s	sys 0.007s
W20260709 13:01:43.062937  1559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2587) took 1431 ms (client timeout 1848 ms). Trace:
I20260709 13:01:43.079227  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:43.006464  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:43.038178  7123 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.100591  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1010) took 1471 ms. Trace:
W20260709 13:01:42.938439  7410 consensus_meta.cc:287] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.004s
I20260709 13:01:43.181188  1526 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:43.182039  7228 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.181946  7410 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.182837  7228 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:43.043205  7159 consensus_meta.cc:287] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.003s
W20260709 13:01:42.944754  7427 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.111s	user 0.000s	sys 0.002s
I20260709 13:01:42.922833  7431 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:43.061643  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2595) took 1385 ms. Trace:
I20260709 13:01:43.171370  7123 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.215670  7123 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:43.174224  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.174660  7334 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.643s	user 0.003s	sys 0.016s
I20260709 13:01:43.175009  6971 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.176297  2267 raft_consensus.cc:2393] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:01:43.160243  1559 rpcz_store.cc:269] 0709 13:01:41.631071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.644412 (+ 13341us) service_pool.cc:224] Handling call
0709 13:01:43.062573 (+1418161us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54003d95d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:43.062769 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536940288}
I20260709 13:01:43.178908  7439 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:43.183220  7341 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:42.948159  7405 consensus_meta.cc:287] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.923s	user 0.009s	sys 0.003s
I20260709 13:01:43.183641  7325 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.181226  7420 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.194849  7410 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:43.211006  1557 rpcz_store.cc:276] 0709 13:01:41.676088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.783684 (+107596us) service_pool.cc:224] Handling call
0709 13:01:43.060954 (+1277270us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b5400169c54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:43.061310 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140014848}
I20260709 13:01:43.212100  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:43.219358  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:43.194424  7159 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.200251  7179 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.267264  1704 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:43.245172  7228 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:43.283535  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.289871  1708 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:43.267318  7390 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.269904  7419 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:43.285730  7446 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:43.308564  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2472) took 1354 ms. Trace:
W20260709 13:01:43.308662  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.311792  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:43.317195  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.317706  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.318634  1706 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:43.322924  1702 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
W20260709 13:01:43.289882  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47926.9us
W20260709 13:01:43.323553  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.283697  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 218626us
I20260709 13:01:43.327502  1702 pending_rounds.cc:85] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 11
I20260709 13:01:43.309995  7446 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.343631  7420 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.344508  1700 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:43.345044  7419 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.346462  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:43.347059  6971 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:43.348157  1630 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:43.348316  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:43.335012  1702 pending_rounds.cc:107] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:01:43.353915  1702 raft_consensus.cc:2889] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:43.358727  7390 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.361313  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:43.361554  7390 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:43.361722  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:43.362457  1626 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:43.362519  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:43.363135  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:43.364035  1626 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:43.364521  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:43.365346  1628 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:43.365510  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:43.354940  7392 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:43.309466  7405 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.372360  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:43.351593  7446 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:43.379266  6859 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:43.381376  7179 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:43.386456  7255 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.016s
I20260709 13:01:43.386374  6818 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:43.383803  1627 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:43.390359  7392 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.398679  2234 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:43.384292  7307 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.041s	sys 0.051s
I20260709 13:01:43.403527  7364 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:43.405632  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2734) took 1089 ms. Trace:
I20260709 13:01:43.389081  6971 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:43.397261  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.013s
I20260709 13:01:43.408427  7173 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:01:43.401439  7276 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.399621  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.006s	sys 0.011s
W20260709 13:01:43.413344  7466 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:01:43.416656  7159 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.416584  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2723) took 1144 ms. Trace:
I20260709 13:01:43.395644  7392 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.415370  2268 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:43.414601  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.005s	sys 0.014s
I20260709 13:01:43.424226  1706 rpcz_store.cc:276] 0709 13:01:42.271954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.272066 (+   112us) service_pool.cc:224] Handling call
0709 13:01:43.416320 (+1144254us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54001c4dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:43.416508 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232194816}
W20260709 13:01:43.429415  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.006s	sys 0.012s
I20260709 13:01:43.387192  7255 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.469254  7392 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:43.411124  7276 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:43.441708  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.411931  7307 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.042s	sys 0.051s
I20260709 13:01:43.430240  7341 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:43.476322  7341 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.476869  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:43.479799  7341 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.409832  1701 rpcz_store.cc:276] 0709 13:01:42.316337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.339031 (+ 22694us) service_pool.cc:224] Handling call
0709 13:01:42.358729 (+ 19698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.542116 (+183387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.404980 (+862864us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54001fcf54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:43.405387 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340428672}
I20260709 13:01:43.434944  7447 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.458619  1705 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:01:43.467741  7405 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:43.468415  7325 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:43.466099  6565 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:43.412081  6971 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:43.496134  7364 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:43.496862  7159 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:43.499838  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 67421.1us
I20260709 13:01:43.511399  6565 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:43.498507  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:43.516249  7447 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.517611  7364 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:43.518779  7447 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.499115  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1013) took 1868 ms. Trace:
I20260709 13:01:43.499604  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1252) took 1054 ms. Trace:
I20260709 13:01:43.519603  1552 rpcz_store.cc:276] 0709 13:01:41.630683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.059923 (+429240us) service_pool.cc:224] Handling call
0709 13:01:43.066216 (+1006293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.067454 (+  1238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.498868 (+431414us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b5400169c50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:43.499056 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108784512}
I20260709 13:01:43.500695  7419 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:43.512956  6971 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:43.580538  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 82179.8us
I20260709 13:01:43.519542  7392 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:43.497834  1601 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:43.582101  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 58789.9us
I20260709 13:01:43.520036  2262 rpcz_store.cc:276] 0709 13:01:42.444817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.446282 (+  1465us) service_pool.cc:224] Handling call
0709 13:01:42.446520 (+   238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.446811 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.446832 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.459872 (+ 13040us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.006841 (+546969us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:43.283547 (+276706us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.338412 (+ 54865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.351455 (+ 13043us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:43.499247 (+147792us) raft_consensus.cc:1685] finished
0709 13:01:43.499266 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.499426 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":340471,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":52,"raft.queue_time_us":16566,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":5615,"thread_start_us":772470,"threads_started":2,"wal-append.queue_time_us":1011889}
I20260709 13:01:43.600353  7242 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:43.600867  7327 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:43.601275  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 103704us
I20260709 13:01:43.497762  6942 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.099s
I20260709 13:01:43.604063  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:43.162070  1558 rpcz_store.cc:276] 0709 13:01:41.629528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.024039 (+394511us) service_pool.cc:224] Handling call
0709 13:01:42.024367 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.024593 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:42.362595 (+338002us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.073256 (+710661us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.073579 (+   323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.073638 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:43.073749 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.073890 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.100504 (+ 26614us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":706949,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":71021,"raft.queue_time_us":3787,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":239,"thread_start_us":1046785,"threads_started":2}
I20260709 13:01:43.609251  7455 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:01:43.600898  7242 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:43.599530  7255 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.594864  7392 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:43.624809  7392 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.601588  7327 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:43.584857  7347 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.223s
I20260709 13:01:43.619156  7431 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.622211  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:43.623200  1630 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:43.627489  6565 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:43.633666  7459 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:43.616817  7242 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:43.631472  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:43.639636  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.636234  6565 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.650925  1633 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:43.653607  1630 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:43.613803  7447 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:01:43.657413  7235 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:43.657820  7447 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:43.658401  7447 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:43.659708  7447 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:43.662441  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 107432us
W20260709 13:01:43.662791  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 908259us
I20260709 13:01:43.663980  1673 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:43.664805  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.666079  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2739) took 1241 ms. Trace:
I20260709 13:01:43.666448  7325 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:43.666518  1703 rpcz_store.cc:276] 0709 13:01:42.354852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.355484 (+   632us) service_pool.cc:224] Handling call
0709 13:01:42.355792 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.355979 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:43.170401 (+814422us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.424681 (+254280us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.426251 (+  1570us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.431012 (+  4761us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:43.519737 (+ 88725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.557225 (+ 37488us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.596709 (+ 39484us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2831,"prepare.queue_time_us":555188,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":102,"raft.queue_time_us":3888,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":10286,"spinlock_wait_cycles":40960,"thread_start_us":625560,"threads_started":2,"wal-append.queue_time_us":327611}
I20260709 13:01:43.669267  7421 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.669879  7421 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.670372  1703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:48630
I20260709 13:01:43.671162  1703 raft_consensus.cc:606] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:43.671474  1703 raft_consensus.cc:614] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:43.672247  7421 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:43.673004  7255 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:43.678462  7327 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.681697  1703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:48630
I20260709 13:01:43.682514  1703 raft_consensus.cc:606] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:43.682672  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80507.7us
I20260709 13:01:43.683017  1703 raft_consensus.cc:614] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:43.684543  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2725) took 1409 ms. Trace:
I20260709 13:01:43.685209   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:43.684901  1707 rpcz_store.cc:276] 0709 13:01:42.274779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.274918 (+   139us) service_pool.cc:224] Handling call
0709 13:01:42.309537 (+ 34619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.309982 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:42.656120 (+346138us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.383522 (+727402us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.521313 (+137791us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.521485 (+   172us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:43.521532 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.579550 (+ 58018us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:43.684189 (+104639us) raft_consensus.cc:1685] finished
0709 13:01:43.684219 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.684389 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12848,"prepare.queue_time_us":568194,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":21115,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":17164,"thread_start_us":842020,"threads_started":2,"wal-append.queue_time_us":673844}
I20260709 13:01:43.688028  1701 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:43.688503  1701 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:43.681538  7446 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.690677  7446 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:43.691067  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:43.692492  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:43.693825  1524 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:43.697839  7419 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:43.698362  7341 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:43.698545  7419 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.699131  7341 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:43.700897  7419 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.706168  7405 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.706771  7405 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.708586  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:43.709000  7405 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.709573  7405 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.709187  1700 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:43.714442  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.715178  1557 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:01:43.715581  7325 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.716325  7325 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:43.718492  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 52989.8us
I20260709 13:01:43.719602  7431 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:43.689459  1701 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.721280  1701 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:43.724123  7159 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:43.724915  7159 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.726840  7325 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:43.727841  7159 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:43.728907  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:43.309190  1555 rpcz_store.cc:276] 0709 13:01:41.954423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.257743 (+303320us) service_pool.cc:224] Handling call
0709 13:01:42.274186 (+ 16443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.274383 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:43.066937 (+792554us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.305798 (+238861us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.307981 (+  2183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:43.308051 (+    70us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:43.308148 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.308251 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.308476 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13047,"prepare.queue_time_us":508284,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"raft.queue_time_us":16200,"raft.run_wall_time_us":8479,"spinlock_wait_cycles":36687360,"thread_start_us":963936,"threads_started":2}
I20260709 13:01:43.737241  7419 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:43.738301  7419 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.734040  7435 raft_consensus.cc:3055] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:43.734609  7159 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.735370  6942 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:43.720057  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:43.739794  1633 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:43.742563  6942 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:43.743868  7461 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:01:43.744786  1555 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:43.744989  6942 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:43.741657  7435 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:43.745630  7364 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:43.746946  1557 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:43.747151  7420 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:43.740053  7341 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:43.747778  7420 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.748028  7341 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.748381  7159 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.741849  7255 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:01:43.749984  7420 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.750273  6565 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.753423  6565 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.738874  7419 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.750523  7159 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.756618  1700 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:43.756836  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:43.757216  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:43.756883  6971 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.757596  1708 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:43.757897  1700 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:43.758329  2267 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 14: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:43.758404  1706 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:43.759259  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:43.739164  7446 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:43.760452  7364 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:43.760996  7364 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:43.760917  7446 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.762225  7364 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.757941  1634 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:43.764390  7419 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.746809  7435 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.746721  7334 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:43.766495  7334 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:43.767140  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:43.767753  1634 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:43.768870  6565 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.769784  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.770639  1552 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:43.770941  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:43.771576  1557 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:43.772203  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:43.773325  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.773614  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.773986  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:43.774374  1556 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:43.774592  1552 raft_consensus.cc:2376] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12. Re-sending same reply.
I20260709 13:01:43.774386  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.775336  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.775564  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.775970  1559 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:43.776377  1560 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:43.778229  7419 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:43.778410  1560 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:01:43.779923  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 192141us
I20260709 13:01:43.779306  1560 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:43.807098  1634 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:43.807369  1557 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
W20260709 13:01:43.810479  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 81695.7us
I20260709 13:01:43.811369  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:43.811863  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.812059  1558 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:43.778733  7419 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.817929  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:43.819037  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:43.820199  6565 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:43.821847  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 194918us
I20260709 13:01:43.759243  6971 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:43.824323  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.825874  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 84002.2us
I20260709 13:01:43.831135  1701 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:01:43.831681  1701 pending_rounds.cc:85] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 8
I20260709 13:01:43.832019  1701 pending_rounds.cc:107] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:01:43.833122  1701 raft_consensus.cc:2889] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:43.834236  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:43.832930  2235 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:43.836992  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.820266  7341 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:43.824174  7159 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.846419  1559 raft_consensus.cc:2410] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:01:43.817040  7419 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:43.855262  1557 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:43.816488  7405 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:43.836575  7455 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:43.952836  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:43.884264  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2471) took 1946 ms. Trace:
W20260709 13:01:43.894369  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 174408us
W20260709 13:01:43.993039  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.912041  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 84967.5us
W20260709 13:01:43.979161  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 95895.2us
I20260709 13:01:43.880638  1705 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:43.922466  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:43.954476  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.917896  2271 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:43.938235  1556 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:43.912578  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:43.915593  2268 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:43.942480  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:43.938767  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:43.922051  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:43.913003  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:43.843111  7235 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:43.883675  1558 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:43.942059  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.922819  2263 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:43.939749  1559 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:01:43.905364  1709 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 13:01:43.858211  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 164469us
I20260709 13:01:43.899978   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:43.843428  7431 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:44.047518  7431 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:44.051215  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 108047us
I20260709 13:01:43.885468  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1222) took 1343 ms. Trace:
I20260709 13:01:44.035090  1554 rpcz_store.cc:276] 0709 13:01:41.937408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.236590 (+299182us) service_pool.cc:224] Handling call
0709 13:01:42.272130 (+ 35540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.068011 (+795881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.883886 (+815875us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400182754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:43.884155 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633317120}
W20260709 13:01:44.053594  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 100906us
I20260709 13:01:44.039372  2262 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:43.904692  7462 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.512s	user 0.003s	sys 0.008s
W20260709 13:01:43.884970  7469 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:01:43.914103  7453 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.547s	user 0.000s	sys 0.011s
I20260709 13:01:43.908846  7421 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:43.892846  7334 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:43.946259  6961 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.925634  7276 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:43.928445  6846 raft_consensus.cc:3055] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:43.864563  1560 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.060782  2267 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:44.059554  6818 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:43.947577  7173 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:43.883204  7282 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.179s
I20260709 13:01:44.062255  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:43.907408  7447 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.063268  7347 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.103915  6942 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:44.104267  7347 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:44.104674  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:44.063963  2269 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:44.064082  7481 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:44.064998  7410 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:44.065732  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:43.854158  7242 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.106698  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.884477  6859 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:43.884091  7069 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.879974  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.894071  7446 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:44.082871  2264 raft_consensus.cc:2368] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16.
I20260709 13:01:43.909940  7159 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:44.052872  2266 rpcz_store.cc:276] 0709 13:01:42.541559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.541757 (+   198us) service_pool.cc:224] Handling call
0709 13:01:43.885070 (+1343313us) spinlock_profiling.cc:243] Waited 82.2 ms on lock 0x7b5400671e54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:43.885243 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189067136}
I20260709 13:01:43.946542  7325 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:43.880302  7341 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:43.891067  7402 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.081924  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:44.111742  1708 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:44.095391  6846 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:44.100287  1552 raft_consensus.cc:2368] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16.
I20260709 13:01:44.084901  7235 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:44.101260  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:43.984310  7435 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:44.109897  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47003.5us
I20260709 13:01:44.108341  1551 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
W20260709 13:01:44.111052  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.111321  1555 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:44.108906  7392 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:43.946869  7457 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:44.098960  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.100135  6818 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.116611  6971 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:44.116734  7159 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:44.117969  7242 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:44.101162  7455 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:01:44.102269  7173 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.101382  7228 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:01:44.118906  6846 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.123240  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:44.107225  6961 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:44.094367  7334 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
W20260709 13:01:44.235129  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.169252  2267 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
W20260709 13:01:44.211557  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.178655  2262 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:01:44.111424  7364 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.128996  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:44.109035  6859 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:44.129653  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:44.277734  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 149026us
I20260709 13:01:44.106638  7421 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:44.154166  7439 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.127580  6818 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:44.292519  6846 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.292888  7334 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:44.293404  7334 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:44.293108  7439 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.294370  7334 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.295753  7439 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:44.114111  7325 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.299854  7325 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:44.300388  7325 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:44.300804  7325 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:44.112774  7341 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.301638  7325 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:44.302722  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 174156us
I20260709 13:01:44.303591  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:44.129402  7392 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:44.304476  7446 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:44.305066  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:44.305874  7446 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:44.128260  7069 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:44.306384  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 192774us
I20260709 13:01:44.306398  7446 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:44.129871  6971 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.307981  7069 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:44.307662  7446 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.308887  7235 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.309443  1634 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:44.310228  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:44.310887  2262 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:44.287304  7364 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.256598  7255 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.303714  7341 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:44.313488  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:44.273005  6859 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.277643  7159 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.323138  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 241599us
I20260709 13:01:44.323300  1627 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
W20260709 13:01:44.325141  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 196234us
I20260709 13:01:44.295838  7334 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.308897  6971 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:44.331284  1455 catalog_manager.cc:5697] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 12 to 14, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:44.332374  7347 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:44.130373  7457 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.323731  7159 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.338338  1674 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:44.329566  7276 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:01:44.342269  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 142010us
I20260709 13:01:44.344420  7405 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:44.345839  7421 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:44.347532  6818 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:44.348112  7419 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.348176  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:44.349872  7488 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:01:44.351866  7327 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:44.355353  7173 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:44.326678  7255 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.369155  1560 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:44.370151  7431 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:44.370441  6961 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:44.371841  7148 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:01:44.380123  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46466.2us
I20260709 13:01:44.387924  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:44.409933  7148 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.410095  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:44.411142  1634 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:44.414184  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:44.415443  1599 leader_election.cc:400] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16.
I20260709 13:01:44.410446  7148 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:44.415760  1599 leader_election.cc:403] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:44.417035  1599 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:44.419116  7484 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:44.419577  7419 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:44.421317  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:44.423326  6942 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:44.423784  6942 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:44.424080  1634 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:44.425328  7159 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:44.424122  6942 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.426122  7421 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:44.426739  7421 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:44.427124  7421 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.430197  2267 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:44.430090  7410 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:01:44.432166  7364 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:44.372112  7276 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:44.433445  7276 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.435377  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:44.436161  7489 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:44.436161  7228 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:44.437004  7489 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:44.437980  7489 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.421965  2234 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:44.426191  7159 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:44.419672  7484 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:44.453008  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:44.436620  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:44.456262  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:44.417876  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:44.456844  1634 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:44.460177  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:44.461135  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 132197us
I20260709 13:01:44.463199  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.395570  7439 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:44.466166  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 48359.6us
I20260709 13:01:44.471210  1560 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:44.414621  7255 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:44.482131  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:44.474290  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 128141us
I20260709 13:01:44.484041  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:44.484587  1702 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.484472  2235 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:44.455421  7173 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:44.474762  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.486397  1704 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:44.467487  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:44.477156  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:44.453965  7405 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:44.491094  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:44.491315  7405 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.491885  7405 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.482013  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.494432  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.494812  1701 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:44.496187  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.496690  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.497392  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.497808  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.497891  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:44.498407  1700 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:01:44.499090  1702 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:44.499994  1704 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:44.500619  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:44.498417  1703 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:44.501263  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:44.501266  1554 raft_consensus.cc:2376] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13. Re-sending same reply.
I20260709 13:01:44.501760  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.502079  1558 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:44.504309  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.504969  1558 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:44.507920  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.508497  1558 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
W20260709 13:01:44.476919  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 139966us
I20260709 13:01:44.513473  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.514122  1554 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:01:44.498546  1560 raft_consensus.cc:2376] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17. Re-sending same reply.
I20260709 13:01:44.515203  1705 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:44.515239  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46172.5us
I20260709 13:01:44.408491  7069 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:01:44.464598  6961 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:44.479842  1455 catalog_manager.cc:5697] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 14 to 17, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.480643  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.464514  7228 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:44.409374  7487 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:01:44.525665  1706 raft_consensus.cc:2410] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:01:44.516031  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.529363  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.529982  1560 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:44.514780  7235 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.534567  7235 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.535866  7492 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.536463  7492 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.536996  7235 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:44.523641  6961 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:44.539003  6961 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:44.541262  6942 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.469247  7439 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:44.554574  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 118029us
W20260709 13:01:44.555583  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 451111us
I20260709 13:01:44.556877  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.558139  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.558439  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:44.558748  1703 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
W20260709 13:01:44.559767  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 53476us
I20260709 13:01:44.518580  7307 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:44.567068  1634 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:44.468370  7364 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:01:44.575729  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.579061  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:44.579684  2267 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:44.582088  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.582710  1703 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:44.583616  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.584168  1701 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:44.584709  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:44.585466  7325 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:44.586098  7325 raft_consensus.cc:697] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:44.586347  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.586884  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:44.587057  7325 consensus_queue.cc:237] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:44.587558  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:44.588068  1560 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:44.548318  7439 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.585734  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:44.591253  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 106881us
I20260709 13:01:44.591490  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.596778  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:44.592438  1704 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:44.562419  7307 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.585677  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:44.600099  6565 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:44.569015  7173 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:44.615574  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:44.562541  7431 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:44.620404  1524 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:44.591946  7235 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:44.577493  7228 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:44.617549  1455 catalog_manager.cc:5697] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 13 to 14, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:44.596011  7255 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:44.569015  7405 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.603214  7341 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:44.614689  7307 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:44.654289  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.588800  7494 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:01:44.623854  7235 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.598676  7447 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:01:44.625792  7242 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:44.661549  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:44.619041  7497 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:44.642616  7341 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:44.665283  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 152865us
I20260709 13:01:44.674391  6565 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:44.674769  6565 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:44.663337  7455 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:44.626139  7431 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:44.689024  1445 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4f1725fe36e349ac85405627f9c93d95 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:44.666646  7235 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:44.679021  7499 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:01:44.676002  6818 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:44.699214  6942 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:44.700021  7235 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.700609  7228 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:44.701411  7496 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.332s	user 0.000s	sys 0.003s
I20260709 13:01:44.703051  7500 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:44.670614  7497 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.706346  1455 catalog_manager.cc:5697] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 11 to 12, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 12 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:44.672426  7341 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:44.708352  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:44.708802  1455 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 12 to 14, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.710552  1705 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:44.681871  7493 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:44.684429  7148 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.664950  7484 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:44.687368  7435 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
W20260709 13:01:44.688110  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 102561us
I20260709 13:01:44.688556  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:44.707365  7497 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:44.679513  7421 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:44.714501  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.751367  1708 raft_consensus.cc:2393] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:01:44.673815  7402 consensus_meta.cc:287] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.558s	user 0.005s	sys 0.005s
W20260709 13:01:44.726630  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 113345us
W20260709 13:01:44.728168  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 66714.8us
I20260709 13:01:44.668291  7242 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:44.754340  1701 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:44.710388  7495 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:44.715150  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:44.739880  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 116628us
W20260709 13:01:44.740422  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 225970us
I20260709 13:01:44.745816  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:44.748401  6565 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:44.753203  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.748656  1455 catalog_manager.cc:5697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 11 to 12, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:01:44.753377  1700 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:01:44.762910  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:44.768122  7493 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:44.769137  7502 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:01:44.769269  7493 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.761286  7242 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:44.774443  7402 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:44.776263  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:44.777415  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.778122  7491 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:44.778198  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:44.778458  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.778661  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:44.779083  1556 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:44.779213  1555 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:44.779381  6565 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:44.779510  1554 raft_consensus.cc:2410] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:01:44.777526  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.780340  1551 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:44.780467  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:44.781086  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 66046.2us
I20260709 13:01:44.781570  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.782199  7455 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:44.782519  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:44.782722  7455 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:44.783242  7455 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.765532  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:44.774492  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 120105us
I20260709 13:01:44.797295  1455 catalog_manager.cc:5697] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 13 to 14, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:44.810389  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44931.4us
I20260709 13:01:44.812714  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:44.814052  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.814810  1557 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:44.751994  6846 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:01:44.818508  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.819555  7228 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:44.819999  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.820119  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:44.822686  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.828393  2269 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:44.824000  1707 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:44.830587  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:44.831406  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:44.764978  6971 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.839792  2264 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:01:44.842192  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.822587  7402 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:44.829543  6942 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:44.828284  7228 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:01:44.851749  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.862100  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:44.840569  7495 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:44.762527  7173 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:44.837582  7457 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:44.849960  7255 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:44.855362  6942 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.840713  7481 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:01:44.875826  1455 catalog_manager.cc:5697] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
W20260709 13:01:44.874989  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 91296.4us
W20260709 13:01:44.881386  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 69901.4us
I20260709 13:01:44.844702  6971 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:44.885303  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 74066.5us
I20260709 13:01:44.867478  7511 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:44.871054  7484 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:44.886324  1674 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:44.895782  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:44.897352  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:44.898005  1552 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:44.898353  7492 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:44.879330  7392 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:44.878219  6942 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:44.900496  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:44.903990  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.905274  7159 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16.
I20260709 13:01:44.891755  7228 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:44.906143  1556 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:44.903995  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:44.913193  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:44.884089  7405 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:44.922719  1552 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:01:44.933621  1673 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:44.935757  1553 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:44.926584  1455 catalog_manager.cc:5697] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 6 to 14, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:01:44.902743  6818 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:44.909668  6846 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:44.902907  7457 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:01:44.959201  1631 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:44.925925  7518 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:44.958684  6818 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.965806  6846 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.957056  7508 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.151s
I20260709 13:01:44.980542  7148 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:44.990321  7514 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.974373  7518 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.987454  6818 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:44.994148  7498 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:01:44.995493  7530 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:44.998301  1454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 234) took 22720 ms (client timeout 15000 ms). Trace:
I20260709 13:01:45.024827  1455 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 12 to 14, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:44.973119  7228 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:44.942662  6961 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:45.003086  6846 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:45.043399  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 159424us
I20260709 13:01:44.942950  7511 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:01:44.979790  7421 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:45.038412  7529 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:45.088013  7525 log.cc:927] Time spent T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:45.060400  7341 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:45.073987  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 183932us
I20260709 13:01:45.076498  2269 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:45.077252   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:45.022637  7518 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:45.086015  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:45.087643  7529 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.029511  7439 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.103698  1702 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:45.106884  7341 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:44.973444  7255 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:45.113137  7439 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:45.113962  7529 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:45.118831  6859 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.002s
I20260709 13:01:45.022197  7514 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:45.124258  6961 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:45.125133  7455 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.125288  7242 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:45.111070  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 197205us
I20260709 13:01:45.214370  7455 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:45.214481  7242 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:45.214865  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:44.985491  7495 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:45.090417  7491 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:45.130570  1455 catalog_manager.cc:5697] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.218371  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:45.219039  1557 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:45.219614  1455 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 8 to 2, term changed from 15 to 17, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193), VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194), VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195), VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:45.027899  7069 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 13:01:45.134415  2264 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:45.222146  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:45.222440  7529 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:01:45.136293  7534 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:45.222822  7529 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:45.223857  7529 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.225077  7529 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:45.138664  7435 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:45.139430  7173 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:45.226620  7173 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.143641  6565 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:45.228371  6565 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:45.222779  1552 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:45.025686  1454 rpcz_store.cc:269] 0709 13:01:22.125682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.125943 (+   261us) service_pool.cc:224] Handling call
0709 13:01:44.837502 (+22711559us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:38.387419 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:38.711733 (+324314us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:38.742728 (+ 30995us) write_op.cc:435] Acquired schema lock
0709 13:01:38.749835 (+  7107us) tablet.cc:662] Decoding operations
0709 13:01:38.771743 (+ 21908us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:38.771843 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:38.771874 (+    31us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:01:38.773699 (+  1825us) tablet.cc:701] Row locks acquired
0709 13:01:38.773750 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:01:38.773938 (+   188us) write_op.cc:270] Start()
0709 13:01:38.823845 (+ 49907us) write_op.cc:276] Timestamp: P: 1783602098773870 usec, L: 0
0709 13:01:38.908826 (+ 84981us) op_driver.cc:348] REPLICATION: starting
0709 13:01:38.964381 (+ 55555us) log.cc:844] Serialized 8323 byte log entry
0709 13:01:40.309935 (+1345554us) op_driver.cc:464] REPLICATION: finished
0709 13:01:40.613120 (+303185us) write_op.cc:301] APPLY: starting
0709 13:01:40.619631 (+  6511us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:40.893584 (+273953us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:40.893707 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:41.419646 (+525939us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:41.484014 (+ 64368us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:01:41.484087 (+    73us) write_op.cc:312] APPLY: finished
0709 13:01:41.484652 (+   565us) log.cc:844] Serialized 188 byte log entry
0709 13:01:41.634638 (+149986us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:41.655939 (+ 21301us) write_op.cc:454] Released schema lock
0709 13:01:41.674572 (+ 18633us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:41.749553 (+ 74981us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:41.755254 (+  5701us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1893,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":228089,"apply.run_cpu_time_us":42888,"apply.run_wall_time_us":1175041,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91865,"num_ops":21,"prepare.queue_time_us":252485,"prepare.run_cpu_time_us":9465,"prepare.run_wall_time_us":668542,"raft.queue_time_us":553278,"raft.run_cpu_time_us":10164,"raft.run_wall_time_us":126395,"replication_time_us":1400935,"thread_start_us":1046337,"threads_started":5,"wal-append.queue_time_us":301573,"wal-append.run_cpu_time_us":23422,"wal-append.run_wall_time_us":3463586}]]}
W20260709 13:01:45.146071  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 212595us
W20260709 13:01:45.146435  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 99877.7us
I20260709 13:01:45.204830  6859 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.206446  6942 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.208070  7514 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:45.241184  1552 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:45.208623  6846 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.215315  2267 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:45.230628  2235 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:45.231873  1557 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:45.235736  6565 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.245483  1600 leader_election.cc:400] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16.
I20260709 13:01:45.250497  2235 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:45.246943  1455 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 9 to 13, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:45.232088  6961 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:01:45.247036  7518 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.257161  1557 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:45.258939  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:45.268375  1560 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:45.259578  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:45.261180  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:45.267028  1709 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:45.269325  1554 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:45.232749  7455 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:45.271437  1552 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:45.235428  7173 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:45.260706  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:45.272966  1601 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:45.273465  1553 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:45.274700  6565 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:45.260619  1455 catalog_manager.cc:5697] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 9 to 13, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:45.235991  6859 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:45.253204  7439 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:45.282936  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:45.284830  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:45.285401  1557 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:45.285844  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:45.286468  1552 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:45.257536  7242 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:45.281229  7486 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:01:45.292905  7533 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:45.297778  7431 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:45.301484  7486 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:45.302002  7486 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:45.306453  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:45.307123  1557 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:45.307181  7486 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:45.308511  7486 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:45.274708  7497 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.303493  1705 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:45.310575  1557 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:01:45.314869  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:45.315735  1560 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
W20260709 13:01:45.341405  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.343875  1560 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:01:45.345171  6846 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:45.345794  1455 catalog_manager.cc:5697] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 7 to 11, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.281664  7455 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:01:45.349511  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 54797.3us
I20260709 13:01:45.359922  6818 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:45.361299  7497 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:45.361410  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.261178  7484 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:01:45.362397  7518 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:45.256376  7540 consensus_queue.cc:1059] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.114s
I20260709 13:01:45.363623  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.434885  2263 raft_consensus.cc:2410] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:01:45.434779  7486 raft_consensus.cc:3055] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:45.364828  2262 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:45.364936  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.436182  1455 catalog_manager.cc:5697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.437108  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:45.365407  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.365566  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:45.366457  1634 raft_consensus.cc:1217] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 11.11->[12.12-12.12]   Dedup: 12.12->[]
I20260709 13:01:45.438443  1455 catalog_manager.cc:5697] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 9 to 11, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.439548  1634 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:01:45.367403  2268 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:45.367568  1627 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:45.367939  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.368177  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:45.440727  1455 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 9 to 11, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 11 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.368609  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.460881  1628 raft_consensus.cc:2410] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:01:45.368892  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:45.369483  1633 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:45.370811  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:45.374481  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:45.375850  7307 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.709s	user 0.007s	sys 0.003s
I20260709 13:01:45.341873  7507 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:01:45.377415  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.377434  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.379496  7533 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:45.380636  7439 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:45.384963  1701 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:45.385191  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:45.389881  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.391863  7235 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:45.393002  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:45.394107  7514 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:45.397601  1551 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:01:45.397691  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:45.476320  1703 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:01:45.476197  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 78574.4us
I20260709 13:01:45.475589  1551 pending_rounds.cc:85] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 8
W20260709 13:01:45.399822  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.403571  1553 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
W20260709 13:01:45.478415  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 85492us
I20260709 13:01:45.415998  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:45.417146  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:45.479602  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.418944  7447 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.422503  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.423226  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.423918  7421 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:45.426436  7497 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:45.427999  7276 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:45.430083  7551 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:45.421669  6818 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:45.364293  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.368403  6942 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:45.442189  1635 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:45.443181  7455 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:45.446206  7282 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:01:45.455330  7519 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.482s	user 0.000s	sys 0.010s
I20260709 13:01:45.458652  7486 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:45.453686  6971 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:45.518111  1556 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:01:45.468683  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:45.518662  1556 pending_rounds.cc:85] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 10
I20260709 13:01:45.518940  1555 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:45.469264  2264 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:45.472407  1706 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:45.477178  1551 pending_rounds.cc:107] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:01:45.479566  1560 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:45.520206  1551 raft_consensus.cc:2889] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:45.410840  1554 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:45.474798  7514 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:45.479090  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:45.486832  6961 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:45.494369  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:45.495076  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.494994  7421 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.525799  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:45.495819  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.495913  7518 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:45.496446  7235 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:45.503260  1631 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:45.532539  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:45.506677  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:45.533203  1700 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.512465  2271 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:45.513329  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:45.514703  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.513931  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.517364  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.462177  1559 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:45.533655  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:45.530895  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:45.518971  1556 pending_rounds.cc:107] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:01:45.535137  2262 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:45.535342  1556 raft_consensus.cc:2889] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:45.402598  7512 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.429s	user 0.000s	sys 0.003s
I20260709 13:01:45.523509  1557 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:45.525283  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.526422  2269 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:45.523820  1628 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:45.525432  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.539670  2268 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:45.529582  1553 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:45.529407  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.531437  2267 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:45.540933  2265 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:45.541597  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:45.545356  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:45.546455  1554 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:45.518061  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:45.536665  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:45.468119  7307 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.550899  2263 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:45.525796  6846 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:01:45.553508  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:45.556906  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:45.559206  7538 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:45.559818  7538 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:45.560858  7495 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:45.560736  7538 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.561326  7327 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:01:45.562763  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44806.9us
I20260709 13:01:45.498348  7447 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:45.563555  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:45.526928  7497 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:45.526161  7544 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:45.529227  7435 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.571062  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:45.570459  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.533002  6961 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:45.574693  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:45.576834  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 168770us
I20260709 13:01:45.603237  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.603869  1554 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:45.564877  6942 raft_consensus.cc:3055] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:45.612118  2269 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:45.570379  7242 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:01:45.574054  7457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.032s	sys 0.019s
W20260709 13:01:45.617146  7457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.032s	sys 0.019s
I20260709 13:01:45.617681  7500 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:45.618295  7500 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:45.619426  7500 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.621165  7500 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:45.577605  7435 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.622292  7497 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:45.622869  7497 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.624109  7435 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:45.609735  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:45.626091  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.626523  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.627305  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.627561  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.628415  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:45.628553  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.629606  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:45.611069  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.630781  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:45.568257  7530 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.631403  7242 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:45.632421  7242 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.631549  7530 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.609613  7173 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:45.635092  7173 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:45.635342  7530 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:45.636096  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:45.636662  1707 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:45.636371  7173 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.639528  7421 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:45.641862  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.646348  1600 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:01:45.651541  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.608227  1560 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:45.654541  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:45.654598  1635 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:01:45.655319  1560 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:45.655951  1634 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:45.548621  7235 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.660787  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.661885  1635 raft_consensus.cc:2368] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16.
I20260709 13:01:45.665784  2262 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:45.668606  1628 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:45.680217  1707 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:45.674561  7487 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:45.681927  7550 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:45.684319  7276 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:45.611845  6942 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:45.695827  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 94295.5us
I20260709 13:01:45.720999  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.726148  1628 raft_consensus.cc:2368] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13.
I20260709 13:01:45.701304  1700 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:45.699767  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:45.706189  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.707541  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:45.708209  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:45.729446  1708 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:45.678967  7431 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.730320  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.732348  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:45.734808  1560 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:01:45.740883  7242 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:45.704131  7529 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:01:45.741611  7242 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:45.742764  7242 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.743409  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:45.744074  1709 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
W20260709 13:01:45.746076  7552 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:01:45.746742  7307 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:45.747887  1626 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:45.704380  7487 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.754281  7487 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:45.758800  7447 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:45.604769  7486 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.762240  7431 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.763705  7235 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:45.764516  7431 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:45.765868  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:45.766634  1708 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:45.767400  1707 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:45.772517  7491 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:45.773260  7491 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:45.773769  1560 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:45.774199  1560 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:45.775030  1560 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.776003  1560 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:45.779444  2236 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:45.780622  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:45.781631  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:45.782837  6846 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:45.773284  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.786645  1526 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:45.788282  7446 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:45.788697  7446 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.789021  7446 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:45.788952  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:45.789938  2262 raft_consensus.cc:2410] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:45.791554  2262 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:45.792073  1557 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:45.792002  7491 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:45.793049  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.793393  1557 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:45.794907  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:45.797243  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.797919  2269 raft_consensus.cc:2368] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13.
I20260709 13:01:45.800979  1555 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:45.806968  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:45.785398  1628 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:45.808147  1559 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:45.809382  1559 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:45.811937  1631 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:45.813131  1555 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:45.814054  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:45.816394  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 51028.4us
I20260709 13:01:45.817948  1631 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:45.818290  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:45.818552  1627 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:01:45.826639  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:45.832430  1560 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:45.785396  6961 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:45.851869  7527 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:45.852330  7527 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:45.853132  7527 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.807112  7439 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:45.854315  7439 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.783967  6846 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:45.838467  1702 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:45.838433  1700 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:45.833052  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:45.855903  7527 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:45.856977  2266 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:45.858796  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.845891  1628 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:45.847710  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.863540  2264 raft_consensus.cc:2368] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13.
I20260709 13:01:45.848906  1630 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:45.815546  7235 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:45.837695  7556 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:01:45.818974  7173 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:45.854779  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2625) took 1343 ms. Trace:
I20260709 13:01:45.865928  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:45.830900  6971 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:45.869661  1558 rpcz_store.cc:276] 0709 13:01:44.511796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.512082 (+   286us) service_pool.cc:224] Handling call
0709 13:01:44.519194 (+  7112us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.546682 (+ 27488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.546714 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.588616 (+ 41902us) log.cc:844] Serialized 26 byte log entry
0709 13:01:44.856614 (+267998us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:44.856653 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.856720 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.401832 (+545112us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:45.685555 (+283723us) raft_consensus.cc:1685] finished
0709 13:01:45.685602 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.854633 (+169031us) spinlock_profiling.cc:243] Waited 6.79 ms on lock 0x7b54003d95d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:45.854732 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58,"raft.queue_time_us":288,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":12289,"spinlock_wait_cycles":37723776,"thread_start_us":264302,"threads_started":1,"wal-append.queue_time_us":295293}
I20260709 13:01:45.871481  1707 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:45.875542  1708 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:45.887122  2266 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:45.854818  7439 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:45.872120  7538 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:45.896463  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.899935  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:45.905689  7487 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:45.907907  7487 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:45.908851  6846 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:45.909663  1626 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:45.742779  6942 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.872484  7489 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.917402  2262 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:45.868112  7491 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:45.917384  2266 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:45.872257  7435 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.872165  7173 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.897683  6971 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:45.923810  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.960166  2264 raft_consensus.cc:2368] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16.
I20260709 13:01:45.924126  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:45.928195  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.953312  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.887233  7235 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:45.965200  7489 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.968019  7489 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:45.962927  7435 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.970942  7435 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:45.971954  2271 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: []
W20260709 13:01:45.973450  7568 log.cc:927] Time spent T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:45.965283  6971 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.974923  6942 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:45.981042  7497 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:45.982439  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:45.984732  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:45.987421  7493 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:45.987939  7493 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:45.995906  7562 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
W20260709 13:01:46.006258  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 106461us
I20260709 13:01:46.007190  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:46.007984  6961 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:46.008582  7392 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:46.008962  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:46.009840  7431 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:45.921768  7538 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.009861  7491 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:46.011237  7491 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:46.012568  7538 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:46.012351  7491 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:45.925846  7173 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:46.013907  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:46.014657  7491 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:46.015601  1634 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:45.920590  7533 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:46.023649  7533 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:46.024834  7533 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:46.027096  7447 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:45.984751  7514 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:46.031821  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.033000  2235 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:46.034701  1553 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:46.035130  1553 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:46.036134  1553 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.037331  1553 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:46.039536  1556 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:46.039419  7235 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:46.042816  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.042521  7439 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:46.043519  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.973304  1524 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:46.057188  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 83976.4us
I20260709 13:01:46.057909  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:46.058648  1524 leader_election.cc:400] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13.
I20260709 13:01:46.059303  1524 leader_election.cc:403] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:46.046840  6846 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:46.050997  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:46.058779  1628 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:46.045109  7500 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:46.045903  7242 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:46.064412  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:46.065285  1524 leader_election.cc:400] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13.
W20260709 13:01:46.071971  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 62105.6us
W20260709 13:01:46.072628  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.077095  1524 leader_election.cc:403] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:46.078413  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:46.079941  6565 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13.
I20260709 13:01:46.080679  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:46.087858  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:46.088800  1634 raft_consensus.cc:2410] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:01:46.092497  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:46.093413  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:46.094933  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:46.092517  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:46.096604  1630 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:46.091491  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:46.100677  2266 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:46.100771  1706 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:46.103076  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:46.104648  7565 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:46.108317  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:46.070703  7255 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:46.112272  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:46.071009  6846 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.113387  2271 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:46.068396  7514 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13.
I20260709 13:01:46.159024  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:46.160943  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:46.158761  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:46.176373  1631 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:46.177469  7439 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:46.179261  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:46.180403  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:46.181388  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:46.181766  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:46.092110  7518 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:01:46.182991  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:46.141893  1553 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:46.186190  1631 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:46.186975  1627 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:46.162773  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:46.185361  7480 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:46.189419  7480 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:46.189690  2265 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:46.190397  7480 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:46.191459  7480 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:46.193017  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:46.186112  1634 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:46.187110  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:46.200409  1631 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:46.127579  7497 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:46.206892  7497 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:46.212503  7551 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:01:46.214402  7567 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
I20260709 13:01:46.161334  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:46.201300  1627 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:46.218012  7486 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:46.086560  7527 raft_consensus.cc:2764] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:01:46.109404  7435 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:01:46.201687  6846 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:46.219494  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.220357  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 63546.9us
I20260709 13:01:45.988870  7493 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.112901  7550 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:46.156594  7446 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:46.098076  7533 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:46.265954  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 154165us
I20260709 13:01:46.095603  7392 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.178s
I20260709 13:01:46.267755  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:46.115777  6565 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:46.254230  1628 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:46.280701  6565 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:46.253798  1630 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
I20260709 13:01:46.100437  7500 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.149372  7173 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.102284  7538 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.100s
I20260709 13:01:46.274066  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:46.116204  7565 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:46.294368  2271 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 18 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:46.208163  7497 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.271699  7282 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:46.287447  6565 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.157138  7419 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.140s
I20260709 13:01:46.276283  7550 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:46.305204  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:46.276080  7514 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:01:46.279958  7542 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:01:46.294400  7255 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.311026  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.325315  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 225980us
I20260709 13:01:46.303958  7282 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:46.308442  7550 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.333607  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:46.309870  7565 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:46.337026  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 242694us
I20260709 13:01:46.338068  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:46.339691  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:46.339927  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:46.341749  2262 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:46.346808  1703 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:46.346938  2271 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:46.344286  7551 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:01:46.311427  6961 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:46.378587  2264 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:46.386456  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:46.388868  7282 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.389600  1553 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:46.392781  1629 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:46.328091  7255 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:46.402755  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.406322  6961 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:46.423148  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.393409  7518 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.395740  7565 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:46.443228  7446 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:46.446376  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:46.447158  1552 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:46.430454  7518 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.430851  7506 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.474103  1552 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
W20260709 13:01:46.475189  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 394608us
I20260709 13:01:46.476480  1524 leader_election.cc:400] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16.
I20260709 13:01:46.480866  1524 leader_election.cc:403] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:46.478324  2235 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:46.505510  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.505595  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 293403us
I20260709 13:01:46.506537  1524 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:46.508008  7159 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:46.510133  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:46.510351  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:46.510998  7498 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:46.511487  7498 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:46.512723  7586 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.512470  7498 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:46.486622  7500 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:46.494202  7446 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16.
I20260709 13:01:46.513350  7586 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:46.523635  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.536238  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.470995  7506 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:46.523828  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.500042  7173 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:46.541567  6565 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:46.543489  2263 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:46.493772  7514 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:01:46.524684  6859 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:46.514006  7498 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:46.493463  7582 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
W20260709 13:01:46.637358  7584 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:01:46.514636  7518 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:46.533066  6846 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:46.548151  7544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.000s	sys 0.015s
I20260709 13:01:46.613526  6961 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:46.624305  7586 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:46.625090  7514 consensus_queue.cc:1243] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:46.625670  6565 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:46.626214  7446 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.628620  7581 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:46.629169  7173 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:46.605011  7500 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.606393  6859 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:46.516795  7585 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.145s
W20260709 13:01:46.643864  7544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.000s	sys 0.016s
W20260709 13:01:46.656760  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 323226us
I20260709 13:01:46.665222  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:46.676299  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:46.677230  1560 raft_consensus.cc:2410] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:01:46.678197  6565 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.678771  6565 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:46.681268  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:46.653676  7586 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:46.652464  7514 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:46.661445  6961 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.703166  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:46.703503  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:46.661907  7544 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:46.708567  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:46.662232  7581 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:46.710659  1557 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:46.655304  7446 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:46.709614  6565 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:46.691622  7565 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:46.662302  7173 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.692938  7586 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:01:46.710798  7587 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:01:46.663424  7500 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:46.727351  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 62179.1us
W20260709 13:01:46.732177  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.752344  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:46.755290  1560 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:46.715773  7579 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.761999  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.762919  7565 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:46.763972  1557 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:46.764909  1673 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:46.769251  7593 raft_consensus.cc:2764] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:46.770263  7544 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.710294  6961 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.708748  7514 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.758672  7282 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.780472  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:46.712252  6859 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.791427  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:46.794982  1552 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:46.799060  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:46.799906  1560 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:46.805343  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 295327us
I20260709 13:01:46.812563  1673 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:46.806402  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:46.814889  1524 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:46.815867  6565 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:46.817220  1524 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:46.818823  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:46.820344  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:46.827118  1558 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:46.771699  7579 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.817351  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:46.831204  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 352989us
I20260709 13:01:46.838379  1560 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:46.839653  6565 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:46.842569  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.803654  7514 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:46.843753  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:46.844966  1634 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:46.848668  1632 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:46.809494  6859 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:46.847131  6565 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:46.847730  1630 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:46.851315  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:46.854496  1633 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:46.807150  7590 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:46.856663  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:46.797051  7282 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.862242  7431 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:46.828625  6846 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:46.826773  7595 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:46.870170  2268 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:01:46.871655  2234 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:46.840459  7565 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:46.787545  7586 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.885349  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:46.885823  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.886713  6565 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:46.891110  6565 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.894948  2269 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:46.867120  7514 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:46.845184  7593 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:01:46.912375  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:46.872103  7431 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:46.918119  1558 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:01:46.918645  6565 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:46.810215  7581 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.896484  7506 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:46.862370  7591 consensus_queue.cc:1059] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:01:46.931708  1557 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:46.866845  7455 consensus_queue.cc:1059] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:01:46.903335  7565 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:01:46.956679  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 136445us
I20260709 13:01:46.937536  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2586) took 1376 ms. Trace:
I20260709 13:01:46.959219  1556 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:46.959474  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:46.939220  7550 consensus_meta.cc:287] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.002s
I20260709 13:01:46.939679  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:46.966967  1558 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:46.946403  7604 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:46.948602  7228 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:46.933331  7500 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:46.930832  7282 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:46.954993  7592 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
W20260709 13:01:46.932628  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 61416.6us
I20260709 13:01:46.958213  1632 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:46.959240  1629 rpcz_store.cc:276] 0709 13:01:45.560801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.630576 (+ 69775us) service_pool.cc:224] Handling call
0709 13:01:46.937364 (+1306788us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b540006ccd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:46.937478 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1702806400}
I20260709 13:01:46.966050  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:46.928812  7431 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:46.929662  7586 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:46.935519  7173 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:47.007800  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.050870  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 67488us
I20260709 13:01:47.058130  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:47.051353  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 67629.6us
W20260709 13:01:47.058648  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 92718.7us
I20260709 13:01:47.058794  2269 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
W20260709 13:01:47.059074  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.957034  7506 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:47.059571  1524 leader_election.cc:400] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16.
I20260709 13:01:47.058832  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:47.060587  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:47.061709  6565 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:47.062551  6565 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:47.074664  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:47.079510  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:46.959125  7446 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:46.967522  7514 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:47.081275  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:47.087754  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:47.088889  2234 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:46.967949  7578 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:46.973049  7228 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:47.092772  1524 leader_election.cc:400] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13.
I20260709 13:01:47.049226  7492 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.973266  7550 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.091569  7604 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:47.099295  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 214056us
I20260709 13:01:47.082719  6961 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:47.110989  1705 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:47.114845  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.122071  7544 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:47.122936  7544 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.125551  7544 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:47.125801  7565 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.127069  7506 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:47.127621  7447 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.128017  7506 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:47.128170  7447 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.129554  7497 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:47.129969  7497 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:47.130777  7497 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.131863  7447 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:47.132016  7497 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:47.096504  7578 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.094411  7603 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:01:47.088340  6846 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:47.134125  7492 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.143728  7605 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:47.144302  7605 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:47.146456  1558 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:47.137533  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:47.142957  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 54158us
I20260709 13:01:47.132584  7544 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.159621  2235 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:47.159500  7544 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.100018  7446 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:47.074432  7439 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 13:01:47.135552  7498 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:01:47.187047  6565 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:47.132192  7590 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:47.134684  7579 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:47.134414  7593 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:47.247133  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 81401.9us
I20260709 13:01:47.164275  7447 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:47.249794  1558 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:47.267648  1524 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:47.274796  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:47.161757  7544 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:47.162740  7611 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:47.247145  7604 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:47.332010  6565 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:47.331678  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 51282.2us
I20260709 13:01:47.137213  7601 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.135s
I20260709 13:01:47.337397  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:47.266930  7498 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:01:47.347553  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.267894  6859 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.288725  7579 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:47.355554  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:47.356424  2266 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:47.357383  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:47.357985  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:47.358278  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:47.358565  1632 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:47.358946  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:47.359503  2270 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:47.359647  1634 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:47.360294  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:47.360882  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.352820  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:47.353915  6565 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:47.358050  2267 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:47.362068  6565 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:47.362355  1524 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.597s (SENT)
I20260709 13:01:47.363938  2268 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:47.366210  1629 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 13:01:47.249822  7602 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:01:47.335539  7514 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:47.350756  7446 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:47.376538  1630 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:01:47.372732  1629 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:47.349720  7498 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:47.387543  1632 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:47.387926  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:47.389038  7565 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:47.389691  7565 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.390244  7585 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:01:47.393379  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.394273  7565 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:47.394692  7532 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:47.395519  7565 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:47.395391  7532 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.403309  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:47.407848  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1079) took 1877 ms. Trace:
I20260709 13:01:47.408422  1705 rpcz_store.cc:276] 0709 13:01:45.530181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.530287 (+   106us) service_pool.cc:224] Handling call
0709 13:01:45.530559 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.148845 (+1618286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.407534 (+258689us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54000a6ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:47.407768 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3634434944}
I20260709 13:01:47.410020  7565 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:47.411911  7542 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:47.412461  7542 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.373104  7611 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.363783  7544 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:47.371973  7492 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:47.429605  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.430557  1627 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:47.281498  7593 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.426326  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.432047  1626 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:47.427708  7532 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:01:47.427798  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.436184  1635 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:47.428404  1700 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:47.433553  1705 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:01:47.290402  7447 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.389277  6961 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:47.436625  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.440690  1630 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
W20260709 13:01:47.437090  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 74786.5us
I20260709 13:01:47.437646  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:47.440321  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.415110  7602 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:47.364329  6859 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.446871  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:47.456544  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.461233  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.461887  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.457782  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:47.462356  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.462895  1628 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:47.430228  7614 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.412846  7565 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.385988  7603 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:01:47.467130  1627 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:01:47.466830  7614 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.469039  7614 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:47.386868  7605 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:47.470690  7615 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:01:47.474406  7597 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.628s	user 0.006s	sys 0.006s
I20260709 13:01:47.480397  7565 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:47.480845  7491 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:47.481220  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1292) took 1127 ms. Trace:
I20260709 13:01:47.481436  7491 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:47.481693  2265 rpcz_store.cc:276] 0709 13:01:46.353346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.411202 (+ 57856us) service_pool.cc:224] Handling call
0709 13:01:46.411605 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.807958 (+396353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.808004 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.830522 (+ 22518us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.967794 (+137272us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:01:46.967831 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.967905 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.480988 (+513083us) raft_consensus.cc:1685] finished
0709 13:01:47.481011 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.481160 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":154988,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":9972,"thread_start_us":473171,"threads_started":2,"wal-append.queue_time_us":393400}
I20260709 13:01:47.482599  7491 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.429569  7611 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.484018  7491 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:47.484818  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:47.485467  1556 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:01:47.485560  7611 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:47.439683  7533 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.159s	user 0.011s	sys 0.004s
I20260709 13:01:47.495479  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:47.496243  1556 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:47.456492  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:01:47.503504  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.461383  7590 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:47.507583  1634 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:01:47.508085  1634 pending_rounds.cc:85] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 12
I20260709 13:01:47.508378  1634 pending_rounds.cc:107] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:01:47.508664  1634 raft_consensus.cc:2889] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:47.459961  7446 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:47.436445  7431 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:47.515486  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.503957  7612 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:01:47.523025  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 411898us
I20260709 13:01:47.532236  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.533632  1708 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:47.453291  6961 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.497020  7602 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:47.437038  7544 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.514115  7435 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:47.552163  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 164369us
W20260709 13:01:47.545352  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 88966.9us
I20260709 13:01:47.464178  7579 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:01:47.505091  7542 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:47.564687  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:47.486541  7498 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.567852  7604 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:47.568706  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 165516us
I20260709 13:01:47.571283  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:47.578469  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:47.578616  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:47.589886  7255 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:47.593595  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1276) took 1745 ms. Trace:
W20260709 13:01:47.594313  7599 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.725s	user 0.003s	sys 0.025s
I20260709 13:01:47.593657  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:47.596036  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1055) took 1209 ms. Trace:
I20260709 13:01:47.594075  2263 rpcz_store.cc:276] 0709 13:01:45.848531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.848653 (+   122us) service_pool.cc:224] Handling call
0709 13:01:46.543223 (+694570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.595677 (+ 52454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.593400 (+997723us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b5400521a50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:47.593539 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591923968}
I20260709 13:01:47.596520  1554 rpcz_store.cc:276] 0709 13:01:46.386697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.386852 (+   155us) service_pool.cc:224] Handling call
0709 13:01:46.388937 (+  2085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.437188 (+ 48251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.437233 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.441984 (+  4751us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.797925 (+355941us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:46.797977 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.945128 (+147151us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b54003ea8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:46.945176 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.593677 (+648501us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:47.595833 (+  2156us) raft_consensus.cc:1685] finished
0709 13:01:47.595854 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.595984 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2737,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4772,"spinlock_wait_cycles":178746880,"thread_start_us":325622,"threads_started":1,"wal-append.queue_time_us":416062}
I20260709 13:01:47.551700  7612 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:47.606475  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.551862  6971 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:47.535984  7235 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:01:47.608970  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:47.609601  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:47.634492  2271 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:47.610241  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:47.635349  2265 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:47.635730  1702 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
W20260709 13:01:47.610689  7616 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
W20260709 13:01:47.611440  7620 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:01:47.611974  7500 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:47.613454  7595 consensus_meta.cc:287] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.000s
I20260709 13:01:47.645558  7595 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:47.614779  7447 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:47.646910  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.648422  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.654104  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.615535  7544 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:47.615604  7593 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:47.538944  7173 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:01:47.600324  7579 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:47.520704  7446 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.596057  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:47.672334  2268 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:47.605351  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:47.628713  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:47.629114  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:47.674229  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 45621.6us
I20260709 13:01:47.674587  1705 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:47.632890  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.674998  1673 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:47.675330  1709 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:47.639966  6859 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:47.676424  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:47.674234  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 68787.8us
I20260709 13:01:47.640422  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.644594  7634 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:01:47.650008  1707 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:47.636338  7532 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:01:47.658003  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.563185  7435 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.658203  7602 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.665902  6961 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:47.635257  7255 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:47.666450  7591 raft_consensus.cc:3055] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:47.674429  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.677098  1709 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:47.636103  1702 pending_rounds.cc:85] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 10
I20260709 13:01:47.699265  1702 pending_rounds.cc:107] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:01:47.699627  1702 raft_consensus.cc:2889] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:47.607167  1704 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:47.677911  1700 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
W20260709 13:01:47.679349  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.655422  7242 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:47.669883  7579 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:47.690375  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 159425us
I20260709 13:01:47.790241  1600 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:47.694401  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:47.635397  6971 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.698516  7590 consensus_queue.cc:1059] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:47.809266  1600 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:47.666536  7604 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.677800  7595 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:47.728852  7446 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:47.651604  7612 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.687292  7542 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:01:47.728531  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.812487  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.696785  7255 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:47.744405  1701 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:47.757676  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:47.818243  1704 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:47.760907  1709 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:47.818430  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.710264  7593 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:47.789491  7282 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:47.687367  6846 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.012s	sys 0.020s
I20260709 13:01:47.698475  7591 raft_consensus.cc:740] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:47.703392  7544 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:47.791781  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.835114  1701 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:01:47.835361  6971 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:47.835976  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:47.790926  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 43530us
I20260709 13:01:47.755985  1707 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:01:47.814098  7595 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.838846  7435 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:47.841176  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.809866  7635 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:01:47.823177  7446 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:47.842650  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:47.843469  1702 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 11: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:47.843626  7282 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:47.794459  7631 log.cc:927] Time spent T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.178s	user 0.001s	sys 0.002s
I20260709 13:01:47.823740  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.852203  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.853591  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.758591  7532 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:47.865608  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.827637  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.866636  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:47.828504  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.867376  1700 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:01:47.830469  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:47.791497  7579 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.792491  7582 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.822868  7255 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:47.811375  7242 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.877045  1704 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:47.854871  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:47.838884  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:47.726698  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:47.864022  1705 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
W20260709 13:01:47.879875  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 313231us
I20260709 13:01:47.880718  1700 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:47.867657  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:47.829216  7497 consensus_meta.cc:287] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.692s	user 0.013s	sys 0.001s
I20260709 13:01:47.871665  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:47.832314  6846 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.012s	sys 0.021s
I20260709 13:01:47.869720  7639 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:47.873833  1634 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:47.792454  7622 consensus_queue.cc:1059] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:01:47.883980  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:47.875144  7282 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:47.931675  1552 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:01:47.885113  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46327.4us
I20260709 13:01:47.866361  7595 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:47.869541  7455 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.892493  1557 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:47.872741  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:47.886631  7518 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:47.938884  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:47.896932  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:47.943387  1560 raft_consensus.cc:2393] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:47.944584  1557 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:01:47.891523  7635 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:47.937644  1627 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 11.
I20260709 13:01:47.872313  7532 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.930670  7480 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:47.948094  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:47.934180  7625 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:47.951431  1560 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:47.883292  7637 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:01:47.962455  1560 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:01:47.964677  1560 pending_rounds.cc:85] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 8
I20260709 13:01:47.942009  7518 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:47.964993  1560 pending_rounds.cc:107] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:01:47.972229  1560 raft_consensus.cc:2889] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:47.950169  7626 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:47.879735  7582 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:47.978288  7242 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:47.959605  7601 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:47.961475  7590 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:47.936504  7455 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:47.972229  7586 consensus_meta.cc:287] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.898s	user 0.007s	sys 0.005s
I20260709 13:01:47.979595  7639 raft_consensus.cc:697] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:47.982946  7626 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.988016  7639 consensus_queue.cc:237] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.990228  7582 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:47.991329  7622 raft_consensus.cc:3055] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:47.991708  7622 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:47.992517  7622 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.993703  7622 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:47.995297  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:47.996461  1674 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:47.972640  7634 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:47.998238  6961 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:47.998607  7624 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:47.998389  7634 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:47.972606  7493 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.000540  1674 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:47.986778  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 175597us
I20260709 13:01:48.005167  1559 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:01:47.947767  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 136568us
I20260709 13:01:48.009429  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:48.011788  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 131327us
I20260709 13:01:48.012965  1599 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:47.986310  7590 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.998643  6961 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:48.026304  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 332010us
I20260709 13:01:47.999178  7624 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:48.018474  7623 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:48.012012  7431 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:47.991724  7228 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.037559  7228 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:48.038722  7532 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.040357  7634 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:48.025540  7590 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:48.043671  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:48.044263  1556 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:48.045825  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:48.049489  1709 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:01:48.050678  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:48.052085  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:48.052824  1560 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:48.029546  6961 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:48.032994  7624 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:48.074844  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.067651  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:48.009580  7493 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.081269  1526 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:48.232188  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 151046us
W20260709 13:01:48.233021  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 221610us
I20260709 13:01:48.233772  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:48.238379  1551 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:48.239842  1557 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:48.233196  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:48.254529  7447 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:48.255179  7447 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.255640  7447 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:48.267020  7656 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:01:48.048817  7446 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:48.270243  7634 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.271148  7659 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
I20260709 13:01:48.270854  7634 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:48.303129  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 69436.9us
I20260709 13:01:48.063272  7542 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:48.035554  7491 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.240s
I20260709 13:01:48.024437  7518 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.233625  7514 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.320964  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.329385  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 316548us
I20260709 13:01:48.311564  7623 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:48.314525  7582 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.314845  6846 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:48.346973  7527 raft_consensus.cc:3055] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:48.310948  7532 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:01:48.311102  7635 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:01:48.310801  7431 consensus_queue.cc:1059] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:01:48.312095  7586 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:01:48.342633  7514 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.245393  7595 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.361510  7446 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:48.356602  7623 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:48.359359  7518 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:48.360232  7634 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:48.399714  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 376611us
I20260709 13:01:48.400731  7455 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.401682  1634 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:01:48.379501  7527 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:48.368333  7582 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.413450  1555 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:48.399801  7282 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:48.399354  7623 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:48.429214  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:48.380220  6846 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:48.431021  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.427634  7282 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.438917  7455 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.469569  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1068) took 1327 ms. Trace:
I20260709 13:01:48.469996  1558 rpcz_store.cc:276] 0709 13:01:47.142600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.160407 (+ 17807us) service_pool.cc:224] Handling call
0709 13:01:47.160730 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.272798 (+112068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.469228 (+1196430us) spinlock_profiling.cc:243] Waited 88.8 ms on lock 0x7b54002dc3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:48.469484 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204288384}
W20260709 13:01:48.474947  7666 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:01:48.463259  7661 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.479511  7661 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.481729  7661 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.457110  7282 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:48.452612  7527 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:48.467947  7255 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.585s	user 0.016s	sys 0.001s
I20260709 13:01:48.483703  7498 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:48.451431  7392 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:48.484283  7455 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.498953  7493 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:48.511169  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.516217  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.517722  7582 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:48.520879  1709 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14. Ops: [13.14-13.14]
W20260709 13:01:48.521075  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.516682  7527 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:48.519619  7578 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:48.540298  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:48.544683  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 131519us
I20260709 13:01:48.547463  1601 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:48.548147  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:48.515697  7392 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.549767  1558 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:01:48.550660  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:48.552475  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 310818us
I20260709 13:01:48.555729  1551 raft_consensus.cc:2410] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:01:48.556216  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:48.573634  7664 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:01:48.574224  7514 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.548898  7680 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.583221  7579 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.000s
W20260709 13:01:48.584020  7228 consensus_meta.cc:287] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.544s	user 0.003s	sys 0.011s
I20260709 13:01:48.544741  7661 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.617830  7661 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.620842  7661 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.560771  7595 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.621873  1553 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 14. (term mismatch)
I20260709 13:01:48.622292  1553 pending_rounds.cc:85] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 13
I20260709 13:01:48.622514  1553 pending_rounds.cc:107] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 13.14
I20260709 13:01:48.622736  1553 raft_consensus.cc:2889] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:48.623147  6961 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:48.624084  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1066) took 1695 ms. Trace:
I20260709 13:01:48.549280  7637 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:48.624871  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2468) took 1043 ms. Trace:
I20260709 13:01:48.560258  7431 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:48.591943  7392 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.600389  7601 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:48.597931  7447 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:48.605310  7623 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:48.589991  7590 consensus_meta.cc:287] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.515s	user 0.003s	sys 0.003s
I20260709 13:01:48.605693  7645 raft_consensus.cc:2955] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Committing config change with OpId 13.8: config changed from index 2 to 8, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:48.660682  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:48.663411  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:48.664646  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:48.625289  1627 rpcz_store.cc:276] 0709 13:01:47.581653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.952771 (+371118us) service_pool.cc:224] Handling call
0709 13:01:47.953233 (+   462us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:48.003104 (+ 49871us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:48.023722 (+ 20618us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.379672 (+355950us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.379846 (+   174us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:48.398504 (+ 18658us) log.cc:844] Serialized 52 byte log entry
0709 13:01:48.398740 (+   236us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:48.411826 (+ 13086us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.430728 (+ 18902us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.518887 (+ 88159us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b48002610d8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:01:48.536984 (+ 18097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.537098 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.606894 (+ 69796us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b1800396940. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:01:48.624673 (+ 17779us) raft_consensus.cc:1685] finished
0709 13:01:48.624695 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.624815 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188688,"prepare.queue_time_us":26300,"prepare.run_cpu_time_us":158,"prepare.run_wall_time_us":163,"raft.queue_time_us":302089,"raft.run_cpu_time_us":2683,"raft.run_wall_time_us":180876,"spinlock_wait_cycles":26278016,"thread_start_us":344904,"threads_started":3,"wal-append.queue_time_us":480474}
I20260709 13:01:48.666960  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:48.521916  7255 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.668220  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:48.669342  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:48.609807  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50081.3us
W20260709 13:01:48.609869  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 62541us
I20260709 13:01:48.611850  7686 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:48.612653  7683 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:48.613722  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2474) took 1016 ms. Trace:
I20260709 13:01:48.613639  7677 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:01:48.611367  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 55238.4us
I20260709 13:01:48.608249  6846 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:48.620476  7680 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:48.608562  7679 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.590689  7455 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.630060  7624 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:48.618830  7550 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.629360  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:48.611210  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 268890us
W20260709 13:01:48.630942  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.624472  1553 rpcz_store.cc:276] 0709 13:01:46.929114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.130544 (+201430us) service_pool.cc:224] Handling call
0709 13:01:47.130873 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.623328 (+1492455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.623852 (+   524us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400181854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:48.624029 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3428477184}
I20260709 13:01:48.625706  7431 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.634011  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:48.610823  7675 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:48.625316  6961 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:48.657622  7595 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:48.658957  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:48.661958  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:48.632006  7579 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.669994  7255 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.671057  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:48.672310  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:48.673240  1552 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:48.721555  1560 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:01:48.675707  1601 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:48.682135  1526 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:48.723086  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:48.685724  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:48.651811  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:48.725091  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 73462us
I20260709 13:01:48.726552  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:48.725867  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:48.728121  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:48.727180  1556 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:48.692332  1626 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:01:48.696784  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1071) took 1198 ms. Trace:
I20260709 13:01:48.705082  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:48.738399  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:48.738934  1704 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:48.705735  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:48.739171  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:48.693470   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:48.712723  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:48.714298  6565 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.715307  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1067) took 1730 ms. Trace:
I20260709 13:01:48.716236  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:48.676146  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:48.716236  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:48.684820  7624 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:48.744544  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:48.744797  1627 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:48.679446  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:48.736099  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 60486.4us
I20260709 13:01:48.691452  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:48.672050  1700 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:48.696619  1703 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:01:48.682298  1629 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:48.737475  1554 rpcz_store.cc:276] 0709 13:01:47.498173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.627950 (+129777us) service_pool.cc:224] Handling call
0709 13:01:47.640446 (+ 12496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.685872 (+ 45426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.685903 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.685943 (+    40us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:47.685992 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.696537 (+1010545us) spinlock_profiling.cc:243] Waited 45.2 ms on lock 0x7b540030be54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:48.696583 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.696717 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103929600}
I20260709 13:01:48.752910  1560 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:48.742043  1559 rpcz_store.cc:276] 0709 13:01:46.984436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.133153 (+148717us) service_pool.cc:224] Handling call
0709 13:01:47.133434 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.005569 (+872135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.715103 (+709534us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b540030aa54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:48.715253 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2004125952}
I20260709 13:01:48.680420  1634 rpcz_store.cc:276] 0709 13:01:47.597293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.969682 (+372389us) service_pool.cc:224] Handling call
0709 13:01:47.970186 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.410226 (+440040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.613455 (+203229us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400357354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:48.613659 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987040640}
I20260709 13:01:48.788470  6565 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:48.789072  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:48.789012  6565 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:48.791679  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 79069.2us
W20260709 13:01:48.698408  7618 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.343s	user 0.006s	sys 0.001s
I20260709 13:01:48.795710  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:48.795794  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:48.796382  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 59016.6us
I20260709 13:01:48.799036  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:48.794368  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:48.799981  1556 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:48.803092  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:48.804677  1601 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:48.686884  6846 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:48.687565  7431 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.684130  7680 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:48.694442  7626 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:48.785609  7635 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:48.746522  7514 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:48.746423  7586 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:48.711818  7623 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:48.908749  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:48.714160  7579 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.907653  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:48.907958  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 103383us
I20260709 13:01:48.785367  7661 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:48.910204  1551 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:01:48.692888  7498 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.682730  7679 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.951164  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:48.951855  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 158379us
I20260709 13:01:48.921957  7493 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:48.786501  7439 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:48.747519  7544 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:48.794126  7624 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.803864  1556 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:48.964452  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:48.809948  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 124296us
I20260709 13:01:48.966084  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:48.782982  7447 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:48.678399  7686 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:48.922655  6565 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.658412  7601 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:48.685242  7590 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.801735  7655 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.150s
I20260709 13:01:48.927358  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:48.671357  7282 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.801803  7540 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:48.691967  7595 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:48.942596  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:48.811795  6961 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:48.920589  7455 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:48.918535  7622 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:48.803817  7612 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:48.920806  6846 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.687613  7675 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.682153  7593 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.995712  7593 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:48.996925  7282 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:48.998129  7675 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:48.999439  7590 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:48.969177  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 166033us
I20260709 13:01:48.812144  7500 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.139s
I20260709 13:01:48.907759  7578 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:01:48.803438  7480 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.148s
W20260709 13:01:48.926895  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.976179  1626 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:48.809912  7419 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.142s
I20260709 13:01:48.971431  7544 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.979058  7611 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:48.979517  7493 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:48.993419  7612 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:49.029062  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.982239  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:48.982836  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:48.984534  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:48.985208  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1100) took 1111 ms. Trace:
I20260709 13:01:48.946758  7661 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:48.985976  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:49.039116  1702 rpcz_store.cc:276] 0709 13:01:47.873392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.873521 (+   129us) service_pool.cc:224] Handling call
0709 13:01:47.874276 (+   755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.875471 (+  1195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.875504 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.602189 (+726685us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b2c00057cb8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2
0709 13:01:48.615359 (+ 13170us) log.cc:844] Serialized 26 byte log entry
0709 13:01:48.908230 (+292871us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:48.908281 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.908350 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.984860 (+ 76510us) raft_consensus.cc:1685] finished
0709 13:01:48.984882 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.985143 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2839,"raft.queue_time_us":1253,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":5733,"spinlock_wait_cycles":7590272,"thread_start_us":235402,"threads_started":1,"wal-append.queue_time_us":348160}
I20260709 13:01:48.989085  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:48.992698  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:48.954888  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:49.053184  1551 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:49.056882  1551 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:48.963608  7439 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.058061  7439 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:48.988322  7455 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:49.003342  1708 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:48.976262  7623 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.937076  7514 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.986689  7518 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:48.971902  7686 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:48.994596  7655 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.953137  7498 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:48.980331  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.036725  1630 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:49.049526  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 63635.5us
I20260709 13:01:49.048715  6961 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.985673  7624 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:49.071866  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:49.024240  7544 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:49.075663  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:49.117408  1702 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:49.077250  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:49.024138  7611 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:49.078944  1626 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:49.081044  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:49.066537  7677 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:01:49.026167  7282 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:48.988884  6565 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.132164  6565 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:49.066948  7661 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:49.073989  7455 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:49.026527  7581 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:01:49.073179  7590 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:49.120119  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 48415.1us
I20260709 13:01:49.069077  7419 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:01:49.122153  1559 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
W20260709 13:01:49.119210  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 97407.3us
I20260709 13:01:49.156714  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:49.122525  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 145008us
I20260709 13:01:49.048054  7612 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:49.129720  1630 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:49.085011  7693 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:49.162286  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:49.122501  7692 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.131006  7527 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.158197  1627 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:01:49.141757  7687 log.cc:927] Time spent T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:01:49.116782  6961 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.163054  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.176545  1630 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:49.082396  7586 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:49.164319  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.165324  2235 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:49.136161  7696 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:49.180651  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:49.172118  7498 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:49.083824  7623 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.158684  7540 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:49.155860  7590 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.159441  7419 consensus_queue.cc:1243] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:49.136217  7282 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:49.176738  7688 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:01:49.194573  7698 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:49.219077  1703 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
W20260709 13:01:49.220511  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.223579  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.086331  7655 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.224221  1633 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:49.198101  1702 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:01:49.198683  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:49.198766  7540 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:49.216990  7591 consensus_queue.cc:260] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.166364  7611 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.226502  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:49.175979  7447 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:01:49.200912  7595 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:49.179473  7527 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:49.168951  7693 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.230485  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:49.202628  6846 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:49.226881  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:49.205519  7590 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:49.233668  1556 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:49.199369  7701 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:49.222538  7579 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:49.201717  7705 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:49.227804  7586 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:49.234316  7591 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:49.201814  7696 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:49.234534  7159 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:49.235670  7699 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:01:49.243737  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:49.245965  1706 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 13:01:49.246459  7697 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:01:49.247259  1705 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:49.251325  1702 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:49.208017  7578 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:01:49.233037  7518 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:49.238098  7695 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:01:49.261428  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 103465us
I20260709 13:01:49.177654  7692 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:49.237819  7655 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:49.239912  7623 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:49.287673  1708 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:49.287490  1601 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:49.343077  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 55671.4us
I20260709 13:01:49.223441  7700 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:01:49.291603  7709 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.260214  7705 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.260715  7593 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.294193  7680 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.255438  6846 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.253310  7540 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:49.280565  7624 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:49.296490  1524 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.697s (SENT) [suppressed 7 similar messages]
I20260709 13:01:49.258632  7579 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.301784  7159 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:49.302237  7635 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:01:49.294656  6961 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:49.300467  1706 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:01:49.362489  1706 pending_rounds.cc:85] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 7
I20260709 13:01:49.362804  1706 pending_rounds.cc:107] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:01:49.363098  1706 raft_consensus.cc:2889] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:49.364411  1709 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:49.299798  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.365139  1630 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
I20260709 13:01:49.298388  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.339891  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.323613  7518 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:49.358603  1628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.005s	sys 0.004s
W20260709 13:01:49.307268  7654 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.976s	user 0.004s	sys 0.000s
W20260709 13:01:49.369141  1628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.005s	sys 0.005s
I20260709 13:01:49.369287  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.351236  7705 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:49.259533  7701 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.359385  7579 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:49.409489  1632 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:01:49.412215  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.416679  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.400493  7542 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:49.422626  7542 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.423913  7622 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:01:49.424382  7622 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:49.424786  7542 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:49.429611  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.433451  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.375690  7518 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:49.353114  7709 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.430994  1629 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:49.438624  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.400473  7626 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:49.529026  1632 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
W20260709 13:01:49.545616  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 249204us
I20260709 13:01:49.400202  6961 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:49.360047  6846 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.564254  7694 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:49.355033  7680 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:49.584394  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2475) took 1937 ms. Trace:
I20260709 13:01:49.588043  1635 rpcz_store.cc:276] 0709 13:01:47.609363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.260232 (+650869us) service_pool.cc:224] Handling call
0709 13:01:48.260673 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:48.326074 (+ 65401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.326121 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:48.719881 (+393760us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b2c0005c228. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2
0709 13:01:48.732870 (+ 12989us) log.cc:844] Serialized 52 byte log entry
0709 13:01:49.008367 (+275497us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:49.134847 (+126480us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.157183 (+ 22336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.157255 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.440817 (+283562us) raft_consensus.cc:1685] finished
0709 13:01:49.546006 (+105189us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.546249 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82968,"prepare.queue_time_us":208224,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":117976,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":11953,"spinlock_wait_cycles":25777920,"thread_start_us":195156,"threads_started":2,"wal-append.queue_time_us":318706}
I20260709 13:01:49.620152  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.546332  7696 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:49.586937  7624 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:49.605465  7698 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:49.811269  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:49.864250  7675 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.854s	user 0.012s	sys 0.002s
I20260709 13:01:49.425302  7622 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:49.823779  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:49.655643  7646 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:49.849325  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:49.581522  7617 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.206s
I20260709 13:01:49.850679  2269 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:49.770190  7527 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:49.590269  6961 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.929905  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:49.859504  7693 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:49.836907  7695 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.199s	user 0.001s	sys 0.002s
I20260709 13:01:49.870018  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:49.943812  2265 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:49.944348  1702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.133s	sys 0.247s
W20260709 13:01:49.944643  1702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.133s	sys 0.247s
I20260709 13:01:49.777624  7282 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:49.581756  7447 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:49.788353  7677 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:49.608119  7694 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:49.891132  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.033s	sys 0.100s
W20260709 13:01:49.975481  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.034s	sys 0.100s
W20260709 13:01:49.975857  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 630506us
I20260709 13:01:49.820771  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:49.880497  7706 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.596s	user 0.001s	sys 0.000s
W20260709 13:01:49.880751  7644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.557s	user 0.010s	sys 0.029s
I20260709 13:01:49.593433  7159 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:49.934273  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 63878.3us
I20260709 13:01:49.945387  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2816) took 1002 ms. Trace:
I20260709 13:01:49.892915  7711 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.998116  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2667) took 1215 ms. Trace:
I20260709 13:01:49.904778  7624 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:49.926792  7593 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:49.986344  1630 raft_consensus.cc:2410] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:01:49.964512  7622 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:49.937325  7527 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:49.989423  1702 rpcz_store.cc:276] 0709 13:01:48.943303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.302538 (+359235us) service_pool.cc:224] Handling call
0709 13:01:49.302875 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.303126 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:49.303479 (+   353us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.945011 (+641532us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.945069 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:49.945107 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.945194 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.945327 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4390,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"thread_start_us":641174,"threads_started":1}
W20260709 13:01:49.993216  7716 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 13:01:49.968554  7665 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.524s	user 0.000s	sys 0.009s
I20260709 13:01:49.897104  7635 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.958876  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:49.933804  7602 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:49.984552  7644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.666s	user 0.010s	sys 0.030s
I20260709 13:01:49.990590  7724 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.913932  7675 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:50.004273  7645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.012s	sys 0.000s
I20260709 13:01:49.998631  1554 rpcz_store.cc:276] 0709 13:01:48.782432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.784831 (+  2399us) service_pool.cc:224] Handling call
0709 13:01:48.864245 (+ 79414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:48.952101 (+ 87856us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:48.991246 (+ 39145us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.138727 (+147481us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:49.157749 (+ 19022us) log.cc:844] Serialized 52 byte log entry
0709 13:01:49.157888 (+   139us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:49.157926 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.157993 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.997839 (+839846us) raft_consensus.cc:1685] finished
0709 13:01:49.997865 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.998055 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7794,"prepare.queue_time_us":35630,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":144334,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":4358,"thread_start_us":181777,"threads_started":2,"wal-append.queue_time_us":229640}
I20260709 13:01:49.980947  7692 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.032147  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:49.980181  7677 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:50.111946  7612 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.946s	user 0.012s	sys 0.000s
I20260709 13:01:50.160647  7612 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.163084  7612 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.163968  1560 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:01:50.163861  7579 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.003s
I20260709 13:01:50.124220  7500 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.167311  7579 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.167537  7500 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.169591  7579 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:50.153875  7713 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:01:50.169902  7500 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.172313  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2482) took 1537 ms. Trace:
I20260709 13:01:50.172636  1628 rpcz_store.cc:276] 0709 13:01:48.635016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.718173 (+ 83157us) service_pool.cc:224] Handling call
0709 13:01:48.718465 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.718790 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.718818 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:48.719284 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.372495 (+653211us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:49.372551 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.372707 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.172120 (+799413us) raft_consensus.cc:1685] finished
0709 13:01:50.172140 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.172258 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5315,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":14838,"thread_start_us":652531,"threads_started":1,"wal-append.queue_time_us":869945}
I20260709 13:01:50.174366  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:50.174913  1628 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.178386  7680 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.179436  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.180048  1700 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:50.181041  7675 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.144290  7712 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:50.187001  7712 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.189453  7579 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:50.190056  7579 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.192153  7579 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:50.194872  7728 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 13:01:50.196188  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2828) took 1042 ms. Trace:
I20260709 13:01:50.154327  7730 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.025300  7527 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:49.996999  7711 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.158598  7701 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.037438  7602 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.031759  7635 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.113819  7698 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:50.122538  7645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.014s	sys 0.000s
I20260709 13:01:50.165254  7734 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.165381  7740 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:50.149726  1631 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:01:50.161824  7601 consensus_meta.cc:287] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.170s	user 0.005s	sys 0.006s
I20260709 13:01:50.200867  1628 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:01:50.201020  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:50.196553  1704 rpcz_store.cc:276] 0709 13:01:49.153669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.346553 (+192884us) service_pool.cc:224] Handling call
0709 13:01:49.346868 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.347231 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.347262 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.347715 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.542274 (+194559us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:49.542335 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.542440 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.195952 (+653512us) raft_consensus.cc:1685] finished
0709 13:01:50.195971 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.196129 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1629,"raft.queue_time_us":2538,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2484,"thread_start_us":156908,"threads_started":1,"wal-append.queue_time_us":421201}
I20260709 13:01:50.120365  7644 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.124483  7282 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:50.219683  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 230852us
W20260709 13:01:50.169848  7661 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.016s	user 0.003s	sys 0.010s
W20260709 13:01:50.225579  1634 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.016s	sys 0.017s
W20260709 13:01:50.269032  1634 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.016s	sys 0.018s
I20260709 13:01:50.121515  7724 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.235105  2268 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:50.244297  2270 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 11.
I20260709 13:01:50.226691  7701 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:50.267561  1628 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:50.217780  7593 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:50.225448  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:50.274806  2234 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:50.297716  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:50.299162  2234 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:50.233129  7590 consensus_meta.cc:287] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.948s	user 0.009s	sys 0.003s
I20260709 13:01:50.281629  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:50.301632  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:50.287562  7518 consensus_meta.cc:287] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.715s	user 0.006s	sys 0.006s
I20260709 13:01:50.289435  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1090) took 1090 ms. Trace:
I20260709 13:01:50.302788  1556 rpcz_store.cc:276] 0709 13:01:49.198847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.231267 (+ 32420us) service_pool.cc:224] Handling call
0709 13:01:49.231565 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.255055 (+ 23490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.289123 (+1034068us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5400169c54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:50.289363 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4048768}
I20260709 13:01:50.290740  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1079) took 1500 ms. Trace:
I20260709 13:01:50.304036  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:50.294047  7732 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:50.304986  2269 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:50.307057  7518 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.307876  7736 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:50.308367  7743 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:50.309159  7731 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:50.309808  7590 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:50.296693  7439 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.238s	user 0.009s	sys 0.004s
I20260709 13:01:50.311517  1704 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:01:50.312330  7694 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.375059  1704 pending_rounds.cc:85] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 10
I20260709 13:01:50.312647  7514 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.385905  7518 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.315267  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.386773  7745 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.387517  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.388128  1708 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:50.389000  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.321187  7446 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:50.390261  7446 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.336046  7731 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.394359  7731 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:50.395283  7705 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.981s	user 0.004s	sys 0.007s
I20260709 13:01:50.395776  7705 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.396922  2264 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:50.314438  1702 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:50.322570  7593 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.400257  7590 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:50.402052  7593 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:50.323988  7722 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:01:50.330690  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:50.403429  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1248) took 1109 ms. Trace:
I20260709 13:01:50.271202  7709 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.335296  6565 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:50.334491  1709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2565) took 1596 ms (client timeout 1659 ms). Trace:
W20260709 13:01:50.404642  7544 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.279s	user 0.011s	sys 0.004s
I20260709 13:01:50.403781  1633 rpcz_store.cc:276] 0709 13:01:49.293710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.294722 (+  1012us) service_pool.cc:224] Handling call
0709 13:01:49.295057 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.295402 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.295433 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.295830 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.780621 (+484791us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:49.780674 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.780753 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.403219 (+622466us) raft_consensus.cc:1685] finished
0709 13:01:50.403238 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.403374 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":75,"thread_start_us":484423,"threads_started":1,"wal-append.queue_time_us":727565}
W20260709 13:01:50.404505  1709 rpcz_store.cc:269] 0709 13:01:48.738431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.739831 (+  1400us) service_pool.cc:224] Handling call
0709 13:01:50.334294 (+1594463us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54001def54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:50.334432 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301559552}
I20260709 13:01:50.405174  7544 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.373555  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:50.405714  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.274955  7282 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.270629  7644 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.274411  7740 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.277390  7661 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:50.366549  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.265554  7601 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.314330  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:50.406355  1700 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:01:50.429211  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.406407  1633 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
W20260709 13:01:50.403899  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 73332.2us
I20260709 13:01:50.421262  2265 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:01:50.431468  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:50.431928  2265 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:50.431777  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:50.285997  7712 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.231211  7730 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.382544  7602 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.383483  7724 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:50.384339  2269 raft_consensus.cc:1240] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:50.444510  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:50.248417  7734 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.387266  7745 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:50.318843  7733 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.281s	user 0.000s	sys 0.002s
I20260709 13:01:50.399755  6961 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.376089  1704 pending_rounds.cc:107] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:01:50.437809  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:50.439765  1707 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:50.417908  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1250) took 1120 ms. Trace:
W20260709 13:01:50.420169  7591 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.135s	user 0.009s	sys 0.002s
W20260709 13:01:50.435485  7455 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.269s	user 0.010s	sys 0.004s
W20260709 13:01:50.448614  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.475298  1635 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:50.478746  6565 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:50.450157  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:50.407395  7711 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.451170  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.305788  7701 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.451927  7544 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.335115  7732 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.451910  7282 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.411303  7635 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.368966  7439 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.464293  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:50.457985  2265 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:50.469687  1704 raft_consensus.cc:2889] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:50.554522  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:50.540413  1709 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:50.543542  7591 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:50.558569  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:50.461740  7745 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:50.413260  7677 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.476816  1627 rpcz_store.cc:276] 0709 13:01:49.297087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.297619 (+   532us) service_pool.cc:224] Handling call
0709 13:01:49.297924 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.298388 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.298427 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.338819 (+ 40392us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.646176 (+307357us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:49.646220 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.646290 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.417664 (+771374us) raft_consensus.cc:1685] finished
0709 13:01:50.417686 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.417843 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2767,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":288427,"threads_started":1,"wal-append.queue_time_us":915879}
I20260709 13:01:50.546648  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:50.574414  1556 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:50.549355  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:50.441453  7593 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 13:01:50.554692  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:50.521417  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 83746.7us
I20260709 13:01:50.583771  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:50.485097  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.584986  1700 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:50.555531  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:50.469496  7679 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.471510  7624 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:50.467269  6961 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:50.449121  7686 consensus_meta.cc:287] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.337s	user 0.006s	sys 0.007s
I20260709 13:01:50.459919  7734 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.461349  7646 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:50.480244  6565 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.557205  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:50.438817  7590 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:50.461757  7447 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:50.485096  7712 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.593382  7745 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:50.631815  7646 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:50.633177  7644 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.615368  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1089) took 1416 ms. Trace:
I20260709 13:01:50.634856  7732 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.634960  7611 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:50.636765  7740 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.634485  1551 rpcz_store.cc:276] 0709 13:01:49.198583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.199456 (+   873us) service_pool.cc:224] Handling call
0709 13:01:49.199715 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.528437 (+328722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.528465 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.528504 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:49.528532 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.614999 (+1086467us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400309dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:50.615084 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.615286 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755479936}
I20260709 13:01:50.607244  2264 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:50.617151  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2654) took 2953 ms. Trace:
I20260709 13:01:50.619359  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2481) took 1985 ms. Trace:
I20260709 13:01:50.646747  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:50.649089  6846 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:50.642871  7622 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.000s
I20260709 13:01:50.651155  1630 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:01:50.658186  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.659060  1627 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:50.661314  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.661568  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.662250  1633 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:50.646939  1552 rpcz_store.cc:276] 0709 13:01:47.664075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.932449 (+268374us) service_pool.cc:224] Handling call
0709 13:01:47.932789 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.721979 (+789190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.616797 (+1894818us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54003d95d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:50.617025 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1702527232}
I20260709 13:01:50.485476  7694 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:50.689532  7694 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.693018  7694 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.566768  2263 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:50.459681  7730 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.485368  7514 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:50.586624  1554 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:50.553069  7579 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:50.486090  7455 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:50.729557  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 428034us
I20260709 13:01:50.730418  2234 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:50.555954  7714 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:50.470067  7731 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.597711  7439 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:50.598057  7701 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.599334  7446 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.599781  1674 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:50.695544  7686 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.490444  1701 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:50.640240  7601 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.647302  7447 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:50.648451  7612 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:50.648216  7679 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:50.647578  1631 rpcz_store.cc:276] 0709 13:01:48.634198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.686343 (+ 52145us) service_pool.cc:224] Handling call
0709 13:01:48.686657 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.234886 (+1548229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.619037 (+384151us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54003377d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:50.619287 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3364275584}
I20260709 13:01:50.750069  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:50.699129  6565 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.711472  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.637988  7661 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.760537  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2498) took 1123 ms. Trace:
I20260709 13:01:50.761620  2265 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:50.715529  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:50.732103  7694 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:50.716984  1703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2821) took 1772 ms (client timeout 1902 ms). Trace:
I20260709 13:01:50.631528  7705 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:50.695232  7699 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.717368  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:50.719373  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.765934  1633 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:50.720467  1702 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:50.649027  7527 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.766646  1555 raft_consensus.cc:2393] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:50.602569  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:50.698076  7712 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.723765  7282 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:01:50.740173  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 374198us
I20260709 13:01:50.724045  7514 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.745231  7645 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:50.748621  1551 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:50.748112  7446 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.754549  7679 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.778661  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.779469  7712 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:50.779930  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.780361  7679 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:50.781256  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.737964  7590 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:50.714865  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:50.782362  1709 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:50.782639  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1092) took 1340 ms. Trace:
W20260709 13:01:50.762328  1703 rpcz_store.cc:269] 0709 13:01:48.944652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.076935 (+132283us) service_pool.cc:224] Handling call
0709 13:01:50.716812 (+1639877us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54000b7f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:50.716925 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231559424}
I20260709 13:01:50.760989  1628 rpcz_store.cc:276] 0709 13:01:49.636769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.285304 (+648535us) service_pool.cc:224] Handling call
0709 13:01:50.298605 (+ 13301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.299045 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.299088 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.299589 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.657636 (+358047us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:50.657677 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.657750 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.760284 (+102534us) raft_consensus.cc:1685] finished
0709 13:01:50.760306 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.760462 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":11828,"thread_start_us":283014,"threads_started":1,"wal-append.queue_time_us":423851}
I20260709 13:01:50.783043  1558 rpcz_store.cc:276] 0709 13:01:49.441934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.442086 (+   152us) service_pool.cc:224] Handling call
0709 13:01:49.588199 (+146113us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.773120 (+184921us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:01:50.038136 (+265016us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.294878 (+256742us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.295347 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.295470 (+   123us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:01:50.295502 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.295570 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.782437 (+486867us) raft_consensus.cc:1685] finished
0709 13:01:50.782459 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.782582 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31663,"prepare.queue_time_us":616883,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":33875,"raft.run_cpu_time_us":8955,"raft.run_wall_time_us":265000,"thread_start_us":344631,"threads_started":2,"wal-append.queue_time_us":470785}
I20260709 13:01:50.785033  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.785559  1558 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:50.786089  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:50.698323  7734 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:50.735029  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 135399us
I20260709 13:01:50.735711  7740 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:50.787900  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.769076  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.772608  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.743203  7542 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.737085  7714 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.787325  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:50.731567  7579 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.789508  1633 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:01:50.794286  1674 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:50.792685  1634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.014s	sys 0.040s
W20260709 13:01:50.795504  1634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.014s	sys 0.040s
I20260709 13:01:50.796600  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.798662  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2668) took 2004 ms. Trace:
I20260709 13:01:50.763708  7694 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:50.799140  1560 rpcz_store.cc:276] 0709 13:01:48.793879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.798871 (+  4992us) service_pool.cc:224] Handling call
0709 13:01:48.799227 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.164495 (+1365268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.798339 (+633844us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002db9d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:50.798565 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3138270464}
I20260709 13:01:50.804163  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:50.804836  1560 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:50.790431  7734 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.808100  1553 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:01:50.824775  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:50.819516  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.827208  1704 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:50.827950  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.828794  1709 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:50.829913  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:50.830718  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:50.811853  7593 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:01:50.835791  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.836526  1705 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:50.763988  7612 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.801684  7544 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:50.852826  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1312) took 1047 ms. Trace:
I20260709 13:01:50.853434  2266 rpcz_store.cc:276] 0709 13:01:49.805197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.824544 (+ 19347us) service_pool.cc:224] Handling call
0709 13:01:49.869246 (+ 44702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.869490 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:50.052618 (+183128us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.434591 (+381973us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.723825 (+289234us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b1800249640. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1
0709 13:01:50.852134 (+128309us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b1800249640. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:01:50.852345 (+   211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.852417 (+    72us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:50.852486 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.852578 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.852750 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26937,"prepare.queue_time_us":317332,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":10377,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5483,"spinlock_wait_cycles":64389120,"thread_start_us":503392,"threads_started":2,"wal-append.queue_time_us":660503}
I20260709 13:01:50.858052  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:50.798763  7624 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:50.807538  7694 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:50.807781  7745 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:50.869552  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 127760us
I20260709 13:01:50.870039  1559 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:50.871893  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1313) took 1060 ms. Trace:
I20260709 13:01:50.872766  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:50.787482  7699 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.871186  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1308) took 1091 ms. Trace:
W20260709 13:01:50.875646  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 141918us
I20260709 13:01:50.872808  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:50.872296  2262 rpcz_store.cc:276] 0709 13:01:49.811619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.811812 (+   193us) service_pool.cc:224] Handling call
0709 13:01:49.812341 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.812753 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:50.230703 (+417950us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.871597 (+640894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.871643 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:50.871683 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.871746 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.871843 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":304834,"prepare.queue_time_us":356882,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"thread_start_us":690098,"threads_started":2,"wal-append.queue_time_us":516485}
I20260709 13:01:50.878201  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:50.878630  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 148298us
I20260709 13:01:50.879231  1705 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 11.
I20260709 13:01:50.852504  7544 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.875167  2271 rpcz_store.cc:276] 0709 13:01:49.779909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.780046 (+   137us) service_pool.cc:224] Handling call
0709 13:01:49.822887 (+ 42841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.823172 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:01:50.273556 (+450384us) log.cc:844] Serialized 14 byte log entry
0709 13:01:50.870849 (+597293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.870900 (+    51us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:50.870940 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.871005 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.871131 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":351568,"prepare.queue_time_us":359357,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":666197,"threads_started":2,"wal-append.queue_time_us":472270}
I20260709 13:01:50.888090  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:50.888896  1558 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:50.889178  2270 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:01:50.802995  7542 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:50.883935  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:50.885243  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:50.862155  7624 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:50.890620  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 244011us
I20260709 13:01:50.872857  7578 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:50.874733  7493 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.799003  7740 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.891844  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:50.892778  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.894977  2262 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:50.942047  1709 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:50.883639  1560 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:50.897908  1526 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:50.920496  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52946.7us
I20260709 13:01:50.891474  1601 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:50.943178  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:50.924247  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 66342.4us
I20260709 13:01:50.943840  1560 raft_consensus.cc:2410] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:01:50.915709  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:50.939950  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:50.873062  7736 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:50.946444  2264 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:50.947213  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:50.898262  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 66515.5us
I20260709 13:01:50.940760  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:50.946401  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 48616.6us
I20260709 13:01:50.949151  7742 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:50.949136  7679 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:50.953969  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1251) took 1656 ms. Trace:
I20260709 13:01:50.954417  1634 rpcz_store.cc:276] 0709 13:01:49.297382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.369943 (+ 72561us) service_pool.cc:224] Handling call
0709 13:01:49.370363 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:50.269528 (+899165us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:50.269575 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:50.270439 (+   864us) log.cc:844] Serialized 52 byte log entry
0709 13:01:50.795866 (+525427us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:50.795905 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.795969 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.953697 (+157728us) raft_consensus.cc:1685] finished
0709 13:01:50.953719 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.953906 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":236083,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":17824,"thread_start_us":1407621,"threads_started":2,"wal-append.queue_time_us":605518}
W20260709 13:01:50.956840  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 65090.8us
I20260709 13:01:50.877868  7758 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:50.887689  7439 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:50.957643  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:50.964242  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:50.958482  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 67087.7us
I20260709 13:01:50.965881  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:50.958840  2266 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:50.966638  1628 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:50.892676  7544 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:50.878008  7741 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:01:50.951924  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:50.878782  7745 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:50.967038  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.899262  7624 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.025796  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:50.964838  7758 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.896883  7705 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 13:01:51.034680  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:51.035429  2270 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.039772  1628 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:50.966507  7282 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:01:51.041262  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 69172.9us
I20260709 13:01:50.970250  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:51.010519  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 58669.3us
W20260709 13:01:51.042197  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 72037.8us
I20260709 13:01:51.042567  1526 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:50.962675  7762 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:50.974547  1601 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:51.041337  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2831) took 1058 ms. Trace:
I20260709 13:01:51.050457  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.045172  1526 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:51.046226  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:51.040905  7758 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:51.044387  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:51.024609  7698 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:51.024400  7731 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:51.048626  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:50.949573  7493 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.023447  7480 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:51.047386  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 103196us
I20260709 13:01:51.051641  1706 rpcz_store.cc:276] 0709 13:01:49.982587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.982772 (+   185us) service_pool.cc:224] Handling call
0709 13:01:49.988435 (+  5663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.037184 (+ 48749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.037223 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.037270 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:50.037303 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.041091 (+1003788us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b5400387cd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:51.041136 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.041280 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111494400}
I20260709 13:01:50.950639  7578 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.021863  7644 raft_consensus.cc:2764] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:01:51.060088  7601 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:51.074774  2236 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:51.052990  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.077594  7579 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:51.078606  7757 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:01:51.079813  7740 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:51.080497  7602 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:51.081660  7612 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:51.082558  7759 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:01:51.091413  7734 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.041534  7686 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.064272  7611 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:50.963524  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:50.898540  7498 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:51.054131  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:51.098456  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 135013us
W20260709 13:01:51.098718  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44711.5us
I20260709 13:01:51.054318  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.057775  1632 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:51.049425  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.060622  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.099926  1709 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:51.047006  7712 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:51.007462  7730 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:01:51.040786  7282 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.050145  7446 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:51.102294  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.052223  7698 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.104136  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.104435  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.105275  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:50.967916  7455 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:51.099217  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:51.108227  6846 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:51.115587  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.114725  2270 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:51.118760  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.122130  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.123093  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:51.120781  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 146360us
W20260709 13:01:51.125686  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.127832  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.103145  7724 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:01:51.130478  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.130618  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:51.131935  1709 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:51.067193  7480 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:51.135490  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.136858  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:51.137941  2264 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:51.138152  2266 raft_consensus.cc:2410] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:01:51.074759  7601 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:51.140308  7493 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:51.112496  7282 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:51.107584  7611 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:51.102766  7712 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:51.109058  7767 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:51.142362  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.133252  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:51.109483  7514 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:51.144498  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.144533  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.155768  1706 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:51.156085  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.146127  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:51.119619  7698 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:51.141360  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:51.136289  7734 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:51.162418  7455 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:51.150007  7712 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:51.165544  7661 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:51.106515  7602 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:01:51.151222  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.171665  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.171726  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:51.197118  1705 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:01:51.197290  1560 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.131218  7591 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:51.174233  2262 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:51.174798  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.143095  7480 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.157718  1599 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:51.176052  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.175880  1709 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:01:51.142871  7601 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.177276  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.177263  7455 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:51.183809  7542 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.165940  7745 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:01:51.144735  7498 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:01:51.148666  7540 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:51.185961  7447 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.186932  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.188087  7694 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.220218  1704 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:51.177187  7740 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.144961  7766 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:01:51.241505  7740 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.242591  7694 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:51.185099  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2497) took 1758 ms (client timeout 1989 ms). Trace:
I20260709 13:01:51.243726  7740 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.244604  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:51.243503  1635 rpcz_store.cc:269] 0709 13:01:49.426524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.619785 (+193261us) service_pool.cc:224] Handling call
0709 13:01:51.184921 (+1565136us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54002fb7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:51.185043 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1964631936}
I20260709 13:01:51.166604  7611 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:51.238394  7773 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:51.248347  7611 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:51.249614  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.175462  7734 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.250289  7734 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.251001  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:51.251757  2266 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:51.252483  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:51.231498  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 73846.4us
I20260709 13:01:51.232697  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.174595  7767 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:51.254325  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.255192  2262 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:51.255271  7767 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.255940  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:51.257831  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.189704  7624 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.234547  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:51.262887  2264 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:51.274914  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.276811  1634 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:01:51.278846  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.281093  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.282244  1704 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:01:51.282615  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.283481  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.284798  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.284986  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.227341  7455 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:51.196707  7661 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:51.253633  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.198851  7591 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:51.254407  1709 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:51.259240  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.286244  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.297231  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:51.298705  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.262782  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:51.288437  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:51.199468  7758 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.290819  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:51.291882  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 57414.2us
I20260709 13:01:51.322636  1627 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:51.322870  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:51.238739  1560 raft_consensus.cc:2410] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 12.
I20260709 13:01:51.258423  7617 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:51.295331  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:51.295929  1703 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:51.297106  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.296960  7493 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:51.304692  1631 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 12: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:51.282367  7480 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.306296  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.378175  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:51.378814  1629 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:51.379531  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:51.380183  1553 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:51.380976  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:51.284550  7677 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:01:51.381695  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.310287  7591 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:51.295563  7766 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:01:51.310760  7712 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:51.317715  7624 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.316085  7742 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:51.276193  7694 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:51.309547  7734 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:51.318336  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:51.319268  7447 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.290357  7282 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:51.299306  2271 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:51.321188  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.323558  1633 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:51.381955  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:51.427407  1553 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:51.386956  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:51.428303  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:51.385851  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1253) took 1503 ms. Trace:
I20260709 13:01:51.428915  1556 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:51.324383  7617 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:51.344406  7518 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.413549  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:51.429280  2269 rpcz_store.cc:276] 0709 13:01:49.882174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.336419 (+454245us) service_pool.cc:224] Handling call
0709 13:01:50.370167 (+ 33748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.444915 (+ 74748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.385534 (+940619us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b540054ea54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:51.385774 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32141184}
I20260709 13:01:51.435307  1553 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:51.388111  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:51.411294  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 278132us
I20260709 13:01:51.311197  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:51.414690  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 49405.1us
I20260709 13:01:51.289742  7598 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:51.313539  7698 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.412289  1706 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:51.412355  1629 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:51.417275  7493 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:51.438827  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:51.439759  1560 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:51.441598  1703 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:51.356304  7754 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 11.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.085s
I20260709 13:01:51.451152  7493 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.421569  7694 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:51.461150  7646 consensus_meta.cc:287] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.826s	user 0.008s	sys 0.004s
I20260709 13:01:51.475278  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:51.476759  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.477672  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.478767  1700 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:51.478699  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:51.477422  2271 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:51.483858  7758 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.484123  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.485320  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.486673  7544 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:51.487231  7282 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:51.488858  7544 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:51.451005  7598 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.442251  7661 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:51.492902  7742 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.535621  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:51.567143  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 91978.8us
I20260709 13:01:51.489565  7780 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:51.477481  7646 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:51.570688  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:51.575332  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:51.533752  7758 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:51.481855  7617 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.570153  7711 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:51.571503  7439 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:01:51.603202  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:51.573560  7542 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:51.608079  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.614166  1700 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:51.610605  1556 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:51.610620  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.616609  1556 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:51.618252  1556 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: [14.11-16.12]
W20260709 13:01:51.588405  7785 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:51.599880  7439 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:51.598851  7712 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:51.625255  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.632509  2269 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:01:51.634101  1700 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:51.586822  7698 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.624372  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:51.594983  7694 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:51.604558  7740 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.587343  7780 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:51.598521  7734 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:51.586822  7617 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:51.619014  7542 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:51.620608  7635 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.651568  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1306) took 1873 ms. Trace:
I20260709 13:01:51.581597  7661 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:51.622323  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:51.652159  2263 rpcz_store.cc:276] 0709 13:01:49.778708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.778884 (+   176us) service_pool.cc:224] Handling call
0709 13:01:49.823307 (+ 44423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.729668 (+906361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.651304 (+921636us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b5400566b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:51.651475 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1709452160}
I20260709 13:01:51.596277  7758 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:51.618952  7745 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:51.621310  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:51.630328  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.655615  2265 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:51.623389  7624 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:51.587219  7711 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.646688  7493 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.647300  7646 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:51.650280  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:51.598954  7544 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:01:51.627676  7439 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:51.675894  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:51.676986  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 54781.6us
I20260709 13:01:51.683013  7765 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:51.665661  7582 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:51.690577  7582 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.700552  2235 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:51.701709  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:51.702736  7786 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:01:51.703065  7705 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.703862  7705 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:01:51.704005  7763 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.627s	user 0.000s	sys 0.004s
I20260709 13:01:51.704280  7705 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.704707  7705 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:51.718209  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.705963  2235 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:51.707331  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.720258  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:51.723138  1526 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:51.728544  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.731729  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.733225  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.733417  1631 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:51.733634  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1113) took 1424 ms. Trace:
I20260709 13:01:51.732497  1526 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:51.736763  1526 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:51.738782  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.740032  2266 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:01:51.678334  7734 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:51.645255  7740 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:51.734050  1708 rpcz_store.cc:276] 0709 13:01:50.309466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.389736 (+ 80270us) service_pool.cc:224] Handling call
0709 13:01:50.399551 (+  9815us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:50.741774 (+342223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.741807 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:50.765439 (+ 23632us) log.cc:844] Serialized 52 byte log entry
0709 13:01:50.892435 (+126996us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:50.892477 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.892546 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.703312 (+810766us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:51.705656 (+  2344us) raft_consensus.cc:1685] finished
0709 13:01:51.705678 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.733573 (+ 27895us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":957,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":73212160,"thread_start_us":443064,"threads_started":2,"wal-append.queue_time_us":238810}
I20260709 13:01:51.748695  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:51.749579  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:51.751174  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:51.751879  1633 raft_consensus.cc:2368] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18.
I20260709 13:01:51.664263  7635 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.676261  7745 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:51.738269  7698 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:51.764760  7635 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.765074  7698 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:51.765654  7698 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:51.766520  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2682) took 1217 ms. Trace:
I20260709 13:01:51.767244  7764 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:51.767170  1555 rpcz_store.cc:276] 0709 13:01:50.548931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.549082 (+   151us) service_pool.cc:224] Handling call
0709 13:01:51.766311 (+1217229us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54003ea8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:51.766461 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438160768}
I20260709 13:01:51.767722  7764 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:51.768716  7764 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.741323  7677 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.766635  1553 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:51.764123  1673 leader_election.cc:400] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18.
I20260709 13:01:51.775118  1673 leader_election.cc:403] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:01:51.775385  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:51.746628  7734 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.745757  7712 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:51.780038  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.781046  1633 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:51.770460  7677 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.674083  7624 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.728819  7717 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
W20260709 13:01:51.761720  7601 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.006s
I20260709 13:01:51.756681  7447 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:51.809624  7717 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:51.809978  7447 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.810386  7717 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:51.810534  7764 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:51.811407  7717 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.809675  7698 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:51.814323  7698 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:51.815424  1630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2499) took 1928 ms (client timeout 1763 ms). Trace:
W20260709 13:01:51.815938  1630 rpcz_store.cc:269] 0709 13:01:49.886892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.005140 (+118248us) service_pool.cc:224] Handling call
0709 13:01:51.815217 (+1810077us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54002fa3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:51.815321 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237993856}
I20260709 13:01:51.817260  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:51.766471  7611 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:51.799484  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:51.802331  7694 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:51.780330  7581 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:51.803351  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:51.804473  7677 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.783361  7712 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.807093  1635 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:51.807443  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:51.850401  1632 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:51.815554  7711 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:51.779495  7734 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:51.819095  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 116251us
W20260709 13:01:51.820456  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 78820.5us
I20260709 13:01:51.811431  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:51.854621  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:51.854656  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:51.855439  1630 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:51.783828  7635 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18.
I20260709 13:01:51.855944  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:51.858415  2235 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:51.858845  1633 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:51.810532  7447 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.860831  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:51.859723  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 106068us
I20260709 13:01:51.862406  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:51.863075  1708 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.848626  7611 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.746922  7542 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:51.809561  7601 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:51.857177  7784 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:01:51.867641  1632 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
W20260709 13:01:51.867760  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 118262us
I20260709 13:01:51.853736  7712 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.868527  1703 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:01:51.871099  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 84969.3us
I20260709 13:01:51.870862  1633 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:51.857784  7581 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:51.776993  7758 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.883383  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:51.884397  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 135785us
I20260709 13:01:51.863910  7711 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:51.881311  1630 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:01:51.866951  7754 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:51.881311  1632 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:51.871346  7611 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:51.785445  7439 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.886673  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:51.904003  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:51.904554  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:51.909085  1555 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:51.902841  7455 consensus_meta.cc:287] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 13:01:51.912559  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:51.913547  1555 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:51.914247  7801 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:51.914702  7801 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:51.915064  7801 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.915396  7601 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.915494  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:51.916208  1703 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:51.910763  7624 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.917265  7439 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.910600  7581 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.919742  7581 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:51.920241  7581 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:51.867376  7745 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.921132  7581 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.921989  7591 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.923120  7455 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.924957  1700 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:51.925186  7455 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.925829  7591 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:51.909375  7698 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.911288  7493 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:51.930042  1703 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 12.
I20260709 13:01:51.898216  7754 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:51.933219  1708 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:51.934553  1703 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:01:51.944144  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 60855.5us
I20260709 13:01:51.950057  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2549) took 1399 ms. Trace:
I20260709 13:01:51.950663  1551 rpcz_store.cc:276] 0709 13:01:50.550222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.646382 (+ 96160us) service_pool.cc:224] Handling call
0709 13:01:50.646708 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.778378 (+131670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.949781 (+1171403us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400182c54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:51.949958 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233946880}
W20260709 13:01:51.956108  7798 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:01:51.935124  7754 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:50.304261  1557 rpcz_store.cc:276] 0709 13:01:48.790603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.790789 (+   186us) service_pool.cc:224] Handling call
0709 13:01:48.827251 (+ 36462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.114991 (+287740us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:49.122997 (+  8006us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.548730 (+425733us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.548798 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:49.548856 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.290452 (+741596us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54002db4d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:50.290518 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.290673 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16128,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1549,"raft.queue_time_us":40698,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3263,"spinlock_wait_cycles":661088640,"thread_start_us":425272,"threads_started":2,"wal-append.queue_time_us":161669,"wal-append.run_cpu_time_us":1087,"wal-append.run_wall_time_us":1011878}
W20260709 13:01:51.958691  2268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 1307) took 2179 ms (client timeout 1902 ms). Trace:
I20260709 13:01:51.958953  2267 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:01:51.959127  2268 rpcz_store.cc:269] 0709 13:01:49.779238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.779549 (+   311us) service_pool.cc:224] Handling call
0709 13:01:51.958459 (+2178910us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54007b0f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:51.958597 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753113472}
W20260709 13:01:51.960031  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.960393  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:51.961633  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:51.912492  7799 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:01:51.963097  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:51.963296  7493 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:51.963748  7493 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:51.964250  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:51.964546  7493 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.967984  7731 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:51.968832  7731 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:51.969432  7731 consensus_queue.cc:1243] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:51.970362  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2567) took 3231 ms. Trace:
I20260709 13:01:51.970760  1707 rpcz_store.cc:276] 0709 13:01:48.739239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.783719 (+ 44480us) service_pool.cc:224] Handling call
0709 13:01:48.795704 (+ 11985us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.476807 (+1681103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.969893 (+1493086us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54000b6b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:51.970276 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3780520192}
I20260709 13:01:51.963142  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:51.972740  7730 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:51.973199  7730 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:51.973363  7591 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:51.959141  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2553) took 1407 ms. Trace:
I20260709 13:01:51.974423  1552 rpcz_store.cc:276] 0709 13:01:50.551315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.688559 (+137244us) service_pool.cc:224] Handling call
0709 13:01:50.688868 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.782275 (+ 93407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.782304 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.782346 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:50.782375 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.958927 (+1176552us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b5400384854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:51.958971 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.959092 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214390016}
I20260709 13:01:51.973208  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:51.976889  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:51.977579  1705 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:51.978453  1601 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:51.979089  7591 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:51.979475  7591 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.979812  7591 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.978621  7590 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:51.970928  7731 consensus_queue.cc:1059] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:51.984577  7602 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:51.985015  7602 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:51.986325  7582 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:51.985956  7602 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:51.987150  7602 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:51.987910  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2570) took 1660 ms. Trace:
I20260709 13:01:51.987984  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:51.988673  1555 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:51.988410  1702 rpcz_store.cc:276] 0709 13:01:50.327273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.399834 (+ 72561us) service_pool.cc:224] Handling call
0709 13:01:50.717648 (+317814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.766529 (+ 48881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.987699 (+1221170us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54000b7f50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:51.987838 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730248576}
I20260709 13:01:51.990545  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:51.998416  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:51.999151  1560 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:51.999703  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:51.977926  1674 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:52.004468  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:51.965850  7493 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:52.007606  1555 raft_consensus.cc:2410] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:01:52.008257  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:52.006831  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.006335  1560 pending_rounds.cc:85] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 10
I20260709 13:01:52.013492  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.016855  1560 pending_rounds.cc:107] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:01:52.017196  1560 raft_consensus.cc:2889] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:52.020741  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:52.131302  1701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 1107) took 3391 ms (client timeout 2763 ms). Trace:
I20260709 13:01:52.023442  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:52.132548  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.133632  1551 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:01:52.131809  1701 rpcz_store.cc:269] 0709 13:01:48.628501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.664355 (+ 35854us) service_pool.cc:224] Handling call
0709 13:01:52.019376 (+3355021us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b5400233f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:52.019511 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4197790080}
I20260709 13:01:51.994956  7801 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.142185  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:52.142866  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.006917  7527 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:52.147626  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:52.152058  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 128688us
I20260709 13:01:52.159364  1551 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:52.159683  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:52.019927  7590 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:01:52.195642  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 306154us
I20260709 13:01:52.132072  7455 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:52.191468  7624 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:52.203863  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:52.141662  7699 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:52.206570  1701 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:52.152796  7527 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:52.205292  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.214634  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.018981  7711 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.179s
I20260709 13:01:52.196900  7765 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.218896  1555 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:52.222216  7711 raft_consensus.cc:3055] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:52.224725  7578 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:52.240444  7711 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:52.253077  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.253968  1556 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:52.255092  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:52.256664  1556 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:52.260438  7801 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:52.213742  7624 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.263060  7624 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:52.013448  7730 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.207231  7590 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:52.283982  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:52.284974  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:52.288196  1701 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:52.285804  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2554) took 1734 ms. Trace:
I20260709 13:01:52.289215  1554 rpcz_store.cc:276] 0709 13:01:50.551574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.739394 (+187820us) service_pool.cc:224] Handling call
0709 13:01:50.746322 (+  6928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.832777 (+ 86455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.832826 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.832889 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:50.832937 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.285576 (+1452639us) spinlock_profiling.cc:243] Waited 86.2 ms on lock 0x7b54003d86d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:52.285628 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.285747 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198212864}
I20260709 13:01:52.287814  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2501) took 1514 ms. Trace:
W20260709 13:01:52.292616  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 83111.6us
I20260709 13:01:52.296103  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:52.328907  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.291798  1628 rpcz_store.cc:276] 0709 13:01:50.773212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.785864 (+ 12652us) service_pool.cc:224] Handling call
0709 13:01:52.287648 (+1501784us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540008a2d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:52.287755 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413705600}
W20260709 13:01:52.321519  7764 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.002s
I20260709 13:01:52.292519  7779 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:52.346616  7809 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:01:52.341432  7801 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:52.342378  1701 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:52.352152  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:52.305217  7805 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:01:52.358934  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:52.362924  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 73396.9us
W20260709 13:01:52.353060  7709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.027s	sys 0.024s
W20260709 13:01:52.366818  7709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.294s	user 0.027s	sys 0.024s
I20260709 13:01:52.374393  7717 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:52.375891  7598 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:52.378840  7801 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:52.291447  7711 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.322655  7758 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:01:52.354688  7698 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:52.325026  7447 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.382648  1524 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:52.362740  7694 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:52.309294  7527 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.391412  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.397254  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.398088  1557 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:52.400796  7698 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:52.400971  7624 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:52.403735  1559 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2556) took 1851 ms (client timeout 1923 ms). Trace:
W20260709 13:01:52.404187  1559 rpcz_store.cc:269] 0709 13:01:50.552112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.602252 (+ 50140us) service_pool.cc:224] Handling call
0709 13:01:52.403568 (+1801316us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400178754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:52.403672 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236361472}
I20260709 13:01:52.407416  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:52.396503  7635 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:01:52.411803  7694 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:52.381480  7591 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.390563  7699 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:52.415215  7591 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:52.406675  7705 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.003s
I20260709 13:01:52.418922  7705 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.422289  7698 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:52.423504  7698 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.423803  7624 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:52.424124  7698 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.422360  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:52.434427  7705 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:52.397182  7712 consensus_meta.cc:287] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 13:01:52.385263  7754 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.443967  7714 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:52.443861  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:52.393623  7590 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.444825  7698 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:52.447772  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:52.460330  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.463907  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2585) took 1164 ms. Trace:
I20260709 13:01:52.448577  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:52.464533  1705 rpcz_store.cc:276] 0709 13:01:51.299119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.306043 (+  6924us) service_pool.cc:224] Handling call
0709 13:01:52.463715 (+1157672us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54000b8454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:52.463838 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1377209216}
I20260709 13:01:52.459563  1554 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:01:52.444916  7754 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:52.453990  7699 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:52.466554  1700 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:52.438014  7709 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:52.468819  7709 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:52.469797  7709 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.463867  1555 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:52.459744  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:52.473130  1560 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.472362  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.473940  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:52.459950  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.476451  1555 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:52.477217  1551 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:52.478178  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:52.408857  7711 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:52.478971  1635 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:01:52.479278  1526 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.479763  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:52.477180  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.019s	sys 0.020s
I20260709 13:01:52.476640  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:52.482390  1551 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:01:52.482318  1556 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:52.483067  1555 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:52.486359  1551 pending_rounds.cc:85] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 12
I20260709 13:01:52.486560  1555 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:52.486739  1551 pending_rounds.cc:107] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 14.13
W20260709 13:01:52.487064  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.020s	sys 0.021s
I20260709 13:01:52.487131  1551 raft_consensus.cc:2889] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:52.491027  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.492208  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.438486  7447 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:52.458942  7734 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 13:01:52.494895  1560 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:52.495039  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:52.495954  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.496963  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:52.497390  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:52.447398  7480 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:52.501470  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 648323us
I20260709 13:01:52.488200  1555 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.504818  1555 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:52.449560  7611 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.543s	user 0.003s	sys 0.004s
I20260709 13:01:52.499977  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:52.498896  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:52.507614  1633 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:52.479370  7709 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:52.502765  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:52.446429  7740 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:52.511225  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:52.511857  1635 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:52.516809  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.517827  1631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:52.518481  1631 raft_consensus.cc:606] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:52.518965  1631 raft_consensus.cc:614] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:52.510481  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:52.521407  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:52.532845  1633 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:01:52.501056  1674 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.519420  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:52.538956  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.539603  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.494313  7699 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.494467  7805 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:52.499191  7714 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:52.445182  7712 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:52.556574  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 578235us
I20260709 13:01:52.558082  2234 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:52.550099  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:52.552520  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:52.562857  2265 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:52.547008  1635 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:01:52.501953  7801 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:52.554931  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.555004  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:52.567067  2271 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:52.499744  7635 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:52.481870  7544 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 13:01:52.568624  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 64106.6us
I20260709 13:01:52.517524  7447 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:52.559857  2270 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:52.565428  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:52.564735  7637 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:52.571359  7598 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:52.564822  7758 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:01:52.575898  2263 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:52.576314  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:52.568452  7779 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:52.578169  7779 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.579795  7761 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:52.580476  7779 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:52.566138  7741 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:52.502089  7764 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:01:52.553288  7624 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:52.589433  1552 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:01:52.582386  7741 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.508193  7734 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.590358  1555 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:01:52.602262  1555 pending_rounds.cc:85] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 10
I20260709 13:01:52.603046  1555 pending_rounds.cc:107] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:01:52.508452  7820 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:01:52.568756  7635 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.518154  7611 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.573567  7447 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:52.588573  7805 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.613517  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:52.599105  7758 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:52.612355  7740 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.619932  7740 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.611987  7644 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.622574  7644 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.625453  7644 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:52.596771  7637 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:52.626595  7815 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:01:52.627009  7637 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.661360  7712 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:52.663339  7734 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:52.607445  7624 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:52.664034  7765 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.590905  7591 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:52.664953  7591 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.665095  7624 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.611246  7447 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:52.667424  7591 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:52.667600  7714 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:52.630841  7740 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:52.631702  6961 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:52.670503  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.633574  1600 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:52.673192  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:52.675184  7282 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:52.675948  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:52.676223  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:52.638662  1553 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:52.639544  7611 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:52.608592  7635 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:52.677999  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:52.680290  1629 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:52.681222  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:52.682180  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.642168  7741 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:52.642315  7758 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:52.646414  7730 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:52.684023  7758 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:52.627653  7814 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:01:52.657462  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.686480  7480 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:52.687282  7480 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:52.688071  7480 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:52.690565  1600 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:52.693626  7823 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:52.699839  7732 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:52.700414  7732 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:52.701351  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:52.701479  7732 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.703415  7823 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:52.703460  7732 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.704073  7823 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:52.704638  7823 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:52.708734  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1278) took 1004 ms. Trace:
I20260709 13:01:52.711123  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:52.716662  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1273) took 1409 ms. Trace:
I20260709 13:01:52.727399  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.728096  1556 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:52.728233  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:52.727316  1634 rpcz_store.cc:276] 0709 13:01:51.307655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.375047 (+ 67392us) service_pool.cc:224] Handling call
0709 13:01:51.375416 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.375672 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:01:51.615410 (+239738us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.716250 (+1100840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.716314 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:01:52.716385 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.716474 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.716606 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":772514,"prepare.queue_time_us":226685,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":723907,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":541347,"threads_started":3,"wal-append.queue_time_us":231800}
I20260709 13:01:52.729630  1634 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:52.729952  1629 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:01:52.709209  1627 rpcz_store.cc:276] 0709 13:01:51.704102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.712456 (+  8354us) service_pool.cc:224] Handling call
0709 13:01:51.712837 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.713110 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:01:51.734290 (+ 21180us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.468916 (+734626us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b18001c9540. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:01:52.704907 (+235991us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.705999 (+  1092us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.708328 (+  2329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.708378 (+    50us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:52.708421 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.708488 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.708672 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8396,"prepare.queue_time_us":104511,"prepare.run_cpu_time_us":151,"prepare.run_wall_time_us":155,"raft.queue_time_us":738045,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":190,"spinlock_wait_cycles":8237824,"thread_start_us":234710,"threads_started":2}
I20260709 13:01:52.735100  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.735757  1556 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:01:52.737794  1556 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:52.741580  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.717860  7635 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.720435  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:52.723923  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:52.608043  1555 raft_consensus.cc:2889] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:52.757899  1551 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:52.757869  2266 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
W20260709 13:01:52.760690  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 195361us
I20260709 13:01:52.746241  6961 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:52.762458  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:52.764595  1551 raft_consensus.cc:2393] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:52.755963  7758 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.767827  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:52.768384  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:52.774111  1634 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:52.771075  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 275208us
I20260709 13:01:52.777128  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:52.778420  1627 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:52.768976  7758 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.780486  7635 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:52.780659  7758 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:52.789753  7823 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.792848  6961 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.795991  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:52.798295  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 298405us
I20260709 13:01:52.800789  1551 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:52.801203  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.803687  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.804977  7754 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.806442  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.807077  7590 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:52.807559  7590 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.808801  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:52.809383  1634 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:52.809623  7590 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:52.804665  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:52.811373  1627 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:52.813512  1704 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:01:52.814805  1709 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:52.816190  1705 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:52.817891  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:52.818475  1701 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:52.819044  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:52.819725  1704 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:52.821640  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:52.822947  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:52.824213  1707 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:52.805487  7754 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.794073  6961 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:52.834601  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:52.827952  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:52.835896  1702 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:01:52.829541  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.829727  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:52.837847  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:52.831281  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:52.840135  1628 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:52.840616  2266 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:52.830281  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:52.837823  1707 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:52.843652  1706 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:52.848847  1704 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:52.849982  1526 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:52.857215  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:52.853050  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:52.858374  1701 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:52.810550  7611 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:52.796845  7447 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.832249  7768 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:52.966336  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:52.853005  7826 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:52.979285  7498 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:01:52.970338  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:52.913197  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 60259.2us
I20260709 13:01:52.984012  7734 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:52.913071  7714 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:52.984529  7734 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:52.985199  7714 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:52.985699  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.983187  1701 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:01:52.838042  7795 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:52.987008  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:52.987269  7714 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:52.960541  7801 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:52.988250  1526 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:52.988482  7801 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:52.966782  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:52.988821  7714 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:52.989251  7714 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.989626  7714 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:52.989439  7801 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:52.989925  7694 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:52.972426  7805 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.911886  7698 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:52.991084  7805 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:52.991464  7698 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:52.992486  7698 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.970362  7823 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:52.979023  7159 consensus_queue.cc:1059] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:01:52.995405  7159 raft_consensus.cc:3055] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:52.995759  7159 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:52.996593  7159 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.912636  7712 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:01:52.999955  7447 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:52.979507  7637 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:01:52.994285  7768 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.976372  7754 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:52.985464  7734 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:52.958695  1556 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:53.002004  7637 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:53.006382  7637 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:52.957402  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:52.978120  7761 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:52.957893  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.007884  1555 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:01:53.007745  7761 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.008255  7754 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.005887  7734 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:52.963020  7624 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.009024  7754 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.007330  7637 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.014513  7754 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:53.015909  7768 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:53.017765  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.018293  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.018215  7624 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:53.020227  7709 consensus_meta.cc:287] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.003s
I20260709 13:01:52.986850  7795 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.020498  1704 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:01:53.021445  7624 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.026503  7159 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:53.039647  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:53.028740  1634 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:53.042959  7828 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:52.980144  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:53.044697  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64622.5us
I20260709 13:01:53.044942  7758 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:53.045882  7800 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:53.046180  7646 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:52.826395  7825 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:52.977288  7527 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:53.028679  1632 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:53.029124  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:53.046514  7800 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.048497  7800 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:53.029774  7823 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:53.050263  7825 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:53.050222  7823 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.052875  7823 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.053725  7825 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:53.048033  1601 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:53.064105  7498 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:53.065393  7498 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:53.066438  7498 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.068454  7761 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:52.907799  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 78411.7us
I20260709 13:01:53.066896  7709 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:53.070852  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:53.078152  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:53.074185  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.075598  1560 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:53.080708  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:53.081622  1628 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:53.084311  1554 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:53.084650  1601 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:53.085036  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:53.085600  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:53.096326  1524 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:53.099037  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:53.106164  1706 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:53.107393  7827 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.107899  7827 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.108882  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:53.109467  1701 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.083389  7611 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:01:53.095564  7709 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.111038  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:53.111668  7827 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:53.111960  7709 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:53.095103  7826 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:53.117846  1707 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:01:53.104542  7677 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:53.118470  7677 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.119539  1701 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:53.120563  7677 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.121474  2262 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:53.122493  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:53.122725  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1093) took 2066 ms. Trace:
I20260709 13:01:53.123049  2262 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:53.123175  1558 rpcz_store.cc:276] 0709 13:01:51.056621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.056777 (+   156us) service_pool.cc:224] Handling call
0709 13:01:52.404029 (+1347252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.404217 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.404242 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.404286 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:52.404318 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.404376 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.122562 (+718186us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400178750. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:53.122669 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3083721088}
I20260709 13:01:53.125218  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:53.125753  7542 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:53.125804  2268 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:53.124043  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:53.129869  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.133136  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.082237  7637 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.140411  1673 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:53.138391  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:53.131217  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:53.144248  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:53.146446  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:53.155328  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:53.161121  2264 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:53.105090  7645 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:53.104509  7624 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:53.105262  7712 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:53.057588  7800 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.170042  2262 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:01:53.179945  1629 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:01:53.202972  1629 pending_rounds.cc:85] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 13
I20260709 13:01:53.203383  1629 pending_rounds.cc:107] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:01:53.203657  1629 raft_consensus.cc:2889] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:53.104930  7823 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:53.103766  7447 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260709 13:01:53.187281  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 56139.2us
I20260709 13:01:53.191852  2264 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:53.113128  7743 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:53.094921  7754 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:01:53.222783  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:53.154618  7717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.059s	sys 0.098s
I20260709 13:01:53.103832  7761 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:01:53.113579  7590 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:01:53.183585  7645 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.183959  7699 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:53.181583  7828 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:53.202450  7712 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.243554  7712 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:53.222584  7447 consensus_queue.cc:1243] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:53.197899  7824 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:01:53.246007  7282 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:53.247840  7282 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.248409  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1115) took 1242 ms. Trace:
I20260709 13:01:53.248780  1552 rpcz_store.cc:276] 0709 13:01:52.005695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.005925 (+   230us) service_pool.cc:224] Handling call
0709 13:01:52.006240 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:52.591232 (+584992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.248158 (+656926us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b5400169c54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:53.248352 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1340709248}
I20260709 13:01:53.184049  7711 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.198787  7624 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.207139  7811 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:53.203557  7709 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.162952  7827 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:01:53.216367  7611 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:53.181806  7581 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:01:53.234215  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1294) took 2323 ms. Trace:
I20260709 13:01:53.241820  7645 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:53.263055  2267 rpcz_store.cc:276] 0709 13:01:50.903106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.903248 (+   142us) service_pool.cc:224] Handling call
0709 13:01:51.958588 (+1055340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.959419 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.226533 (+1267114us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54007b0f50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:53.226665 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2426359168}
W20260709 13:01:53.227586  7717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.060s	sys 0.099s
W20260709 13:01:53.258780  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 252535us
I20260709 13:01:53.249564  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:53.264755  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2566) took 1255 ms. Trace:
I20260709 13:01:53.270159  1557 rpcz_store.cc:276] 0709 13:01:52.008961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.009104 (+   143us) service_pool.cc:224] Handling call
0709 13:01:52.009510 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.402376 (+392866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.264469 (+862093us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400373054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:53.264681 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893218048}
I20260709 13:01:53.222208  7758 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 13:01:53.283221  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.241128  7699 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:53.290548  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:53.226961  7743 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.257221  7624 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.223755  7694 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:53.234668  7825 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.259235  7820 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:53.332333  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:53.334818  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:53.336148  1702 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
W20260709 13:01:53.317215  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.246423  7447 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:01:53.289773  7827 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:53.364118  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:53.345325  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:53.293350  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:53.365120  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:53.363920  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:53.346364  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:53.258167  7711 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.392100  2271 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 15: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:53.400172  1701 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:53.400730  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:53.375427  1704 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:53.378911  1709 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
W20260709 13:01:53.384572  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 91315.9us
I20260709 13:01:53.263782  7811 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:53.372848  7825 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:53.384049  7842 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:01:53.338845  7805 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:53.406461  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:53.406843  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:53.416638  1701 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
W20260709 13:01:53.417757  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.264529  7709 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.370869  7480 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:01:53.405818  7455 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:53.385598  7827 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.377856  7527 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:01:53.446435  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.404269  7820 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.367012  7694 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.466727  7282 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.425204  7455 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:53.402858  7699 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.444464  7824 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:53.467170  7800 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:53.447956  7527 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.504601  7824 raft_consensus.cc:3055] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:53.473039  7811 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.538414  7824 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:53.557011  7743 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:53.576807  7823 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:53.590750  7823 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:53.595551  7846 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:01:53.603915  7734 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.000s
I20260709 13:01:53.604255  7795 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:53.614426  7826 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:53.616932  7826 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.620410  7827 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.623461  7820 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.585589  7824 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.625094  7824 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:53.627159  7801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.016s	sys 0.017s
W20260709 13:01:53.663476  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.001s	sys 0.027s
W20260709 13:01:53.664426  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.002s	sys 0.028s
W20260709 13:01:53.664813  1555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.003s	sys 0.012s
W20260709 13:01:53.665418  1555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.003s	sys 0.012s
W20260709 13:01:53.666360  1551 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.012s	sys 0.029s
W20260709 13:01:53.666903  1551 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.012s	sys 0.029s
W20260709 13:01:53.667387  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 571100us
W20260709 13:01:53.668927  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.016s
W20260709 13:01:53.669394  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.000s	sys 0.016s
W20260709 13:01:53.669826  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 537501us
I20260709 13:01:53.676448  1526 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:53.683425  1627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.030s	sys 0.009s
W20260709 13:01:53.684118  1627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.030s	sys 0.010s
W20260709 13:01:53.684697  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.683482  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.691006  1628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.004s	sys 0.007s
W20260709 13:01:53.691491  1628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.004s	sys 0.007s
W20260709 13:01:53.702386  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.008s	sys 0.008s
W20260709 13:01:53.703022  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.009s	sys 0.008s
W20260709 13:01:53.708232  1700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.003s	sys 0.015s
W20260709 13:01:53.708770  1700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.003s	sys 0.015s
I20260709 13:01:53.709987  1703 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:53.712761  1700 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:53.715306  1700 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:01:53.717553  1700 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:01:53.719007  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:53.720607  1709 raft_consensus.cc:2410] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 20 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260709 13:01:53.681856  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.735862  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.741480  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:53.746922  7498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.004s	sys 0.003s
W20260709 13:01:53.747536  7498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.004s	sys 0.003s
I20260709 13:01:53.748910  7825 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:53.750500  7754 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.751669  7754 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.752295  7825 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:53.749512  7724 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.755105  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 78880.8us
I20260709 13:01:53.773133  7826 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:53.773761  7826 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:53.775660  7826 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.786176  7826 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:53.788414  7714 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.757s	user 0.012s	sys 0.000s
I20260709 13:01:53.788645  7861 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:53.789119  7714 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.789566  7861 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.793731  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.795254  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.798424  1557 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20. Ops: []
I20260709 13:01:53.799324  7844 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:53.799947  7712 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.586532  7709 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:53.816772  1633 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:01:53.826503  7717 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.827734  7717 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:53.830176  1630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.011s	sys 0.010s
I20260709 13:01:53.830714  1551 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:53.832587  7743 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:01:53.834194  7743 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:53.834647  7743 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:53.830792  1630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.011s	sys 0.010s
I20260709 13:01:53.836488  7714 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.838547  7712 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:53.840684  7861 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.841230  1559 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:01:53.876706  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.877883  1553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2567) took 1864 ms (client timeout 1709 ms). Trace:
W20260709 13:01:53.878520  1553 rpcz_store.cc:269] 0709 13:01:52.013086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.013257 (+   171us) service_pool.cc:224] Handling call
0709 13:01:53.877374 (+1864117us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54002dc3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:53.877634 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1428996352}
W20260709 13:01:53.879386  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 56406.9us
I20260709 13:01:53.882225  7498 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:53.883082  7498 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:53.883672  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.001s	sys 0.017s
W20260709 13:01:53.884094  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.001s	sys 0.017s
W20260709 13:01:53.843233  1598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.001s	sys 0.015s
W20260709 13:01:53.885016  1598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.001s	sys 0.015s
I20260709 13:01:53.887120  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:53.888046  1707 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:53.893061  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:53.894104  1702 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:53.836160  7743 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.896075  7805 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.896926  7805 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.847304  1556 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:01:53.898662  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:53.848402  1558 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:53.901121  7419 raft_consensus.cc:3055] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:53.901562  7419 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:53.843428  1599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.004s	sys 0.013s
W20260709 13:01:53.902498  1599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.005s	sys 0.013s
I20260709 13:01:53.852315  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1329) took 1023 ms. Trace:
I20260709 13:01:53.903035  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:53.856598  1555 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 15: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:53.857823  7754 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:53.855019  7724 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.844002  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:53.907199  1557 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:53.863626  7645 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.557s	user 0.017s	sys 0.006s
I20260709 13:01:53.863396  7677 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.859218  7455 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.908826  7645 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.909190  7677 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.867393  7761 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:01:53.903213  2269 rpcz_store.cc:276] 0709 13:01:52.828920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.829331 (+   411us) service_pool.cc:224] Handling call
0709 13:01:53.263783 (+434452us) spinlock_profiling.cc:243] Waited 8.08 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 13:01:53.263997 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.378356 (+114359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.378403 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:53.378459 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:53.378501 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.851613 (+473112us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400598dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:53.851719 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.852064 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281037440}
I20260709 13:01:53.849540  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.911603  7677 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.912046  7645 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:53.849068  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.913775  1552 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:53.913695  7805 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.848994  7820 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:01:53.915196  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.915791  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.915441  7820 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:53.856194  7542 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.730s	user 0.015s	sys 0.007s
I20260709 13:01:53.918977  1708 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:53.919720  7611 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:53.872604  7711 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:53.920241  7611 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:53.846306  7844 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:53.921267  7780 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.861227  7624 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:53.948169  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.960927  7455 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:53.908057  7724 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:53.958920  7498 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.927574  7820 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.963135  7624 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:53.922375  7844 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:53.932725  1701 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:53.949376  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:53.961668  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.965520  1551 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:53.861943  7527 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:53.972649  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.973106  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.973454  1556 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:53.931682  1601 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:53.894142  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 734093us
I20260709 13:01:53.975713  1673 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:53.976779  7820 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:53.966619  2236 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:53.978775  7820 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:53.921797  7611 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.980613  7611 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:53.981206  7159 consensus_meta.cc:287] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.897s	user 0.009s	sys 0.009s
I20260709 13:01:53.926928  7862 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:01:53.940898  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.934019  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.849345  7480 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:01:53.969733  7720 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:53.896144  7743 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:53.960597  1558 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:01:53.970819  1553 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:01:53.971463  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.948822  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.967559  7591 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.935859  7761 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:01:53.996023  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.000209  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:54.000680  1557 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:01:54.004173  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:54.006851  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:54.007599  7734 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:53.999586  7591 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.011112  7447 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.011439  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:54.011772  7447 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:53.921947  7780 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.012519  7591 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:54.013362  1628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "207df21ae856459f9637b16a0feb2796"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:54.014207  7861 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.014959  7861 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.018203  7724 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:54.018707  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:54.019024  7732 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.019276  7724 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:54.020028  7732 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.023097  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:54.023298  7624 consensus_queue.cc:1059] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:54.024283  7624 raft_consensus.cc:3055] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:54.024783  7624 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:01:54.024961  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 93490.6us
I20260709 13:01:53.995532  7862 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:54.026402  7862 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:54.028716  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:54.029683  7732 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:54.029865  1629 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:54.005898  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:54.023491  7740 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:54.023101  1700 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:01:54.012183  1633 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:53.873445  7717 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:53.936252  7836 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.643s	user 0.003s	sys 0.008s
I20260709 13:01:54.032313  7740 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:53.999461  7761 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:54.030131  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:54.046648  1702 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:01:54.046067  2234 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:53.943619  7699 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:54.054114  7720 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.056706  7720 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:54.057210  7732 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:54.057369  1705 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:54.057756  7732 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.058161  7732 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:54.035653  7624 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.058879  1705 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:54.059330  7624 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:54.059815  7498 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:54.060263  7498 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:54.060636  7498 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:54.061784  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:54.062513  7800 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:01:54.063625  1629 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:01:54.064751  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:53.941741  7419 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.066900  1626 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:01:54.067098  7419 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.067335  1626 pending_rounds.cc:85] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 6
I20260709 13:01:54.067660  1626 pending_rounds.cc:107] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:01:54.067956  1626 raft_consensus.cc:2889] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:54.070758  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:54.063651  1599 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:54.075538  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:54.076409  1635 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.077406  7447 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:54.057216  7720 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 13:01:54.080680  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 71461.9us
I20260709 13:01:54.081331  1707 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:54.090013  1552 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:54.090297  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:53.869764  7661 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:01:54.089564  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 58515.9us
I20260709 13:01:54.090901  7740 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.096124  1557 raft_consensus.cc:2410] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:01:54.096696  7740 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:54.091109  7527 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:01:54.094950  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:54.100378  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:54.106060  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:54.108628  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:54.107131  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:54.105500  1673 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.508s (SENT)
W20260709 13:01:54.113976  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50477.5us
I20260709 13:01:54.114936  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:54.115661  1551 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
W20260709 13:01:54.116371  1706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.006s	sys 0.010s
W20260709 13:01:54.117008  1706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.007s	sys 0.011s
I20260709 13:01:54.118008  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2606) took 1011 ms. Trace:
I20260709 13:01:54.118432  1706 rpcz_store.cc:276] 0709 13:01:53.106953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.128799 (+ 21846us) service_pool.cc:224] Handling call
0709 13:01:53.129104 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.138989 (+  9885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.139017 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.139425 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.117522 (+978097us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:54.117589 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.117709 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.117780 (+    71us) raft_consensus.cc:1685] finished
0709 13:01:54.117794 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.117944 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9484,"raft.queue_time_us":22852,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3122,"thread_start_us":977689,"threads_started":1,"wal-append.queue_time_us":842327}
I20260709 13:01:54.122789  1553 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:54.124248  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:54.126385  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:54.127837  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:54.128579  1560 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
W20260709 13:01:54.129226  7824 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.504s	user 0.013s	sys 0.005s
I20260709 13:01:54.098889  7861 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:54.092217  7591 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:01:54.126199  7795 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:01:54.132246  7780 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:54.115366  1673 leader_election.cc:336] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.560s (SENT)
I20260709 13:01:54.137984  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:54.137760  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:54.116437  7792 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:54.093633  7661 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:54.143719  1558 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.146415  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:54.143653  1555 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
W20260709 13:01:54.149012  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.147794  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:54.150271  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:54.150233  1559 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:54.153060  1701 raft_consensus.cc:2410] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:01:54.162638  1626 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:01:54.173236  1702 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:54.186568  1707 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:54.179229  1599 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:54.171047  7820 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:54.162365  1458 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 11 to 14, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.194737  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:54.196610  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:54.198241  7761 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.199515  7447 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:54.199954  7761 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:54.201395  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:54.203073  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:54.204218  7591 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:54.204738  7591 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.205215  7591 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:54.206121  7867 raft_consensus.cc:2764] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:01:54.206971  7879 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:01:54.207896  7780 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:54.208283  7780 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.208647  7780 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:54.211508  7860 consensus_queue.cc:1175] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6923294c847b48ebb577e0935d316aa3" responder_term: 19 status { last_received { term: 19 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 19 index: 15 } }
I20260709 13:01:54.212837  7878 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:54.218137  7644 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:01:54.218672  7447 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:54.219867  7447 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.220732  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:54.221463  1704 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
W20260709 13:01:54.222739  7637 consensus_meta.cc:287] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.063s	user 0.011s	sys 0.007s
I20260709 13:01:54.223452  7661 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:54.223811  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 175781us
I20260709 13:01:54.224437  1629 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:01:54.224731  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 218981us
I20260709 13:01:54.213994  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:54.243422  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.256320  1600 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:54.260141  1635 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
W20260709 13:01:54.253767  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 138423us
I20260709 13:01:54.261489  1704 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:54.230017  7591 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.277053  2235 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:54.266255  7661 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:54.281944  1673 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.562s (SENT)
I20260709 13:01:54.282652  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:54.286358  1551 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:54.270358  7795 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:01:54.289871  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 53710us
I20260709 13:01:54.288385  7858 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:54.301586  2235 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:54.277005  7879 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:54.307638  7866 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:54.307477  7698 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:01:54.308194  7591 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:54.307658  7864 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:54.309026  7864 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:54.310241  7645 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:54.310189  7864 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.311376  7867 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:54.311750  7867 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:54.312553  7867 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.313354  1551 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:54.315119  7637 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:54.315841  7637 consensus_queue.cc:1243] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:54.318544  1551 pending_rounds.cc:85] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 8
I20260709 13:01:54.318863  1551 pending_rounds.cc:107] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:01:54.319104  1551 raft_consensus.cc:2889] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:54.319732  7826 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.003s
I20260709 13:01:54.323202  1558 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:54.324374  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:54.325213  7866 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:54.325776  7866 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:54.326790  7866 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.327576  2269 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:01:54.327765  7732 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.329036  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:54.329679  2271 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:54.297070  7743 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:54.330879  7743 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.331228  7743 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.303645  7498 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.333706  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:54.334517  2267 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
W20260709 13:01:54.308332  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 159435us
I20260709 13:01:54.343259  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:54.344008  1635 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:01:54.344951  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:54.345804  1559 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:54.345899  1558 raft_consensus.cc:2393] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:54.351954  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:54.352897  7844 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:54.354383  7844 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:54.354779  7844 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:54.355155  7844 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:54.295404  7734 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:01:54.355615  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 141724us
I20260709 13:01:54.313849  7867 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:54.364104  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:54.365448  7724 consensus_queue.cc:1059] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:54.365777  7498 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:54.366113  7858 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:54.368784  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:54.369580  7646 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.369982  7734 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:54.370105  7800 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:54.370855  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:54.357241  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:54.380383  1558 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:54.377450  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:54.389639  1553 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:54.353643  7862 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.342962  7732 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:54.391521  7724 raft_consensus.cc:3055] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:54.391098  7780 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.394865  1702 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:01:54.402894  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:54.403759  7677 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:54.407290  1700 raft_consensus.cc:2410] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:01:54.356804  7419 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:01:54.432812  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.452607  1704 raft_consensus.cc:2368] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:01:54.454368  1706 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:54.388438  7858 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.370561  7879 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:54.459441  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 67397.9us
I20260709 13:01:54.455869  2269 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:54.462275  2267 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:54.429440  7754 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.469813  1628 raft_consensus.cc:606] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:54.470412  1628 raft_consensus.cc:614] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:54.471143  1630 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:54.427981  7724 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:54.471364  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 193761us
I20260709 13:01:54.455665  7419 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.475442  7419 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:54.478132  7754 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.479557  7743 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.480438  7754 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:54.484591  1635 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:01:54.481791  7743 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:54.453042  7677 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:54.492496  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.493952  1703 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:54.481985  7754 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:01:54.447829  7795 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:54.495811  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.496122  1553 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:01:54.430267  7646 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.503605  1601 leader_election.cc:400] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:01:54.503988  1601 leader_election.cc:403] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:01:54.474440  7820 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.506233  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.530625  7820 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:54.510766  7883 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.102s	user 0.004s	sys 0.000s
I20260709 13:01:54.536739  7734 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.539511  7862 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:54.540817  7795 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.544276  7795 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:54.514842  7677 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.515813  7645 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:54.522326  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 153681us
I20260709 13:01:54.528198  7879 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:54.529013  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.532804  7820 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:54.488549  7732 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:54.455844  7800 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.551514  7864 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:54.564248  7844 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:54.571588  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 223055us
I20260709 13:01:54.572357  7800 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:54.574568  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:54.575410  1553 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:54.575945  1599 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:54.576435  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:54.577359  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:54.578517  7864 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:01:54.578796  7159 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:54.579319  7864 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:54.579738  7724 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.581140  7724 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.598811  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:54.604010  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:54.604785  1555 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:54.603642  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:54.559832  7717 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:54.611342  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:54.604782  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:54.616389  1703 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:54.617455  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:54.618458  1559 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:54.619118  1601 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:54.575448  7644 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 13:01:54.624167  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 46914.6us
I20260709 13:01:54.603693  7780 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:54.625003  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:54.625213  7644 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:54.626111  7644 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.619526  1700 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:01:54.600533  7645 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:54.631428  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:54.600256  7542 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:54.633589  7527 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.628141  7864 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:54.640494  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:54.660355  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:54.660692  1559 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:54.641383  1628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:54.611302  7879 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:54.613952  7717 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:54.644253  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:54.647948  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:54.650645  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:54.611783  7866 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.645370  2271 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:54.652227  1627 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 13:01:54.654273  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.679184  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:54.650926  7677 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.708850  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:54.710230  1700 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:01:54.710100  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 252441us
I20260709 13:01:54.711032  1629 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:01:54.712010  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:54.712760  1560 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.713199  1633 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:54.667027  7867 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.713798  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 51489.5us
I20260709 13:01:54.646389  7447 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:01:54.720731  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:54.682075  7844 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:54.653167  7699 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
W20260709 13:01:54.724716  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.663766  7714 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:01:54.720984  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:54.668316  7542 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.775182  7765 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:01:54.776283  7893 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:01:54.958271  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.776633  7581 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:01:54.789283  7646 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:54.720350  7720 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:54.720103  7527 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:54.792353  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 148194us
I20260709 13:01:54.970542  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:54.720075  7879 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.701910  7866 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.730777  7867 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:54.759131  7498 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:54.730357  7780 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:54.786303  7645 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.660193  7826 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:01:54.918077  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:54.725637  7712 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:01:54.922685  1559 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:01:54.921948  1555 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
W20260709 13:01:54.924160  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 560219us
I20260709 13:01:54.929332  1560 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
W20260709 13:01:54.936964  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.712036  7732 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:54.940466  2271 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:01:54.944573  1630 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:54.946554  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:54.993638  1635 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:01:54.946971  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:54.922395  7698 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:54.957746  7765 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.989038  1629 raft_consensus.cc:2410] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:01:54.992795  2271 pending_rounds.cc:85] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 9
I20260709 13:01:55.002692  2271 pending_rounds.cc:107] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:01:55.003046  2271 raft_consensus.cc:2889] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:55.003481  2271 pending_rounds.cc:107] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:01:55.003780  2271 raft_consensus.cc:2889] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:54.944322  7419 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:54.991729  1633 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:01:54.984750  7897 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.147s	user 0.005s	sys 0.007s
W20260709 13:01:55.014977  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44555.2us
I20260709 13:01:55.017324  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:55.018595  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:55.006858  7765 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:55.014587  7732 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.020236  7527 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:55.021341  7732 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:55.022730  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 383741us
I20260709 13:01:55.023622  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:55.001284  7447 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:55.026854  7780 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.027313  7866 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:55.010982  7743 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:55.030174  7743 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.033355  7743 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:55.009279  7498 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.034543  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:55.035748  7498 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:55.014973  2269 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:55.020259  7542 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:55.038935  7902 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.039702  7902 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.040663  7714 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:55.041066  7714 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.041474  7714 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:55.043553  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.045365  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:55.052631  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:55.053259  1700 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:55.054176  7698 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.055290  7635 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.055938  7635 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:55.056763  7698 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:55.057792  1635 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:01:55.053314  1702 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 12.
I20260709 13:01:55.059978  1633 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:55.072448  1635 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:55.073719  7611 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:55.074177  7611 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.074539  7611 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:55.084288  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:55.066308  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 47769us
I20260709 13:01:55.085424  1560 raft_consensus.cc:2393] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 14: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:55.064793  1703 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:55.090760  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:55.091897  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:55.066109  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:55.099983  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.100657  7900 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:55.096630  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:55.102312  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 76386.2us
I20260709 13:01:55.109171  1673 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:55.109608  7895 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 13:01:55.111088  7890 log.cc:927] Time spent T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
W20260709 13:01:55.112071  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46068.3us
I20260709 13:01:55.119138  2235 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:55.113461  1601 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:55.126771  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:55.085527  7879 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:55.057998  7635 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:55.072470  7867 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:55.132853  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:55.125523  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:55.139523  1709 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:55.104441  7527 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:55.134055  1560 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:55.143988  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:55.146448  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:55.150841  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:55.152524  1633 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:55.123041  7826 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.167546  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:55.162966  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.123297  7820 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:55.124205  7498 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.164114  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:55.133872  7903 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:55.176543  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:55.168421  1629 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
W20260709 13:01:55.149657  7858 consensus_meta.cc:287] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.678s	user 0.004s	sys 0.013s
I20260709 13:01:55.181887  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:55.190754  2269 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:55.183336  1701 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:55.132611  7743 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:55.138767  7761 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:55.129232  7581 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 13:01:55.199384  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:55.199529  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:55.163686  7711 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.180459  7542 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:55.210474  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 176073us
W20260709 13:01:55.186946  7644 consensus_meta.cc:287] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.560s	user 0.015s	sys 0.006s
I20260709 13:01:55.183764  7860 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:55.209692  1551 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
W20260709 13:01:55.217239  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 108209us
I20260709 13:01:55.151571  7732 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:01:55.226045  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:55.165864  7712 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:55.203930  7761 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.199120  7820 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:55.239166  7743 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.240363  7820 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:55.241338  7743 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:55.242321  7717 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.243486  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:55.244221  1629 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:01:55.237774  7907 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:01:55.238782  7419 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:55.184855  7826 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.247987  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:55.213001  7542 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.230820  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:55.220616  7644 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:55.252362  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2617) took 1013 ms. Trace:
W20260709 13:01:55.247037  7891 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 13:01:55.204244  7858 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:55.260413  7892 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:01:55.257575  7712 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:01:55.248917  7859 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:01:55.261895  7741 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:01:55.263671  7826 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:55.313850  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:55.264133  7542 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:55.278777  7677 consensus_meta.cc:287] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
I20260709 13:01:55.203570  7498 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:55.232071  7860 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:55.247500  7761 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:55.280367  1635 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:55.295123  1628 raft_consensus.cc:606] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:55.342573  1628 raft_consensus.cc:614] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:55.271299  1707 rpcz_store.cc:276] 0709 13:01:54.238460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.238567 (+   107us) service_pool.cc:224] Handling call
0709 13:01:54.252174 (+ 13607us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:54.279805 (+ 27631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.279838 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:54.338607 (+ 58769us) log.cc:844] Serialized 52 byte log entry
0709 13:01:54.363906 (+ 25299us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b48001e0258. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:01:54.496907 (+133001us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:54.496941 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.497001 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.247027 (+750026us) raft_consensus.cc:1685] finished
0709 13:01:55.247056 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.252272 (+  5216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7916,"raft.run_cpu_time_us":2255,"raft.run_wall_time_us":86688,"spinlock_wait_cycles":5308160,"thread_start_us":157886,"threads_started":1,"wal-append.queue_time_us":362722}
I20260709 13:01:55.279973  7879 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:55.219170  7711 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.323020  2271 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:55.340822  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:55.346450  7861 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.345321  7826 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:01:55.416109  7917 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:55.417518  7765 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.347282  7844 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:55.429409  7765 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:55.412374  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 263714us
W20260709 13:01:55.425091  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.445775  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:55.446621  1560 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:55.449513  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.469540  7916 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:01:55.470285  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 199884us
I20260709 13:01:55.472362  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:55.473336  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2538) took 1187 ms. Trace:
I20260709 13:01:55.473768  1632 rpcz_store.cc:276] 0709 13:01:54.086791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.090275 (+  3484us) service_pool.cc:224] Handling call
0709 13:01:54.136557 (+ 46282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.182133 (+ 45576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.182164 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.230216 (+ 48052us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.456112 (+225896us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:54.456169 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.456255 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.110397 (+654142us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:55.268764 (+158367us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b24002c2028. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dad689c4 00007f06dad66acb 00007f06daf21dc9 00007f06daf21a55 00007f06daf20fb0 00007f06ddb97488 00007f06ddb97be8 00007f06ddb6f398 00007f06ddb6a76a 00007f06ddb69bb6
0709 13:01:55.269331 (+   567us) raft_consensus.cc:1685] finished
0709 13:01:55.269354 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.269521 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13809,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":36749,"spinlock_wait_cycles":118066432,"thread_start_us":225341,"threads_started":1,"wal-append.queue_time_us":739260}
I20260709 13:01:55.475483  7711 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:55.476186  7711 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:55.476591  7711 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:55.477126  7711 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:55.477749  7909 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.457s	user 0.002s	sys 0.002s
I20260709 13:01:55.479480  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1338) took 1071 ms. Trace:
I20260709 13:01:55.479851  2265 rpcz_store.cc:276] 0709 13:01:54.408357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.408586 (+   229us) service_pool.cc:224] Handling call
0709 13:01:54.453156 (+ 44570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.503666 (+ 50510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.503701 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.553666 (+ 49965us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.937737 (+384071us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:54.937795 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.037502 (+ 99707us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b5400710f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:55.037552 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.477067 (+439515us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:55.479067 (+  2000us) raft_consensus.cc:1685] finished
0709 13:01:55.479093 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.479291 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11308,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":46528,"spinlock_wait_cycles":167232128,"thread_start_us":376117,"threads_started":1,"wal-append.queue_time_us":460946}
I20260709 13:01:55.351156  7699 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 13:01:55.490408  7860 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.355350  7902 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:55.497918  7912 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.422s	user 0.001s	sys 0.001s
I20260709 13:01:55.499465  7498 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:55.502534  7858 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:55.474973  7904 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.401s	user 0.002s	sys 0.001s
I20260709 13:01:55.473953  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:55.507504  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 303440us
I20260709 13:01:55.535138  1700 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:01:55.476532  7906 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.398s	user 0.003s	sys 0.000s
I20260709 13:01:55.559002  1635 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:55.572530  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:55.567386  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:55.549428  7724 consensus_meta.cc:287] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.933s	user 0.014s	sys 0.000s
I20260709 13:01:55.506260  7720 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:55.457834  1560 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
W20260709 13:01:55.586715  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 395110us
I20260709 13:01:55.602295  1458 catalog_manager.cc:5697] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 13 to 14, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:55.605599  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 412131us
I20260709 13:01:55.586261  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:55.425423  7879 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.143s
I20260709 13:01:55.423942  7861 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.560930  7699 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:55.567953  7498 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:55.606870  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:55.485620  7611 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:55.583204  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 425422us
I20260709 13:01:55.635428  1458 catalog_manager.cc:5697] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:55.631803  7714 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.000s
I20260709 13:01:55.584954  7902 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:55.637753  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:55.617476  7527 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:55.601975  7795 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:01:55.640353  7903 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:55.653829  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.669329  1551 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:55.670076  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:01:55.654834  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.644588  1599 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.700s (SENT) [suppressed 15 similar messages]
I20260709 13:01:55.608610  7677 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:01:55.687691  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 213850us
I20260709 13:01:55.675947  2234 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:55.666392  7902 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:55.699734  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 350759us
I20260709 13:01:55.700891  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:55.699348  7754 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.705657  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2889) took 1330 ms. Trace:
I20260709 13:01:55.687032  7858 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.707070  7923 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:55.712889  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:55.714612  2271 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:55.702528  7902 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:55.702231  7724 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.709856  1708 rpcz_store.cc:276] 0709 13:01:54.369610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.382605 (+ 12995us) service_pool.cc:224] Handling call
0709 13:01:54.404638 (+ 22033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.405211 (+   573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.405252 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.405873 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.759522 (+353649us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:54.759567 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.759635 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.475801 (+716166us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:55.686607 (+210806us) raft_consensus.cc:1685] finished
0709 13:01:55.686630 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.700354 (+ 13724us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9655,"raft.queue_time_us":1439,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":28392,"spinlock_wait_cycles":12166016,"thread_start_us":353175,"threads_started":1,"wal-append.queue_time_us":576731}
I20260709 13:01:55.668869  7498 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.717401  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:55.666230  7714 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.714201  1458 catalog_manager.cc:5697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 11 to 14, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.669251  7699 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.705673  7447 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:55.710155  7754 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.725627  1458 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.709415  7927 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:55.714421  7923 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:55.706152  7826 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
W20260709 13:01:55.730924  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 86379.1us
I20260709 13:01:55.710615  7712 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:01:55.705942  7720 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.720449  7858 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:55.742861  1458 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 11 to 14, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:55.733543  7923 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:55.789520  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 79591.9us
I20260709 13:01:55.727849  7724 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.749658  7159 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.795754  7159 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:55.797469  7699 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:55.798818  7935 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:01:55.733556  7581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.006s	sys 0.003s
I20260709 13:01:55.800017  7934 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:55.717664  7527 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:55.807962  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 95937.6us
W20260709 13:01:55.804855  1455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35568 (request call id 323) took 25619 ms (client timeout 15000 ms). Trace:
I20260709 13:01:55.723500  7903 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.808830  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:55.741827  7447 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:01:55.813673  7159 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:55.813829  7928 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:55.813840  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:55.815521  1628 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:01:55.817988  7498 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:55.819344  7932 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:55.820026  7932 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:55.823199  2235 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:55.814155  1630 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:01:55.813089  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:55.838907  7826 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.845044  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:55.849040  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 54292.3us
I20260709 13:01:55.851514  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:55.852257  2271 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:01:55.855377  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:55.856000  2271 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:55.857328  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:55.858744  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:55.859279  7933 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:01:55.860574  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:55.861150  1629 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:55.865495  7931 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.866086  7931 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:55.866921  7945 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:55.868525  7931 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:55.832340  7699 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:55.870128  7724 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:55.881456  1629 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:55.842824  7934 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:55.884112  1458 catalog_manager.cc:5697] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 9 to 13, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:55.841341  7826 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:55.891268  7861 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:55.907814  7940 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:55.908319  7940 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.908667  7940 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:55.892499  7932 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:55.909049  7861 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:55.909510  7861 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.909868  7861 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:55.910844  1458 catalog_manager.cc:5697] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:55.916921  2271 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:55.921610  7698 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:55.925793  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:55.926822  1555 raft_consensus.cc:2410] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:55.927023  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:55.927791  1558 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 20: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:55.928570  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:55.930280  7861 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:55.931483  1554 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:55.934823  7861 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:55.936529  7805 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:55.936971  7805 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:01:55.809038  1455 rpcz_store.cc:269] 0709 13:01:30.047194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.053943 (+  6749us) service_pool.cc:224] Handling call
0709 13:01:55.643082 (+25589139us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:46.372738 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:46.373582 (+   844us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:46.373649 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:01:46.373676 (+    27us) tablet.cc:662] Decoding operations
0709 13:01:46.470604 (+ 96928us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:46.495389 (+ 24785us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:46.497506 (+  2117us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:01:46.609511 (+112005us) tablet.cc:701] Row locks acquired
0709 13:01:46.609566 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:01:46.609786 (+   220us) write_op.cc:270] Start()
0709 13:01:46.609963 (+   177us) write_op.cc:276] Timestamp: P: 1783602106609703 usec, L: 0
0709 13:01:46.641460 (+ 31497us) op_driver.cc:348] REPLICATION: starting
0709 13:01:46.803795 (+162335us) log.cc:844] Serialized 7524 byte log entry
0709 13:01:47.979251 (+1175456us) op_driver.cc:464] REPLICATION: finished
0709 13:01:48.403464 (+424213us) write_op.cc:301] APPLY: starting
0709 13:01:48.403582 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:48.701065 (+297483us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:48.701186 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:48.997793 (+296607us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:48.998409 (+   616us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:01:48.998514 (+   105us) write_op.cc:312] APPLY: finished
0709 13:01:48.999611 (+  1097us) log.cc:844] Serialized 164 byte log entry
0709 13:01:49.161576 (+161965us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:49.184712 (+ 23136us) write_op.cc:454] Released schema lock
0709 13:01:49.194430 (+  9718us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:49.209302 (+ 14872us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:49.209343 (+    41us) write_op.cc:454] Released schema lock
0709 13:01:49.240585 (+ 31242us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b540009b354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcc32a 00007f06ddf51f14 00007f06ddf51ec3 00007f06ddf51e38 00007f06ddf51df3 00007f06ddf510dc 00007f06ddf7ae16 00007f06ddf62cbb 00007f06ddf4d39d 00007f06ddf50d75
Metrics: {"mutex_wait_us":277159,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":409155,"apply.run_cpu_time_us":58370,"apply.run_wall_time_us":806459,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79331,"num_ops":18,"prepare.queue_time_us":330952,"prepare.run_cpu_time_us":86987,"prepare.run_wall_time_us":919986,"raft.queue_time_us":298154,"raft.run_cpu_time_us":40599,"raft.run_wall_time_us":1293546,"replication_time_us":1335578,"spinlock_wait_cycles":50176384,"thread_start_us":1093320,"threads_started":5,"wal-append.queue_time_us":844708,"wal-append.run_cpu_time_us":25015,"wal-append.run_wall_time_us":2528832}]]}
W20260709 13:01:55.947307  7542 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.568s	user 0.003s	sys 0.007s
W20260709 13:01:55.959237  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 319221us
W20260709 13:01:55.961552  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 152103us
I20260709 13:01:55.946620  7934 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:55.982283  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 104363us
I20260709 13:01:55.966442  7542 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:55.985658  7542 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:55.989564  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:55.990741  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:55.991992  1629 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:55.991959  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:56.005167  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.005897  2264 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:56.007893  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:56.008538  2270 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:56.010282  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:56.010860  1630 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:01:56.011162  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:55.937901  7805 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:56.012288  7805 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:56.015460  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:55.965881  7820 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:56.022101  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:56.029901  1458 catalog_manager.cc:5697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:55.994560  7699 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:56.017519  7754 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:56.029084  7903 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:01:56.046346  7951 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:01:56.046265  7934 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.047446  7714 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:56.034653  7717 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.045660  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:01:56.041139  7761 consensus_meta.cc:287] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.692s	user 0.007s	sys 0.004s
I20260709 13:01:56.034946  7864 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:56.051077  1629 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:56.037536  7858 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:56.065672  1630 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:01:56.030833  7820 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:56.065352  7711 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.588s	user 0.006s	sys 0.005s
I20260709 13:01:56.084169  7939 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:56.084743  7939 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.085095  7939 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.092139  7938 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:56.093003  7938 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:56.094280  7419 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:56.063895  7754 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.083662  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:56.055267  1458 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 2 to 8, term changed from 17 to 20, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to <none>, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193), VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194), VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195), VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 20 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:56.110730  1630 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:56.111696  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:56.094761  7419 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:56.120280  2271 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:56.118734  1458 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 13 to 15, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:01:56.062443  7761 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:56.131644  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:56.119897  7908 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.918s	user 0.004s	sys 0.002s
I20260709 13:01:56.140074  1633 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:01:56.140936  7948 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:56.135144  7844 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:56.141403  7948 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:56.141861  7948 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:56.141753  7844 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.165539  7940 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.166234  7959 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:56.166981  7959 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.169358  7959 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:56.158360  7950 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:56.173332  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.174057  2271 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:56.175180  7419 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.175477  1458 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 11 to 12, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.176445  7419 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:56.178726  7960 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:01:56.179181  7820 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:01:56.170375  7826 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:56.158353  7952 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:01:56.149360  7714 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:56.181375  7714 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:56.183499  7714 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:56.177404  7939 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.187211  7761 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:56.187455  7961 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:01:56.187645  7939 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:56.094331  7938 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.188403  7950 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:56.188609  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2628) took 1069 ms. Trace:
I20260709 13:01:56.189002  1703 rpcz_store.cc:276] 0709 13:01:55.119368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.208722 (+ 89354us) service_pool.cc:224] Handling call
0709 13:01:55.209034 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.944196 (+735162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.944228 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.944714 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:01:55.967529 (+ 22815us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:55.968648 (+  1119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.968728 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.188421 (+219693us) raft_consensus.cc:1685] finished
0709 13:01:56.188441 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.188558 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":718218,"raft.queue_time_us":719416,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":22459,"threads_started":1,"wal-append.queue_time_us":110913}
I20260709 13:01:56.190927  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.191510  2265 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:56.189355  7950 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.114391  7754 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.111613  7711 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:56.217540  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 986845us
I20260709 13:01:56.177734  1458 catalog_manager.cc:5697] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:56.193897  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.203081  7956 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.203953  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:56.204613  7953 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.205049  7734 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:56.205230  7858 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.206000  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:56.208205  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:56.210000  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:56.211091  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:56.247330  2264 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.211933  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:56.248373  1629 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:56.229373  1458 catalog_manager.cc:5697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 2 to 14. New cstate: current_term: 14 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.231381  2270 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:56.249995  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:56.244825  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 277857us
I20260709 13:01:56.243651  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:56.245254  2267 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:56.252108  2269 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:56.251420  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:56.253705  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:56.262919  7717 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:56.266278  7624 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:56.242483  7902 consensus_meta.cc:287] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 13:01:56.268586  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:56.266907  7624 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.216032  7780 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:56.228255  7826 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:56.276861  2269 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:01:56.290521  1628 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:56.295071  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:56.253912  7939 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:56.285461  2271 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
W20260709 13:01:56.287269  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.300127  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:56.300733  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:56.275432  7624 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.313952  2271 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:56.309893  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 91303.9us
I20260709 13:01:56.113452  7699 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:56.314858  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.286605  7765 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.313194  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:56.286738  7866 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:56.246832  7923 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.291150  7861 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:56.317188  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:56.300889  7936 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:56.323431  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:56.301887  7939 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:56.323165  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:56.254813  7858 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:56.332106  1707 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:56.240950  7956 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.247965  7953 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.277261  7902 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.305907  7820 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:56.273089  7734 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.352170  2270 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:56.355170  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:56.355993  1709 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:56.356341  2271 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:01:56.316990  7929 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:56.295552  7826 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:56.364259  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:56.365382  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.369521  2271 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:01:56.369776  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:56.366017  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:56.366880  2265 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:01:56.367856  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.323400  7542 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:01:56.428695  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:56.398046  1526 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:56.415144  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.391026  1628 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:01:56.439457  7844 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:56.340481  7780 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 13:01:56.361274  1673 connection.cc:256] RPC call timeout handler was delayed by -2.209850461999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
I20260709 13:01:56.343884  7950 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.406383  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:56.450907  1709 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:01:56.348311  7939 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:56.448886  7950 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.448589  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:56.390949  1626 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:01:56.341403  7866 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.442335  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.490852  2269 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:56.492029  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.492776  2269 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:56.494585  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.498775  2269 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:56.401594  2268 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:56.504866  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.514464  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.515528  2263 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 11: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:56.515745  1634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:56.516450  1634 raft_consensus.cc:606] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:56.516482  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:56.517364  7964 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:01:56.519134  7926 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:56.519682  7923 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:56.519750  7926 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:56.520454  7754 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:56.521504  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.517786  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:56.545801  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2630) took 1425 ms. Trace:
I20260709 13:01:56.548084  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:56.342471  7765 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.553004  7765 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:56.553629  1700 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:56.557148  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 159219us
I20260709 13:01:56.563366  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:56.563942  1555 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:01:56.516537  7975 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:01:56.564334  1628 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:01:56.586992  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:56.588143  1555 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.473599  7950 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:56.596726  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.546721  1701 rpcz_store.cc:276] 0709 13:01:55.119970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.225942 (+105972us) service_pool.cc:224] Handling call
0709 13:01:55.246674 (+ 20732us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.945647 (+698973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.945677 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.946091 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.275714 (+329623us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:56.275774 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.275874 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.522992 (+247118us) raft_consensus.cc:1685] finished
0709 13:01:56.523018 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.545609 (+ 22591us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":965292,"raft.queue_time_us":690967,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4328,"thread_start_us":329242,"threads_started":1,"wal-append.queue_time_us":404477}
I20260709 13:01:56.602705  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:56.389842  7820 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:56.611068  1551 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:56.613756  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:56.614442  1626 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:56.605029  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:56.615131  1558 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:56.619952  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:56.620810  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:56.625877  1700 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:01:56.617491  2268 raft_consensus.cc:2410] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:01:56.636322  2262 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:56.640232  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1309) took 1495 ms. Trace:
I20260709 13:01:56.657196  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:56.657866  2269 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:56.661724  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:56.671795  1557 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:56.676337  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:56.612709  7953 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:56.617625  7940 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:56.676456  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 228755us
I20260709 13:01:56.653072  1627 rpcz_store.cc:276] 0709 13:01:55.145155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.145323 (+   168us) service_pool.cc:224] Handling call
0709 13:01:55.175469 (+ 30146us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:55.199232 (+ 23763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.199265 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:55.220977 (+ 21712us) log.cc:844] Serialized 52 byte log entry
0709 13:01:55.461188 (+240211us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:55.715595 (+254407us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.715768 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.715857 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.639948 (+924091us) raft_consensus.cc:1685] finished
0709 13:01:56.639987 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.640162 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6599,"prepare.queue_time_us":211609,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":5719,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":19914,"thread_start_us":319402,"threads_started":2,"wal-append.queue_time_us":693123}
I20260709 13:01:56.687166  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:56.689082  1551 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:01:56.706897  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:56.707873  1627 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
W20260709 13:01:56.751012  1673 connection.cc:256] RPC call timeout handler was delayed by -2.1029279219999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 13:01:56.751590  1673 connection.cc:256] RPC call timeout handler was delayed by -1.8335651639999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 13:01:56.751988  1673 connection.cc:256] RPC call timeout handler was delayed by -1.7115141839999524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
W20260709 13:01:56.752362  1673 connection.cc:256] RPC call timeout handler was delayed by -1.1928504619999671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3129s for a response
I20260709 13:01:56.754793  1551 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:01:56.763219  1558 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:01:56.772842  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:56.780323  1555 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:56.782112  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:56.782773  1627 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:56.699713  7958 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:56.750087  7952 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:01:56.709570  7950 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:56.732626  7926 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:56.774389  7805 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.762s	user 0.011s	sys 0.001s
I20260709 13:01:56.783542  7903 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.826596  2264 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.001s
I20260709 13:01:56.827349  2264 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:56.819832  1558 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:56.820196  7911 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:56.782434  7979 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:56.821798  7973 log.cc:927] Time spent T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:01:56.693668  7724 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 13:01:56.405179  7929 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.827324  2235 leader_election.cc:400] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:01:56.820643  7955 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:56.813211  2269 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
W20260709 13:01:56.820207  7930 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.866s	user 0.004s	sys 0.001s
I20260709 13:01:56.837193  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:56.813395  7711 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:56.822911  7858 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:56.877434  2235 leader_election.cc:403] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:01:56.840436  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 393139us
I20260709 13:01:56.839968  7879 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.905637  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:56.791625  7958 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:56.836815  7903 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:56.872249  7950 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:01:56.984115  7967 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
I20260709 13:01:56.936848  7879 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:57.119024  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 294362us
I20260709 13:01:56.935278  7988 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.870118  7911 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:57.011195  1709 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.007s	sys 0.013s
I20260709 13:01:57.152596  1627 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
W20260709 13:01:57.121870  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.016s	sys 0.014s
W20260709 13:01:57.024279  7938 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.010s	sys 0.010s
I20260709 13:01:56.841264  7979 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:57.175257  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.016s	sys 0.020s
W20260709 13:01:57.181180  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.017s	sys 0.020s
I20260709 13:01:56.935034  7754 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.185673  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:57.176245  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.017s	sys 0.014s
I20260709 13:01:57.185289  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2627) took 2066 ms. Trace:
W20260709 13:01:57.175354  1709 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.007s	sys 0.018s
I20260709 13:01:57.158972  7711 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:01:57.193008  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:57.180300  7938 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.011s	sys 0.011s
I20260709 13:01:57.166671  7844 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:57.212273  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:57.188499  1702 rpcz_store.cc:276] 0709 13:01:55.118983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.128226 (+  9243us) service_pool.cc:224] Handling call
0709 13:01:55.128515 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.161678 (+ 33163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.161726 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.174704 (+ 12978us) log.cc:844] Serialized 26 byte log entry
0709 13:01:55.608676 (+433972us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:55.608718 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.608787 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.312840 (+704053us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:57.176530 (+863690us) raft_consensus.cc:1685] finished
0709 13:01:57.176561 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.185221 (+  8660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":699997,"raft.queue_time_us":52003,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":24090,"spinlock_wait_cycles":40235904,"thread_start_us":390190,"threads_started":1,"wal-append.queue_time_us":504612}
I20260709 13:01:57.154559  7542 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:01:57.180815  7976 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.307s	user 0.000s	sys 0.008s
I20260709 13:01:57.224457  1627 raft_consensus.cc:2410] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:01:57.223883  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:57.187680  7948 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.045s	user 0.012s	sys 0.000s
I20260709 13:01:57.205834  1551 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
W20260709 13:01:57.211423  1634 consensus_meta.cc:287] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.514s	user 0.005s	sys 0.005s
I20260709 13:01:57.324059  1634 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:57.325045  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:57.325770  1634 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:57.172780  7743 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:57.238950  7734 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:57.333231  7611 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:57.239156  7977 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:57.239604  1627 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:57.334049  1634 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:57.243739  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:57.335014  1558 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
W20260709 13:01:57.222867  7982 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.400s	user 0.000s	sys 0.001s
I20260709 13:01:57.282940  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2693) took 1294 ms. Trace:
I20260709 13:01:57.223349  7844 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:01:57.296627  1628 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.657s	user 0.004s	sys 0.004s
I20260709 13:01:57.297991  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:57.288741  7447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.004s	sys 0.037s
I20260709 13:01:57.205379  7754 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.366876  7754 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:57.244062  7986 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:57.259526  7861 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:57.369572  7861 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:57.283800  7913 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.328111  1551 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:57.179929  7988 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:57.327344  7743 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:01:57.355170  1626 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.000s
I20260709 13:01:57.339921  2269 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:57.358609  1628 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:01:57.358788  1557 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:01:57.315605  7591 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.363983  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.364006  7866 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:57.364938  7447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.004s	sys 0.038s
I20260709 13:01:57.369532  7986 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.240940  7542 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:57.355690  1632 rpcz_store.cc:276] 0709 13:01:55.989011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.997984 (+  8973us) service_pool.cc:224] Handling call
0709 13:01:56.028178 (+ 30194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.038341 (+ 10163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.038401 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.051318 (+ 12917us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.214260 (+162942us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:56.214297 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.214362 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.282642 (+1068280us) raft_consensus.cc:1685] finished
0709 13:01:57.282673 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.282856 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1073,"raft.queue_time_us":6196,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":3643,"thread_start_us":140934,"threads_started":1,"wal-append.queue_time_us":282463}
I20260709 13:01:57.370982  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.375123  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2634) took 1071 ms. Trace:
I20260709 13:01:57.383735  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2541) took 1021 ms. Trace:
I20260709 13:01:57.385051  1626 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:01:57.386019  1630 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:01:57.386245  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2542) took 1023 ms. Trace:
I20260709 13:01:57.383641  1700 rpcz_store.cc:276] 0709 13:01:56.299548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.299723 (+   175us) service_pool.cc:224] Handling call
0709 13:01:57.371085 (+1071362us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400376ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:57.371186 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581137152}
I20260709 13:01:57.384447  1628 rpcz_store.cc:276] 0709 13:01:56.362127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.586075 (+223948us) service_pool.cc:224] Handling call
0709 13:01:57.383669 (+797594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.377446  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2922) took 1053 ms. Trace:
I20260709 13:01:57.355967  7900 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:57.356091  7734 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:57.386685  1626 rpcz_store.cc:276] 0709 13:01:56.362444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.570262 (+207818us) service_pool.cc:224] Handling call
0709 13:01:57.386194 (+815932us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.395802  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.394374  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.394702  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2916) took 1428 ms. Trace:
I20260709 13:01:57.361413  7844 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:57.396643  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:57.396893  1706 rpcz_store.cc:276] 0709 13:01:55.966649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.967271 (+   622us) service_pool.cc:224] Handling call
0709 13:01:55.986677 (+ 19406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:56.260252 (+273575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.260282 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:56.260917 (+   635us) log.cc:844] Serialized 52 byte log entry
0709 13:01:56.316294 (+ 55377us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:56.316333 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.316396 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.394442 (+1078046us) raft_consensus.cc:1685] finished
0709 13:01:57.394469 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.394635 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257118,"raft.queue_time_us":265899,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":95,"thread_start_us":54996,"threads_started":1,"wal-append.queue_time_us":462842}
I20260709 13:01:57.388625  1708 rpcz_store.cc:276] 0709 13:01:56.324115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.342724 (+ 18609us) service_pool.cc:224] Handling call
0709 13:01:56.356670 (+ 13946us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:56.365993 (+  9323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.366045 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:56.366659 (+   614us) log.cc:844] Serialized 52 byte log entry
0709 13:01:56.678938 (+312279us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:57.011815 (+332877us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.154127 (+142312us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.374208 (+220081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.374302 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.374362 (+    60us) raft_consensus.cc:1685] finished
0709 13:01:57.374382 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.377349 (+  2967us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":755,"prepare.queue_time_us":165617,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":4605,"raft.queue_time_us":255283,"raft.run_cpu_time_us":473,"raft.run_wall_time_us":26655,"thread_start_us":839034,"threads_started":3,"wal-append.queue_time_us":997081}
I20260709 13:01:57.453164  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.455124  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2691) took 1601 ms. Trace:
I20260709 13:01:57.455603  1633 rpcz_store.cc:276] 0709 13:01:55.853538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.854651 (+  1113us) service_pool.cc:224] Handling call
0709 13:01:55.854972 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.140676 (+285704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.397353 (+1256677us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b540007ab54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:57.455053 (+ 57700us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":654976384}
I20260709 13:01:57.336623  7948 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.501823  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2920) took 1195 ms. Trace:
I20260709 13:01:57.502380  1704 rpcz_store.cc:276] 0709 13:01:56.306273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.344121 (+ 37848us) service_pool.cc:224] Handling call
0709 13:01:56.344424 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.669516 (+325092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.669571 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:56.669631 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:56.669676 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.501553 (+831877us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b5400387cd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:57.501619 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.501764 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747085184}
I20260709 13:01:57.503968  7948 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:57.505044  2271 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:57.506202  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1294) took 1141 ms. Trace:
I20260709 13:01:57.506560  2271 rpcz_store.cc:276] 0709 13:01:56.364877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.521258 (+156381us) service_pool.cc:224] Handling call
0709 13:01:57.505995 (+984737us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b5400289bd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:57.506139 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2260309248}
I20260709 13:01:57.507513  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.508358  2265 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 18. Current term is 19.
I20260709 13:01:57.460590  7743 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.513710  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.514475  1700 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 10.
I20260709 13:01:57.515825  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:57.516577  1553 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:01:57.514313  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:57.462311  7979 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:57.463006  7624 consensus_meta.cc:287] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.133s	user 0.011s	sys 0.000s
I20260709 13:01:57.462837  7734 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.340508  7977 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.466650  7986 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:57.470655  8000 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:57.471522  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:57.472666  2267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 1343) took 2323 ms (client timeout 2101 ms). Trace:
I20260709 13:01:57.473984  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1283) took 1199 ms. Trace:
I20260709 13:01:57.474380  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:57.476732  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.552170  1631 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:57.478704  7911 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:57.480183  7861 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:57.481457  7991 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:01:57.315999  7950 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.481348  7864 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:01:57.483318  7419 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.306s	user 0.014s	sys 0.000s
W20260709 13:01:57.483786  7974 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.868s	user 0.003s	sys 0.000s
I20260709 13:01:57.484197  7958 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:57.485082  7971 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.916s	user 0.002s	sys 0.000s
I20260709 13:01:57.486217  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2918) took 1189 ms. Trace:
I20260709 13:01:57.647966  1703 rpcz_store.cc:276] 0709 13:01:56.296473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.298108 (+  1635us) service_pool.cc:224] Handling call
0709 13:01:56.330470 (+ 32362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.337796 (+  7326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.337829 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.352900 (+ 15071us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.682592 (+329692us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:56.682651 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.682714 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.485989 (+803275us) raft_consensus.cc:1685] finished
0709 13:01:57.486016 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.486159 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16391,"raft.queue_time_us":12256,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":2187,"thread_start_us":314862,"threads_started":1,"wal-append.queue_time_us":991693}
W20260709 13:01:57.487171  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.487494  7542 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:57.487830  7902 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:57.489113  7826 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:57.490375  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.491304  7929 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:57.373063  7820 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:57.396538  7591 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.495236  7903 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:57.457762  7900 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.496264  1629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:01:57.390863  7913 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.507648  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.669294  1629 raft_consensus.cc:606] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:57.669516  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:57.512188  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.508723  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:57.670477  2264 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:57.512514  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.521611  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:57.671887  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.461166  7988 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:57.528180  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:57.672719  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 151238us
I20260709 13:01:57.517763  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:57.673759  2234 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:57.525980  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:57.547180  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2928) took 1132 ms. Trace:
I20260709 13:01:57.674975  1633 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 11.
W20260709 13:01:57.513206  7939 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.061s	user 0.012s	sys 0.030s
I20260709 13:01:57.552944  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:57.677624  1635 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:01:57.551433  2270 rpcz_store.cc:276] 0709 13:01:56.274723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.274882 (+   159us) service_pool.cc:224] Handling call
0709 13:01:57.473742 (+1198860us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b54000dcd54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:57.473894 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129163520}
W20260709 13:01:57.550585  2267 rpcz_store.cc:269] 0709 13:01:55.149363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.158058 (+  8695us) service_pool.cc:224] Handling call
0709 13:01:57.472427 (+2314369us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400583254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:57.472553 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2389146880}
I20260709 13:01:57.547283  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.545193  7624 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:57.532644  7698 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:57.557231  7761 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.557379  7977 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:57.553783  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.538955  7712 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.623373  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.547676  7805 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.544260  7997 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.704454  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.705137  1626 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:01:57.700719  1706 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:57.655328  7611 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.669745  1629 raft_consensus.cc:614] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:57.674372  1553 raft_consensus.cc:2410] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:01:57.547737  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:57.694584  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:57.674829  1709 rpcz_store.cc:276] 0709 13:01:56.420360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.463816 (+ 43456us) service_pool.cc:224] Handling call
0709 13:01:56.472164 (+  8348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.479655 (+  7491us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:01:57.190174 (+710519us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.546839 (+356665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.546908 (+    69us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:57.546954 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.547019 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.547126 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1838,"prepare.queue_time_us":340755,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":12242,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":1058317,"threads_started":2}
I20260709 13:01:57.703061  1702 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:57.708845  2271 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:57.629299  2268 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:57.705489  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:57.654382  7956 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:57.707564  2262 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:57.709764  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:57.712042  2267 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:57.713060  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:57.718366  1705 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:57.719601  2234 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:57.719967  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.720709  2264 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:01:57.702368  7903 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:57.704224  7902 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:57.719079  1673 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:57.727425  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.731940  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.732942  1702 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
W20260709 13:01:57.730796  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 368361us
I20260709 13:01:57.719502  7988 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:57.720885  7724 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:57.702652  7698 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:57.758627  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.699703  7939 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.725050  7820 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:57.711287  7711 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 13:01:57.707418  7712 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:57.751209  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 270956us
I20260709 13:01:57.710605  7761 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.707149  7805 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.715121  7611 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:57.710837  7997 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.786480  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.767421  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.767411  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.788219  2270 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:57.769757  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:57.739048  7929 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:57.776597  7977 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.793330  1554 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:57.751423  7988 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:57.751780  7724 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:57.760057  7447 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.805586  1552 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:57.761689  7903 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:57.747175  7542 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:01:57.807525  1599 connection.cc:256] RPC call timeout handler was delayed by -1.0610967419999611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
I20260709 13:01:57.809468  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:57.811879  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.813962  1702 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:01:57.751201  7911 consensus_queue.cc:1059] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:01:57.778666  7711 consensus_queue.cc:1243] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 17.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 13:01:57.816998  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 51040.9us
I20260709 13:01:57.806191  7988 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:57.811290  7903 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.828898  7903 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:57.829209  8006 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:57.830859  7805 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:57.823263  7826 raft_consensus.cc:2764] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:01:57.833149  8010 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:57.834529  8010 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:57.834838  8010 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:57.835889  7624 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:57.835650  8010 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.837080  8010 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:57.804153  7956 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.838478  7956 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:57.809274  7724 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:57.841632  2268 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:57.810734  7977 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.849726  2270 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:57.850289  1673 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:57.852826  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 375294us
I20260709 13:01:57.854171  1600 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:57.809762  7864 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.856994  1702 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:01:57.858215  7864 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.816721  7929 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:57.814178  8009 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:57.820264  7902 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.867710  2270 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:57.873878  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:57.814679  7447 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:57.866047  7911 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:57.893460  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.896472  1673 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:57.898928  7698 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:57.892058  7765 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:57.899712  8017 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.900400  8017 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.901623  7939 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:57.856022  8003 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:01:57.887904  7902 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.870554  7611 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:57.909299  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 194416us
I20260709 13:01:57.910725  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:57.876447  7761 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:57.928738  2234 leader_election.cc:400] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
W20260709 13:01:57.902593  7965 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.814s	user 0.007s	sys 0.000s
I20260709 13:01:57.866606  7805 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:01:57.942411  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.903906   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:57.895004  8009 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:57.870879  7844 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:57.904003  7480 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:01:57.953696  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.905332  7864 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:57.943934  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:57.902448  7542 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:01:57.958197  7480 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:57.959736   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:57.961519  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:57.962191  1633 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:57.963910  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.964082  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:57.888779  7993 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:01:57.920574  7913 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:57.938967  7419 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:57.968117  1702 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 17: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:57.949828  7761 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:57.970458  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:57.950446  8015 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:57.943306  7754 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:01:57.905858  7977 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:57.965867  7711 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:57.969116  7447 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:57.962908  7956 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:57.981077  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1356) took 1550 ms. Trace:
I20260709 13:01:57.976706  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:57.965016  7480 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:57.973608  7761 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.989811  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.991899  2263 rpcz_store.cc:276] 0709 13:01:56.431025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.563036 (+132011us) service_pool.cc:224] Handling call
0709 13:01:56.604012 (+ 40976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.604222 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:56.660959 (+ 56737us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.671445 (+1010486us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b1800443560. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9
0709 13:01:57.852450 (+181005us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b1800443560. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:01:57.979385 (+126935us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.979445 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:57.980756 (+  1311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.980856 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.981006 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12601,"prepare.queue_time_us":52112,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":26258,"raft.run_wall_time_us":9695,"spinlock_wait_cycles":61265280,"thread_start_us":115560,"threads_started":1}
I20260709 13:01:57.999116  2267 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:58.001127  7903 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.014881  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:58.004248  8017 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:57.981426  7419 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:58.002287  8009 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.013167  7956 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.005983  7724 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.021226  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:57.986663  8005 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.183s	user 0.001s	sys 0.001s
I20260709 13:01:58.002177  7712 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:58.009563  2270 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:58.022704  1626 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:58.026146  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:57.979837  7929 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:58.008625  7761 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:57.984699  8015 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:57.990247  7711 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.035040  7419 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.035598  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.035820  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:58.036397  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.021450  7900 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:58.047027  8018 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:01:58.047509  7724 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:58.040971  7844 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:58.041332  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2759) took 1223 ms. Trace:
I20260709 13:01:58.041539  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:58.059010  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.057610  1555 rpcz_store.cc:276] 0709 13:01:56.817672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.836126 (+ 18454us) service_pool.cc:224] Handling call
0709 13:01:58.041178 (+1205052us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b54003d95d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:58.041283 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2188360960}
I20260709 13:01:58.071061  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:58.072428  1553 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:01:58.074653  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 220579us
I20260709 13:01:58.076469  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:58.079296  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:58.075130  1633 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:01:58.081779  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:58.083819  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.082273  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.088234  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.053377  7711 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:58.077898  8021 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:01:58.092096  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:58.094192  1553 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 20: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:58.092756  1706 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:58.091217  1701 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:01:58.096012  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:58.096925  1701 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:01:58.031406  7805 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:01:58.101423  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.098901  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.072628  7724 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:01:58.089358  7858 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:58.104773  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:58.030879  7956 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.105425  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.097468  7447 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:58.089691  7480 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:01:58.109649  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.111596  1706 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:01:58.105773  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:58.119225  1553 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:01:58.090293  7864 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:58.105131  7902 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:58.120612  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.121217  1704 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:58.121786  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.130012  7956 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:58.135201  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.104640  7900 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
W20260709 13:01:58.136646  8011 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:01:58.136377  7988 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:58.138599  7903 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:58.139292  7447 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.143776  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:58.158385  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52688us
I20260709 13:01:58.108896  7858 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:58.162282  7480 consensus_queue.cc:1243] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:58.156881  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:58.162673  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.162917  7480 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:58.108285  7724 consensus_queue.cc:1243] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:58.163416  7480 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.162622  7858 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:58.163914  7480 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:58.158912  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.164631  1551 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
W20260709 13:01:58.120556  8019 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:01:58.151705  7864 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.163427  1706 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 10.
I20260709 13:01:58.166720  7864 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:58.167845  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:58.156226  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46606.6us
I20260709 13:01:58.163174  1555 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:58.173507  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.106801  8027 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 13:01:58.158820  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:58.178620  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.155845  7988 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
W20260709 13:01:58.184894  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 76742.5us
I20260709 13:01:58.177043  7858 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:58.188376  7879 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:58.189114  7858 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:58.192118  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2750) took 1633 ms. Trace:
I20260709 13:01:58.192528  1554 rpcz_store.cc:276] 0709 13:01:56.558707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.558851 (+   144us) service_pool.cc:224] Handling call
0709 13:01:56.598917 (+ 40066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.806827 (+1207910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.191848 (+385021us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540030b954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:58.192026 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2731450752}
I20260709 13:01:58.201179  1555 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:01:58.207983  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:58.208340  1704 raft_consensus.cc:2410] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:01:58.209036  2264 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:01:58.210539  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:58.212204  2264 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:58.163506  8015 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:58.213626  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 103780us
I20260709 13:01:58.221602  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.225143  1558 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:01:58.223343  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:58.227717  2264 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:58.228339  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.228120  1560 pending_rounds.cc:85] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 10
I20260709 13:01:58.231670  1560 pending_rounds.cc:107] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:01:58.184399  8027 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.183205  7712 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:58.231935  1560 raft_consensus.cc:2889] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.239755  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:58.233500  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.233690  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.240561  1553 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:58.240903  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.197115  8028 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:58.236784  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.238556  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:01:58.239384  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 2921) took 1926 ms (client timeout 2007 ms). Trace:
I20260709 13:01:58.242057  1551 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
W20260709 13:01:58.241901  1705 rpcz_store.cc:269] 0709 13:01:56.313379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.322872 (+  9493us) service_pool.cc:224] Handling call
0709 13:01:58.239214 (+1916342us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54001ad6d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:58.239333 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3150853504}
I20260709 13:01:58.193799  7711 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.245798  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.248330  2264 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:01:58.224730  7765 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:58.256948  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:58.239945  7734 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:58.258070  2264 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:58.240010  7712 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:58.258479  8027 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:01:58.271144  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:58.235143  7958 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:01:58.274309  1702 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:58.272693  7734 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:58.258965  7699 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.275301  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:58.283438  2264 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:58.284237  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:58.284715  2264 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:58.275828  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 89386.7us
I20260709 13:01:58.273129  7712 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:58.278055  7987 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.959s	user 0.001s	sys 0.006s
I20260709 13:01:58.297853  2264 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
W20260709 13:01:58.294499  8041 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 13:01:58.299546  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:58.304522  2264 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:58.306011  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:58.312239  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:58.312603  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.319521  2264 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:01:58.290812  7699 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:58.315272  7969 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 1.708s	user 0.013s	sys 0.000s
I20260709 13:01:58.315313  8040 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:58.333570  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:58.337591  8046 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:58.338220  8046 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.338660  8046 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:58.347002  7711 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:58.351356  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1357) took 1917 ms. Trace:
I20260709 13:01:58.351796  2266 rpcz_store.cc:276] 0709 13:01:56.433986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.563447 (+129461us) service_pool.cc:224] Handling call
0709 13:01:56.606049 (+ 42602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.637871 (+ 31822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.637903 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.638522 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.885160 (+246638us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:56.885215 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.885301 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.212778 (+1327477us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:58.336721 (+123943us) raft_consensus.cc:1685] finished
0709 13:01:58.336743 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.351181 (+ 14438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7106,"raft.queue_time_us":2691,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":9099,"spinlock_wait_cycles":6101376,"thread_start_us":201919,"threads_started":1,"wal-append.queue_time_us":548582}
I20260709 13:01:58.354627  8028 raft_consensus.cc:993] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 13:01:58.355121  8028 raft_consensus.cc:1081] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 13:01:58.345844  7480 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.356585  7743 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:58.356956  7761 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:58.358242  7480 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:01:58.362625  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 466242us
I20260709 13:01:58.407567  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:58.363312  7624 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:58.365075  7455 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:58.371459  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 253581us
I20260709 13:01:58.374015  1701 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:58.379297  7611 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:58.361903  7864 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:58.414330  7611 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:58.414240  7988 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:58.415352  7611 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:58.415884  7864 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:58.383599  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.416414  7611 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:58.417435  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:01:58.335755  8038 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 13:01:58.397424  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.419054  1674 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.332667  8027 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:58.331743  7447 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:58.419905  8003 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:58.334687  8040 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.408303  1629 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.420457  8040 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.408288  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:58.407658  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:58.426163  1634 raft_consensus.cc:2368] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21.
I20260709 13:01:58.410140  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:58.426597  8003 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:58.415762  7988 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:58.427663  1674 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:58.428278  7711 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:58.350265  1600 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:58.429036  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:58.430701  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.431121  2234 leader_election.cc:400] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21.
I20260709 13:01:58.430284  1629 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:58.425662  1701 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:58.431476  2234 leader_election.cc:403] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:01:58.429153  7993 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:58.433265  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.433501  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.434737  1702 raft_consensus.cc:2410] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:01:58.436174  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.436784  1707 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:01:58.470305  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:58.470326  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.447197  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:58.437634  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 87413.2us
I20260709 13:01:58.475801  1704 raft_consensus.cc:2376] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19. Re-sending same reply.
I20260709 13:01:58.475075  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:58.476289  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 232052us
I20260709 13:01:58.449772  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:58.478124  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 165607us
I20260709 13:01:58.471755  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.439635  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.479676  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.399765  7911 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:58.481230  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47821.3us
I20260709 13:01:58.481887  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.482147  1552 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:58.480365  1704 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:01:58.488461  1702 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:58.483019  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.436198  2234 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:58.483494  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.483675  7903 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:58.480338  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.479530  1705 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:01:58.435354  7993 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.410686  7940 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.474623  8027 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:58.490669  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.511386  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:58.491222  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 55204us
I20260709 13:01:58.512207  1559 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:58.434634  7765 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:58.491253  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:58.476109  7929 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:58.493103  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.474684  7717 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:58.495054  1599 leader_election.cc:400] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 18. Current term is 19.
I20260709 13:01:58.536259  1599 leader_election.cc:403] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:58.429567  8010 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:01:58.495352  1709 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:58.496924  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:58.542747  1558 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:58.490969  8003 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:58.498426  8039 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:58.504367  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:01:58.505638  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 97440.2us
I20260709 13:01:58.552314  1705 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.552569  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.437951  7624 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:58.475705  7455 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:58.513821  1704 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.471446  7712 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.517519  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.560968  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:58.562186  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.515864  8027 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.539317  7923 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.534170  7940 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:58.539999  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46973.6us
I20260709 13:01:58.597195  2236 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.494136  7754 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:58.543040  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 48129.8us
I20260709 13:01:58.544783  7765 raft_consensus.cc:697] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:58.514966  8028 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:58.514746  7591 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:58.564296  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:58.565339  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.438254  7948 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:58.607125  2271 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:58.607723  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.553637  7858 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 18. Current term is 19.
I20260709 13:01:58.644140  1704 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:58.631678  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:58.562887  8039 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:58.557669  8017 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:58.634518  1555 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:58.639670  1559 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:01:58.591434  8027 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:58.646890  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 81658.1us
I20260709 13:01:58.596817  7911 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.554522  8003 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:58.651571  2236 leader_election.cc:400] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:01:58.672416  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.659976  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.661056  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.686304  1704 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:58.503490  7993 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:58.590277  7624 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.689831  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:58.673718  8036 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.643720  7717 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.633134  8028 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:58.691319  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:58.711745  1559 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:01:58.695573  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.703428  1558 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:01:58.703336  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.712730  1702 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:01:58.668224  7419 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.707113  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:58.660156  7591 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:58.713794  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.716252  1704 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:01:58.721585  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:58.715052  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:58.723330  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:58.724972  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.695924  8052 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.705961  7754 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:58.715181  8028 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:58.741297  1601 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.722647  1704 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48138
I20260709 13:01:58.743702  1704 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:58.744212  1704 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:58.749065  1601 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.729698  7928 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.753705  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.755383  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:58.732692  8040 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:58.794816  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 232379us
W20260709 13:01:58.795526  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.758630  7480 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:58.736649  7864 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:58.730212  7542 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:58.731698  7903 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:58.789943  1703 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:58.778760  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:58.733026  7754 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.761588  1704 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.796141  1705 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 12.
W20260709 13:01:58.797278  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 43679.5us
I20260709 13:01:58.799896  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.710772  8036 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.813800  1601 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:58.803781  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:01:58.806290  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 198678us
I20260709 13:01:58.751423  7419 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:58.733858  7988 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:01:58.823666  1635 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 12: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:01:58.807469  8048 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 13:01:58.815575  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.815698  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:58.774367  8063 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:58.786744  8052 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:58.775552  7761 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:58.773557  7712 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:58.824710  1631 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:58.771646  7929 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:58.823817  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:58.836643  1629 raft_consensus.cc:2393] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:58.746556  7911 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:01:58.827593  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:58.827695  1599 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:58.813575  7754 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:58.737401  7765 consensus_queue.cc:237] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:58.824524  7698 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:58.832427  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:58.833645  1704 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:58.838685  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:58.799389  7940 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:58.779945  7997 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:58.813571  7864 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:58.843838  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.828449  7480 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:01:58.894733  7864 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:58.895641  7903 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:58.896193  7903 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.848462  1626 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:58.828100  7542 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:58.901372  1558 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:58.903916  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:58.842407  8003 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:58.857733  7761 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:58.857774  8063 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:58.905757  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:58.913998  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:58.906193  7761 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.865518  2265 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:01:58.836045  7929 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:58.847930  7698 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:58.871446  8040 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:58.875329  8015 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:58.747947  8039 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:58.811688  7879 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 13:01:58.839260  8050 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:01:58.884318  8036 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:58.832044  7959 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:58.904042  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 175069us
I20260709 13:01:58.856832  1703 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:01:58.859433  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:01:59.030678  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 171374us
I20260709 13:01:58.916201  1629 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21. Ops: []
I20260709 13:01:58.865420  7712 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:58.988477  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 265234us
I20260709 13:01:58.950863  8066 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:58.955350  7761 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:59.030804  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 203298us
I20260709 13:01:58.845326  7455 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:01:58.975744  8046 consensus_meta.cc:287] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.003s
I20260709 13:01:59.042434  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:59.051851  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:58.909653  7542 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:58.909427  8010 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.115s
I20260709 13:01:58.958455  8007 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:58.988723  7743 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:58.973111  7698 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:58.949736  7859 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 13:01:58.995400  8063 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:59.053385  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:59.077122  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 50021.5us
I20260709 13:01:59.082273  8065 consensus_queue.cc:1059] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:59.085049  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:59.042611  7903 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:59.124325  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 71018.1us
I20260709 13:01:59.126412  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:59.131637  7977 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:59.131943  7717 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:01:59.132401  8067 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:01:59.132560  7717 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.133100  7717 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:59.125160  1673 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:59.127493  7997 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:59.053314  8036 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.135111  8036 raft_consensus.cc:3055] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:59.135492  8036 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:59.091367  7743 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.136292  8036 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.137466  8036 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.138190  7743 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:59.138779  7743 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:59.139206  7743 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:01:59.140097  7743 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:59.142760  8069 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 13:01:59.155613  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 341969us
I20260709 13:01:59.156502  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:59.078723  7447 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:59.051887  7959 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:59.157685  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:01:59.087808  7940 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:59.086709  8007 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:59.080720  8066 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:59.046757  8052 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:59.085855  8015 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.092s
W20260709 13:01:59.176002  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 94571.3us
I20260709 13:01:59.177253  8017 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:59.169561  7956 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:59.173754  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:59.093538  8027 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:59.079056  8046 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.180337  7903 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.166460  7447 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:59.170591  8036 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:59.206822  7956 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:01:59.210649  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 84641.5us
I20260709 13:01:59.092264  8037 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.111s
I20260709 13:01:59.181236  7455 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:59.214172  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2558) took 1242 ms. Trace:
I20260709 13:01:59.203437  8075 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:01:59.225304  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47507.5us
I20260709 13:01:59.210161  8017 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.225850  1633 rpcz_store.cc:276] 0709 13:01:57.965813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.970146 (+  4333us) service_pool.cc:224] Handling call
0709 13:01:59.207187 (+1237041us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540018ecd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:59.207296 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238932864}
I20260709 13:01:59.226497  1634 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:01:59.131965  8070 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:01:59.163877  8063 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:59.231922  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 79680.4us
I20260709 13:01:59.225972  7447 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:59.246088  1703 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:59.163877  7929 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.245095  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:59.253015  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:59.240644  8017 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:59.253815  1703 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:01:59.253472  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:59.243144  8074 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:59.251296  7455 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:59.237783  7997 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:01:59.243444  7959 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.257516  7699 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:59.249477  8052 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.229715  7903 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:59.271603  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 60430us
W20260709 13:01:59.293409  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 160001us
I20260709 13:01:59.296365  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:59.259109  8084 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.295845  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.300534  1633 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:59.236150  8075 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.301359  8088 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:59.302177  8088 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:01:59.302508  7948 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
I20260709 13:01:59.303097  7948 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21.
I20260709 13:01:59.303509  8075 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:59.251866  8007 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.307770  8007 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.309533  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:59.311863  7993 consensus_meta.cc:287] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.602s	user 0.011s	sys 0.000s
I20260709 13:01:59.263636  8074 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:59.313061  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.315799  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:59.313448  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:59.307760  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:59.316452  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63033.3us
I20260709 13:01:59.295158  8046 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:59.322738  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:01:59.323182  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 100511us
I20260709 13:01:59.328262  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.302549  8088 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.351801  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.349797  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.369084  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:59.370286  2271 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:59.367996  1632 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:01:59.367750  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:59.252691  7956 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:59.378139  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.378249  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:59.375824  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:01:59.379040  2266 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:59.375073  7699 raft_consensus.cc:2764] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:01:59.380056  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.381561  1633 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:01:59.376219  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:59.312412  7993 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:01:59.391832  8077 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:01:59.384050  7864 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:01:59.394491  8087 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.315856  8084 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.395035  8087 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.396893  8084 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:59.397286  8087 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:59.397588  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:01:59.394733  8028 consensus_meta.cc:287] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.000s
I20260709 13:01:59.399968  8028 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:59.390733  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:01:59.350119  8070 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.409821  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.372339  7734 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:59.264403  8066 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.447898  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:59.405515  8085 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:59.473352  2270 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:01:59.448966  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:59.397887  8087 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:59.479827  8087 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.480234  8087 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:59.369055  8088 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:59.449775  1707 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:01:59.439093  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 48537us
I20260709 13:01:59.449843  1630 raft_consensus.cc:2410] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:01:59.450908  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:59.446911  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:59.499255  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 52476.6us
I20260709 13:01:59.347390  7958 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:01:59.499531  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:59.407516  2236 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:01:59.388249  7455 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:01:59.402006  7542 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:59.451581  7879 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:59.478891  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:59.479156  8072 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:01:59.479462  2266 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:59.517493  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:59.519582  1703 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:59.410893  7743 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:01:59.474012  8027 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:59.471897  7734 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:01:59.526639  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:59.528578  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.529609  1630 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:01:59.518146  7591 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:59.540352  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:59.545922  2270 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:59.540668  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:01:59.541170  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 133737us
I20260709 13:01:59.543874  1627 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:59.466394  8070 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.544159  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:59.405476  7997 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.520752  8075 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:01:59.548170  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:59.550693  1556 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:01:59.545188  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 96847.5us
I20260709 13:01:59.560299  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.531087  8039 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:59.547351  2266 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:01:59.542304  8063 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:59.565990  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:59.567853  2270 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:59.568492  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2946) took 1057 ms. Trace:
I20260709 13:01:59.568899  1702 rpcz_store.cc:276] 0709 13:01:58.511054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.713425 (+202371us) service_pool.cc:224] Handling call
0709 13:01:58.713727 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:58.727877 (+ 14150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.727931 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.733751 (+  5820us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.095358 (+361607us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:01:59.095415 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.095506 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.568297 (+472791us) raft_consensus.cc:1685] finished
0709 13:01:59.568318 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.568436 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8532,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6773,"thread_start_us":308968,"threads_started":1,"wal-append.queue_time_us":469373}
I20260709 13:01:59.573716  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.574041  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:59.574497  1630 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:01:59.493961  8085 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.575965  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:59.526844  7455 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.577533  2266 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:59.545567  7717 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.582649  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:59.587049  7455 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:59.587850  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:01:59.588656  2266 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:01:59.589531  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:59.509457  8074 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.581307  7761 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:59.594854  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46602.4us
I20260709 13:01:59.595361  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:59.612155  2270 raft_consensus.cc:2410] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:01:59.612676  1633 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:01:59.620085  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:01:59.600214  8095 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:59.624105  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:01:59.627220  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.627966  1632 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:59.627875  1633 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:01:59.602632  8105 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:59.571803  8039 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.619218  8028 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:59.616524  8108 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:01:59.718371  8108 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:59.719734  8059 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.469s	user 0.002s	sys 0.000s
I20260709 13:01:59.720695  8108 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:59.683213  2270 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
W20260709 13:01:59.682771  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 119106us
I20260709 13:01:59.601496  7698 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:59.723058  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.723304  7698 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:59.725778  1552 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:59.693890  8109 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:01:59.694671  8096 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:01:59.702776  8070 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:59.708436  8088 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:01:59.628554  8074 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:59.710280  7903 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:59.689281  8105 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.714869  1627 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:59.717000  7820 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:59.751281  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:59.717159  7754 consensus_meta.cc:287] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.868s	user 0.009s	sys 0.000s
I20260709 13:01:59.723348  2270 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:01:59.730145  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50055.9us
I20260709 13:01:59.747889  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:59.752858  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:59.753356  1524 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:01:59.746794  1599 connection.cc:256] RPC call timeout handler was delayed by -1.9425474860000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
I20260709 13:01:59.678241  7993 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:59.593909  7734 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:59.725530  7712 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.002s
I20260709 13:01:59.753966  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:01:59.751701  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.759785  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:59.757117  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:59.694733  7761 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:59.761508  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:59.761786  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.730108  7698 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:01:59.763159  2270 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:59.766189  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:59.764780  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:59.764796  1627 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:01:59.742962  8116 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:59.754314  8108 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:59.751113  7820 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:01:59.763480  8081 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:59.763942  7712 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:59.752358  8105 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:59.787588  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:59.793427  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:01:59.797854  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 43954.7us
I20260709 13:01:59.782523  7734 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:59.798687  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.838389  1629 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:01:59.839367  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:59.804193  8085 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:01:59.805760  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1376) took 1259 ms. Trace:
I20260709 13:01:59.840735  2263 rpcz_store.cc:276] 0709 13:01:58.546796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.546977 (+   181us) service_pool.cc:224] Handling call
0709 13:01:58.561541 (+ 14564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.625005 (+ 63464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.625052 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.625107 (+    55us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:01:58.625152 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.805470 (+1180318us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b5400710f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:59.805531 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.805690 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145351552}
I20260709 13:01:59.809131  7820 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:01:59.810927  8114 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:59.831115  8088 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:59.832427  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.853231  1626 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:01:59.784844  8100 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:59.837244  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:59.759073  7754 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.842378  1559 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:01:59.844338  1557 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:01:59.779592  7997 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:01:59.849568  1558 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:59.784178  7698 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.863798  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:59.865676  8081 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:59.885656  1709 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 1152) took 1860 ms (client timeout 1685 ms). Trace:
W20260709 13:01:59.886188  1709 rpcz_store.cc:269] 0709 13:01:58.025618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.025849 (+   231us) service_pool.cc:224] Handling call
0709 13:01:59.885455 (+1859606us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b540012a554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:59.885590 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066011008}
I20260709 13:01:59.867941  7761 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:59.890513  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:59.871917  7754 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:59.872465  2268 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: [15.15-15.15]
W20260709 13:01:59.872534  8007 consensus_meta.cc:287] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.000s
I20260709 13:01:59.892424  1553 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:59.882176  1558 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
W20260709 13:01:59.867619  8055 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.241s	user 0.003s	sys 0.001s
I20260709 13:01:59.887950  1706 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:01:59.890290  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.894654  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.894593  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1375) took 1641 ms. Trace:
I20260709 13:01:59.896075  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:59.895160  2264 rpcz_store.cc:276] 0709 13:01:58.253006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.332222 (+ 79216us) service_pool.cc:224] Handling call
0709 13:01:58.332530 (+   308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:58.349257 (+ 16727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.349286 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:58.378637 (+ 29351us) log.cc:844] Serialized 52 byte log entry
0709 13:01:58.481464 (+102827us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:58.481519 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.481602 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.867056 (+1385454us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:01:59.894302 (+ 27246us) raft_consensus.cc:1685] finished
0709 13:01:59.894331 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.894538 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16498,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":6417664,"thread_start_us":102431,"threads_started":1,"wal-append.queue_time_us":217532}
I20260709 13:01:59.870620  8039 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:59.899526  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.901856  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.902897  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.905786  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2560) took 1093 ms. Trace:
I20260709 13:01:59.906234  1634 rpcz_store.cc:276] 0709 13:01:58.812602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.812768 (+   166us) service_pool.cc:224] Handling call
0709 13:01:58.813076 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.239033 (+425957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.905516 (+666483us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400338bd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:01:59.905726 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950083328}
I20260709 13:01:59.906744  1551 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:01:59.907025  8105 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.909144  8105 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:01:59.913355  1599 leader_election.cc:336] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.874s (SENT)
W20260709 13:01:59.914575  8017 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.645s	user 0.005s	sys 0.005s
I20260709 13:01:59.915058  7717 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:01:59.915019  8017 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:01:59.916695  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2660) took 1477 ms. Trace:
I20260709 13:01:59.917382  8017 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:01:59.889730  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:01:59.918998  1557 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:59.920394  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.920805  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.924386  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:01:59.917080  1707 rpcz_store.cc:276] 0709 13:01:58.438849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.439363 (+   514us) service_pool.cc:224] Handling call
0709 13:01:59.916497 (+1477134us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b5400220454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:01:59.916636 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2221357312}
W20260709 13:01:59.926443  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 170892us
I20260709 13:01:59.927878  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:59.928529  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:01:59.929374  1701 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:01:59.885777  7820 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:59.931388  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.933326  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:59.934823  1631 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:59.941114  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.941807  1557 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:01:59.925849  7911 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:59.935021  7864 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.965572  1524 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:01:59.938541  7950 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:59.962724  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.960161  1674 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:01:59.965268  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 101586us
I20260709 13:01:59.970324  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:59.971824  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.958194  7699 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:59.973273  7765 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:01:59.976564  7699 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:01:59.977082  7699 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:59.977553  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.979029  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:01:59.931041  8081 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:01:59.989041  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:01:59.993693  1709 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:01:59.961731  7911 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:00.001354  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.002487  7993 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:00.002593  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:01:59.978364  7977 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:59.967386  8090 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:01:59.979418  7864 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:00.006004  7956 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:00.000140  7447 consensus_meta.cc:287] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.731s	user 0.006s	sys 0.006s
I20260709 13:02:00.009902  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:00.021370  1634 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:00.020684  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50500.8us
I20260709 13:02:00.023628  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:00.025835  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:00.026715  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:00.030256  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.030927  2264 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
W20260709 13:02:00.007150  8087 consensus_meta.cc:287] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.004s
I20260709 13:02:00.032114  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:01:59.998912  7765 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:00.040827  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:00.041445  7993 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:00.049604  8086 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.059147  8086 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:00.031785  8115 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:00.067044  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:00.047070  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:00.020684  7911 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:00.029219  7611 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:00.049122  1705 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:00.050120  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:00.051311  1551 raft_consensus.cc:2410] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:02:00.040000  1702 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:00.045676  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.006491  7977 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:00.010460  7864 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:00.077503  1703 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 12: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:02:00.080597  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.077204  7542 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:00.057364  8063 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:00.084908  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1182) took 1695 ms. Trace:
I20260709 13:02:00.089711  1555 rpcz_store.cc:276] 0709 13:01:58.389622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.389789 (+   167us) service_pool.cc:224] Handling call
0709 13:01:58.390234 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.662615 (+272381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.084678 (+1422063us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b540030be54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:00.084848 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561275776}
I20260709 13:02:00.075547  7765 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:00.024765  7447 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:00.028190  7950 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:02:00.087339  1634 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:00.061894  8086 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:00.079847  7977 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:00.082742  7455 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:00.097334  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:00.054811  8087 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:00.103431  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.105428  1554 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:00.106810  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:00.107095  7455 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:00.114615  7765 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:00.118454  1705 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:00.120154  1635 raft_consensus.cc:2410] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:02:00.121454  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.093952  7879 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:00.143599  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.147315  1673 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:00.147456  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.145138  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.151500  1630 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:00.153137  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.150300  2263 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
W20260709 13:02:00.156692  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 174651us
I20260709 13:02:00.160189  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:00.161325  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.162969  1560 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:00.164424  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.165056  2270 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:00.165297  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.167248  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:00.168293  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:00.169485  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:00.171053  1555 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
W20260709 13:02:00.171527  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 192597us
I20260709 13:02:00.171339  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:00.173007  1634 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:00.172210  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:00.183481  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:00.143568  8081 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:00.183444  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:00.186050  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:00.162096  7993 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:02:00.187536  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:00.196123  2263 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:00.156685  7956 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.190121  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.201030  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.201309  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:00.175180  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:00.199731  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:00.212764  1705 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:00.193385  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:00.162338  8007 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:00.209703  2271 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:00.171011  8071 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:00.220886  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.155841  7542 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:02:00.191489  7950 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:00.164273  7455 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:02:00.221786  2270 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:00.231832  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:00.232637  2270 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:00.200696  8110 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:00.225113  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49910.7us
I20260709 13:02:00.227643  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.236114  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.242085  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.242936  2271 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:00.243391  1634 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:02:00.220083  7993 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:00.216130  7698 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:00.255347  1705 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:00.257828  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:00.261224  1705 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:00.200956  8081 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:00.232021  7950 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:00.216265  7956 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:00.220909  8128 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 13:02:00.274219  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:00.275303  2271 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:00.268903  7950 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:00.279670  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:00.285269  1705 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:00.285876  1709 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:00.286356  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:00.288548  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:00.289894  1705 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:00.309279  2270 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:00.313815  2270 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:02:00.346000  1705 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:00.278601  8007 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:02:00.348727  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 69131.3us
I20260709 13:02:00.370980  1599 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:00.361845  1674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.380937  2271 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:02:00.384935  8139 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:02:00.386015  8133 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:02:00.387395  8131 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:02:00.387959  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:00.388441  8129 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:02:00.390149  8132 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:02:00.390461  7864 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:00.390554  8028 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:00.391759  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1306) took 1049 ms. Trace:
I20260709 13:02:00.407802  7711 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.408545  7711 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:00.421845  8134 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:00.423795  7956 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:00.427258  8128 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.427495  8142 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:00.427990  8128 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:00.427323  8081 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:00.432497  8107 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.433136  8107 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:00.348577  8126 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:00.435782  8107 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:00.435491  8126 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:00.438604  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:00.439177  8087 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:00.392195  2266 rpcz_store.cc:276] 0709 13:01:59.342258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.629445 (+287187us) service_pool.cc:224] Handling call
0709 13:01:59.744406 (+114961us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.762865 (+ 18459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.762904 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.778434 (+ 15530us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.089354 (+310920us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:00.178784 (+ 89430us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.197399 (+ 18615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.197504 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.391549 (+194045us) raft_consensus.cc:1685] finished
0709 13:02:00.391569 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.391703 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27930,"prepare.queue_time_us":56609,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":62216,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":27220,"thread_start_us":254878,"threads_started":1,"wal-append.queue_time_us":444907}
W20260709 13:02:00.456347  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50511.5us
I20260709 13:02:00.345472  8027 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:00.347571  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:00.375823  7447 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:00.370572  8007 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:02:00.517355  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.525269  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.526525  1628 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:02:00.527112  1628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 1337) took 1717 ms (client timeout 2141 ms). Trace:
W20260709 13:02:00.527585  1628 rpcz_store.cc:269] 0709 13:01:58.809566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.809696 (+   130us) service_pool.cc:224] Handling call
0709 13:02:00.525131 (+1715435us) spinlock_profiling.cc:243] Waited 894 us on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaeee 0000000000375939 00007f06e2f1e1e0 00007f06e2fe70c4 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:02:00.527045 (+  1914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074496}
I20260709 13:02:00.535487  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.540824  2263 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:00.497936  8126 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:00.490869  8027 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:00.599454  8027 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:00.543649  8007 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:00.600529  8007 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:00.546825  7734 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.000s
I20260709 13:02:00.547807  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:00.604823  1628 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:00.606228  1631 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:00.555352  7711 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:00.560163  7699 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260709 13:02:00.618801  7699 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:00.620007  8112 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 1.032s	user 0.015s	sys 0.004s
I20260709 13:02:00.564707  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.621539  1627 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:00.567036  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1160) took 2530 ms. Trace:
I20260709 13:02:00.622601  1706 rpcz_store.cc:276] 0709 13:01:58.036850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.167214 (+130364us) service_pool.cc:224] Handling call
0709 13:01:59.885603 (+1718389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.894456 (+  8853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.566773 (+672317us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b540012a550. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:00.566927 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3951519104}
I20260709 13:02:00.628023  1627 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:00.574144  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1383) took 1239 ms. Trace:
I20260709 13:02:00.629186  2268 rpcz_store.cc:276] 0709 13:01:59.335053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.335686 (+   633us) service_pool.cc:224] Handling call
0709 13:01:59.372323 (+ 36637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.891817 (+519494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.573888 (+682071us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b5400521a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:00.574080 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149716736}
I20260709 13:02:00.574368  8142 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:00.576830  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1384) took 1241 ms. Trace:
I20260709 13:02:00.630945  8142 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:00.630892  2262 rpcz_store.cc:276] 0709 13:01:59.335485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.335677 (+   192us) service_pool.cc:224] Handling call
0709 13:01:59.369482 (+ 33805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.942659 (+573177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.942689 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.980540 (+ 37851us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.230321 (+249781us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:00.235630 (+  5309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.576446 (+340816us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54007701d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:00.576494 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.576551 (+    57us) raft_consensus.cc:1685] finished
0709 13:02:00.576566 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.576777 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31889,"raft.queue_time_us":113251,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10246,"spinlock_wait_cycles":449736960,"thread_start_us":571916,"threads_started":2,"wal-append.queue_time_us":330222}
I20260709 13:02:00.576504  7977 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:00.577067  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.634724  8142 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:00.581357  2265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 1363) took 3111 ms (client timeout 1874 ms). Trace:
I20260709 13:02:00.581749  2269 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:02:00.635815  1553 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:00.585502  7911 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.000s
W20260709 13:02:00.635670  2265 rpcz_store.cc:269] 0709 13:01:57.469501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.519752 (+ 50251us) service_pool.cc:224] Handling call
0709 13:02:00.581178 (+3061426us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54007102d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:00.581291 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2728527616}
W20260709 13:02:00.590844  8074 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.839s	user 0.012s	sys 0.000s
I20260709 13:02:00.592854  1633 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:00.593314  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2698) took 1297 ms. Trace:
I20260709 13:02:00.596688  7956 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:00.570313  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 377017us
I20260709 13:02:00.635051  1626 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:00.636893  7977 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:00.580780  1554 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:00.645533  1635 rpcz_store.cc:276] 0709 13:01:59.295701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.296147 (+   446us) service_pool.cc:224] Handling call
0709 13:02:00.592318 (+1296171us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b540035d254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:00.593252 (+   934us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1889802624}
I20260709 13:02:00.650609  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:00.636575  7911 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:00.665701  1628 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:00.667254  1707 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:00.657509  8071 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:00.669649  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:00.670661  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.675724  1629 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:00.651180  7956 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:00.685473  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:00.680549  7542 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:00.687463  7699 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:00.687883  8142 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.720994  7542 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:00.721866  7542 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:00.724695  7542 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:00.693593  8071 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:00.697333  7988 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:00.764757  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2719) took 1184 ms. Trace:
I20260709 13:02:00.765301  1633 rpcz_store.cc:276] 0709 13:01:59.580839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.628891 (+ 48052us) service_pool.cc:224] Handling call
0709 13:02:00.592455 (+963564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.645256 (+ 52801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.764531 (+119275us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b540035d250. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:00.764693 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068296448}
I20260709 13:02:00.769484  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.770972  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.772686  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:00.776571  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:00.778291  1630 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:00.779975  1630 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:02:00.780418  1630 pending_rounds.cc:85] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 7
I20260709 13:02:00.780732  1630 pending_rounds.cc:107] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:02:00.781050  1630 raft_consensus.cc:2889] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:00.741947  8071 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.711537  8147 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:02:00.790923  1633 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:00.713277  8142 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:00.782418  7993 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:00.782255  8100 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:00.799352  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.788539  8071 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:00.784310  7950 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:00.777827  7988 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:00.818358  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2711) took 1492 ms. Trace:
I20260709 13:02:00.822175  1632 rpcz_store.cc:276] 0709 13:01:59.326187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.372391 (+ 46204us) service_pool.cc:224] Handling call
0709 13:02:00.818091 (+1445700us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400165dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:00.818276 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519064320}
I20260709 13:02:00.824595  1633 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:00.837678  8147 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:00.834749  8150 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:02:00.838449  7911 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:00.820865  8017 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:00.826256  8149 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:00.821388  7542 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:02:00.828562  8084 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:00.830793  7929 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:00.894286  8084 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:00.896713  8128 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:00.845952  8151 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:02:00.846300  7956 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:00.847868  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:00.848863  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:00.850200  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:00.850473  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:00.851495  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 75036.5us
I20260709 13:02:00.900902  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:00.904275  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:00.903733  1706 raft_consensus.cc:2410] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:00.906422  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:00.907361  1702 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:02:00.851919  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:00.909940  1709 raft_consensus.cc:2410] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:02:00.852893  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:00.910828  1705 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:00.855192  7480 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.849835  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:00.915977  1701 raft_consensus.cc:3060] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:00.851982  7948 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:00.861227  8148 log.cc:927] Time spent T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:02:00.866600  7743 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.868741  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1364) took 3398 ms. Trace:
I20260709 13:02:00.943579  2269 rpcz_store.cc:276] 0709 13:01:57.469777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.856155 (+386378us) service_pool.cc:224] Handling call
0709 13:02:00.581318 (+2725163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.636050 (+ 54732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.868397 (+232347us) spinlock_profiling.cc:243] Waited 2.71 s on lock 0x7b54007102d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:00.868621 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6229709568}
I20260709 13:02:00.881603  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 2652) took 1122 ms. Trace:
W20260709 13:02:00.898994  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 655555us
I20260709 13:02:00.946671  1526 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:00.914770  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:00.945426  1554 rpcz_store.cc:276] 0709 13:01:59.759316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.759574 (+   258us) service_pool.cc:224] Handling call
0709 13:02:00.881360 (+1121786us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400178754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:00.881517 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793634560}
W20260709 13:02:00.961953  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47295.8us
I20260709 13:02:00.900358  8125 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:00.970301  1703 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:00.896713  8084 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:00.890053  8017 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:00.939205  8128 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:00.951246  7712 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.981401  1701 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:00.922677  8027 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:02:00.990573  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:00.923331  7480 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:00.999073  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2792) took 1011 ms. Trace:
W20260709 13:02:00.985345  8098 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.420s	user 0.015s	sys 0.000s
I20260709 13:02:00.973747  8125 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:01.001389  8125 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:00.954432  7711 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:02:01.002846  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2569) took 1078 ms. Trace:
W20260709 13:02:01.002971  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 56442.3us
I20260709 13:02:00.904742  8149 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.003211  1634 rpcz_store.cc:276] 0709 13:01:59.923957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.251553 (+327596us) service_pool.cc:224] Handling call
0709 13:02:00.271750 (+ 20197us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:00.276030 (+  4280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.276059 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:00.279765 (+  3706us) log.cc:844] Serialized 52 byte log entry
0709 13:02:00.642386 (+362621us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:00.791708 (+149322us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.803110 (+ 11402us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.817544 (+ 14434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.817646 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.845443 (+ 27797us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:01.002617 (+157174us) raft_consensus.cc:1685] finished
0709 13:02:01.002645 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.002787 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132297,"prepare.queue_time_us":214983,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":1479,"raft.queue_time_us":42488,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":10584,"spinlock_wait_cycles":64589952,"thread_start_us":351207,"threads_started":2,"wal-append.queue_time_us":336663}
I20260709 13:02:00.999441  1557 rpcz_store.cc:276] 0709 13:01:59.988022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.990164 (+  2142us) service_pool.cc:224] Handling call
0709 13:01:59.990540 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.210538 (+219998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.210573 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.220344 (+  9771us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.645108 (+424764us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:00.645155 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.645221 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.998858 (+353637us) raft_consensus.cc:1685] finished
0709 13:02:00.998879 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.999016 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58546,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":576527,"threads_started":2,"wal-append.queue_time_us":440661}
I20260709 13:02:00.954246  8070 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:02:00.983578  8128 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:00.995328  7699 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.988415  8065 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:01.018250  8136 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:01.026312  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:00.997576  7591 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:00.997552  7958 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:01.019279  8074 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:02:01.002938  8098 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.440s	user 0.016s	sys 0.000s
I20260709 13:02:00.955286  7743 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.024199  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:00.998450  8007 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:00.997824  7997 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:01.054253  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.054533  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.056402  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.057984  1554 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:01.025231  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:01.018672  8127 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:02:01.034505  8158 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:01.039247  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:01.064257  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:00.992143  7712 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:01.023532  8128 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:01.051753  1703 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:01:59.599615   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:01.049187  7591 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.073501  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:01.038434  7699 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.077492  7591 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.077618  1703 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:01.070012  7940 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:01.079452  8149 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.079784  7940 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:01.047703  8074 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:01.080797  7940 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.081035  8074 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.083033  8010 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:01.083467  8010 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:01.049046  7958 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:01.084332  8010 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:01.085444  8010 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:01.087404  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:01.086462  7958 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.063349  8127 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:01.097098  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:01.097790  1703 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:02:01.066730  7480 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.090824  7928 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:02:01.103482  8135 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:01.103909  7712 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.104001  8135 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:01.104674  8135 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:01.105190  8127 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.106549  8127 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:01.113339  1556 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:01.092811  7977 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:01.079484  7743 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.124480  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:01.127185  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.130832  1555 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:02:01.134091  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.071683  7997 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.142416  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2781) took 1970 ms. Trace:
I20260709 13:02:01.143234  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2952) took 2453 ms. Trace:
I20260709 13:02:01.143925  1704 rpcz_store.cc:276] 0709 13:01:58.692216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.025662 (+333446us) service_pool.cc:224] Handling call
0709 13:01:59.025992 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.130243 (+104251us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:59.255618 (+125375us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.910795 (+655177us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b18003fbbc0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f23a 00007f06ddfd9a2a
0709 13:02:00.526231 (+615436us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b18003fbbc0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06e19c73c7 00007f06ddfd99a7 00007f06ddfe90bf 00007f06ddfe9038
0709 13:02:00.774454 (+248223us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.774769 (+   315us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:00.774840 (+    71us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:00.774906 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.142918 (+368012us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b540005d054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:01.142990 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.143161 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29105,"prepare.queue_time_us":133432,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2835,"raft.queue_time_us":8476,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":19575,"spinlock_wait_cycles":275174528,"thread_start_us":575675,"threads_started":3,"wal-append.queue_time_us":1017141}
I20260709 13:02:01.140914  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:01.149116  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.142941  1552 rpcz_store.cc:276] 0709 13:01:59.172336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.172480 (+   144us) service_pool.cc:224] Handling call
0709 13:01:59.200948 (+ 28468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.729823 (+528875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.142115 (+1412292us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b5400311ad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:01.142309 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206674816}
I20260709 13:02:01.150595  1555 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:01.150195  1524 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:01.130086  7988 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.156692  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:01.157747  8167 log.cc:927] Time spent T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:02:01.162179  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.120143  8169 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:02:01.174482  1552 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:01.168118  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2575) took 1023 ms. Trace:
I20260709 13:02:01.175334  1627 rpcz_store.cc:276] 0709 13:02:00.144610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.647746 (+503136us) service_pool.cc:224] Handling call
0709 13:02:00.659152 (+ 11406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.659597 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.659636 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.660242 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.787018 (+126776us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:00.828843 (+ 41825us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.829100 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.830077 (+   977us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.898612 (+ 68535us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b1800332d40. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:02:01.161501 (+262889us) raft_consensus.cc:1685] finished
0709 13:02:01.167913 (+  6412us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.168055 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42204,"prepare.run_wall_time_us":44,"raft.queue_time_us":3342,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":3010,"spinlock_wait_cycles":6099072,"thread_start_us":145913,"threads_started":2,"wal-append.queue_time_us":236883}
I20260709 13:02:01.178845  8108 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:01.159132  8009 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:01.194754  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:01.207031  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2566) took 1285 ms. Trace:
I20260709 13:02:01.208168  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:01.209434  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.210616  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:01.211187  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:01.212669  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:01.213418  2269 raft_consensus.cc:2368] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17.
I20260709 13:02:01.213824  2264 raft_consensus.cc:2393] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:01.207471  1629 rpcz_store.cc:276] 0709 13:01:59.921972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.923134 (+  1162us) service_pool.cc:224] Handling call
0709 13:02:01.206880 (+1283746us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54003372d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:01.206978 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1671090048}
I20260709 13:02:01.214661  1601 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:01.218794  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:01.226243  8136 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:01.226691  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:01.222932  7699 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.222000  8090 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.197357  8017 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.218297  8070 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.222340  7956 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:01.196343  7743 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.222186  8052 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.357935  8154 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.136s	user 0.003s	sys 0.003s
I20260709 13:02:01.358593  2269 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:01.359086  7997 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.359474  7734 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:02:01.360550  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 135964us
I20260709 13:02:01.197479  8088 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:02:01.363929  7419 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:01.214689  8074 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.119s
I20260709 13:02:01.196503  8138 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:01.227047  8149 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:01.246966  8103 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:01.369165  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 154595us
I20260709 13:02:01.416186  1601 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:01.367957  8125 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.375597  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:01.367744  7928 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:01.369943  8065 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:01.418555  7928 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.370258  8090 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.418056  8181 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:01.420842  8090 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.384526  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.225441  2236 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:01.365324  8009 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:01.423008  8009 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:01.388971  8052 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.373126  8136 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:02:01.397219  7929 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.507s	user 0.015s	sys 0.000s
I20260709 13:02:01.414840  2269 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:01.418992  7928 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:01.397682  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.442591  1552 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:01.423053  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:01.427522  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 202169us
I20260709 13:02:01.415755  7419 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.429863  8027 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.430857  7711 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.401137  8126 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:01.433493  8107 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:01.495085  1708 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:01.384837  7956 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.387593  8135 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.435175  8125 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.373692  8070 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:01.440795  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 65289.3us
I20260709 13:02:01.445851  2236 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:01.385650  7743 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:01.512202  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 148778us
I20260709 13:02:01.487771  8098 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:01.512897  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:01.497977  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.499866  1634 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:01.505417  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.506270  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:01.442137  8136 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:01.517410  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.496165  7624 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.509611  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63846.5us
I20260709 13:02:01.515627  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:01.520838  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:01.521952  1560 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:01.523139  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.502350  8177 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:01.426883  8103 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.534530  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:01.540746  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 123410us
I20260709 13:02:01.541889  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:01.519543  8081 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:01.521030  8125 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:01.495667  8027 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.546833  1601 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:01.499060  7711 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.524434  7624 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:01.551759  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.502887  8126 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.529690  7447 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:01.528467  7997 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:01.556262  1524 leader_election.cc:400] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17.
W20260709 13:02:01.557293  8183 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:02:01.563280  7743 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.563804  8135 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.536851  8107 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:02:01.573788  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 45927.2us
I20260709 13:02:01.574599  1524 leader_election.cc:403] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:02:01.535287  8088 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:02:01.548305  8108 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:01.565447  8081 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:01.583390  8179 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:01.546473  7761 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:02:01.583966  7959 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:01.584242  8179 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:01.583434  8088 consensus_queue.cc:1243] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:01.586670  7711 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:01.586786  7419 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.589296  8103 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:01.574414  7997 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:01.589973  7997 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:01.583330  8138 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17.
I20260709 13:02:01.584261  8081 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.581100  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:01.554426  8017 raft_consensus.cc:2804] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:01.592576  8017 raft_consensus.cc:697] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:01.593516  8017 consensus_queue.cc:237] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.582165  8127 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:02:01.575430  8185 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:02:01.577929  8128 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.598766  8049 raft_consensus.cc:3055] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:01.599213  8049 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:01.600019  8049 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:01.601138  8180 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:02:01.611666  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:01.612967  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:01.614490  1628 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:01.616899  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:01.600536  8128 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:01.575766  8071 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.767s	user 0.013s	sys 0.005s
I20260709 13:02:01.620609  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:01.634073  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.545128  8177 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.636793  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.639698  8027 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.640569  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:01.640717  7956 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.641173  2265 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:01.625694  8065 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:01.625988  8103 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:01.645846  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.627813  8107 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:01.649085  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.650094  2262 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:02:01.648381  2268 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:01.651880  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.637312  8184 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:01.660285  2262 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:01.634835  7711 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:02:01.665234  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:01.630082  8071 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.647830  8065 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:01.670053  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.680403  8142 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.680943  8107 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.681856  2265 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
W20260709 13:02:01.683136  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 279625us
I20260709 13:02:01.684907  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.686147  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.686827  2268 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:01.687610  8138 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:01.688433  8176 log.cc:927] Time spent T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.259s	user 0.003s	sys 0.001s
I20260709 13:02:01.688207  8138 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.688982  8179 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:01.668260  8081 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:01.690408  8081 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.696573  8177 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.698316  8108 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:01.698621  8071 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.663971  8052 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.671066  8065 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:01.671432  8126 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.683525  8070 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.699021  8108 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:01.719521  8108 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.726799  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:01.727586  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:01.728726  1628 raft_consensus.cc:2410] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:02:01.729061  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 91204.6us
I20260709 13:02:01.721503  7928 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.735652  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.736523  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:01.737183  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:01.737914  2262 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:01.739045  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:01.742085  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.742875  2262 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:01.744433  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.747335  2270 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:02:01.749974  7928 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.752487  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:01.753273  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.754925  7997 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:01.759441  2262 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:01.761327  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:01.761801  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:01.765975  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:01.764787  8071 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:01.729854  8136 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:01.760810  8126 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:01.777297  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:01.771978  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:01.772619  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:01.755939  8130 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:01.759352  7698 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:01.768973  7624 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.778152  1709 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:01.784292  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:01.785014  1709 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:02:01.784430  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:01.778120  1704 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:02:01.778299  1702 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:01.760073  8081 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:01.782727  2262 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:01.769876  8177 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:01.785936  1705 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:02:01.788479  8177 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.765158  8138 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:01.795529  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.789264  8130 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.781626  8126 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.788904  8177 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:01.759773  8108 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:02:01.770877  7734 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:01.789958  7940 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:01.882525  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.783038  7712 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:01.907162  8191 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:02:01.884495  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.932740  2263 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:02:01.890736  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.933830  2267 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:01.893105  1554 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:01.881361  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:01.892282  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:01.874402  8128 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:01.883077  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:01.929809  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:01.928920  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:01.900022  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:01.931668  7940 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.967151  2271 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:01.936491  1627 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:01.968386  2269 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:01.969869  1601 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:01.976492  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:01.976729  2271 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: [15.15-15.15]
I20260709 13:02:01.980072  1601 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:01.978446  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:01.988235  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:02.053606  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 73585.1us
W20260709 13:02:01.951328  8196 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:02.054143  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:02.054251  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 66113.7us
W20260709 13:02:01.952383  8195 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:02:01.935045  7712 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:01.987119  8184 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:02.082157  8149 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:02.070955  7624 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.987351  8074 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:01.948305  7950 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.953987  7997 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:01.953460  8136 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:02.093320  1627 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:01.990986  8081 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.048781  8181 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:01.937815  8192 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.126s
I20260709 13:02:01.933079  7734 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:02.070501  8191 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:02:01.957175  8065 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.087769  7959 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:02:02.117564  8086 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.013s	sys 0.063s
I20260709 13:02:02.095667  8186 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.120867  2269 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:01.978384  8128 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.092896  8100 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:02.103436  8184 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.153451  8181 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:02.173925  8086 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.013s	sys 0.063s
I20260709 13:02:02.117166  8149 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:02.129328  7956 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:02.095448  7879 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:02:02.131994  8007 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:02.166822  8180 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.050s	user 0.000s	sys 0.002s
I20260709 13:02:02.129307  8074 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.166451  1673 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:02.130731  7624 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:02.173043  8126 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:02.178401  7959 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:02.138954  8177 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:02.195271  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 97984.2us
I20260709 13:02:02.191394  8184 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:02.204624  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:02.198127  8149 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.156265  8081 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.191213  8130 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.210918  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:02.192631  8181 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.212217  8087 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:02:02.214488  7929 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:02.215091  8027 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:02.186582  8186 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.207060  8074 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.223662  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:02.209586  8147 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:02.201603  7956 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:02.204528  7940 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:02.223815  1700 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:02:02.191983  8100 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:02.236792  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.237681  8080 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:02.207926  7959 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:02.216832  7712 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.242604  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:02.205945  8007 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.224344  7929 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:02.248757  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:02.225277  7711 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:02.253285  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47901.2us
I20260709 13:02:02.241561  8147 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.260793  1703 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:02.268208  7956 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:02.271097  7624 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:02.272784  8081 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.264675  7711 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.274106  7734 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:02.275091  7711 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:02.281342  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 56528.9us
I20260709 13:02:02.287353  8186 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:02.294852  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:02.295244  8177 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.299288  1635 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:02.300181  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:02.310750  1627 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:02.239136  8027 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.261247  7929 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:02.307281  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:02.319998  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:02.320308  8210 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:02:02.321895  8052 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:02.322484  8052 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.327122  8007 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.328255  8128 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:02.319070  8201 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:02:02.264961  8147 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.262809  8080 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:02.338613  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:02.339268  1705 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:02.340509  1628 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:02.347175  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 64583.9us
I20260709 13:02:02.296605  8100 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.370163  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:02.370373  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:02.370784  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:02.367358  2236 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45513 timed out after 1.759s (SENT) [suppressed 26 similar messages]
W20260709 13:02:02.368402  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.370199  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:02.368523  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:02.369513  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:02.374912  1552 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:02.379647  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:02.325141  8052 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.384040  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:02.388862  8177 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:02.389340  8065 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:02.391589  8165 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 1.372s	user 0.003s	sys 0.000s
I20260709 13:02:02.394374  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1396) took 1186 ms. Trace:
I20260709 13:02:02.374682  8184 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:02.394829  2270 rpcz_store.cc:276] 0709 13:02:01.208097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.222177 (+ 14080us) service_pool.cc:224] Handling call
0709 13:02:01.225912 (+  3735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:01.747808 (+521896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.394091 (+646283us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54007b02d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:02.394309 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883807104}
I20260709 13:02:02.396494  8184 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:02.388067  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:02.399529  1628 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:02.370579  8080 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:02.389544  8074 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:02.406136  8090 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.011s	sys 0.000s
I20260709 13:02:02.398694  8081 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:02.380338  8210 consensus_queue.cc:1059] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:02:02.396973  8027 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.409005  7879 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:02.426152  1629 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:02:02.430277  7698 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:02.430809  7698 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:02.421314  8090 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.011s	sys 0.000s
I20260709 13:02:02.422210  8081 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.406174  7711 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:02:02.406597  8214 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:02:02.410589  8206 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:02:02.426851  7879 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:02.493575  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:02.497529  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:02.497715  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:02.498329  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:02.456374  8081 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:02.498839  2271 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:02.499631  2263 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:02.496340  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:02.504230  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:02.504550  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:02.486672  8071 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:02.512950  7879 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.514353  8142 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:02.514933  8142 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:02.517041  8142 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:02.519337  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2736) took 1313 ms. Trace:
I20260709 13:02:02.519734  1633 rpcz_store.cc:276] 0709 13:02:01.206244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.518576 (+1312332us) service_pool.cc:224] Handling call
0709 13:02:02.518875 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.519047 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.519072 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.519109 (+    37us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:02.519137 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.519185 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.519285 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.523828  7624 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:02.524322  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:02.503334  8065 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:02.530004  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:02.531688  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:02.536036  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1203) took 1322 ms. Trace:
I20260709 13:02:02.536441  1553 rpcz_store.cc:276] 0709 13:02:01.213873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.550341 (+336468us) service_pool.cc:224] Handling call
0709 13:02:01.550602 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.572599 (+ 21997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.572631 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.572670 (+    39us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:01.572700 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.535832 (+963132us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b540030af54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:02.535876 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.535984 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50148736}
I20260709 13:02:02.544173  2268 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:02:02.545892  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1357) took 1324 ms. Trace:
I20260709 13:02:02.546782  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:02.547534  2262 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:02.548975  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:02.514379  7879 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:02.546309  1631 rpcz_store.cc:276] 0709 13:02:01.221524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.545141 (+1323617us) service_pool.cc:224] Handling call
0709 13:02:02.545421 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.545582 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.545606 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.545648 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:02.545682 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.545752 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.545842 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:02.554299  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:02.555256  2267 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
W20260709 13:02:02.557248  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 1190) took 2106 ms (client timeout 1759 ms). Trace:
W20260709 13:02:02.557844  1708 rpcz_store.cc:269] 0709 13:02:00.438110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.438302 (+   192us) service_pool.cc:224] Handling call
0709 13:02:02.544592 (+2106290us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001c52d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:02.544703 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2428056448}
I20260709 13:02:02.558414  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:02.560029  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:02.507503  8205 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:02:02.560701  1554 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:02.565982  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:02.568306  2271 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:02:02.567113  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:02.572105  1600 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:02.495848  8080 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.529150  8071 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.652978  8213 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:02.661300  8074 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.657637  7950 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:02.666188  8149 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:02.667032  7950 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:02.669082  8149 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:02.561683  8100 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:02.560096  8223 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:02.561990  7959 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.627358  2266 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:02:02.753384  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 74646.5us
W20260709 13:02:02.790702  8181 consensus_meta.cc:287] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.001s
I20260709 13:02:02.791136  8181 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.792104  7959 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.792207  8074 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:02.792891  8074 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.793298  8181 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.794412  1553 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:02.795019  8074 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.788616  7698 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.828850  7997 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:02.829499  7997 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:02.859578  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 293686us
I20260709 13:02:02.789747  8223 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.616218  8142 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.181s
I20260709 13:02:02.860978  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1202) took 1796 ms. Trace:
I20260709 13:02:02.870874  1557 rpcz_store.cc:276] 0709 13:02:01.064446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.064735 (+   289us) service_pool.cc:224] Handling call
0709 13:02:01.065001 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.159774 (+ 94773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.159809 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.159854 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:01.159887 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.860725 (+1700838us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b5400180954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:02.860771 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.860909 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217488768}
I20260709 13:02:02.797206  8100 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:02.861073  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:02.887302  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1356) took 1666 ms. Trace:
I20260709 13:02:02.887960  1629 rpcz_store.cc:276] 0709 13:02:01.221216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.272733 (+1051517us) service_pool.cc:224] Handling call
0709 13:02:02.273100 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.432436 (+159336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.886978 (+454542us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54002fa8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:02.887222 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351403776}
I20260709 13:02:02.890460  1551 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:02.892197  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2662) took 1702 ms. Trace:
I20260709 13:02:02.892586  1551 rpcz_store.cc:276] 0709 13:02:01.190235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.190371 (+   136us) service_pool.cc:224] Handling call
0709 13:02:02.890210 (+1699839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.890983 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.891968 (+   985us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b5400181d50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:02.892129 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3908877184}
I20260709 13:02:02.898265  7542 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:02.898736  7542 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:02.899614  7542 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:02.900635  7542 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.900720  8049 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:02.909946  1560 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2800) took 1786 ms (client timeout 2042 ms). Trace:
W20260709 13:02:02.910789  1560 rpcz_store.cc:269] 0709 13:02:01.123983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.124143 (+   160us) service_pool.cc:224] Handling call
0709 13:02:02.890075 (+1765932us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400181d54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:02.909854 (+ 19779us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901045120}
W20260709 13:02:02.911623  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50689.5us
I20260709 13:02:02.912418  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:02.866830  8177 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:02.873215  8208 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.905720  7997 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:02.926663  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 101176us
I20260709 13:02:02.929097  1553 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:02.929842  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:02.932027  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:02.932580  2266 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:02.932914  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:02.933867  1552 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:02.879459  8100 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:02.941615  2266 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:02.875861  7624 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:02:02.956909  7624 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:02.957343  7624 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:02.958345  7624 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:02.953660  7929 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 13:02:02.960029  7929 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:02.922717  7858 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:02.962715  7929 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.953874  8223 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.963428  8065 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:02.954648  8071 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.955379  7698 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:02.923319  7542 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:02.924149  8224 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:02.978340  8224 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:02.978778  8224 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:02.923169  7950 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:02.982934  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 410913us
I20260709 13:02:02.914418  8081 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:02.985922  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:02.987308  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:02.990134  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:02.992023  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52138.2us
I20260709 13:02:02.992465  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:02.993187  1674 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:02.984815  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:02.947849  8177 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:02:02.999809  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:02.998943  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.009934  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:02.997553  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 430492us
I20260709 13:02:03.010406  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:03.013679  1702 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.946200  8208 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:03.013993  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1402) took 1253 ms. Trace:
I20260709 13:02:03.014659  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.017552  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:03.018172  1705 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:03.022410  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.023348  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:03.034677  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 47722.7us
I20260709 13:02:02.990083  8071 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:02.989849  7542 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:02.993911  8223 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:02.997793  7956 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:03.138872  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:02.994419  8142 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:03.061821  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:03.064415  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.089725  1705 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:03.168233  1557 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:03.168793  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:03.027585  8147 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.002s
I20260709 13:02:03.169886  8147 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.170498  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.172132  8147 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.172853  1707 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:03.141341  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 100483us
I20260709 13:02:03.173245  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.173949  1557 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:03.174508  8206 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.174957  8206 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.177277  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.178932  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:03.179962  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 73462.8us
I20260709 13:02:03.182453  1705 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:02:03.140354  8071 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:03.164170  1702 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:02:03.158834  7611 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:03.157122  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 133860us
I20260709 13:02:03.183004  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.187227  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.182390  7940 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:03.047472  8212 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.189375  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.190532  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:03.199263  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.200207  1560 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:03.205605  8071 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:03.205315  7940 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.206547  7611 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.207059  8236 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.207572  8236 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.209546  8236 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.209487  7940 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:03.185304  8219 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:02:03.205734  7734 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:03.211452  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:03.234299  1702 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.234978  1554 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:03.212158  1706 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:03.213129  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.236335  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:03.237339  1705 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.214624  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.238165  1551 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:03.214663  1599 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.179270  8213 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.210681  1557 raft_consensus.cc:2410] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:02:03.240496  8227 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:03.241024  8227 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:03.241514  8227 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:03.104651  7480 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.111s
I20260709 13:02:03.250620  8003 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.252348  8081 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:03.253595  8206 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.255686  8208 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:03.183086  8142 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:03.178568  8027 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.224150  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:03.262087  1553 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:03.259848  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.154789  7542 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.292294  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.292900  1705 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:03.273209  1702 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:03.283620  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.287889  8007 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:03.294123  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:03.294544  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.294869  1702 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:03.295977  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.154994  8223 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.234890  8049 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:03.302170  8049 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.302608  8049 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:03.302407  8052 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:03.304237  8052 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:03.290942  8027 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.297698  7956 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:03.308470  7542 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.308681  8027 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.301802  8007 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.311476  8007 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.312086  7591 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:03.312500  7591 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:03.313390  8223 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.313292  7591 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:03.314502  7591 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:03.315901  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.316651  1703 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 14: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:03.317523  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.296937  1706 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:03.237751  7734 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:03.319208  8234 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:03.319772  8234 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.318846  7734 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.320835  7734 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:03.321115  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.321714  1560 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:02:03.320200  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.322610  1706 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:02:03.323530  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.330474  1706 raft_consensus.cc:2368] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:03.330751  8138 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:03.331252  8138 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:03.331526  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.325219  8086 raft_consensus.cc:3055] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:03.326920  1553 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:03.329524  7858 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:03.299880  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.333640  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:03.342238  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 166082us
I20260709 13:02:03.277263  8142 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:03.341449  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.325423  8100 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:03.351300  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 51524.8us
I20260709 13:02:03.353407  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:03.354701  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.360203  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.361382  1630 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:03.362758  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.332326  1706 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:03.364353  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.356144  7480 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:03.341961  7858 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:03.356799  8052 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:02:03.367123  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.367316  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:03.368444  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.369690  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:03.370394  2236 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:03.370905  8128 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:03.371052  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.371382  8128 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:03.371759  1551 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:02:03.372074  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:03.372538  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.372282  8128 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.373019  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.373277  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:03.374217  7743 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:03.374379  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 2983) took 1598 ms. Trace:
I20260709 13:02:03.340432  8086 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:03.389770  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.375123  1558 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:03.375663  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.374848  1701 rpcz_store.cc:276] 0709 13:02:01.775914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.776027 (+   113us) service_pool.cc:224] Handling call
0709 13:02:01.781345 (+  5318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:01.781812 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.781855 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:01.807643 (+ 25788us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.958929 (+1151286us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b1800377da0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:02:03.216605 (+257676us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:03.216681 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.216785 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.374092 (+157307us) raft_consensus.cc:1685] finished
0709 13:02:03.374114 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.374308 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19535,"raft.queue_time_us":116,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":15740,"spinlock_wait_cycles":9417984,"thread_start_us":257452,"threads_started":1,"wal-append.queue_time_us":1424311}
I20260709 13:02:03.378139  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.339632  8049 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.385130  1552 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:03.371809  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.391121  1702 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:02:03.399451  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.390383  1708 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:02:03.392216  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.401381  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.392397  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.402751  1632 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:03.403177  7611 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.404008  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.379045  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:03.395421  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.405354  1703 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:02:03.406355  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.408206  8223 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:03.408931  8223 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.410229  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:03.411893  7591 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:03.412317  7591 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.412526  8186 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:03.412712  7591 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:03.413046  8186 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:03.413512  8186 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:03.413754  7940 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.339426  8138 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.414470  7940 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.415699  8138 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:03.421437  8086 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.423025  8086 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:03.423283  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.428468  8049 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.375036  8042 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:02:03.430680  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 1355) took 2209 ms. Trace:
I20260709 13:02:03.431136  1634 rpcz_store.cc:276] 0709 13:02:01.220864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.221392 (+   528us) service_pool.cc:224] Handling call
0709 13:02:03.430457 (+2209065us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540007a154. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:03.430589 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304150272}
I20260709 13:02:03.431785  8234 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.432966  7858 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:03.433838  8100 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:03.434628  8100 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:03.436183  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2686) took 2369 ms. Trace:
I20260709 13:02:03.436645  1707 rpcz_store.cc:276] 0709 13:02:01.066960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.087333 (+ 20373us) service_pool.cc:224] Handling call
0709 13:02:02.544795 (+1457462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.173254 (+628459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.435194 (+261940us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b54001c52d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:03.435978 (+   784us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54001c52d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:03.436123 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4795330688}
I20260709 13:02:03.439196  1707 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:03.400431  1702 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:02:03.395560  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 118722us
I20260709 13:02:03.374886  7743 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.397535  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.442714  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:03.444805  1705 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:03.398176  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.445564  1707 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:02:03.446091  1626 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
W20260709 13:02:03.450392  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.451004  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.451651  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.449855  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:03.453408  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.455394  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.458830  1703 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:03.460708  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:03.462255  1627 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:03.481765  1706 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:02:03.482879  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.400385  8249 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.485374  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:03.484047  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.484025  2235 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.460916  8080 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:03.491169  1526 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:03.493928  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.481158  8179 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:03.500062  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.502625  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:03.505110  1634 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:03.505292  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.505498  1632 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: [14.11-16.12]
I20260709 13:02:03.506412  2235 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.507400  1526 leader_election.cc:400] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:03.507786  1526 leader_election.cc:403] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:03.516686  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.517867  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.518494  1709 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:03.520397  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.495326  8234 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:03.496779  8080 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:03.508716  8179 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.482769  8215 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:02:03.509326  7948 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:03.541381  1709 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:03.537297  7591 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.499902  7743 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:03.512909  8252 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.492758  8244 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:03.461321  7940 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:03.513881  7698 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:03.500779  8009 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.515889  8249 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:03.537931  8088 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:02:03.559010  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:03.460469  8224 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.550259  8080 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.580001  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.553951  8179 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.586959  1709 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:03.562311  2236 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:03.589550  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.590420  1555 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:03.549919  8130 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:02:03.595134  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:03.598871  1700 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:03.576236  8234 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:03.601419  2235 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.570727  7698 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:03.603785  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.603678  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.605672  1631 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:03.614884  8234 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:03.597407  8135 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:03.627064  8135 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.627573  8135 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:03.600039  7948 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.636363  7858 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:03.643863  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.650772  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.652179  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.652474  1560 raft_consensus.cc:1275] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:02:03.642782  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47754.3us
I20260709 13:02:03.653518  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:03.653659  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:03.656386  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:03.657684  1626 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:02:03.658869  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.659631  1626 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:03.641963  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.664481  1705 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:03.553710  8250 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:02:03.672646  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:03.675738  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.680315  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.682088  1705 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:02:03.682996  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:03.684875  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.567951  7950 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:02:03.687337  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.693645  2234 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:03.689101  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.695629  2236 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.696409  7743 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:03.697181  2236 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.697127  7743 consensus_queue.cc:1059] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:03.577981  8244 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:03.698477  7743 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:03.644191  7923 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:03.649328  7698 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:03.642234  8249 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.701752  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:03.712114  1554 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 13.
I20260709 13:02:03.715200  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.716279  1626 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:03.698637  8107 raft_consensus.cc:3055] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:03.720137  1601 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:03.693145  7940 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.703351  7711 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.700548  8215 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.698484  8250 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:03.646870  8208 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:02:03.712039  7950 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:03.582680  8227 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.713120  8256 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:03.732882  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.679855  8186 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.735546  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.719450  8107 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:03.708770  7923 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:03.732398  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:03.749544  1601 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.703423  7928 consensus_queue.cc:1059] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:02:03.734705  8128 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:03.751178  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.752211  1626 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 13: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:03.754841  8186 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:03.755415  8088 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:03.756271  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.756774  8244 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:02:03.756918  1633 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:03.727916  7940 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.758149  7761 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:03.758755  7761 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:03.760143  7940 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:03.736163  8188 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:03.762518  8188 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:03.734011  8237 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:03.721021  8210 consensus_queue.cc:1048] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:02:03.766723  8027 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:03.763537  8188 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.731787  8250 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:03.771982  1634 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:03.746135  7950 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:03.774580  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:03.776880  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:03.777904  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.779414  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:03.728271  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:03.776021  1555 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:03.740837  8256 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:03.788501  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 83515.4us
I20260709 13:02:03.781057  1553 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:03.754408  7923 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:03.791698  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:03.794822  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:03.795617  2270 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:03.798991  2263 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:02:03.800181  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:03.781905  7858 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.745543  7711 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:02:03.802163  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.787714  8027 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:03.802114  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:03.787251  8237 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:03.808736  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:03.793002  8256 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.798460  7977 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:03.811479  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:03.787166  8088 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:02:03.801455  7611 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.816072  8235 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:03.819151  1558 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:02:03.796044  8130 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:02:03.760170  7761 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.829447  7950 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.848541  8130 consensus_queue.cc:1243] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:03.830474  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.832372  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:03.834071  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:03.850903  1633 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:03.851245  2263 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:03.835129  7959 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:03.835964  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:03.853760  2268 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:03.837092  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.855365  1524 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:03.855901  2234 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:03.822872  8087 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:03.841306  8230 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.999s	user 0.005s	sys 0.009s
I20260709 13:02:03.840945  7698 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.016201  2265 rpcz_store.cc:276] 0709 13:02:01.760331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.760448 (+   117us) service_pool.cc:224] Handling call
0709 13:02:01.774496 (+ 14048us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.774726 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:01.784794 (+ 10068us) log.cc:844] Serialized 14 byte log entry
0709 13:02:02.914016 (+1129222us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b180049f240. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f23a 00007f06ddfd9a2a
0709 13:02:03.013394 (+ 99378us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.013631 (+   237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.013678 (+    47us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:03.013723 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.013841 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.013943 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7160,"prepare.queue_time_us":11795,"prepare.run_cpu_time_us":1863,"prepare.run_wall_time_us":13181,"raft.queue_time_us":7399,"spinlock_wait_cycles":13304320,"thread_start_us":91684,"threads_started":1}
I20260709 13:02:03.812713  8234 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.819325  8075 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.843230  8235 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.870296  8075 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.872172  8235 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.806411  7858 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:03.851882  1634 raft_consensus.cc:2376] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19. Re-sending same reply.
I20260709 13:02:03.840386  8135 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.843667  8254 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:03.857297  7611 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:03.865983  8227 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.853430  7959 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:03.876164  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.852962  8138 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:03.859822  7940 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:03.852797  8246 consensus_queue.cc:1059] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:02:03.812621  8250 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:03.891887  8250 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:03.892310  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.892952  1633 raft_consensus.cc:2376] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15. Re-sending same reply.
I20260709 13:02:03.893147  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.887542  1551 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:03.886183  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 181168us
I20260709 13:02:03.850843  8027 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:03.888850  7940 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.872430  8075 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.889619  1559 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 20: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:02:03.885684  8142 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.000s
I20260709 13:02:03.894799  1524 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:03.900455  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2605) took 1496 ms. Trace:
I20260709 13:02:03.895244  1629 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:03.895438  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.900892  1628 rpcz_store.cc:276] 0709 13:02:02.403725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.403857 (+   132us) service_pool.cc:224] Handling call
0709 13:02:02.404147 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.426517 (+ 22370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.426565 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.427061 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:02:02.841334 (+414273us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:02.841378 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.841444 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.840743 (+999299us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:03.897317 (+ 56574us) raft_consensus.cc:1685] finished
0709 13:02:03.897338 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.900390 (+  3052us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46794,"raft.queue_time_us":33336,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9838,"spinlock_wait_cycles":51733632,"thread_start_us":348252,"threads_started":1,"wal-append.queue_time_us":377019}
I20260709 13:02:03.902398  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:03.903141  2271 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14. Ops: [12.10-13.11]
I20260709 13:02:03.903952  2263 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:03.904904  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:03.884891  7928 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.906522  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:03.909523  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.887075  8138 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:03.911192  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:03.898136  8127 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.912626  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:03.898006  7940 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.913130  2268 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20. Ops: []
W20260709 13:02:03.913411  8263 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:02:03.913872  2262 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:02:03.914892  2269 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:03.927278  8135 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.916890  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.912808  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:03.883663  8254 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:03.921391  8127 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.922497  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:03.932322  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:03.937849  8261 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:02:03.940181  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.941354  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.942160  8186 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:03.942585  8186 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:03.942965  8186 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:03.943212  7858 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:03.944051  8265 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:02:03.946372  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:03.981447  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 51216.5us
I20260709 13:02:03.981657  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:03.985352  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:03.929041  8234 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.906153  8142 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:03.889658  8237 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:03.996447  7698 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:03.918267  7928 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.002358  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:04.002931  1633 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:02:04.011646  8142 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:04.017565  8254 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:04.009173  7923 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.020882  8179 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:04.021725  7940 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.028352  8179 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:04.027940  2264 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:04.030143  8080 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.040472  8080 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:04.045430  2270 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:04.046360  8186 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.048121  7923 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:04.032584  7940 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:04.033200  7928 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:04.036880  8127 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:04.036576  8107 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:03.992970  8138 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.031572  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:04.042773  8075 raft_consensus.cc:3055] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:04.043895  8256 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.048353  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:04.056660  2262 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:04.056074  8075 raft_consensus.cc:740] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:04.059018  8138 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:04.059126  8075 consensus_queue.cc:260] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.060659  8075 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:04.061647  7879 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:04.062157  7879 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:04.063059  7879 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:04.064553  7879 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:04.065030  2267 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:04.066960  7624 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:04.071267  8070 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:04.071765  8070 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:04.072897  8070 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.075567  8186 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:04.077574  8107 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:04.079351  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:04.082114  2268 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:04.081314  8070 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:04.089901  8224 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:04.077889  7959 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.091862  7959 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:04.139056  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:04.141888  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.142534  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 153723us
I20260709 13:02:04.144302  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:04.152062  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:04.153796  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.155776  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.157578  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:04.035320  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3000) took 1040 ms. Trace:
I20260709 13:02:04.226882  1700 rpcz_store.cc:276] 0709 13:02:02.994718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.994827 (+   109us) service_pool.cc:224] Handling call
0709 13:02:02.998084 (+  3257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.599463 (+601379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.035038 (+435575us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54001c4dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:04.035252 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381186944}
I20260709 13:02:04.178541  7712 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:04.179522  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:04.180159  7591 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:04.183523  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:04.188304  8075 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:04.209214  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:04.212169  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:04.216135  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:04.219648  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:04.227656  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:04.180999  7761 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:04.234292  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 82499.3us
W20260709 13:02:04.236886  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.238708  1626 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:04.239967  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:04.230791  8138 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:04.246315  2235 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:04.246595  8075 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:04.254638  7761 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.268376  7761 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:04.257087  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:04.270709  1706 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:02:04.256871  2262 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:04.277415  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:04.278894  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:04.280294  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:04.280963  2262 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:04.257421  2270 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:04.286427  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:04.288266  2270 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:04.285166  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:04.288419  1627 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:04.292699  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:04.263007  8256 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:04.293962  2271 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:04.298758  8215 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.299250  1634 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:04.299491  8215 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.264717  8075 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:04.302413  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:04.305195  1632 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:02:04.305297  1626 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:04.314392  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 70218.1us
I20260709 13:02:04.317972  8252 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:04.269330  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:04.269367  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:04.328474  7940 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:04.329478  7940 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.337394  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1203) took 1048 ms. Trace:
I20260709 13:02:04.337900  1703 rpcz_store.cc:276] 0709 13:02:03.288447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.483821 (+195374us) service_pool.cc:224] Handling call
0709 13:02:03.493268 (+  9447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.493606 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.493635 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.515257 (+ 21622us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.709767 (+194510us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:03.725374 (+ 15607us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.336344 (+610970us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b1800469a80. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:02:04.336752 (+   408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.336839 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:04.336923 (+    84us) raft_consensus.cc:1685] finished
0709 13:02:04.337040 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.337228 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4233,"prepare.queue_time_us":17122,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":451,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4981,"spinlock_wait_cycles":10326784,"thread_start_us":149192,"threads_started":1,"wal-append.queue_time_us":239769}
I20260709 13:02:04.347289  8017 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:04.347987  8017 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:04.348239  8081 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:04.348901  8081 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:04.351138  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:04.354709  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 85577.1us
I20260709 13:02:04.344429  7940 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:04.370904  8081 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.380313  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:04.381006  8208 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:04.381474  8208 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:04.382632  8208 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:04.385507  8090 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:04.388949  8208 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:04.389413  8090 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:04.390507  8215 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:04.386149  1660 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:36797 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:36797 timed out after 15.000s (SENT)
I20260709 13:02:04.390913  8090 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:04.392349  8090 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:04.396924  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:04.402599  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:04.403617  1709 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:04.412992  1635 raft_consensus.cc:1240] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:04.413419  1631 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:02:04.425841  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.413483  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:04.428447  2269 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:04.429544  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:04.349903  8017 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.431427  8138 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:02:04.438369  8207 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:04.439252  8138 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:04.439075  8207 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:04.439666  8138 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:04.440590  8138 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.440248  1456 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:04.442121  8207 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:04.443885  8136 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:04.444433  8136 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:04.444968  8136 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:04.446457  8017 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:04.448058  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:04.448843  8138 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:04.450224  7712 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:04.450738  7712 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.451104  7712 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:04.458328  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:04.460824  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:04.463866  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.465534  2265 raft_consensus.cc:2410] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:02:04.470333  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.471120  1556 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:04.471239  1630 raft_consensus.cc:2410] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 18 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:02:04.473378  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:04.474092  1558 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:04.476163  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:04.476965  1551 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:04.477237  1560 raft_consensus.cc:2410] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 17 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 13:02:04.476303  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:04.484282  1559 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:04.484905  1555 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 22: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:04.485920  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:04.481598  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:04.488461  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:04.488979  1626 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:04.483726  8207 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:04.498628  1704 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
W20260709 13:02:04.518102  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 789804us
I20260709 13:02:04.518823  2269 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:04.511595  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:04.528434  1558 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:04.544222  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:04.540516  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 80603us
I20260709 13:02:04.509536  7712 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:04.548931  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 135628us
I20260709 13:02:04.555042  7712 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:04.558570  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.523805  8065 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:02:04.570330  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:04.572451  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.537966  8136 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.585405  1556 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:04.570060  7712 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:04.608292  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 1197) took 1385 ms. Trace:
I20260709 13:02:04.608803  1704 rpcz_store.cc:276] 0709 13:02:03.223342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.341111 (+117769us) service_pool.cc:224] Handling call
0709 13:02:04.608029 (+1266918us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000b6b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:04.608199 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2633227136}
W20260709 13:02:04.610520  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 75667.9us
I20260709 13:02:04.611725  1524 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:04.613231  8108 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:04.604672  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:04.622769  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.618089  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:04.629837  2267 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:02:04.631557  2267 pending_rounds.cc:85] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 11
W20260709 13:02:04.633368  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 59188.5us
I20260709 13:02:04.636425  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:04.631850  2267 pending_rounds.cc:107] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:02:04.642843  2267 raft_consensus.cc:2889] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.640868  2265 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:04.647526  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:04.654628  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.648761  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:04.660101  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:04.661087  1703 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:04.663046  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:04.668988  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:04.669835  1626 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:04.673810  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:04.674296  8070 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:04.675693  8070 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:04.676100  8070 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:04.677212  8070 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.678143  8027 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:04.678268  1635 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:04.678941  8070 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:04.679517  8136 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:04.683107  8289 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:04.685642  1524 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:04.686772  1626 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:04.668135  8090 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:04.694567  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 119699us
I20260709 13:02:04.702687  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1195) took 1513 ms. Trace:
I20260709 13:02:04.703310  1701 rpcz_store.cc:276] 0709 13:02:03.189552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.447238 (+257686us) service_pool.cc:224] Handling call
0709 13:02:03.450412 (+  3174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.450591 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:03.582761 (+132170us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.731969 (+149208us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.655839 (+923870us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.685027 (+ 29188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.688192 (+  3165us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:04.688237 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.690696 (+  2459us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.702457 (+ 11761us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":678625,"prepare.queue_time_us":386134,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":2434,"raft.queue_time_us":1259773,"raft.run_cpu_time_us":546,"raft.run_wall_time_us":18399,"spinlock_wait_cycles":33280,"thread_start_us":420955,"threads_started":4,"wal-append.queue_time_us":226714}
I20260709 13:02:04.707844  1703 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:04.727042  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1198) took 1493 ms. Trace:
I20260709 13:02:04.731364  1701 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:02:04.732653  1601 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:04.736379  8192 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:04.738323  8049 raft_consensus.cc:2764] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:02:04.733716  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:04.688680  8289 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:04.745743  8136 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:04.746441  8136 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:04.746495  8289 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:04.748812  8136 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:04.749347  8136 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.746783  2235 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:04.749632  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:04.752163  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 87039.3us
I20260709 13:02:04.754477  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:04.755327  7712 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:04.755736  7712 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.756140  7712 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:04.740521  8138 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:04.757547  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:04.757972  8090 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:04.758431  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:04.759274  2267 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:04.759406  1599 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:04.759611  8282 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:04.760079  8282 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:04.760495  8192 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:04.760919  8210 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:04.761135  8282 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.762085  8210 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:04.759296  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:04.762969  8282 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:04.762149  8192 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:04.763923  8192 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:04.764847  8192 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.768070  2235 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:04.769191  7940 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:04.770931  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:04.771442  7940 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:04.771996  7940 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:04.772094  8142 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:04.776292  1554 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
W20260709 13:02:04.776430  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 149264us
I20260709 13:02:04.738977  8207 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:04.729471  1707 rpcz_store.cc:276] 0709 13:02:03.233299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.447374 (+214075us) service_pool.cc:224] Handling call
0709 13:02:03.450386 (+  3012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.450591 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:03.555597 (+105006us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.648474 (+1092877us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.683724 (+ 35250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.687105 (+  3381us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:04.689905 (+  2800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.695052 (+  5147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.726852 (+ 31800us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":649667,"prepare.queue_time_us":276628,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":628913,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":4054,"spinlock_wait_cycles":237440,"thread_start_us":510302,"threads_started":4,"wal-append.queue_time_us":174474}
I20260709 13:02:04.772595  8142 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.794865  8017 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:04.790251  1456 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 9 to 2, term changed from 13 to 12, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193), VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194), VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195), VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:04.782141  8090 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:04.803270  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 53806.9us
I20260709 13:02:04.792399  8142 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:04.790436  8192 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:04.778220  8210 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:02:04.801836  8027 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:04.816437  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:04.817081  1701 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:04.818105  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:04.818504  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 84892.1us
I20260709 13:02:04.818781  1703 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:04.819854  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:04.820477  1708 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:04.820722  1601 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:04.774200  8136 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.821990  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:04.823858  1706 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:04.801610  8017 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:04.822851  1700 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:02:04.840962  8017 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.824404  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:04.823580  2235 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:04.831799  1708 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:04.830417  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:04.824700  8027 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:04.834183  7940 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:04.833892  7712 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:04.847896  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.834677  1456 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 8 to 2, term changed from 20 to 13, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193), VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194), VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195), VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:04.853714  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 50975.7us
I20260709 13:02:04.857789  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:04.859581  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:04.865645  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:04.867226  1559 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:02:04.869848  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:04.873031  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 63653.6us
W20260709 13:02:04.876092  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52644.6us
I20260709 13:02:04.823588  8252 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:02:04.870940  1456 catalog_manager.cc:5697] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.867421  8138 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:04.909786  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 56986.9us
I20260709 13:02:04.922286  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:04.897507  8027 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:04.943527  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:04.903359  8256 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:04.909402  8017 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:04.961031  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:04.965242  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.969069  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:04.963593  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:05.002995  1708 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:05.008162  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:05.015573  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:04.963253  8065 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:05.019300  1703 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:04.934289  8138 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.036756  1554 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:04.982875  8090 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:04.992233  7858 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:02:05.055030  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 188191us
I20260709 13:02:05.061415  1700 raft_consensus.cc:2410] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 17 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 13:02:05.063608  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:05.024832  8065 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:02:05.097266  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 67228.2us
I20260709 13:02:05.101764  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:05.100724  8065 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:05.099999  7712 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:05.128348  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:05.113245  8136 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:05.131098  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:05.136243  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:05.137017  1709 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:05.147346  1702 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:02:05.126225  8256 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:05.157401  1700 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:05.171276  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:05.178810  1702 raft_consensus.cc:2368] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18.
W20260709 13:02:05.177198  8302 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:02:05.170666  8210 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:02:05.180230  8267 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.180809  8267 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:05.181699  8299 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:02:05.183019  8267 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:05.184528  8301 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.185168  8301 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.185709  8256 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.189640  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:05.191896  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:05.203987  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 78597.2us
W20260709 13:02:05.204986  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.177330  8314 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.224148  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.224154  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 299494us
I20260709 13:02:05.208781  8142 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.230904  1708 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
W20260709 13:02:05.222965  8295 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 13:02:05.233803  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.218958  8289 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.243207  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.245875  8188 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:02:05.246101  8296 log.cc:927] Time spent T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 13:02:05.246883  8306 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:02:05.246599  8188 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:05.249058  8188 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:05.258879  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:05.260505  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:05.238320  8314 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.264249  8308 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:05.264920  8308 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:05.277344  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 153600us
I20260709 13:02:05.280393  8267 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:05.266516  8192 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:02:05.253217  8289 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:05.306826  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:05.271234  8210 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:02:05.283039  8316 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:05.297642  8138 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:05.313591  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 138581us
I20260709 13:02:05.318691  8301 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:05.328456  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 339225us
I20260709 13:02:05.326211  8075 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.313230  8315 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:05.322513  1709 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:05.314970  1707 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:02:05.310405  7940 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:05.333408  8320 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.324652  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 424785us
W20260709 13:02:05.337203  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.324303  8308 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:05.326617  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:05.327869  8300 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:02:05.344144  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.347877  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:05.355216  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.358809  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:05.358903  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:05.327939  7950 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:05.375437  8318 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:05.378746  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 54944.4us
I20260709 13:02:05.379308  1526 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:05.380065  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:05.383612  8136 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:05.384167  8136 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:05.385118  8136 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.361775  8267 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:05.387984  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:05.368933  8142 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:05.342088  8315 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.394286  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:05.402635  1554 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:05.368116  8108 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:02:05.367336  8075 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:05.404541  1458 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 235) took 18494 ms (client timeout 15000 ms). Trace:
W20260709 13:02:05.405125  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 78590us
I20260709 13:02:05.405902  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:05.405426  1456 catalog_manager.cc:5697] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.406152  8075 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:05.407080  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:05.407967  8317 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:05.408644  8317 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:05.408967  8317 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:05.409291  8317 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:05.362444  8320 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.412740  8320 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:05.404734  8289 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:05.407312  1456 catalog_manager.cc:5697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 8 to 10, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 10 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.388720  8090 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:05.428599  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:05.429284  8311 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:05.429886  8311 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.431071  8108 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:05.431787  8108 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:05.432126  8108 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:05.432169  8311 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:05.433454  8108 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:05.430284  8321 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:05.434607  8319 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.139s	user 0.000s	sys 0.003s
I20260709 13:02:05.436318  7712 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:05.436694  8215 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:05.453250  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:05.440860  8065 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:05.459524  1630 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:02:05.414938  1458 rpcz_store.cc:269] 0709 13:01:46.910157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.921771 (+ 11614us) service_pool.cc:224] Handling call
0709 13:01:47.886797 (+965026us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b540009b354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf39090 00007f06ddfd7f3a 00007f06e3d8e1cc 00007f06e3e8c37e 00007f06e234d2a4 00007f06e234d232 00007f06e234d161 00007f06e234d0dc 00007f06e234c392 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:05.404290 (+17517493us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:57.364329 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:57.365095 (+   766us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:57.365158 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:01:57.365183 (+    25us) tablet.cc:662] Decoding operations
0709 13:01:57.366458 (+  1275us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:57.366556 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:57.366588 (+    32us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:01:57.367833 (+  1245us) tablet.cc:701] Row locks acquired
0709 13:01:57.367882 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:01:57.368054 (+   172us) write_op.cc:270] Start()
0709 13:01:57.368206 (+   152us) write_op.cc:276] Timestamp: P: 1783602117367979 usec, L: 0
0709 13:01:57.368238 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:01:57.368841 (+   603us) log.cc:844] Serialized 5545 byte log entry
0709 13:01:58.036560 (+667719us) op_driver.cc:464] REPLICATION: finished
0709 13:01:58.128685 (+ 92125us) write_op.cc:301] APPLY: starting
0709 13:01:58.128789 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:58.347911 (+219122us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:58.348142 (+   231us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:58.775522 (+427380us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:58.775832 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:01:58.777872 (+  2040us) write_op.cc:312] APPLY: finished
0709 13:01:58.778338 (+   466us) log.cc:844] Serialized 129 byte log entry
0709 13:01:58.778536 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:58.778688 (+   152us) write_op.cc:454] Released schema lock
0709 13:01:58.778761 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:58.819040 (+ 40279us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:58.825304 (+  6264us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1161749,"reported_tablets":40,"spinlock_wait_cycles":307754368,"child_traces":[["op",{"apply.queue_time_us":74403,"apply.run_cpu_time_us":26525,"apply.run_wall_time_us":666101,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62619,"num_ops":14,"prepare.queue_time_us":542731,"prepare.run_cpu_time_us":18246,"prepare.run_wall_time_us":398441,"raft.queue_time_us":126811,"raft.run_cpu_time_us":25808,"raft.run_wall_time_us":60312,"replication_time_us":668149,"thread_start_us":827845,"threads_started":4,"wal-append.queue_time_us":448723,"wal-append.run_cpu_time_us":14316,"wal-append.run_wall_time_us":1961035}]]}
I20260709 13:02:05.430116  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:05.458950  1556 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:05.444948  8317 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.467523  2262 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:05.455547  8215 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:05.366585  7940 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.442507  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:05.399039  8282 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:05.461992  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:05.476471  2267 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:02:05.466497  1553 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 15: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:05.459487  8321 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.469120  8317 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:05.473196  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:05.461817  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:05.480753  1635 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:02:05.448838  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 116678us
I20260709 13:02:05.477669  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:05.481536  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 99401.2us
I20260709 13:02:05.482074  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:05.480229  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:05.469031  7712 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:05.482641  1601 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:05.467537  8065 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:05.487226  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:05.470194  8215 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.495481  1631 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:05.499305  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:05.493317  8142 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:05.502096  8142 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:05.502511  8142 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:05.507308  7940 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:05.451603  8267 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.459852  8138 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:05.507153  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:05.486433  7712 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:05.521143  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:05.524284  2270 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:02:05.519935  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:05.489622  8282 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:05.489964  8289 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:05.531672  1700 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:05.534418  8128 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:05.535072  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:05.539225  2263 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
W20260709 13:02:05.549911  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 56036.9us
I20260709 13:02:05.526401  8049 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:05.552424  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:05.530541  8317 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.509727  8305 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:02:05.557272  1635 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:05.552359  8003 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:02:05.558440  2264 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:05.559932  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:05.562119  2236 leader_election.cc:400] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18.
I20260709 13:02:05.562484  2236 leader_election.cc:403] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:05.563350  1673 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:05.566527  8003 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:05.566962  8003 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:05.567754  8003 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:05.568933  8003 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:05.570165  8323 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:05.571347  8267 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:05.564188  8049 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.574677  8049 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:05.576687  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:05.539299  8322 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:02:05.597225  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:05.603431  8316 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:05.604447  8335 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:05.604699  1704 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:05.605155  2267 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:05.559999  8317 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:05.607029  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 51080.4us
I20260709 13:02:05.608748  1631 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:02:05.611236  8317 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:05.551187  8090 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:05.628021  8107 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:05.636861  8142 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:05.618554  7940 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.642215  8321 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:05.643005  8326 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:05.654542  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 93845.5us
I20260709 13:02:05.659181  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:05.660977  1554 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:05.609850  8267 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18.
I20260709 13:02:05.660362  2262 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:05.619556  8136 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.565726  7712 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:05.684816  8326 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:05.664517  8335 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:05.692879  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 96278.4us
I20260709 13:02:05.694314  8334 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.134s
I20260709 13:02:05.695577  8334 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:05.695930  8334 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:05.696749  8334 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.698297  1673 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:05.704434  8108 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:05.706480  8314 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:05.706761  7712 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:05.709319  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:05.709200  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:05.600126  8282 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.722355  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:05.724769  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:05.726913  8315 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:05.728324  8142 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:05.728035  8335 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:05.729051  8337 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:02:05.730015  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:05.730804  1703 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:05.734865  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:05.741532  8192 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:05.742156  8289 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:05.743223  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:05.744356  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.745579  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:05.680680  7940 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.750312  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:05.753701  1707 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:02:05.754575  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:05.765923  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:05.767911  1556 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 22: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:05.754536  8326 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:05.773253  8330 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:02:05.750078  8215 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:05.750836  8334 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:05.743436  8070 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:05.786278  2267 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:05.793566  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:05.791220  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:05.797031  2271 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:05.797109  1558 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 15: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:05.791317  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:05.794940  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:05.768280  8192 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:05.799077  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:05.765244  8128 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:05.802363  2262 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:05.798410  2268 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:02:05.689137  8136 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:05.808051  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:05.812031  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 122394us
I20260709 13:02:05.818727  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:05.820529  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:05.822458  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:02:05.829874  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 291576us
I20260709 13:02:05.835419  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:05.814117  8192 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:02:05.839313  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.840698  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:05.828266  8308 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:05.814935  8070 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.850217  1599 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:05.840507  8305 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:05.864102  8346 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:05.824048  8315 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:02:05.817041  8128 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.878082  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:05.879428  1706 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:05.850173  8308 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.881899  8017 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:05.858737  8339 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:02:05.879930  8192 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:05.908493  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 300728us
W20260709 13:02:05.911242  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.913436  8356 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:05.914466  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:05.915983  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:05.918829  8303 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:05.929662  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:05.930676  8267 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:05.931150  8267 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:05.932025  8267 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.861354  8305 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.869324  8003 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:05.949597  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:05.905221  8308 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:05.962881  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:05.963024  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:05.966970  1705 raft_consensus.cc:2410] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:02:05.965539  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 120763us
W20260709 13:02:05.968825  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 142651us
I20260709 13:02:05.967832  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:05.949543  8305 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:05.973908  8347 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:02:05.982563  1704 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:05.994383  1706 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:06.002841  8017 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:06.003049  8346 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:06.003706  8343 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:02:05.991950  8136 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:06.003661  8017 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.004550  8136 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.004926  8341 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.163s
I20260709 13:02:06.005010  8136 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:05.938602  8335 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:02:05.967406  8304 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.017257  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.020503  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.022993  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:06.023676  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.027263  1630 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:05.999076  7761 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:06.025561  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 233978us
I20260709 13:02:06.008216  7940 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:06.024290  1633 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:06.013857  8107 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:06.043081  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:06.045624  8017 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.020579  8256 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:06.033756  8322 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:06.050686  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.049405  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:06.045635  8333 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:06.053057  2270 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:06.076202  1706 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:02:06.075690  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 73779.4us
I20260709 13:02:06.045674  8088 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.075497  8346 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:06.104832  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:06.072404  8282 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.074373  8317 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:06.117393  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:06.049669  8341 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:02:06.033470  8304 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.122740  8303 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:06.123598  8303 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.133432  8317 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.102416  8088 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.135991  8088 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.081018  8312 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.136754  8312 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.118920  8188 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.138656  8188 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.043891  7761 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.140961  8188 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.141548  7761 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.139015  8136 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.146684  1709 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:02:06.148295  2271 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:06.072535  8256 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.105497  8075 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.189909  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 81348us
I20260709 13:02:06.196480  8363 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:06.196687  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.197109  8363 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.197623  8363 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:06.150642  7761 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:06.208801  8358 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:02:06.210641  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:06.211831  8325 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:06.212303  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:06.213178  8325 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:06.213631  8325 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:06.214099  8325 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:06.190510  8108 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:06.220978  8108 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.221482  8108 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.222175  8351 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.222817  8351 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.227818  8366 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:06.228714  8366 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:06.230187  8348 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.255s	user 0.000s	sys 0.002s
I20260709 13:02:06.231643  8365 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 13:02:06.190227  8088 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:06.234975  8088 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.239778  8304 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:06.150276  8070 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:06.247697  8256 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:06.252246  8317 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:06.255815  8366 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.237828  8088 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.262372  8364 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.263093  8364 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.192268  8322 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:06.270823  8312 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.117708  8282 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:06.200016  8075 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:06.309051  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.317342  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 103601us
I20260709 13:02:06.318960  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:02:06.278339  7712 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.571s	user 0.004s	sys 0.008s
I20260709 13:02:06.237409  8325 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.322172  1557 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:06.273981  8282 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:06.276618  8075 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.324452  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.308377  8364 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:06.325395  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 276102us
I20260709 13:02:06.304299  8317 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:06.310319  8351 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.337881  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.245496  8305 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:06.328279  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 322115us
I20260709 13:02:06.333611  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.322078  8326 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:06.336812  8090 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:06.325188  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:06.328593  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 223848us
I20260709 13:02:06.339725  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.330652  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:06.340225  8108 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.343413  8308 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.348019  8108 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.348620  8308 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.348896  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.349539  1555 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:06.345029  1556 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:06.350379  1634 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:06.350436  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.350859  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.351217  1555 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:06.352185  8326 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.353125  1560 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:06.340678  1559 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:06.342123  1557 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:06.342720  1551 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:06.359083  1601 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:02:06.362640  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 284055us
I20260709 13:02:06.365571  8108 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:06.366559  8325 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.369537  2235 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:06.364219  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:06.341244  8335 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.372488  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:06.373313  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.375216  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:06.375358  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.375989  1634 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:06.376420  8090 raft_consensus.cc:2764] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:02:06.376984  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.377821  1631 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:02:06.378683  8334 consensus_meta.cc:287] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.004s
I20260709 13:02:06.378870  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.379910  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.380125  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.380765  1633 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:06.380671  1552 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:06.382494  8186 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.383060  8186 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.380851  8128 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:06.384780  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.384892  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:06.385545  8186 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:06.386202  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.386554  8321 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:06.386906  1559 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:06.342059  8317 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.396307  8128 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:06.396714  8065 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:06.396777  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:06.397265  8065 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:06.397253  8335 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:06.397897  8065 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.398138  8310 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:06.396806  8128 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:06.398804  8310 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:06.398953  8282 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:06.399586  8335 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:06.399519  8282 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:06.404361  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:06.406574  1526 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:06.414089  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.414943  1703 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:06.322249  8346 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:06.424026  1706 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:06.425189  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.398818  8128 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:06.375203  8318 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:06.431123  8317 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:06.400611  8309 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:06.432091  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:06.413534  8108 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:06.433857  8108 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.434837  8256 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:06.435258  8256 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.435604  8256 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:06.437352  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.438231  1631 raft_consensus.cc:2410] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:02:06.438383  2234 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:06.438915  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50693.2us
I20260709 13:02:06.419514  2235 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:06.440905  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 66886.3us
I20260709 13:02:06.432154  8309 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:06.444343  8309 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:06.443190  1631 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:06.449146  8282 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:06.399875  8310 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.450306  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:06.451215  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:06.452929  8070 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:06.459589  1628 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:06.460795  8326 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.461081  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.461607  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.467422  1702 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:06.467648  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.462312  8107 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:06.468293  1554 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:06.468340  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.470795  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.462380  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.462916  8316 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:06.473664  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:06.474290  2270 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:06.474581  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.475168  2268 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:06.463096  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.476207  1629 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:06.477046  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.477558  1629 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:06.479616  1629 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:06.479437  8363 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.480744  1553 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:06.480860  1629 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:06.425952  8322 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:06.470543  8335 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:06.482061  1634 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:06.482368  8335 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.482719  8335 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:06.484179  8305 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.389168  8371 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.112s
I20260709 13:02:06.487530  1706 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:06.460798  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.468250  8107 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:06.489605  8107 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:06.490163  8128 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.492933  8128 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:06.463563  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:06.471189  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64676.4us
W20260709 13:02:06.495911  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 76481us
I20260709 13:02:06.497048  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.498283  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.498890  1554 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:06.462330  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.465346  8282 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:06.501119  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.501473  8368 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:06.466578  1674 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:06.502449  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:06.503219  8256 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.505508  8256 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:06.461791  1627 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:06.496527  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:06.471386  1704 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:06.473100  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.498943  1709 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:06.464107  1558 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:02:06.500965  8304 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:06.500830  8186 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:06.514932  2235 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:06.506385  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.540096  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:06.508307  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.507486  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.507841  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.544378  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.544938  1701 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:06.507913  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.546269  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:06.547030  1704 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:06.544036  1702 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:06.548007  2271 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:06.542860  1707 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:06.507620  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.501814  2263 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:06.541214  1706 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:06.550336  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:06.512516  2270 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:06.542124  1558 pending_rounds.cc:85] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 12
I20260709 13:02:06.554373  1558 pending_rounds.cc:107] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:02:06.554718  1558 raft_consensus.cc:2889] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:06.555279  1559 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:06.546662  1632 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:06.544629  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:06.506330  8363 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.563161  8256 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:06.563691  8256 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.564060  8256 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:06.564615  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 68460us
I20260709 13:02:06.563174  1701 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:06.567729  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:06.573767  8027 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:06.574290  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 59443.8us
I20260709 13:02:06.574424  8027 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:06.575166  8027 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:06.501709  8282 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.583479  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.591065  1556 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:06.596201  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.596976  1552 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:06.541047  8304 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:06.604948  1551 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:02:06.606799  1551 pending_rounds.cc:85] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 8
I20260709 13:02:06.559854  8308 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.558468  8322 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.606635  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:06.613535  1558 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:06.609349  1705 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:06.607268  1551 pending_rounds.cc:107] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:02:06.608860  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.603900  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:06.605309  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44883.5us
I20260709 13:02:06.617198  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:06.618716  8088 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:06.599921  8355 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:06.614898  1551 raft_consensus.cc:2889] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:06.619170  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:06.628487  1626 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:06.600159  8334 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:06.553797  8325 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:06.609869  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:06.622174  1634 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:06.626343  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:06.602195  8363 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:06.620321  8088 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.636006  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:06.604225  8321 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.559443  8368 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:02:06.610868  8304 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.609030  8289 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:06.647426  1629 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:06.657073  2267 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:06.627700  8355 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.660354  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.630450  8049 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.662118  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.643807  8325 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.668888  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.669790  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.667801  2265 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:06.631122  8108 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.647114  8088 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:06.644145  8363 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.676554  8385 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:06.678642  8003 consensus_queue.cc:1059] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:06.679214  8359 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.073s
I20260709 13:02:06.669091  8289 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.686928  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.680720  8049 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.723111  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.692586  8107 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.694883  8065 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.622793  8308 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:06.629346  8322 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:06.710489  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 101064us
I20260709 13:02:06.635682  8256 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.710841  1626 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:06.734602  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:06.735204  2269 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:06.670445  8355 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.658784  8321 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.717069  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.669450  8301 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.674925  8325 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:06.716450  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 68543.3us
I20260709 13:02:06.732810  1558 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:06.757061  2265 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:06.743189  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:06.757306  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:06.747363  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.739847  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:06.744678  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:06.757972  2270 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:06.770926  1628 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:06.780099  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:06.784128  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:06.788635  2266 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:06.788956  8374 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:06.789573  8374 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:06.790671  8374 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.793376  8301 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:06.795828  8301 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:06.799100  8088 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.801591  8088 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.808260  2270 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:06.816331  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:06.713976  8108 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:06.756551  8385 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:02:06.806406  8352 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:02:06.782142  8371 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:06.827011  8364 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:06.825549  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:06.836546  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 64682.5us
I20260709 13:02:06.786746  8359 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:06.839259  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.839600  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:06.819272  8368 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:06.820724  8376 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:06.846764  2265 raft_consensus.cc:2368] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20.
I20260709 13:02:06.851486  2269 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:06.828542  8385 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:06.835558  8070 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:06.818735  8003 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:02:06.867105  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:06.867537  2269 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: [15.13-17.14]
I20260709 13:02:06.875198  1599 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:06.819113  8346 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:02:06.886304  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:06.859544  8376 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.887835  2265 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:06.890401  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:06.901952  1556 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:06.904613  8387 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:06.910010  2263 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:02:06.910578  1556 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:06.911669  8049 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.912096  2235 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:06.912983  8090 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:06.913203  8108 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:06.913461  8090 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:06.914988  8321 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.915607  8321 consensus_queue.cc:1059] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:06.916365  8321 consensus_queue.cc:1243] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:02:06.916985  8321 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:06.917455  8321 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.909637  8335 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.921793  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:06.900539  8329 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:06.931094  8323 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:06.938413  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:06.869923  8368 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:06.881573  8282 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.883599  8252 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.855391  8359 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.917821  8321 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:06.913879  8090 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.892300  8364 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:06.921195  8376 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:06.953962  1630 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:02:06.982906  8364 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:06.983891  8364 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.986397  8289 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.975701  8252 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.987984  8368 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.989218  8252 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:06.990425  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:06.991206  1552 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:06.992870  8322 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:06.954427  8128 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:06.994445  8128 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:06.994892  8128 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:06.957580  8385 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.16, Last appended by leader: 16, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:06.999558  8385 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.000888  8186 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:02:06.950439  8378 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:02:06.946722  8317 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:07.002748  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:06.953737  8215 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:07.009984  8316 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:07.016083  8252 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:07.016716  8252 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.017091  8252 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:06.977548  8256 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:06.949661  8323 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:07.022115  8363 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:07.024259  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 147318us
I20260709 13:02:07.035821  1599 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:07.037586  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:07.023901  8317 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:07.050558  8305 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:07.051096  8305 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:07.051970  8305 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.076107  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:07.079493  2265 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:07.037097  8107 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:07.081933  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:07.092558  8359 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:07.095443  8335 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:07.038640  8303 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:07.106443  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:07.037168  8377 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.114619  8377 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:07.117532  8377 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:07.121012  8359 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:07.130173  8027 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.138820  8317 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.140106  8188 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:07.140563  8188 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:07.142815  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:07.144493  8192 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:07.145192  2271 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:07.146041  8192 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:07.145951  8334 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.141363  8188 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.148962  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:07.040444  8315 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:07.160132  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:07.168090  2263 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:07.016739  8316 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.035246  8304 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.173532  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:07.174063  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:07.175151  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 335882us
I20260709 13:02:07.181144  1551 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:07.180255  1552 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:07.144032  8027 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:07.160256  8334 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:07.185531  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:07.190307  1552 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:02:07.147109  8192 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.168135  8377 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:07.217787  2264 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
W20260709 13:02:07.186652  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 446890us
I20260709 13:02:07.168610  8315 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.231735  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:07.226588  1551 raft_consensus.cc:2368] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20.
I20260709 13:02:07.240206  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:07.242318  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:07.242527  8363 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:07.243042  2265 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:07.242082  1526 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:07.246937  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:07.248937  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:07.250504  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:07.216161  8256 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.149374  8128 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.257651  1600 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:07.238076  8315 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:07.236205  8188 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:07.231112  8318 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.238966  8049 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.243937  8363 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:07.242358  8346 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:07.220817  8282 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:02:07.172098  8323 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.260048  8088 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:07.265944  8303 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:07.232887  8377 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:07.295347  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:07.287787  8346 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.289022  7940 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:07.266235  8256 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.296423  8088 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:07.326278  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 500837us
I20260709 13:02:07.362936  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:07.363199  1673 leader_election.cc:400] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20.
I20260709 13:02:07.363546  1673 leader_election.cc:403] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:07.363672  1551 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21.
I20260709 13:02:07.279366  8049 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:07.314174  8323 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.317564  8346 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.298878  8305 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:07.318509  8325 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.527s	user 0.012s	sys 0.000s
I20260709 13:02:07.365878  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:07.367441  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:07.299976  8303 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:07.371299  1707 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:07.372638  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:07.413338  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:07.414531  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:07.415088  1704 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:07.375126  1706 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:07.369102  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:07.417059  1629 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:07.371712  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:07.309665  8090 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:07.380646  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:07.393316  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:07.402777  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:07.421985  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:07.393357  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:07.393230  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:07.368372  8088 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:07.417416  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:07.288404  8318 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.419886  1631 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:07.312212  8389 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:02:07.409651  8394 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:02:07.369345  8402 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:07.425021  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:07.425531  1707 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:02:07.461287  1707 pending_rounds.cc:85] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 8
I20260709 13:02:07.461545  1707 pending_rounds.cc:107] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:02:07.461783  1707 raft_consensus.cc:2889] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:07.461939  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:07.426204  1703 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:07.422267  1701 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:07.421747  8303 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:07.427111  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 162322us
I20260709 13:02:07.424269  2263 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 15: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:07.357923  7940 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.416394  8326 raft_consensus.cc:3055] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:02:07.490109  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 62130.9us
W20260709 13:02:07.455513  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 52474.9us
I20260709 13:02:07.412046  8305 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.361430  8363 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.462598  1626 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:07.427146  1709 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:02:07.519675  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:07.406415  8252 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.554270  1600 leader_election.cc:400] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20.
I20260709 13:02:07.414989  8325 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:07.571180  1600 leader_election.cc:403] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:02:07.457751  8304 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:07.589078  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 208515us
I20260709 13:02:07.590706  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:07.633983  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:07.614732  1704 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:07.591859  8401 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:02:07.601249  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.665521  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 74937.1us
I20260709 13:02:07.592046  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:07.591476  1708 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:02:07.592983  8403 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 13:02:07.585759  8378 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:02:07.477403  8404 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:07.553126  8326 raft_consensus.cc:740] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:07.554971  8305 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:07.557538  8372 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.116s
I20260709 13:02:07.668941  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:07.668991  1631 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:07.601488  8108 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:02:07.718305  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:07.719178  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 199615us
W20260709 13:02:07.676755  8355 consensus_meta.cc:287] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.858s	user 0.013s	sys 0.000s
I20260709 13:02:07.721596  1626 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
W20260709 13:02:07.727509  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 58668.2us
W20260709 13:02:07.696949  8391 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.773s	user 0.009s	sys 0.000s
I20260709 13:02:07.578816  8363 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.756935  1552 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:02:07.757959  8363 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:07.758581  1629 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:07.700763  8412 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:07.694866  8128 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:07.750303  8417 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:02:07.750756  8407 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 13:02:07.752074  8422 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:07.753496  8410 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:02:07.782550  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:07.754609  8377 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:07.755532  8326 consensus_queue.cc:260] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:07.699383  8419 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:07.635387  8335 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.078s
I20260709 13:02:07.746240  8088 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:07.689404  8304 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:07.687929  8406 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:07.780014  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:07.785995  8417 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:07.786309  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 112495us
I20260709 13:02:07.753950  8346 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.787667  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1358) took 1064 ms. Trace:
I20260709 13:02:07.787837  1707 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:07.824788  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:07.785068  8323 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:07.823835  2271 rpcz_store.cc:276] 0709 13:02:06.717860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.718115 (+   255us) service_pool.cc:224] Handling call
0709 13:02:07.142278 (+424163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.146543 (+  4265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.782335 (+635792us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b5400672ad0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:07.782503 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927520512}
I20260709 13:02:07.739279  8355 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:07.781598  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 277942us
I20260709 13:02:07.703377  8374 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
I20260709 13:02:07.820510  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:07.798938  8419 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:07.827942  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 88828.7us
I20260709 13:02:07.852995  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:07.479445  8402 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:07.855733  8419 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:07.856151  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:07.856983  2271 raft_consensus.cc:2368] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20.
I20260709 13:02:07.833141  8256 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:07.857908  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:07.858440  2271 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:07.859930  8376 consensus_meta.cc:287] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.845s	user 0.012s	sys 0.000s
I20260709 13:02:07.860357  8376 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.861560  8418 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.131s
W20260709 13:02:07.862905  8409 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.416s	user 0.000s	sys 0.001s
I20260709 13:02:07.864459  8427 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:07.865015  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2630) took 1408 ms. Trace:
I20260709 13:02:07.865407  1630 rpcz_store.cc:276] 0709 13:02:06.456687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.465511 (+  8824us) service_pool.cc:224] Handling call
0709 13:02:06.465822 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.003738 (+537916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.864779 (+861041us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54002fb7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:07.864960 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120668416}
I20260709 13:02:07.870093  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:07.871683  8376 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:07.871876  8426 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:02:07.874734  8413 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:02:07.877687  2271 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:07.878932  2271 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:07.886596  8090 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:07.887327  8090 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:07.817901  8398 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.073s
I20260709 13:02:07.823026  8326 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:07.891148  8321 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.883s	user 0.011s	sys 0.000s
I20260709 13:02:07.891575  8321 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:07.829070  8049 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:07.894829  8346 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:07.895663  8088 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:07.896422  8252 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:07.900497  8334 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.671s	user 0.008s	sys 0.003s
I20260709 13:02:07.852169  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2797) took 1272 ms. Trace:
W20260709 13:02:07.916762  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 63865.6us
I20260709 13:02:07.855700  8318 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:07.887804  8090 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.909010  1556 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:07.911175  8321 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:07.911638  7940 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:07.912564  8188 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.627s	user 0.007s	sys 0.003s
I20260709 13:02:07.855934  8416 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:07.932142  1524 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:07.846382  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:07.935177  1707 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
W20260709 13:02:07.916481  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 96045.1us
I20260709 13:02:07.837368  1600 leader_election.cc:400] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21.
W20260709 13:02:07.907287  8425 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:02:07.918725  1632 rpcz_store.cc:276] 0709 13:02:06.570128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.598357 (+ 28229us) service_pool.cc:224] Handling call
0709 13:02:06.598650 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.626595 (+ 27945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.626628 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.638707 (+ 12079us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.804808 (+166101us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:06.804850 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.804923 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.696260 (+891337us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:07.822832 (+126572us) raft_consensus.cc:1685] finished
0709 13:02:07.822860 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.841975 (+ 19115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":856,"raft.queue_time_us":14498,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":10114,"spinlock_wait_cycles":34427648,"thread_start_us":92706,"threads_started":1,"wal-append.queue_time_us":256906}
I20260709 13:02:07.923727  8429 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:07.925625  8090 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:07.925854  8325 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:07.927682  8355 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:07.936646  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:07.865229  8427 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:07.941867  1600 leader_election.cc:403] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:02:07.944342  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:07.946096  2270 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:07.946789  1601 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:07.948220  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:07.933350  8346 raft_consensus.cc:2764] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:02:07.958734  1707 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21.
W20260709 13:02:07.957782  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 120638us
I20260709 13:02:07.848635  8323 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:07.934017  8207 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:07.977228  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:07.980808  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:07.946533  8429 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:07.849406  8406 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:07.922864  8334 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:07.947160  8321 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:07.949013  8142 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:07.994103  1601 leader_election.cc:400] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21.
I20260709 13:02:07.955461  8434 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:07.955822  8088 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:07.958877  7940 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:07.973124  8359 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21.
I20260709 13:02:07.959647  8401 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:08.015846  8401 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.002775  8188 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:07.956854  8422 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:02:07.987610  8429 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:07.987246  8355 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:08.017452  7940 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.998725  8399 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:08.053602  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:08.054368  1700 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:08.056653  8394 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20.
I20260709 13:02:08.010814  8428 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:08.012423  8406 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.013078  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:08.013973  8334 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:08.018318  8088 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:08.016412  8315 consensus_meta.cc:287] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.730s	user 0.007s	sys 0.005s
I20260709 13:02:08.070274  8315 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.003396  8303 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.074100  8303 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:08.002017  8321 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.075155  8305 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.076082  8321 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:07.986708  8017 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:08.076642  1626 raft_consensus.cc:1240] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 18. Ops: []
I20260709 13:02:08.076874  8017 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.999555  8417 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.077337  8017 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:08.001631  8207 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.083056  8207 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.020830  8188 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.084904  8188 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.038733  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:08.086449  1705 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:02:08.061400  8419 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.091078  8419 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.092012  1708 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:08.092667  8088 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:08.094980  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:08.095830  1707 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:08.042979  7940 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:08.045686  8355 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:08.099049  8355 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.017673  8142 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.019721  8434 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.048193  8401 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:08.049197  8385 consensus_meta.cc:287] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.049s	user 0.015s	sys 0.000s
I20260709 13:02:08.015228  8323 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:08.064119  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:08.087811  8428 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.103593  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:08.104388  1704 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:08.105945  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:08.109972  8402 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:08.111785  8397 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.685s	user 0.000s	sys 0.002s
I20260709 13:02:08.113767  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1261) took 1312 ms. Trace:
I20260709 13:02:08.118852  1558 rpcz_store.cc:276] 0709 13:02:06.801277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.801451 (+   174us) service_pool.cc:224] Handling call
0709 13:02:06.801815 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.802201 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.802233 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.802749 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.163084 (+360335us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:07.163124 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.163185 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.111060 (+947875us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:08.113407 (+  2347us) raft_consensus.cc:1685] finished
0709 13:02:08.113432 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.113682 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":174,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":8345856,"thread_start_us":359962,"threads_started":1,"wal-append.queue_time_us":516624}
I20260709 13:02:08.118865  8329 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:08.121672  8329 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:08.128942  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:08.129653  2269 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:02:08.130722  8065 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.135134  8428 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:08.135191  8390 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 1.208s	user 0.003s	sys 0.004s
I20260709 13:02:08.138404  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1435) took 1666 ms. Trace:
I20260709 13:02:08.138772  2262 rpcz_store.cc:276] 0709 13:02:06.472009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.472296 (+   287us) service_pool.cc:224] Handling call
0709 13:02:06.474136 (+  1840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:06.508163 (+ 34027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.508195 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:06.508650 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.808430 (+299780us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:06.808494 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.808589 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.134437 (+1325848us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:08.138133 (+  3696us) raft_consensus.cc:1685] finished
0709 13:02:08.138152 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.138341 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33642,"raft.queue_time_us":66231,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":13690,"spinlock_wait_cycles":31033216,"thread_start_us":299353,"threads_started":1,"wal-append.queue_time_us":418402}
I20260709 13:02:08.141924  8422 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:08.142699  8422 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.143255  8316 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:08.145529  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1432) took 1001 ms. Trace:
I20260709 13:02:08.145920  1628 rpcz_store.cc:276] 0709 13:02:07.144292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.144747 (+   455us) service_pool.cc:224] Handling call
0709 13:02:08.144786 (+1000039us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaeee 0000000000375939 00007f06e2f1e1e0 00007f06e2fe70c4 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 13:02:08.144978 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.145197 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.145236 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.145282 (+    46us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:08.145309 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.145360 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.145475 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5247232}
I20260709 13:02:08.147640  8369 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:02:08.148488  8408 log.cc:927] Time spent T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.569s	user 0.001s	sys 0.000s
I20260709 13:02:08.149612  8334 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:08.150190  8334 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.151053  8142 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.152791  8334 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:08.165547  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:08.167210  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:08.167778  8377 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:08.169757  2267 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:08.170528  8394 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:08.171165  8394 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:08.173338  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.173976  1555 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:08.175953  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.177071  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.178355  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.178897  1553 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:08.179754  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.180276  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:08.180516  1560 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:08.180747  8416 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:08.180980  1553 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:02:08.181284  8416 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:08.181545  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:08.182415  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:08.183460  8282 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.169760  8377 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.183961  8282 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.185555  8422 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:08.186014  8282 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:08.186534  8282 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:08.186972  8282 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.188792  1559 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:08.188982  8282 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
W20260709 13:02:08.191457  2268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 1454) took 1696 ms (client timeout 1987 ms). Trace:
W20260709 13:02:08.191924  2268 rpcz_store.cc:269] 0709 13:02:06.495249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.647014 (+151765us) service_pool.cc:224] Handling call
0709 13:02:08.191228 (+1544214us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b54004e7fd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:08.191357 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162278784}
I20260709 13:02:08.183248  1551 raft_consensus.cc:2368] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18.
I20260709 13:02:08.185637  8377 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:08.204543  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.205166  1702 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:08.204486  1704 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:08.211228  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:08.211872  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:08.212757  1554 raft_consensus.cc:2368] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:08.212106  2262 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:08.214684  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:08.218437  1707 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:08.129176  8412 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20.
I20260709 13:02:08.219666  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:08.203083  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 258840us
I20260709 13:02:08.225339  1700 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:08.229171  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:08.227934  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:08.229977  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:08.231153  1558 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:08.231493  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:08.232234  2262 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:08.232694  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:08.231494  1558 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:08.233387  1707 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:08.235249  1626 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:08.229465  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:08.236469  1700 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 21: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:08.229832  1704 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:08.237104  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:08.237810  1629 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:08.243392  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:08.243727  1559 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:08.243999  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:08.245097  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:08.245132  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:08.243510  1560 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:02:08.243515  2235 leader_election.cc:400] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18.
I20260709 13:02:08.247874  2235 leader_election.cc:403] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:02:08.249634  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:08.252108  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.234331  1558 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.253837  1558 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:08.254945  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:08.257234  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.200785  8017 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.259776  1701 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:08.264914  1707 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:08.267729  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:08.275126  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:08.226128  8282 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:08.278335  8282 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.257158  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.280536  8282 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.281073  1553 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:08.282981  8434 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:08.254307  8316 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:02:08.283856  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:08.286235  2235 leader_election.cc:400] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:08.287338  2235 leader_election.cc:403] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:02:08.282840  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:08.288261  8420 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:08.291406  8404 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:08.291947  8404 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:08.292929  8404 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.296062  8017 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.297961  8088 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.299315  8315 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.298942  8429 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.299875  8316 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:08.303838  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:08.304548  1707 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:02:08.226625  8385 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:08.228890  8356 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:08.306277  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:08.309665  1629 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:08.259725  8374 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.319890  1524 leader_election.cc:400] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20.
I20260709 13:02:08.234193  8402 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:08.234838  8394 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:08.324628  1632 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:08.361734  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:08.250753  8414 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:08.318229  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:08.364602  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.250799  8377 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:08.352247  1524 leader_election.cc:403] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:08.352674  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:08.355501  1551 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:02:08.325853  1700 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:08.367691  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.254081  8304 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.107s
I20260709 13:02:08.326254  8434 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.374922  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.367697  8326 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.381135  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.346649  8356 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:08.250975  8323 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.107s
I20260709 13:02:08.379908  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:08.378547  1558 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:02:08.363226  8420 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:08.392288  1558 pending_rounds.cc:85] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 15
W20260709 13:02:08.393205  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 73556.7us
I20260709 13:02:08.392793  1558 pending_rounds.cc:107] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:02:08.395202  1558 raft_consensus.cc:2889] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.367161  8404 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.399380  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.400221  1553 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:08.407370  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:08.402657  1524 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.671s (SENT) [suppressed 15 similar messages]
I20260709 13:02:08.357350  8385 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.410665  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.392315  8356 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:08.391022  8377 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:08.434262  2266 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:08.367981  8414 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.429546  8192 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:08.436231  8192 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.400741  8423 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20.
I20260709 13:02:08.439080  7940 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.439132  8429 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:08.440192  8414 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:08.351090  8329 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.441504  7940 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:08.442782  8329 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.443217  8088 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:08.443346  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 1249) took 1077 ms. Trace:
I20260709 13:02:08.443768  1702 rpcz_store.cc:276] 0709 13:02:07.365545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.365656 (+   111us) service_pool.cc:224] Handling call
0709 13:02:08.443191 (+1077535us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54000b7054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:08.443290 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1485240576}
I20260709 13:02:08.369035  8394 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.445240  1702 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:02:08.381464  8434 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.365940  8402 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.447943  1630 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:08.403258  8371 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:08.449879  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.452591  1700 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: [15.13-16.14]
I20260709 13:02:08.391289  8326 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.463238  8401 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:08.463796  8401 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:08.464201  8405 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:08.464717  8401 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:08.468171  8448 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:08.470708  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2854) took 1104 ms. Trace:
I20260709 13:02:08.471122  1552 rpcz_store.cc:276] 0709 13:02:07.365809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.371481 (+  5672us) service_pool.cc:224] Handling call
0709 13:02:08.470514 (+1099033us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54001ff4d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:08.470620 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780052736}
I20260709 13:02:08.472488  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1366) took 1241 ms. Trace:
I20260709 13:02:08.472865  2263 rpcz_store.cc:276] 0709 13:02:07.230620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.280163 (+ 49543us) service_pool.cc:224] Handling call
0709 13:02:08.472309 (+1192146us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400710f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:08.472434 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286707072}
I20260709 13:02:08.464780  1709 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:08.451012  8371 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:08.464761  8405 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:08.493427  8401 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.492503  8361 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:08.562211  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:08.562850  1560 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:02:08.568261  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:08.558096  8192 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.595726  8385 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:08.598446  2264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 1462) took 1885 ms (client timeout 1671 ms). Trace:
W20260709 13:02:08.599042  2264 rpcz_store.cc:269] 0709 13:02:06.712789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.712963 (+   174us) service_pool.cc:224] Handling call
0709 13:02:08.598190 (+1885227us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400269154. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:08.598353 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135628672}
I20260709 13:02:08.607156  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:08.607849  1702 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:08.611882  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:08.612526  2265 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:08.615099  1702 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:08.616545  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:08.617082  8418 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:08.617343  1632 raft_consensus.cc:2368] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18.
I20260709 13:02:08.617617  8418 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:08.622313  8446 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:02:08.623771  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:08.624485  1626 raft_consensus.cc:2368] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:08.619750  8418 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:08.624503  1631 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:02:08.628285  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.628301  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.629215  1633 raft_consensus.cc:2368] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22.
I20260709 13:02:08.631548  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.633065  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.634514  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:08.635196  1629 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:08.638232  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:08.638818  1701 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.640614  2265 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:08.646914  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:08.648185  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:08.655005  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.656876  1702 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:08.640048  8441 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:02:08.660935  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:08.662277  2264 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:02:08.566612  8361 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.668819  8361 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:08.669606  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.670212  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.671401  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.671655  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.672798  1559 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:02:08.673920  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.663426  1703 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:08.201562   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:08.678573  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.670297  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:08.679631  1551 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.682574  1701 raft_consensus.cc:2468] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:08.678645  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:08.687779  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:08.689719  1704 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:08.690542  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:08.692822  1554 raft_consensus.cc:2368] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:08.691156  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:08.639890  8289 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:08.697113  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.699440  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:08.699929  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:08.707471  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:08.572305  8377 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.710321  1707 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:08.709614  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:08.725266  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:08.727099  1700 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:08.706503  7950 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:08.734450  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:08.734925  7950 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.737390  7950 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.740234  8308 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:08.741943  8457 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:02:08.742664  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1264) took 1815 ms. Trace:
I20260709 13:02:08.743044  1556 rpcz_store.cc:276] 0709 13:02:06.926932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.927573 (+   641us) service_pool.cc:224] Handling call
0709 13:02:06.928020 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.920296 (+992276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.742444 (+822148us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54002cb854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:08.742607 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2255636736}
I20260709 13:02:08.746373  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:08.746757  8433 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:08.747167  8433 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.747637  8433 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:08.748541  8305 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:08.748967  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.591827  8416 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.750072  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.751178  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.751724  8416 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.726833  8394 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.752614  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:08.755445  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:08.755899  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46362.6us
I20260709 13:02:08.752688  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.640036  8405 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.757121  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:08.757362  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.757639  1630 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:02:08.752975  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.753252  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.590899  8371 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.752131  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.749964  8315 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:08.761260  8329 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:08.761646  8329 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:08.762338  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.762454  8329 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.763770  8329 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:08.726137  8289 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.764794  8326 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:08.763001  1634 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:08.747138  1635 raft_consensus.cc:2368] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:08.766623  2234 leader_election.cc:400] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18.
I20260709 13:02:08.768070  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:08.771884  1560 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:08.766707  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.776762  2234 leader_election.cc:400] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:08.778265  2234 leader_election.cc:400] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22.
I20260709 13:02:08.778633  2234 leader_election.cc:403] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:08.780229  1551 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:08.781586  1552 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:08.754801  1601 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:08.786906  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:08.787302  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:08.788863  1634 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:08.794001  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:08.796377  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:08.756472  8412 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:08.802165  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:08.797467  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:08.799285  8385 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:08.709491  8323 raft_consensus.cc:2764] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:02:08.799769  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:08.805263  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:08.801025  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:08.806988  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:08.810762  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:08.750082  8434 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:08.790642  8394 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.818212  2262 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:08.797876  8308 raft_consensus.cc:2804] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:08.818132  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:08.836602  1703 raft_consensus.cc:2368] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:08.755174  8369 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:02:08.847584  1700 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:08.849107  1630 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:08.817981  8215 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:08.797284  8070 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:02:08.824532  1702 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:08.869268  1601 leader_election.cc:400] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:08.869594  1601 leader_election.cc:403] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:08.862600  1526 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:08.873929  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:08.803354  8049 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:02:08.883500  1599 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:08.855531  8215 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.884913  8215 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:08.885365  8429 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:08.885749  8429 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.886122  8429 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:08.845147  8385 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:08.881698  1526 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:08.855311  8323 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:08.893904  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:08.855707  8308 raft_consensus.cc:697] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:08.857507  8289 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:08.858119  7950 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:08.884161  8440 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:08.890182  8049 consensus_queue.cc:1243] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:08.840423  8394 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:08.890729  8301 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:08.903638  8192 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:08.901172  8108 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:08.901297  8323 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:08.944060  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 541427us
W20260709 13:02:08.962405  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 68638us
I20260709 13:02:08.963095  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:08.964622  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:08.962338  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 266792us
I20260709 13:02:08.968848  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:08.963524  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:08.982430  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:08.953171  8323 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:08.986860  2264 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:08.938061  7950 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:08.995904  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:08.967361  8108 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:08.986119  8374 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.011s
I20260709 13:02:08.961369  8192 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:08.974383  8440 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:08.967448  8334 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:09.078366  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 82574.5us
W20260709 13:02:09.085404  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 289112us
I20260709 13:02:09.086144  1674 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:09.086565  1673 leader_election.cc:400] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:09.086935  1673 leader_election.cc:403] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:02:08.977059  8387 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:08.992954  8356 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.544s	user 0.004s	sys 0.013s
I20260709 13:02:08.974673  8376 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:02:09.118269  8460 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:02:08.986310  8434 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.101s
I20260709 13:02:09.077948  8427 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:09.079188  8003 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:09.080127  8377 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:09.079608  8322 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:09.081351  8374 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18.
W20260709 13:02:09.150153  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 349367us
W20260709 13:02:09.150638  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 345461us
W20260709 13:02:09.147658  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 391146us
W20260709 13:02:09.153821  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 313177us
I20260709 13:02:08.993197  8414 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22.
I20260709 13:02:09.143153  7950 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:09.211609  8107 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:09.134940  8458 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:02:09.215559  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 129118us
I20260709 13:02:09.225169  1600 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:09.222579  1673 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:09.142122  8371 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:09.131464  8394 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:09.109082  8282 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
W20260709 13:02:09.232391  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.143005  8402 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:09.219338  8404 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.810s	user 0.013s	sys 0.007s
I20260709 13:02:09.238201  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:09.221868  8107 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:09.241366  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 253962us
I20260709 13:02:09.199828  8316 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:09.247763  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44851us
W20260709 13:02:09.251225  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 165176us
I20260709 13:02:09.252197  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:09.253945  8416 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:09.256603  8416 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:09.257817  8416 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:09.259147  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:09.259792  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:09.260201  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:09.262427  8282 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:09.263002  8282 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:09.269243  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:09.275089  1706 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:02:09.275709  1706 pending_rounds.cc:85] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 13
I20260709 13:02:09.276095  1706 pending_rounds.cc:107] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:02:09.276391  1706 raft_consensus.cc:2889] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:09.277297  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 72859.5us
I20260709 13:02:09.002143  8308 consensus_queue.cc:237] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:09.130300  8356 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.279557  1674 leader_election.cc:400] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:09.280184  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:09.281348  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:09.279402  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:09.285102  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 314693us
I20260709 13:02:09.285808  1524 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:09.240530  8469 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:09.213724  8429 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.291005  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:09.242931  8107 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:09.293241  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:09.295480  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:09.233409  8372 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260709 13:02:09.243072  8440 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:09.298347  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:09.265352  8377 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:09.273826  8305 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:09.323508  1524 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:09.324822  1551 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:09.277649  8369 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:09.304867  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:09.306942  8474 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:09.308911  8429 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:09.309114  1633 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:09.309772  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:09.343569  8429 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:09.310552  8440 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.312522  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:09.143338  8108 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:09.314772  1707 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:09.316385  1705 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:09.317564  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:09.305239  8401 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.741s	user 0.015s	sys 0.003s
I20260709 13:02:09.319337  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:09.322428  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:09.284070  8316 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.273237  8335 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:02:09.288746  8404 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:09.289019  8003 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:09.341549  8469 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:09.263207  8416 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:09.297756  8470 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:09.342916  8474 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:09.363595  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:09.364694  1701 raft_consensus.cc:2368] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18.
I20260709 13:02:09.332935  1556 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:02:09.239252  8192 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.305644  8394 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:09.369110  1708 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:09.284209  8070 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
W20260709 13:02:09.371656  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52741.7us
I20260709 13:02:09.289614  8312 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:02:09.336421  8252 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:02:09.401952  1707 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:09.335107  8361 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:09.406126  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:09.375228  8401 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:09.459086  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 183369us
I20260709 13:02:09.486886  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:09.492337  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 195086us
I20260709 13:02:09.369681  8316 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.369483  8215 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.498611  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:09.497745  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:09.462278  8404 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:09.459560  8315 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:09.460021  8394 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:02:09.520395  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 201153us
I20260709 13:02:09.392829  8282 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:09.461947  8470 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:02:09.506516  8375 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:09.458228  8361 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:09.509739  8310 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:09.488833  8418 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:02:09.514894  8315 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:02:09.544862  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 221435us
I20260709 13:02:09.551012  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:09.492480  8377 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:09.560417  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 196302us
I20260709 13:02:09.548458  8282 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:09.552968  8368 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:09.546839  8310 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:09.679900  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:09.682323  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:09.557307  8440 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:09.786279  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:09.559412  8356 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:09.791249  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:09.795818  1630 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:09.802800  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:09.804098  1631 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:09.671144  8416 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.827867  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:09.644739  8363 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.163s
I20260709 13:02:09.843246  1707 pending_rounds.cc:85] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 10
I20260709 13:02:09.843598  1707 pending_rounds.cc:107] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:02:09.843845  1707 raft_consensus.cc:2889] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:09.812258  8470 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.833755  8368 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:09.669413  8394 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:09.838363  8335 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:09.839754  8482 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:09.864639  8316 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:09.878017  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.786813  8315 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:09.850133  8485 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:09.879601  8491 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:02:09.868911  8440 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:09.840128  8416 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:09.894143  8371 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.657s	user 0.004s	sys 0.007s
I20260709 13:02:09.862804  8470 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:09.892622  8476 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.395s	user 0.001s	sys 0.001s
I20260709 13:02:09.887121  8215 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:09.894508  7950 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:09.922638  8461 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.634s	user 0.004s	sys 0.008s
I20260709 13:02:09.927660  8361 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:09.912820  8440 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.931181  8416 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:09.931816  8416 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:09.933503  8416 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.934090  8376 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:09.934886  8376 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.882315  8368 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.937747  8368 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:09.939320  8433 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.191s	user 0.014s	sys 0.013s
I20260709 13:02:09.939893  8470 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:09.925818  8480 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:09.947834  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3089) took 2092 ms. Trace:
I20260709 13:02:09.948400  1706 rpcz_store.cc:276] 0709 13:02:07.855135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.296574 (+441439us) service_pool.cc:224] Handling call
0709 13:02:08.296865 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.284431 (+987566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.947544 (+663113us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b54000a82d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:09.947745 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2248881536}
I20260709 13:02:09.949846  8469 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:09.950664  8469 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.956846  1557 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:02:09.958947  8387 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.959605  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:09.961149  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:09.962015  1554 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:09.963397  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:09.959556  8387 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.967288  8387 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:09.976516  8404 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:09.976680  8401 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:09.977335  8404 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:09.977546  8401 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.979847  8401 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:09.901391  8485 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:09.890295  8335 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.015547  8335 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:09.890293  8482 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.014891  8404 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:10.016980  8404 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:10.017529  8482 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:09.927764  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 3097) took 1250 ms. Trace:
I20260709 13:02:10.018049  8402 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:10.018934  8402 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:10.021202  8107 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.002s
I20260709 13:02:10.010672  1702 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 16. Preceding OpId from leader: term: 17 index: 16. (term mismatch)
I20260709 13:02:10.039299  1702 pending_rounds.cc:85] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 15
I20260709 13:02:10.039708  1702 pending_rounds.cc:107] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 16.16
I20260709 13:02:10.040087  1702 raft_consensus.cc:2889] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:09.891146  8316 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:10.041700  8316 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.043051  8364 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:10.043668  8364 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:10.044044  8316 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:09.884361  8310 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.044737  8364 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:10.047482  1556 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:10.012589  8485 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.018167  1708 rpcz_store.cc:276] 0709 13:02:08.677836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.678429 (+   593us) service_pool.cc:224] Handling call
0709 13:02:09.927595 (+1249166us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54001bdad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:09.927706 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576156416}
I20260709 13:02:09.939939  8433 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:10.010248  8470 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.024148  8440 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:10.024806  8369 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.689s	user 0.008s	sys 0.003s
W20260709 13:02:10.030284  8323 consensus_meta.cc:287] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.949s	user 0.010s	sys 0.002s
I20260709 13:02:10.030520  8138 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:09.937570  8376 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.031759  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1464) took 1821 ms. Trace:
I20260709 13:02:10.035317  8387 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:10.035882  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:10.038372  8107 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:10.074244  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.077833  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:10.080291  2267 rpcz_store.cc:276] 0709 13:02:08.210508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.210658 (+   150us) service_pool.cc:224] Handling call
0709 13:02:08.245425 (+ 34767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.269307 (+ 23882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.269356 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.619670 (+350314us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b2c00096928. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dc8c8a11 00007f06dc8d8372 00007f06de00aa01 00007f06ddfcf43a 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2
0709 13:02:08.620103 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.978154 (+358051us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:08.978208 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.978300 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.922000 (+943700us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:10.031539 (+109539us) raft_consensus.cc:1685] finished
0709 13:02:10.031561 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.031706 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13630,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":91859584,"thread_start_us":356236,"threads_started":1,"wal-append.queue_time_us":602067}
I20260709 13:02:10.082996  1706 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:10.036537  8469 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.084096  1700 raft_consensus.cc:2410] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:10.089982  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:10.105432  1702 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:10.072937  8401 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.935622  8416 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:10.107708  1559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.002s	sys 0.006s
I20260709 13:02:10.078882  8364 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:10.077684  8369 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:10.077704  8329 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.092494  8282 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:10.118943  1559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.003s	sys 0.007s
W20260709 13:02:10.113302  8070 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.001s	sys 0.008s
I20260709 13:02:10.132683  1526 leader_election.cc:400] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18.
I20260709 13:02:10.133303  1526 leader_election.cc:403] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:10.134979  2269 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:10.112372  8316 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:10.113265  8482 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.157557  2264 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260709 13:02:10.133128  1560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.005s	sys 0.005s
I20260709 13:02:10.080951  8323 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:10.136265  2236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.000s	sys 0.012s
W20260709 13:02:10.161976  2236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.001s	sys 0.013s
I20260709 13:02:10.140925  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:10.162554  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 641439us
I20260709 13:02:10.141266  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.082602  8138 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:10.163302  2268 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:10.080367  8470 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:10.159935  1560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.005s	sys 0.006s
W20260709 13:02:10.123791  8318 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.003s	sys 0.008s
W20260709 13:02:10.144008  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 316291us
W20260709 13:02:10.131731  8070 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.001s	sys 0.008s
I20260709 13:02:10.171607  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:10.194768  8318 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.004s	sys 0.009s
I20260709 13:02:10.200984  8406 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:10.205041  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:10.163533  2236 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:10.208730  8406 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:02:10.211251  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 71642.6us
W20260709 13:02:10.211845  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 48388.6us
I20260709 13:02:10.219379  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:10.221117  8416 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:10.223546  2269 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:10.104077  8387 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.140287  8335 raft_consensus.cc:3060] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:02:10.123116  8401 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.233570  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:10.236045  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:10.242676  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:10.136585  8282 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.131429  8440 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:02:10.160841  8496 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:10.248515  1633 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 1445) took 1598 ms (client timeout 1622 ms). Trace:
I20260709 13:02:10.253046  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:10.245306  1629 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:10.167899  8405 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:10.263368  8138 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:10.265093  8402 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.272078  8372 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:10.272991  1601 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:10.283396  8389 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:10.169330  8482 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.297029  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:10.177448  8207 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:10.177708  8312 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:10.224071  8478 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.350232  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:10.350987  1557 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:10.293644  1633 rpcz_store.cc:269] 0709 13:02:08.631245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.631344 (+    99us) service_pool.cc:224] Handling call
0709 13:02:10.229516 (+1598172us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b540034b554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:10.229825 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548845440}
I20260709 13:02:10.136241  8329 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.286054  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:10.318922  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.247566  8499 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:02:10.334457  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.334770  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 61877.9us
I20260709 13:02:10.335632  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:10.243386  8334 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:10.161016  8316 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.339679  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:10.344787  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2763) took 1040 ms. Trace:
I20260709 13:02:10.256492  8416 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:10.345323  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.385293  1700 rpcz_store.cc:276] 0709 13:02:09.304414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.304565 (+   151us) service_pool.cc:224] Handling call
0709 13:02:10.344603 (+1040038us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54001fe354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:10.344732 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1732189056}
I20260709 13:02:10.226912  8474 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.087s
W20260709 13:02:10.303872  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50930.2us
I20260709 13:02:10.314862  8469 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:10.370278  8495 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:10.408277  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 122328us
I20260709 13:02:10.335178  8308 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:10.314247  8473 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:02:10.307217  8496 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.435770  1633 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:10.405606  8466 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:10.402225  8412 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:10.314698  8405 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.427652  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:10.138146  8363 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.275s
I20260709 13:02:10.446166  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.408401  8469 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.457000  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:10.399966  8371 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:10.468066  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:10.407958  8499 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:10.475455  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.375156  8312 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.477066  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.477278  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.477152  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.421319  8318 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.415077  8433 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:10.432641  7940 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:10.622092  7940 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:10.622634  8371 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.557787  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.623080  7940 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.624208  7940 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:10.624465  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.625624  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:10.369645  8207 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.628299  8207 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.430737  8414 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:10.629071  8414 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.631067  8414 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:10.560596  2268 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:02:10.633647  2268 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:10.560612  2265 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:10.635255  1630 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:10.639241  2268 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:10.490820  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.493145  8469 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:10.655040  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2798) took 1144 ms. Trace:
I20260709 13:02:10.655519  1559 rpcz_store.cc:276] 0709 13:02:09.510769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.510892 (+   123us) service_pool.cc:224] Handling call
0709 13:02:09.511253 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.511703 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.511743 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.512230 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.128492 (+616262us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:10.128549 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.128638 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.654831 (+526193us) raft_consensus.cc:1685] finished
0709 13:02:10.654852 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.654984 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":907,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5864,"thread_start_us":615935,"threads_started":1,"wal-append.queue_time_us":1140610}
I20260709 13:02:10.662464  8511 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.663221  7950 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.663411  8511 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.663861  7950 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:10.669139  8364 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
I20260709 13:02:10.442646  8484 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.144s
W20260709 13:02:10.483731  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 56166.6us
I20260709 13:02:10.485809  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.571158  2270 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:10.572518  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:10.400172  8334 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.434808  8418 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.670241  8315 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:10.693846  8418 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.694763  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.695154  8334 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:10.696066  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 123633us
I20260709 13:02:10.697059  2264 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:10.679848  7950 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.698469  8389 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:10.680176  8429 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:10.699359  8429 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:10.699652  8418 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:10.586386  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 118372us
I20260709 13:02:10.486349  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.700248  8429 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.591491  8433 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.701262  8429 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:10.701555  8433 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.592221  8524 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:10.597494  8402 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.599009  8316 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:10.458995  8412 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:10.599996  8470 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.447384  8215 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:10.602437  8434 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:10.604082  8312 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.486979  8107 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:10.606947  8318 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.586927  8372 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:10.608846  8387 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.606993  8376 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:10.610412  8282 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.611049  8323 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.612059  8482 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:10.423014  8495 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.375373  8478 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.784926  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.612727  1557 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:10.613256  8499 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.614872  8401 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.563045  8406 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:10.617201  8329 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.487494  8374 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:10.479699  8466 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.619150  8405 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:10.424183  8510 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:10.621497  8496 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.803474  8406 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.804118  8406 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.469573  8416 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.151s
I20260709 13:02:10.742389  8524 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.685770  1524 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:10.670411  1556 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:10.680714  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1287) took 1401 ms. Trace:
I20260709 13:02:10.688611  2266 raft_consensus.cc:2410] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:02:10.706205  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:10.706792  2270 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:02:10.711894  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:10.726670  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:10.736370  1453 catalog_manager.cc:5697] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 14 to 15, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:10.812237  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.742328  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:10.752278  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 393261us
I20260709 13:02:10.753044  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:10.707410  8404 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.002s
I20260709 13:02:10.757491  2264 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:02:10.737989  8488 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.822409  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:10.703372  8511 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:10.669866  8469 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.752377  8412 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:10.770701  1553 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:10.655104  8371 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:10.852725  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:10.779135  1456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35568 (request call id 322) took 63101 ms (client timeout 15000 ms). Trace:
W20260709 13:02:10.766692  8377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.011s	sys 0.018s
I20260709 13:02:10.786929  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:10.742776  8402 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:10.791599  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.765470  8376 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:10.888406  8376 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.889544  8376 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:10.759153  8215 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:10.780040  8310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.008s	sys 0.015s
I20260709 13:02:10.794822  7950 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:10.822270  8484 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:10.429023  8308 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:10.780121  8394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.000s	sys 0.030s
W20260709 13:02:10.810715  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 125036us
I20260709 13:02:10.810423  1560 rpcz_store.cc:276] 0709 13:02:09.279374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.288654 (+  9280us) service_pool.cc:224] Handling call
0709 13:02:09.304338 (+ 15684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.512210 (+207872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.512237 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.512593 (+   356us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.176084 (+663491us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:10.176139 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.176229 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.680477 (+504248us) raft_consensus.cc:1685] finished
0709 13:02:10.680516 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.680655 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22075,"raft.queue_time_us":39698,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"thread_start_us":816676,"threads_started":2,"wal-append.queue_time_us":1143801}
W20260709 13:02:10.815615  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 89084.3us
W20260709 13:02:10.839535  1632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.007s	sys 0.010s
W20260709 13:02:10.839857  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 462262us
I20260709 13:02:10.846504  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:10.846997  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:10.765964  8372 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:10.850370  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:10.839365  8108 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.003s	sys 0.026s
I20260709 13:02:10.854235  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:10.856479  1453 catalog_manager.cc:5697] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 13 to 16, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:10.879307  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:10.846624  8400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.002s	sys 0.020s
I20260709 13:02:10.964989  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.887456  8402 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:10.872447  8377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.012s	sys 0.018s
I20260709 13:02:10.966796  1635 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:10.974377  1702 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:02:10.975821  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:10.976697  1702 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:10.898443  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:10.897190  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:10.823782  8416 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:10.859858  8433 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:10.900766  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:10.968611  8108 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.003s	sys 0.031s
I20260709 13:02:11.001855  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.002938  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:10.965549  8400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.002s	sys 0.020s
W20260709 13:02:10.960453  1632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.007s	sys 0.013s
I20260709 13:02:10.898847  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:10.960772  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:11.073825  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:10.936829  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.962393  1626 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:10.965070  2270 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:02:10.967269  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.856014  1456 rpcz_store.cc:269] 0709 13:01:07.722263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.761248 (+ 38985us) service_pool.cc:224] Handling call
0709 13:02:10.763775 (+63002527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:05.753465 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:05.774362 (+ 20897us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:05.774423 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:02:05.774446 (+    23us) tablet.cc:662] Decoding operations
0709 13:02:05.775475 (+  1029us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:05.775595 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:05.775638 (+    43us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:02:05.776358 (+   720us) tablet.cc:701] Row locks acquired
0709 13:02:05.776415 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:02:05.776611 (+   196us) write_op.cc:270] Start()
0709 13:02:05.776790 (+   179us) write_op.cc:276] Timestamp: P: 1783602125776535 usec, L: 0
0709 13:02:05.776828 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:02:05.822385 (+ 45557us) log.cc:844] Serialized 3091 byte log entry
0709 13:02:06.339815 (+517430us) op_driver.cc:464] REPLICATION: finished
0709 13:02:06.669349 (+329534us) write_op.cc:301] APPLY: starting
0709 13:02:06.708939 (+ 39590us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:07.020809 (+311870us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:07.020944 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:07.238616 (+217672us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:07.303945 (+ 65329us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:02:07.314083 (+ 10138us) write_op.cc:312] APPLY: finished
0709 13:02:07.463837 (+149754us) log.cc:844] Serialized 65 byte log entry
0709 13:02:07.655025 (+191188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:07.655154 (+   129us) write_op.cc:454] Released schema lock
0709 13:02:07.655233 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:07.656669 (+  1436us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:07.656716 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2931440,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":287480,"apply.run_cpu_time_us":17770,"apply.run_wall_time_us":1008687,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29195,"num_ops":6,"prepare.queue_time_us":156395,"prepare.run_cpu_time_us":32030,"prepare.run_wall_time_us":318055,"raft.queue_time_us":280352,"raft.run_cpu_time_us":77006,"raft.run_wall_time_us":265693,"replication_time_us":562802,"spinlock_wait_cycles":1408,"thread_start_us":696296,"threads_started":5,"wal-append.queue_time_us":499018,"wal-append.run_cpu_time_us":43324,"wal-append.run_wall_time_us":2273394}]]}
I20260709 13:02:11.076665  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:10.893939  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:10.981818  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:10.942078  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.983870  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:10.984247  1634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.007s	sys 0.008s
I20260709 13:02:10.985702  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:10.798208  8374 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:10.983218  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.987380  1702 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:10.977993  8401 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.093003  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.093727  1626 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 12.
I20260709 13:02:10.987934  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.094874  1635 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:10.938405  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:10.964664  8394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.000s	sys 0.031s
I20260709 13:02:10.990183  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:10.959178  1633 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:10.991446  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:10.964488  8310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.008s	sys 0.015s
I20260709 13:02:11.107966  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:10.996018  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.109093  1630 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:10.997150  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:10.983942  8485 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.000s	sys 0.016s
W20260709 13:02:10.984647  8070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.014s	sys 0.001s
I20260709 13:02:10.982563  7950 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.071772  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:11.119997  1707 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:11.011162  1703 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:02:11.073284  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.077512  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:11.079802  1634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.007s	sys 0.008s
I20260709 13:02:11.084039  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.122195  2270 raft_consensus.cc:2410] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 19 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:02:11.122414  2267 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:10.986828  8334 consensus_queue.cc:1059] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.121s
I20260709 13:02:11.127921  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:10.988431  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:11.129052  1708 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:11.089882  1706 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 19: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:10.983368  8049 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:11.132756  1453 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 14 to 16, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.979022  8470 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.101612  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.180787  1702 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:02:10.990993  8402 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.110777  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.182554  1701 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:11.111158  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:10.852752  8488 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.112990  1635 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:11.007392  8498 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:11.113794  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 153492us
W20260709 13:02:11.114393  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 132687us
I20260709 13:02:11.116163  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.116456  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:11.091890  8377 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:11.198043  8377 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.198570  8315 consensus_meta.cc:287] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.505s	user 0.014s	sys 0.000s
I20260709 13:02:11.198525  8377 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.200702  8377 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.201181  8488 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.202598  8498 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.107329  8401 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.204862  8498 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.205462  8401 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.190840  8470 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.207625  8470 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:11.208088  8402 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.210343  8402 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.178853  8517 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:11.214530  8517 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:11.216904  8522 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:02:11.217471  8533 log.cc:927] Time spent T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:02:11.084583  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 123929us
I20260709 13:02:11.074009  8416 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:11.219062  8416 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.220137  8372 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:11.125299  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 187013us
I20260709 13:02:11.127645  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.221786  1704 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:02:11.222977  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2827) took 1421 ms. Trace:
I20260709 13:02:11.099423  8323 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:11.224112  8323 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:11.232577  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:11.117477  8485 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.000s	sys 0.017s
I20260709 13:02:11.133833  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.091300  2263 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 21: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:11.135165  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:11.137151  8529 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:02:11.138408  8406 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:11.117008  8070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.014s	sys 0.001s
W20260709 13:02:11.142771  8527 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:02:11.132853  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.132494  8433 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:11.272598  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.097308  8503 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:10.985863  8510 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.142s
I20260709 13:02:11.283303  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.129684  8192 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:11.127596  8509 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:11.098577  8252 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:02:11.183422  1709 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
W20260709 13:02:11.325889  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 134184us
I20260709 13:02:11.326145  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.188691  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.195552  1628 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:11.193694  1705 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:11.196539  8334 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:11.197172  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.221297  8416 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:11.117360  8335 consensus_meta.cc:287] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.886s	user 0.009s	sys 0.001s
W20260709 13:02:11.227730  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 127431us
I20260709 13:02:11.232998  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:11.213821  8429 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 13:02:11.228514  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:11.251513  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:11.252645  1706 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 22 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:02:11.223381  1634 rpcz_store.cc:276] 0709 13:02:09.801431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.850764 (+ 49333us) service_pool.cc:224] Handling call
0709 13:02:09.851076 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.094312 (+243236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.094357 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.119474 (+ 25117us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.122101 (+1002627us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:11.122157 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.122256 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.222766 (+100510us) raft_consensus.cc:1685] finished
0709 13:02:11.222789 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.222919 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17623,"raft.queue_time_us":43801,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3214,"thread_start_us":1231287,"threads_started":2,"wal-append.queue_time_us":985683}
W20260709 13:02:11.258083  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 61973.7us
I20260709 13:02:11.223165  8530 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.260532  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.262902  1704 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260709 13:02:11.267305  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.259455  1453 catalog_manager.cc:5697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 12 to 15, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.438521  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:11.279316  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.439374  1702 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:11.281733  1707 raft_consensus.cc:2410] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:02:11.248548  8323 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:11.290609  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 68609.9us
I20260709 13:02:11.439002  1556 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:11.445930  1701 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:11.231325  8049 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:11.457841  1453 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 14 to 18, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.290791  8510 consensus_queue.cc:1243] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:11.310638  1557 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:11.312314  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.314369  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.318455  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.320425  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:11.329092  1708 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:11.326821  1709 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
W20260709 13:02:11.468927  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 148622us
I20260709 13:02:11.274164  8485 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:11.476861  8485 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:11.269373  8318 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.343643  1631 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:02:11.421535  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 93699us
I20260709 13:02:11.424759  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.477977  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.478255  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.292064  8192 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:11.478868  1705 raft_consensus.cc:2410] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:02:11.479112  8192 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:11.479276  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.479893  2266 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:11.427842  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.436856  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.301405  8503 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.481326  1706 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:11.482401  1706 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:11.482674  8478 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.482800  8503 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.483596  8215 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.484314  8374 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:11.484983  8308 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:11.487170  8412 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.000s
I20260709 13:02:11.487592  8412 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.490098  8320 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.490772  8320 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.493074  8320 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.301756  1632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:02:11.494594  1632 raft_consensus.cc:606] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:11.494928  1632 raft_consensus.cc:614] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:11.498157  8404 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:11.498775  8404 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.414242  8414 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.501565  8414 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.502231  8394 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.502914  8394 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:11.426867  8529 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:02:11.337366  8509 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.489699  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:11.498346  8402 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:11.506361  8402 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.506783  8402 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:11.506927  8509 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.510176  8377 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:02:11.511037  8363 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:11.438777  8335 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18.
I20260709 13:02:11.513214  1555 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:02:11.413532  8466 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.513550  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:11.514750  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:11.515523  7940 consensus_meta.cc:287] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.891s	user 0.008s	sys 0.000s
I20260709 13:02:11.515672  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.516702  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.518242  2264 raft_consensus.cc:2410] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
W20260709 13:02:11.518654  8521 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:02:11.464725  8434 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:02:11.519666  8434 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:11.520047  8434 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:11.520180  8538 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:02:11.445696  8108 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:11.521343  8495 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.521003  8434 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:11.494196  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 265793us
I20260709 13:02:11.522301  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.523677  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.524358  1706 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:11.525266  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.526551  8536 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.526824  8376 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.637s	user 0.001s	sys 0.008s
I20260709 13:02:11.527201  8536 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.528365  8469 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.529372  8517 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.457337  8470 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:11.530221  8470 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.532279  8470 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:02:11.532734  8356 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:11.533502  8524 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:11.528021  8540 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:02:11.476233  8049 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:11.356736  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.556681  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.490165  8416 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:11.535214  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.460283  8530 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.476073  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.525919  1706 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:11.560452  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.481580  8406 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:11.591166  2267 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:02:11.591552  2267 pending_rounds.cc:85] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 13
I20260709 13:02:11.591849  2267 pending_rounds.cc:107] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:02:11.592085  2267 raft_consensus.cc:2889] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.593024  1704 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:11.564671  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.565472  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.558439  1453 catalog_manager.cc:5697] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 14 to 15, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:11.567044  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:11.567947  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.568867  1629 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:11.595763  1554 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:11.596923  1706 raft_consensus.cc:1275] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:02:11.597046  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.568802  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.570112  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.583350  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.599051  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.584703  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:11.594726  1630 raft_consensus.cc:2410] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:02:11.601006  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.601528  1628 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:11.597952  1554 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:11.603355  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.603607  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.603797  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.604485  1626 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:11.605273  1551 raft_consensus.cc:2393] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 22: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:11.608505  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.550097  8412 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.612756  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.604180  1554 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:02:11.554549  8536 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.620524  1453 catalog_manager.cc:5697] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:11.622365  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:11.622756  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 52792.2us
I20260709 13:02:11.560316  8466 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.616957  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:11.619954  1708 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:02:11.623999  1599 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.625538  1627 raft_consensus.cc:2410] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:02:11.614014  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:11.333014  8334 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:11.329350  8512 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.572742  8482 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:11.643082  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:11.668002  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.649624  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.490192  8503 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 13:02:11.619626  8469 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:11.614570  8524 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:11.600019  8517 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:11.585175  8434 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:11.656584  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.653795  1703 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:11.613586  8519 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:11.645395  1526 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:11.650413  8412 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:11.653020  1453 catalog_manager.cc:5697] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 11 to 16, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.672271  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.672888  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.628371  8305 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:11.623574  8376 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:11.612288  8531 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:11.677399  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 112000us
W20260709 13:02:11.678135  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.627976  8329 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:11.590270  8107 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 13:02:11.684250  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.609630  7940 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:02:11.672087  1634 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:11.682416  8517 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.664546  8535 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:11.666368  7950 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.725976  8107 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:11.726500  8107 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:11.727421  8107 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.728739  8107 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:11.731458  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2807) took 1390 ms. Trace:
I20260709 13:02:11.731887  1555 rpcz_store.cc:276] 0709 13:02:10.341331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.342701 (+  1370us) service_pool.cc:224] Handling call
0709 13:02:10.342975 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.513546 (+1170571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.731208 (+217662us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400373054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:11.731400 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2690826496}
I20260709 13:02:11.685463  8402 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.734833  8402 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.703905  8376 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:11.735277  8517 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.735771  8376 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:11.737012  2234 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:11.669723  8534 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:11.652456  8429 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:11.721315  8512 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.613337  8470 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:02:11.658285  8418 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.649482  8466 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.739111  8470 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:11.739014  8418 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.739301  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.739567  8470 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:11.740846  8466 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:11.741187  8418 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.590827  8416 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.741743  8414 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.692580  8524 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.743466  8416 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.678822  8511 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:11.687811  8530 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.744153  8323 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.745394  2263 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:02:11.745508  8495 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:11.697502  1453 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 2 to 8, term changed from 13 to 20, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to <none>, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193), VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194), VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195), VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 20 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:11.747107  8495 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:11.748878  1453 catalog_manager.cc:5697] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 13 to 15, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.707270  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.750838  2236 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.751312  8544 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:11.751796  8544 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:11.752169  8544 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.752236  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:11.711166  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.693428  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.753225  8511 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:11.753482  1635 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:11.684991  1629 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 22 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:02:11.740479  8470 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.713649  8329 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.754433  8470 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:11.749177  8334 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.755321  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:11.756114  8334 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:11.741274  8535 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.758260  8318 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:11.758469  8535 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:11.758800  8252 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:11.754436  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.759514  8329 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.759800  8318 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:11.760236  8318 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:11.760393  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.760277  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.761584  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.762514  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.762565  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.669397  8361 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:11.743922  8524 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:11.764763  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 119458us
W20260709 13:02:11.766603  8541 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:11.767355  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.769418  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.770078  8406 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:11.770490  8406 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:11.770521  1559 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:11.770665  1554 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:02:11.770965  8406 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:11.774235  8377 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:11.775116  8377 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:11.775422  8377 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:11.776000  8485 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.776248  8377 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.776989  8485 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:11.777467  8377 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:11.777552  8192 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.779832  8192 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.780951  1453 catalog_manager.cc:5697] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:11.781447  8482 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:11.781983  8482 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:11.782877  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:11.769980  1553 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:11.763722  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.785430  1631 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:11.785579  1700 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:11.787889  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.788973  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.791072  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:11.791887  2268 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:11.792415  8506 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:11.784399  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:11.793292  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.793926  2264 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:11.782642  1453 catalog_manager.cc:5697] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 12 to 14, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.794442  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.795032  1629 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:11.795868  1631 pending_rounds.cc:85] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 12
I20260709 13:02:11.796042  1629 pending_rounds.cc:85] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 10
I20260709 13:02:11.798717  2234 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:11.800426  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:11.803625  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:11.799443  8418 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:11.804838  8534 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:11.805065  8215 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:11.805368  8534 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.807579  8534 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:11.807876  8535 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.793315  8323 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.808401  8535 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.799762  8070 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:02:11.810828  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.811843  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:11.812043  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.798769  1629 pending_rounds.cc:107] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 15.11
W20260709 13:02:11.815780  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 212086us
I20260709 13:02:11.815887  1629 raft_consensus.cc:2889] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.815376  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:11.816869  1631 pending_rounds.cc:107] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:02:11.817178  1631 raft_consensus.cc:2889] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.814309  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.824751  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.825564  2267 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:11.827149  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:11.873394  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 58089.4us
I20260709 13:02:11.874527  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:11.819689  1453 catalog_manager.cc:5697] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 11 to 14, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.885775  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.793823  8524 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.811076  8416 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:11.888542  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.796334  8470 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:11.889078  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.890651  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:11.891840  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 79862.5us
I20260709 13:02:11.894731  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:11.888985  2263 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:02:11.895654  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.894726  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:11.814144  8535 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:11.815181  8418 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:11.933730  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.908142  1704 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:11.904094  1453 catalog_manager.cc:5697] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:11.948061  2234 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:11.819077  8374 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:11.926887  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 115115us
I20260709 13:02:11.950122  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.950963  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.885531  8215 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:11.962957  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:11.889544  8466 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:11.960268  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.889309  8429 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:11.976845  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 337976us
I20260709 13:02:11.977804  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:11.986735  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:11.975663  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:11.991988  1703 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:02:11.993325  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:11.903841  8511 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:11.995867  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:11.996584  1703 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:11.902611  8402 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:12.004484  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:12.003276  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:12.011170  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:11.956508  8499 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.956401  8364 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:12.015266  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:12.014609  1453 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: config changed from index 2 to 9, term changed from 12 to 17, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to <none>, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193), VOTER 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194), VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195), VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 17 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:11.956087  8469 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:11.961670  8215 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:12.092741  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.083801  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.016134  2234 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:12.104296  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.907853  8524 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:11.926548  8416 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:11.951202  8470 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:12.289345  8049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.025s	sys 0.046s
W20260709 13:02:12.229107  1701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.034s	sys 0.035s
W20260709 13:02:12.567008  1701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.050s	sys 0.044s
I20260709 13:02:12.481518  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:12.419791  1599 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:12.378522  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:12.138288  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.568308  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 148613us
W20260709 13:02:12.307156  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 346996us
W20260709 13:02:12.313234  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 337521us
I20260709 13:02:12.379377  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:12.571041  1559 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:12.202900  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:12.382858  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:12.298259  1554 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.004s	sys 0.042s
W20260709 13:02:12.521808  1524 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.005s	sys 0.025s
I20260709 13:02:12.350419  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:12.355916  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:12.352936  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:12.351467  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:12.345156  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:11.967511  8401 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:12.001680  8070 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:12.017560  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.570371  1600 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:12.574234  1630 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:12.578819  1703 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:12.016206  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:12.424106  1627 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2819) took 2745 ms (client timeout 2189 ms). Trace:
I20260709 13:02:12.340512  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:12.576314  1555 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
W20260709 13:02:12.586997  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 570993us
I20260709 13:02:11.965307  8535 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:12.572126  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:12.575587  1635 raft_consensus.cc:2410] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:02:12.428681  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1454) took 1197 ms. Trace:
W20260709 13:02:12.578413  1557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.008s	sys 0.000s
W20260709 13:02:12.367568  8548 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 13:02:12.574577  1554 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.009s	sys 0.046s
I20260709 13:02:12.591002  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:12.588055  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:12.654502  1707 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
W20260709 13:02:12.370877  8528 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.734s	user 0.005s	sys 0.006s
I20260709 13:02:12.017791  8517 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:11.991252  8466 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:12.440129  8482 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.000s
W20260709 13:02:12.448431  8485 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.002s
W20260709 13:02:12.657294  1557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.009s	sys 0.001s
I20260709 13:02:12.661162  8412 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:12.369110  8545 log.cc:927] Time spent T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:02:12.399804  8558 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:02:12.448028  8334 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.691s	user 0.000s	sys 0.011s
W20260709 13:02:12.464190  8406 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.002s
W20260709 13:02:12.373100  8549 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:02:12.299762  8376 consensus_meta.cc:287] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.002s
I20260709 13:02:12.658425  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:12.355031  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:12.654620  1627 rpcz_store.cc:269] 0709 13:02:09.678764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.678931 (+   167us) service_pool.cc:224] Handling call
0709 13:02:12.423771 (+2744840us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54003381d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:12.423985 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4189851904}
I20260709 13:02:12.657526  1626 rpcz_store.cc:276] 0709 13:02:11.231109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.231233 (+   124us) service_pool.cc:224] Handling call
0709 13:02:11.602463 (+371230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.611688 (+  9225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.428389 (+816701us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b540035be50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:12.428595 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853063936}
I20260709 13:02:12.105437  8192 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:02:12.222985  8371 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.024s	sys 0.023s
I20260709 13:02:12.659287  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:12.664489  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:12.262585  8551 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:12.709869  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 51534.1us
I20260709 13:02:12.665141  8535 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:12.344105  8377 consensus_meta.cc:287] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
I20260709 13:02:11.991101  8434 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:12.666491  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 78526.5us
W20260709 13:02:12.569204  8049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.033s	sys 0.062s
I20260709 13:02:12.008890  8402 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:12.101145  8493 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:12.669301  1558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.000s	sys 0.022s
W20260709 13:02:12.717500  1558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.001s	sys 0.022s
I20260709 13:02:12.669654  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:12.718684  1635 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:12.571594  8509 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.025s	sys 0.028s
I20260709 13:02:12.100684  8484 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:12.222957  8534 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:12.100934  8316 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:12.428507  8394 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:12.307997  8512 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:11.991665  8429 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.017341  8414 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:12.386909  8404 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:12.676339  1631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:02:12.343616  8511 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:12.596289  8531 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:12.578347  8215 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:12.593279  8565 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.591929  8401 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:12.593101  8510 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.211508  8496 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.100165  8372 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.566s
I20260709 13:02:12.003188  8544 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:12.683008  1557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2818) took 1111 ms. Trace:
W20260709 13:02:12.574765  1524 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.005s	sys 0.030s
I20260709 13:02:12.594651  8569 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:12.577841  8469 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:12.684942  1552 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:12.687003  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:12.675098  8503 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:12.688814  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:12.691798  1629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.016s	sys 0.023s
I20260709 13:02:12.676523  8504 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.016613  8318 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:12.185022  8499 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:12.680274  8466 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:12.842700  1629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.022s	sys 0.025s
W20260709 13:02:12.665210  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 74306us
I20260709 13:02:12.773257  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1511) took 1037 ms. Trace:
I20260709 13:02:12.686285  8412 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:12.706110  8192 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.685039  8482 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:12.680716  8517 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:12.267158  8418 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:12.873683  8509 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.025s	sys 0.036s
I20260709 13:02:12.805349  8564 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:12.805932  8416 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:12.794449  8576 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:12.876184  8493 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:12.731943  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:12.927238  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 195413us
I20260709 13:02:12.887516  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:12.932832  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1316) took 1165 ms. Trace:
I20260709 13:02:12.933162  8315 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:02:12.843073  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 834427us
I20260709 13:02:12.938438  8334 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.939005  8334 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:12.941154  8334 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:12.915303  8377 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:02:12.876287  8504 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:12.915078  8485 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
W20260709 13:02:12.706489  8371 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.431s	user 0.025s	sys 0.028s
I20260709 13:02:12.809762  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1499) took 1831 ms. Trace:
I20260709 13:02:12.875177  1633 raft_consensus.cc:2410] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:02:12.731026  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:12.889998  2271 rpcz_store.cc:276] 0709 13:02:11.736145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.744743 (+  8598us) service_pool.cc:224] Handling call
0709 13:02:11.745079 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:11.749789 (+  4710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.749820 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:11.750469 (+   649us) log.cc:844] Serialized 52 byte log entry
0709 13:02:12.010446 (+259977us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:12.587563 (+577117us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.676659 (+ 89096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.676754 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.772946 (+ 96192us) raft_consensus.cc:1685] finished
0709 13:02:12.772979 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.773179 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97208,"prepare.queue_time_us":585292,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":104592,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":7741,"thread_start_us":259536,"threads_started":1,"wal-append.queue_time_us":546920}
I20260709 13:02:12.843297  1557 rpcz_store.cc:276] 0709 13:02:11.571569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.577192 (+  5623us) service_pool.cc:224] Handling call
0709 13:02:11.577513 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.577739 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:02:11.953302 (+375563us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.682660 (+729358us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.682712 (+    52us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:12.682762 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.682823 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.682951 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4425,"prepare.queue_time_us":660805,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":906,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3230,"thread_start_us":1065255,"threads_started":2,"wal-append.queue_time_us":378751}
I20260709 13:02:12.875409  1632 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
W20260709 13:02:12.707366  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 48099.6us
I20260709 13:02:12.736114  1630 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:12.759343  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2783) took 1470 ms. Trace:
W20260709 13:02:12.830291  8571 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:02:12.842886  1631 raft_consensus.cc:606] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:12.733914  8434 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:12.732282  8320 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:12.806999  8568 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:02:12.712378  8551 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.843674  8402 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:12.875743  8401 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:12.941799  8334 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:12.916270  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 2889) took 1600 ms. Trace:
W20260709 13:02:12.818621  8574 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:02:12.876561  8429 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:12.708161  8566 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.204s
I20260709 13:02:12.818837  8524 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:12.806231  8470 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:12.808761  8473 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.015268  8473 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:13.015718  8504 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.017377  8473 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.009497  8334 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.021148  8334 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:12.874328  8469 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:13.000948  8551 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:12.919193  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.030392  1552 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:12.777721  8252 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.035146  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1320) took 1222 ms. Trace:
I20260709 13:02:12.729905  8363 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.038166  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2846) took 1283 ms. Trace:
I20260709 13:02:12.920564  2269 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:12.895387  8412 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:13.040051  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.040750  1552 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:13.041666  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.044051  1552 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:12.706744  8406 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:12.933276  1554 rpcz_store.cc:276] 0709 13:02:11.767810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.771612 (+  3802us) service_pool.cc:224] Handling call
0709 13:02:11.771891 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.772092 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:12.662938 (+890846us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.932511 (+269573us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:12.932561 (+    50us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:12.932603 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.932661 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.932774 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":537007,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":2197,"raft.queue_time_us":2041,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":1157368,"threads_started":2,"wal-append.queue_time_us":265063}
I20260709 13:02:12.876163  8484 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:12.915343  7950 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:12.896454  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:13.047610  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 151222us
W20260709 13:02:12.932832  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45434us
I20260709 13:02:12.976819  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:12.980325  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2680) took 1033 ms. Trace:
I20260709 13:02:13.055154  1632 rpcz_store.cc:276] 0709 13:02:11.946431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.667945 (+721514us) service_pool.cc:224] Handling call
0709 13:02:12.980265 (+312320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:12.956880  1635 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:13.056447  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2682) took 1109 ms. Trace:
I20260709 13:02:12.981092  2234 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:12.942523  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:12.982348  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.709517  8376 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:12.983714  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 217982us
I20260709 13:02:12.887178  8496 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:12.731204  8335 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:12.986533  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:12.991585  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2683) took 1044 ms. Trace:
I20260709 13:02:12.979986  2270 rpcz_store.cc:276] 0709 13:02:10.978675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.123780 (+145105us) service_pool.cc:224] Handling call
0709 13:02:11.124103 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.124451 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:11.183179 (+ 58728us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.774213 (+591034us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.774746 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.774870 (+   124us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:11.774907 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.774968 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.809476 (+1034508us) raft_consensus.cc:1685] finished
0709 13:02:12.809505 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.809688 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126492,"prepare.queue_time_us":58529,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":60487,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":18327,"thread_start_us":445981,"threads_started":1,"wal-append.queue_time_us":775781}
I20260709 13:02:12.876145  8510 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:12.993999  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57634 (request call id 39) took 1037 ms. Trace:
I20260709 13:02:13.103866  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:12.980566  1705 rpcz_store.cc:276] 0709 13:02:11.289354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.479647 (+190293us) service_pool.cc:224] Handling call
0709 13:02:11.480042 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.546496 (+ 66454us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:11.546541 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.555276 (+  8735us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.811827 (+256551us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:11.811864 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.811921 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.759042 (+947121us) raft_consensus.cc:1685] finished
0709 13:02:12.759073 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.759263 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82311,"raft.queue_time_us":65952,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":8424,"thread_start_us":188379,"threads_started":1,"wal-append.queue_time_us":516448}
W20260709 13:02:12.992862  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 420813us
I20260709 13:02:12.998370  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.105377  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.105803  1557 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:13.106353  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:12.712893  8070 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:12.941664  8590 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.117413  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.118403  1557 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:13.119553  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.119717  1555 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:13.120296  1557 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:13.121492  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:12.946303  8482 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.002765  1560 rpcz_store.cc:276] 0709 13:02:11.315991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.316176 (+   185us) service_pool.cc:224] Handling call
0709 13:02:11.316573 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.404425 (+ 87852us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:12.405451 (+1001026us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b1800467f80. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06e19c73c7 00007f06ddfd99a7 00007f06ddfe90bf 00007f06ddfe9038
0709 13:02:12.685136 (+279685us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.850546 (+165410us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.874778 (+ 24232us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.874926 (+   148us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:12.874960 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.875023 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.886415 (+ 11392us) raft_consensus.cc:1685] finished
0709 13:02:12.914874 (+ 28459us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.916209 (+  1335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136764,"prepare.queue_time_us":702852,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":110678,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":25058,"spinlock_wait_cycles":41353472,"thread_start_us":438822,"threads_started":2,"wal-append.queue_time_us":111773}
I20260709 13:02:13.004590  8583 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:13.130846  1557 raft_consensus.cc:2410] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:02:12.991685  8588 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:12.995250  8320 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.993592  8564 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:12.875897  8531 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.024963  8470 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:13.031008  1558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1313) took 1264 ms. Trace:
I20260709 13:02:13.189873  1558 rpcz_store.cc:276] 0709 13:02:11.767035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.786433 (+ 19398us) service_pool.cc:224] Handling call
0709 13:02:11.786793 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.796688 (+  9895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.796717 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.812542 (+ 15825us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.718066 (+905524us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:12.718123 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.718232 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.030815 (+312583us) raft_consensus.cc:1685] finished
0709 13:02:13.030834 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.030951 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71293,"raft.queue_time_us":10083,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":10432,"thread_start_us":889143,"threads_started":1,"wal-append.queue_time_us":902418}
I20260709 13:02:12.895387  8192 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:13.034313  8252 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.035616  1553 rpcz_store.cc:276] 0709 13:02:11.813158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.813286 (+   128us) service_pool.cc:224] Handling call
0709 13:02:11.813576 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.890113 (+ 76537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.890155 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.903778 (+ 13623us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.555860 (+652082us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:12.555977 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.556189 (+   212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.034906 (+478717us) raft_consensus.cc:1685] finished
0709 13:02:13.034938 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.035080 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81559,"raft.queue_time_us":76326,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":31717,"thread_start_us":453748,"threads_started":1,"wal-append.queue_time_us":696994}
I20260709 13:02:13.058465  1700 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:12.873399  8565 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.107263  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.102720  1631 rpcz_store.cc:276] 0709 13:02:11.948435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.676201 (+727766us) service_pool.cc:224] Handling call
0709 13:02:12.985315 (+309114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:13.105113  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3130) took 1604 ms. Trace:
I20260709 13:02:13.038715  1629 rpcz_store.cc:276] 0709 13:02:11.754962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.795593 (+ 40631us) service_pool.cc:224] Handling call
0709 13:02:11.795852 (+   259us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:11.950011 (+154159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.950054 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:11.950661 (+   607us) log.cc:844] Serialized 78 byte log entry
0709 13:02:12.893961 (+943300us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:13.034396 (+140435us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.037377 (+  2981us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.037705 (+   328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.037810 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.037873 (+    63us) raft_consensus.cc:1685] finished
0709 13:02:13.037892 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.038096 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1692,"prepare.queue_time_us":120629,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":8560,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":6545,"thread_start_us":908880,"threads_started":2,"wal-append.queue_time_us":758148}
I20260709 13:02:13.056974  1635 rpcz_store.cc:276] 0709 13:02:11.947104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.669378 (+722274us) service_pool.cc:224] Handling call
0709 13:02:13.056367 (+386989us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:13.087287  1526 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:13.111099  1633 rpcz_store.cc:276] 0709 13:02:11.947419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.676669 (+729250us) service_pool.cc:224] Handling call
0709 13:02:12.991509 (+314840us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:13.065038  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 84032.2us
I20260709 13:02:13.112360  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.107051  1554 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:13.116132  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:13.117216  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.951256  8305 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:13.123564  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 137157us
I20260709 13:02:13.126683  1556 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:13.151181  8579 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:12.269384  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.031s	sys 0.038s
I20260709 13:02:13.169483  8506 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.167533  8434 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.107667  8323 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:13.305214  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.655s	user 0.044s	sys 0.056s
I20260709 13:02:13.110973  8504 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:13.176364  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2675) took 1377 ms. Trace:
I20260709 13:02:13.316649  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2790) took 1341 ms. Trace:
I20260709 13:02:13.105077  8377 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:12.992038  8576 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:13.125094  8509 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:13.183754  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2830) took 1168 ms. Trace:
I20260709 13:02:13.343428  1560 rpcz_store.cc:276] 0709 13:02:12.014835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.182607 (+1167772us) service_pool.cc:224] Handling call
0709 13:02:13.183051 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.183294 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.183336 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.183397 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:13.183446 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.183535 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.183678 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:13.117884  8524 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.125698  7940 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:13.063511  8363 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.102110  7950 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:13.248404  1701 rpcz_store.cc:276] 0709 13:02:11.500799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.586300 (+ 85501us) service_pool.cc:224] Handling call
0709 13:02:11.586701 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.606903 (+ 20202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.606949 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.607529 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.567556 (+960027us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:13.057298 (+489742us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.104695 (+ 47397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.104808 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.104866 (+    58us) raft_consensus.cc:1685] finished
0709 13:02:13.104885 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.105039 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47028,"prepare.queue_time_us":629743,"raft.queue_time_us":55013,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":39128,"thread_start_us":1312301,"threads_started":2,"wal-append.queue_time_us":682911}
I20260709 13:02:13.355230  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.356627  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:13.357448  1701 raft_consensus.cc:2410] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:02:13.123499  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.253037  8485 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.253551  8334 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.263950  8511 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:13.186461  8320 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:13.264780  8560 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.095s	user 0.004s	sys 0.001s
I20260709 13:02:13.266098  8376 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.271970  8499 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:13.272486  8517 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.247917  8470 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.281213  8252 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:13.284266  8318 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:13.288174  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.187574  8554 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.070s	user 0.004s	sys 0.000s
I20260709 13:02:13.294821  1704 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
W20260709 13:02:13.295740  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 233590us
I20260709 13:02:13.381997  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:13.296515  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 189325us
I20260709 13:02:13.130838  8316 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:02:13.286633  1674 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:13.305940  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 1.69203e+06us
I20260709 13:02:13.383950  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:13.111514  8070 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.128648  8590 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:13.190990  8531 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:13.333906  1709 rpcz_store.cc:276] 0709 13:02:11.975331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.353543 (+378212us) service_pool.cc:224] Handling call
0709 13:02:12.353990 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.874008 (+520018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.874053 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.874533 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.056904 (+182371us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:13.056960 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.265575 (+208615us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54001ab8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:13.265634 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.289491 (+ 23857us) raft_consensus.cc:1685] finished
0709 13:02:13.289513 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.316548 (+ 27035us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195263232,"thread_start_us":171690,"threads_started":1,"wal-append.queue_time_us":299021}
I20260709 13:02:13.189000  8544 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.346829  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:13.426957  8394 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:13.427254  1700 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:13.427611  8394 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.427857  2269 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:02:13.428174  8394 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:13.429649  8588 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:13.430490  8589 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:13.430805  8588 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:13.431067  8589 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.432246  2264 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:13.277542  8429 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.299741  8416 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:13.299990  8473 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:13.332765  8504 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.434664  8504 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:13.435057  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:13.336714  8566 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:13.435714  2264 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:13.435995  8566 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:13.425752  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 295621us
I20260709 13:02:13.336911  8495 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.437697  8495 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.438724  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:13.439791  8495 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.336561  8377 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.441406  8377 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:13.441666  8564 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:13.444490  2235 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:13.351229  8496 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.371842  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2838) took 1693 ms. Trace:
I20260709 13:02:13.445679  1628 rpcz_store.cc:276] 0709 13:02:11.678434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.680526 (+  2092us) service_pool.cc:224] Handling call
0709 13:02:11.785424 (+104898us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.788008 (+  2584us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:11.788043 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.791731 (+  3688us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.425740 (+634009us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b18004c07e0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:02:12.547745 (+122005us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:12.547807 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.547904 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.015294 (+467390us) raft_consensus.cc:1685] finished
0709 13:02:13.015321 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.371623 (+356302us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b540007b050. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:13.371769 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2183,"raft.queue_time_us":2279,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":191342208,"thread_start_us":121731,"threads_started":1,"wal-append.queue_time_us":889444}
I20260709 13:02:13.369459  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2827) took 1355 ms. Trace:
I20260709 13:02:13.373507  1552 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:13.375324  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:13.345709  8579 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.447427  1559 rpcz_store.cc:276] 0709 13:02:12.013945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.590829 (+576884us) service_pool.cc:224] Handling call
0709 13:02:12.591253 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.003663 (+412410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.003701 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.003740 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:13.003771 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.369180 (+365409us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54001815d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:13.369240 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.369381 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948099840}
W20260709 13:02:13.447580  8466 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.002s
I20260709 13:02:13.384161  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:13.450145  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 66054.2us
I20260709 13:02:13.451396  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.439819  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.452836  8500 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:13.333110  1630 rpcz_store.cc:276] 0709 13:02:11.798797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.676773 (+877976us) service_pool.cc:224] Handling call
0709 13:02:12.679981 (+  3208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.985774 (+305793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.176130 (+190356us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b540018ecd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:13.176302 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128540416}
I20260709 13:02:13.360256  8493 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.454625  8429 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.341552  8412 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:13.454877  8493 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:13.456676  8412 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.456746  8589 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:13.390708  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 104148us
I20260709 13:02:13.457890  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:13.393440  8070 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:13.458698  8416 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:13.459424  8416 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.459900  8416 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:13.395576  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1318) took 1627 ms. Trace:
I20260709 13:02:13.465871  1556 rpcz_store.cc:276] 0709 13:02:11.768272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.779781 (+ 11509us) service_pool.cc:224] Handling call
0709 13:02:11.780002 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.250581 (+1470579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.395232 (+144651us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003ea8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:13.395495 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3096969984}
I20260709 13:02:13.469188  8469 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.362521  8509 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:13.371423  8334 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.409943  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.410583  8535 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:13.411103  8434 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:13.412703  8376 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.414963  8510 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.421085  8335 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:13.422624  8593 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:02:13.537918  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:13.423847  2270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:02:13.425984  8404 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:13.396258  8576 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.426308  8318 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:13.426574  8595 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:02:13.349382  1554 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:02:13.440079  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:13.448563  8579 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:13.186661  8583 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.454687  8566 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.385473  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.470737  8406 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.471315  8401 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.458784  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:13.472581  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:13.473189  8305 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:13.473217  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.498272  8377 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:13.478382  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.478814  8363 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.481278  8565 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.376276  8511 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.481858  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:13.483218  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.483628  8070 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.484784  8192 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.352106  8524 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.576894  8583 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.533558  8551 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.577554  8377 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.485195  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.470741  8470 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:13.486814  8215 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.589s	user 0.005s	sys 0.005s
I20260709 13:02:13.586266  8215 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.586840  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.587482  1627 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:13.588974  8215 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.536207  8434 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.371533  8485 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.332525  8506 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.477843  8500 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:13.490339  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.491680  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:13.492503  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 71103.7us
I20260709 13:02:13.493566  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.458654  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.498588  1700 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:13.501641  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1299) took 1530 ms. Trace:
I20260709 13:02:13.502224  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:13.531368  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:13.506814  1551 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:02:13.534654  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:13.616027  1626 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:13.614938  1708 rpcz_store.cc:276] 0709 13:02:11.971103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.971239 (+   136us) service_pool.cc:224] Handling call
0709 13:02:11.971672 (+   433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:12.484638 (+512966us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.484692 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:12.535129 (+ 50437us) log.cc:844] Serialized 52 byte log entry
0709 13:02:13.063669 (+528540us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:13.374438 (+310769us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.375042 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.375113 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.501401 (+126288us) raft_consensus.cc:1685] finished
0709 13:02:13.501430 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.501588 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36439,"prepare.queue_time_us":215811,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":268058,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":4932,"thread_start_us":1203269,"threads_started":3,"wal-append.queue_time_us":790192}
W20260709 13:02:13.535467  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 102999us
I20260709 13:02:13.419917  8517 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.539000  2270 raft_consensus.cc:606] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.622463  2270 raft_consensus.cc:614] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:13.539573  1703 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:13.506119  8429 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:13.537087  8335 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:13.551152  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 92452.4us
I20260709 13:02:13.534884  8364 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:13.535504  8376 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.538700  8473 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.540735  8512 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:13.506012  8402 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.542936  8404 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.563853  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.474879  8484 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.567554  1628 raft_consensus.cc:2410] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:13.533083  8394 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.569839  1630 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:13.569361  1705 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:02:13.584262  8590 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.573596  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.576182  8601 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:13.579175  1560 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:13.531198  8509 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.584033  8495 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.584240  8511 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.545660  8320 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:13.487191  7950 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.590555  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:13.593761  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 209904us
I20260709 13:02:13.566335  8566 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:13.598826  8401 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.548898  8318 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:13.629839  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 171281us
I20260709 13:02:13.653856  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:13.655189  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:13.591205  8412 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:13.499209  8466 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:13.668380  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 86122.9us
W20260709 13:02:13.708197  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 53104us
I20260709 13:02:13.597872  8524 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.610877  8434 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:13.657217  8372 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:13.590524  8504 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:13.717092  8611 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:02:13.717278  8590 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:13.718071  8590 consensus_queue.cc:1243] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:02:13.718541  2271 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:13.695214  1706 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:13.697531  1626 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:13.719110  8590 consensus_queue.cc:1059] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:13.697907  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.720144  1556 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:13.720419  8484 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:13.720798  8484 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:13.722184  8320 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.722678  8504 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.698196  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:13.699087  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.724030  1554 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:13.667517  8404 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:13.661418  8473 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.725220  8318 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:13.725847  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.726887  8394 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.728655  8402 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.728777  8512 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.729387  8512 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:13.730327  2270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:02:13.730625  8402 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:13.730993  2270 raft_consensus.cc:606] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.731175  8402 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:13.731381  2270 raft_consensus.cc:614] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:13.732275  8402 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.733003  8376 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.664801  8364 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.709442  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.740793  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:13.708549  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:13.690193  8551 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.657919  8517 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.714978  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:13.688983  8500 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.716784  8372 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:13.726984  8532 raft_consensus.cc:993] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: : Instructing follower 4f1725fe36e349ac85405627f9c93d95 to start an election
W20260709 13:02:13.705814  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 92420.6us
I20260709 13:02:13.771651  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:13.704933  8412 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:13.694415  8566 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.739308  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:13.794330  2270 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:13.744297  1552 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:13.721751  8377 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:13.663256  8429 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.772647  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:13.700876  8495 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:13.774897  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 60004.7us
I20260709 13:02:13.790251  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:13.802498  2265 raft_consensus.cc:2368] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:13.713775  8401 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:13.703522  1634 raft_consensus.cc:2368] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17.
W20260709 13:02:13.766530  8605 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:02:13.798527  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 89171.3us
I20260709 13:02:13.834399  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:13.835642  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:13.835978  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:13.836642  2265 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:13.767606  8603 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.837706  1633 raft_consensus.cc:2410] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:02:13.842924  2270 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:13.845100  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.845448  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.845491  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.846479  1559 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:13.845880  1556 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:13.848629  8511 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:13.849128  8517 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.849819  8511 raft_consensus.cc:3055] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:13.850231  8511 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:13.851056  8511 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.851629  8466 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.852300  8511 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.852622  8404 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:13.789810  8469 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.789330  8372 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:13.854228  8394 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:13.832290  8401 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.854722  8394 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.854959  8401 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:13.855255  8394 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:13.857540  8500 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.795495  8376 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:13.852403  8412 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.862531  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:13.799012  8566 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:13.869004  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.869251  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:13.869794  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:13.870427  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:13.873725  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 216874us
I20260709 13:02:13.874223  1556 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:02:13.875180  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.870519  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:13.798306  8334 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.878526  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.801649  8532 raft_consensus.cc:1081] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Signalling peer 4f1725fe36e349ac85405627f9c93d95 to start an election
I20260709 13:02:13.876202  1560 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:13.890066  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.890298  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.891356  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.797657  8377 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:13.893584  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.893945  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.866245  2269 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:13.879981  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:13.894696  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:13.878257  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.881062  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.881477  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.895380  1700 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:13.895989  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:13.896299  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:13.896850  1626 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:13.884442  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.892254  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:13.884789  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.898809  1703 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:13.866441  1673 connection.cc:256] RPC call timeout handler was delayed by -1.6429779030000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:02:13.899525  1701 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:13.899641  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.900185  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.900432  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.900820  1558 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:13.804263  8551 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:13.900935  1708 raft_consensus.cc:2410] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:02:13.901654  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:13.901930  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:13.902186  1558 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:13.887346  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2897) took 1229 ms. Trace:
W20260709 13:02:13.904652  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 201920us
I20260709 13:02:13.906175  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.883203  1600 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.907624  1600 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:13.909592  1700 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:13.911221  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.912150  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:13.903375  1551 rpcz_store.cc:276] 0709 13:02:12.658141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.730692 (+ 72551us) service_pool.cc:224] Handling call
0709 13:02:13.887189 (+1156497us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54000aa854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:13.887296 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1207728512}
I20260709 13:02:13.912922  1708 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:13.913357  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.914005  1552 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
W20260709 13:02:13.890314  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 228889us
I20260709 13:02:13.914108  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.915944  1700 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:13.917322  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:13.918514  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:13.919587  1552 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:13.918207  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:13.919771  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:13.921120  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.921482  1673 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.925813  1626 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:13.927476  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.928122  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.928823  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.858441  8583 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:13.936805  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:13.911818  1702 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:02:13.873595  8565 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:13.938087  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:13.924392  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:13.937146  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.929268  1673 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.952533  1552 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 20: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:13.952778  1631 raft_consensus.cc:2368] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 23. Current term is 24.
I20260709 13:02:13.924108  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:13.930756  1630 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:13.873821  8376 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.931048  1700 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:02:13.932868  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.935712  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:13.938367  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:13.832891  7940 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:02:13.955289  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:13.939841  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:14.051041  1635 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
W20260709 13:02:14.051282  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 96073.5us
I20260709 13:02:13.957365  2234 leader_election.cc:400] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 23. Current term is 24.
I20260709 13:02:14.051869  2234 leader_election.cc:403] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:13.957603  1631 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:13.959594  1560 raft_consensus.cc:2410] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 17 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 13:02:13.923432  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:14.052708  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:14.053025  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 129673us
I20260709 13:02:14.047672  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:14.061430  1702 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:14.062160  1551 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:13.912138  8576 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.053629  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:14.091447  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:14.063246  1701 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
W20260709 13:02:14.048004  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 94283.5us
I20260709 13:02:14.100093  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2849) took 1123 ms. Trace:
I20260709 13:02:14.100684  1634 rpcz_store.cc:276] 0709 13:02:12.976384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.976548 (+   164us) service_pool.cc:224] Handling call
0709 13:02:13.967225 (+990677us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54003381d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:14.100017 (+132792us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1484174080}
I20260709 13:02:14.103197  1628 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 19: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:14.111122  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:14.111778  1632 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:14.117478  1703 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
W20260709 13:02:14.126966  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 169745us
I20260709 13:02:14.112913  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:14.242551  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 129710us
I20260709 13:02:14.245254  1703 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 13:02:14.136732  1700 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:13.865324  8603 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:13.899091  8503 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.154s
I20260709 13:02:14.143887  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2834) took 1570 ms. Trace:
I20260709 13:02:14.145182  8470 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:14.151588  7940 raft_consensus.cc:3055] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:14.152697  8495 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.960961  8192 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:14.160569  8512 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:14.312460  8512 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:13.921023  8049 consensus_queue.cc:1048] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.190s
I20260709 13:02:14.251638  8466 raft_consensus.cc:2764] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:02:14.317458  8603 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:14.303679  7940 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:14.318919  7940 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:14.320264  7940 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:14.137837  8576 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:14.323191  1702 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 20: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:14.324107  8377 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:14.193590  8429 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:14.114358  8510 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:14.217239  8617 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:14.113142  8524 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:14.138507  8575 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:02:13.960821  8070 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:14.146989  8371 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:02:14.126530  8551 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:14.046526  8565 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:14.073088  8579 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:14.111383  8315 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:14.173810  8607 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.299s	user 0.003s	sys 0.000s
I20260709 13:02:14.130587  8532 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:14.235774  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 283893us
W20260709 13:02:14.372931  8434 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.000s
I20260709 13:02:14.004822  1558 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:14.298218  1553 rpcz_store.cc:276] 0709 13:02:12.573352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.197197 (+623845us) service_pool.cc:224] Handling call
0709 13:02:13.887728 (+690531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.887871 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.887892 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.887928 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:13.887956 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.888003 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.143660 (+255657us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54000aa850. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:14.143812 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1587447680}
I20260709 13:02:14.373488  8551 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:13.932278  8469 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:13.963158  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1298) took 2008 ms. Trace:
I20260709 13:02:14.328369  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:14.329244  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:14.409683  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80559us
I20260709 13:02:14.410956  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:13.946527  8485 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:13.936709  8583 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:14.255609  8416 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.795s	user 0.013s	sys 0.000s
I20260709 13:02:14.234767  8506 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:14.236805  8535 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:14.265890  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:14.428706  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:13.937971  8412 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:14.342595  2265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:02:14.432051  2265 raft_consensus.cc:606] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:14.432498  2265 raft_consensus.cc:614] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:14.300882  8334 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:14.358712  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.955036  8509 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:14.301317  8590 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.300518  8404 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:13.945212  8564 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:14.338896  8510 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:14.421357  8495 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:14.404156  8434 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:14.382305  1708 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:14.248021  1700 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:14.404644  1705 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:14.445581  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:14.251807  1701 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:14.342528  8500 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:02:14.376405  8364 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:14.309713  8376 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:14.411845  1706 rpcz_store.cc:276] 0709 13:02:11.970621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.002064 (+ 31443us) service_pool.cc:224] Handling call
0709 13:02:12.002386 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.719162 (+1716776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.962866 (+243704us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54001fd954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:13.963086 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3888237312}
I20260709 13:02:14.381906  8532 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.415642  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:14.411489  2235 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:14.423947  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 370390us
I20260709 13:02:14.439301  8334 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:14.421154  8070 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:14.421947  8583 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:14.443974  8394 consensus_meta.cc:287] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.000s
I20260709 13:02:14.437944  8506 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:14.504618  2270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.032s	sys 0.091s
W20260709 13:02:14.505241  2270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.032s	sys 0.091s
I20260709 13:02:14.469419  8484 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:14.409289  8551 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:14.431461  8535 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:14.481983  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 70604.2us
I20260709 13:02:14.515108  2235 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:14.450575  8510 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:14.456317  8402 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:14.484874  8070 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:14.485316  8625 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:02:14.487386  8372 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.003s
I20260709 13:02:14.478606  8532 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:14.485702  8334 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:14.510740  8252 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.010s	sys 0.019s
I20260709 13:02:14.488327  8404 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:14.429514  8416 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:14.446542  8590 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:14.504403  8512 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:02:14.512948  8401 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.000s
I20260709 13:02:14.505345  8394 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:14.527041  8473 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:14.520318  8535 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:14.522712  8484 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:14.547255  8565 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:14.557132  8599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.017s	sys 0.024s
W20260709 13:02:14.566390  8599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.017s	sys 0.024s
W20260709 13:02:14.572472  8620 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.386s	user 0.003s	sys 0.000s
W20260709 13:02:14.576066  8623 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.352s	user 0.003s	sys 0.000s
W20260709 13:02:14.433703  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 168022us
W20260709 13:02:14.616463  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.384200  1526 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:14.429677  1631 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
W20260709 13:02:14.621865  1626 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.003s	sys 0.015s
W20260709 13:02:14.622357  1626 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.003s	sys 0.015s
W20260709 13:02:14.621284  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.005s	sys 0.012s
W20260709 13:02:14.625514  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.005s	sys 0.012s
W20260709 13:02:14.626078  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 699439us
I20260709 13:02:14.628588  1600 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:14.630381  1601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.006s	sys 0.013s
W20260709 13:02:14.630986  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.006s	sys 0.013s
W20260709 13:02:14.631506  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 705906us
I20260709 13:02:14.632848  1601 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:14.443578  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:14.636588  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:14.626382  1598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.004s	sys 0.009s
W20260709 13:02:14.638371  1598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.004s	sys 0.009s
W20260709 13:02:14.642797  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.010s
W20260709 13:02:14.643250  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.006s	sys 0.010s
W20260709 13:02:14.454486  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 401849us
W20260709 13:02:14.647521  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.651259  1707 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:14.652665  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2797) took 1591 ms. Trace:
I20260709 13:02:14.653136  1709 rpcz_store.cc:276] 0709 13:02:13.060798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.412777 (+351979us) service_pool.cc:224] Handling call
0709 13:02:13.413193 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:13.458870 (+ 45677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.458901 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:13.459454 (+   553us) log.cc:844] Serialized 52 byte log entry
0709 13:02:13.591181 (+131727us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:13.659541 (+ 68360us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.669555 (+ 10014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.669674 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.173070 (+503396us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:14.651991 (+478921us) raft_consensus.cc:1685] finished
0709 13:02:14.652122 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.652418 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54923,"prepare.queue_time_us":70333,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":69903,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":14264,"spinlock_wait_cycles":30216960,"thread_start_us":131359,"threads_started":1,"wal-append.queue_time_us":254885}
I20260709 13:02:14.479007  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:14.658166  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 143019us
W20260709 13:02:14.659286  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 180212us
I20260709 13:02:14.659986  8499 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:02:14.486742  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 71164.6us
W20260709 13:02:14.530596  8252 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.010s	sys 0.019s
I20260709 13:02:14.530759  8372 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:14.677868  8070 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:14.679931  8590 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:14.686648  8637 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:14.687412  8637 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:14.687973  8637 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:14.695314  8434 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:14.696359  8394 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:14.551524  8512 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:14.698153  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:14.701272  1673 leader_election.cc:400] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:14.702510  8418 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:14.706806  8628 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:14.707594  8628 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:14.548179  8401 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:14.721134  8320 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:14.540967  8404 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:14.723595  8192 raft_consensus.cc:2764] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260709 13:02:14.726534  8631 consensus_queue.cc:1059] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:14.727927  8631 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:14.728358  8631 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:14.731634  1553 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:14.734578  8485 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:14.735154  8485 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:14.735600  8485 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:14.735695  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:14.736763  1557 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:14.739059  8401 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:14.708312  8372 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:14.741091  8320 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:14.742311  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:14.743369  1631 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:14.742789  8320 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:14.750875  8512 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:14.751471  8569 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:14.753049  8418 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:14.753587  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:14.754207  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:14.754511  2264 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:14.755070  2271 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
W20260709 13:02:14.755955  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 96272.7us
I20260709 13:02:14.756283  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:14.753494  8418 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:14.759339  8418 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:14.762475  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 113011us
I20260709 13:02:14.705732  8416 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:14.761232  8418 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:14.847592  8495 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:14.884649  8589 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:14.886996  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 189123us
I20260709 13:02:14.732965  8631 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:14.895376  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 76586.1us
I20260709 13:02:14.909053  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:14.909569  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:14.910521  1552 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:14.911121  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:14.922955  1707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2795) took 1869 ms (client timeout 2333 ms). Trace:
I20260709 13:02:14.923329  8416 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:14.923516  1707 rpcz_store.cc:269] 0709 13:02:13.053917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.367558 (+313641us) service_pool.cc:224] Handling call
0709 13:02:14.922622 (+1555064us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001fe354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:14.922838 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2533599104}
I20260709 13:02:14.924204  8416 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:14.926117  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:14.912823  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 509776us
I20260709 13:02:14.931770  1631 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:14.905799  8590 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:14.916230  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:14.930151  2235 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:14.943413  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:14.947666  8499 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:14.949301  8499 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:14.950886  8531 consensus_meta.cc:287] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.460s	user 0.025s	sys 0.029s
I20260709 13:02:14.951462  8531 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:14.952816  8371 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.009s
I20260709 13:02:14.953115  1629 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:14.953948  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:14.955446  2265 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 19: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:14.958357  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:14.959439  1551 raft_consensus.cc:2393] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 22: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:14.954262  8466 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:14.941166  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:14.940992  8616 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.511s	user 0.000s	sys 0.004s
I20260709 13:02:14.952939  8499 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:14.966292  8499 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:14.966958  8622 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.967777  8622 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:14.953377  8371 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 23. Current term is 24.
I20260709 13:02:14.966981  8499 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:14.978549  8618 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:14.979143  8618 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:14.976897  1552 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 24.
I20260709 13:02:14.983644  8576 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:14.960613  8628 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:14.989846  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2798) took 1095 ms. Trace:
I20260709 13:02:14.990351  1705 rpcz_store.cc:276] 0709 13:02:13.889265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.889824 (+   559us) service_pool.cc:224] Handling call
0709 13:02:14.984129 (+1094305us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b540005d054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:14.984334 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181715328}
I20260709 13:02:14.974938  8466 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:14.992767  8466 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:14.994205  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:14.973709  8622 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:14.978585  8499 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:15.004539  8510 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:15.005309  8412 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.006s
I20260709 13:02:14.948086  8590 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.008128  8590 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.010982  1707 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:15.000864  8532 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:15.011593  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 80410.2us
I20260709 13:02:14.980595  8618 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.013577  1526 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:14.971020  8070 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:14.994745  8416 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:15.035647  1708 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 22. Current term is 23. Ops: []
W20260709 13:02:15.035969  1632 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.924s	user 0.016s	sys 0.016s
I20260709 13:02:15.036525  1632 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:15.037349  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2699) took 1146 ms. Trace:
I20260709 13:02:15.026889  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.043023  8404 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:15.037526  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.037799  1632 rpcz_store.cc:276] 0709 13:02:13.891205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.947731 (+ 56526us) service_pool.cc:224] Handling call
0709 13:02:15.037236 (+1089505us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:15.044643  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.054785  1633 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:15.054785  8590 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:15.058566  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 154514us
W20260709 13:02:15.060225  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 154465us
I20260709 13:02:15.057542  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.061219  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.061465  1705 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:02:15.062621  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:15.062703  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.057258  8590 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.066900  1700 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:15.067659  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.068490  1701 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:15.069202  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.064611  8599 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:15.070448  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.071341  1700 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:15.072690  8510 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.073698  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.074491  1708 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
W20260709 13:02:15.076402  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.064459  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.059517  8618 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:15.086143  1706 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:15.064913  8631 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.087218  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:15.076519  8590 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:15.086198  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.090217  1707 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:15.093526  1628 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 24: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:02:15.093726  8648 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:02:15.090210  8485 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.094753  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:15.099184  8335 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.328s	user 0.014s	sys 0.005s
I20260709 13:02:15.103890  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2696) took 1213 ms. Trace:
W20260709 13:02:15.104110  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.104022  8335 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.104044  8371 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:15.106201  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:15.106914  2269 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:15.107012  8371 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:15.107636  8371 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.108239  8485 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.108315  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:15.095700  8070 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.126837  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:15.127377  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:15.127749  2268 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:15.128365  2265 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:15.128922  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.129908  1708 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 19: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:02:15.130406  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46635.4us
I20260709 13:02:15.110119  1626 rpcz_store.cc:276] 0709 13:02:13.890513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.953393 (+ 62880us) service_pool.cc:224] Handling call
0709 13:02:13.953704 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.623120 (+669416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.623170 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.624362 (+  1192us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.780511 (+156149us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:14.780565 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.809299 (+ 28734us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:15.100289 (+290990us) raft_consensus.cc:1685] finished
0709 13:02:15.100307 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.103801 (+  3494us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":266672,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5470,"spinlock_wait_cycles":1523072,"thread_start_us":731776,"threads_started":2,"wal-append.queue_time_us":335292}
W20260709 13:02:15.133713  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.135018  8335 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.135145  8637 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.137467  8637 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:15.141670  8499 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.145123  8503 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:15.145956  8503 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.147786  8532 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.149799  1555 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:15.151331  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:15.151531  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:15.151904  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:15.152235  1553 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:15.149713  1552 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:15.148325  8503 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.152241  1556 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:15.155519  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:15.156951  8621 consensus_queue.cc:1059] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:15.110386  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:15.158861  8532 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:15.159500  8532 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:02:15.160771  8484 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.012s
I20260709 13:02:15.160609  8532 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.164204  8640 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:15.164652  8640 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:02:15.166090  7940 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.735s	user 0.014s	sys 0.005s
I20260709 13:02:15.165628  8640 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.167807  8499 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.167965  8640 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:15.197664  1707 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:15.109977  8371 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:15.204924  1557 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:15.206882  1553 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
W20260709 13:02:15.208158  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 119693us
I20260709 13:02:15.211207  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:15.211951  1553 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:02:15.121647  8511 consensus_meta.cc:287] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.269s	user 0.020s	sys 0.013s
I20260709 13:02:15.115008  8531 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.216249  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:15.217885  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:15.211380  1708 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:15.219105  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 222634us
I20260709 13:02:15.221367  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:15.224735  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.220189  8499 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:15.227664  7950 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:15.228194  8499 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.228381  7950 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.229763  1556 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:15.230651  8499 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.230829  1551 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:15.239516  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:15.239763  1556 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:15.240193  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.240746  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:15.240885  8604 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 13:02:15.242126  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 101520us
I20260709 13:02:15.212040  1705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5"
dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:48138
I20260709 13:02:15.243021  1705 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:15.243453  1705 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:15.245066  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:15.247182   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:15.251662  8496 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:15.252235  8496 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.240782  8315 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:02:15.252990  8631 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:15.253571  8638 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:15.253978  8638 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:15.254308  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:15.255008  1553 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:15.254942  8638 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.256078  1524 leader_election.cc:400] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17.
I20260709 13:02:15.256405  1524 leader_election.cc:403] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:02:15.256349  8638 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:15.257969  8363 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:15.258451  8363 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.258826  8363 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:15.259088  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:15.261240  8602 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17.
I20260709 13:02:15.262223  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:15.262811  1558 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:15.265381  1705 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.266896  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:15.269330  8566 consensus_meta.cc:287] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.347s	user 0.005s	sys 0.018s
I20260709 13:02:15.270378  1600 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:15.280303  1629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2857) took 1732 ms (client timeout 2144 ms). Trace:
I20260709 13:02:15.278769  2270 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:15.272404  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.273641  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:15.276566  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.297974  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:15.270915  8496 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.280088   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:15.303614  2264 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
W20260709 13:02:15.303733  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 64583.4us
I20260709 13:02:15.284936  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.297047  1601 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:15.297935  1629 rpcz_store.cc:269] 0709 13:02:13.547969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.653544 (+105575us) service_pool.cc:224] Handling call
0709 13:02:15.280039 (+1626495us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540006ccd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:15.280217 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2875514112}
I20260709 13:02:15.308403  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:15.308753  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 74811.5us
I20260709 13:02:15.315395  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:02:15.317646  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 59660.3us
W20260709 13:02:15.324961  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 80018.7us
I20260709 13:02:15.329300  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:15.329710  8334 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.796s	user 0.013s	sys 0.015s
I20260709 13:02:15.278007  7950 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.330158  8334 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.330787  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.331506  1706 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:15.332397  8334 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.332670  8510 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:15.333068  8637 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:15.332394  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.334580  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:15.335632  1705 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.279671  8377 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.333544  8637 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.345517  1555 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:15.269951  8566 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.342059  8404 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:02:15.347513  8500 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:15.349023  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.359129  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:15.362607  8583 consensus_meta.cc:287] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.850s	user 0.015s	sys 0.006s
I20260709 13:02:15.304411  8631 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:02:15.307113  8499 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:15.384861  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:15.375597  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:15.385257  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:15.377318  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 58996.1us
I20260709 13:02:15.378957  1706 raft_consensus.cc:2368] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 22. Current term is 23.
I20260709 13:02:15.345268  8637 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:15.342198  8621 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:15.387210  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:15.384779  8404 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:15.393210  1708 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:15.388980  8500 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:15.393942  2268 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:15.395283  1629 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:15.374410  8510 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:15.404780  8500 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.405416  8510 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:15.395035  8583 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.406646  8510 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.408223  8583 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:02:15.408169  8510 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:15.399678  1709 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:15.400879  8499 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.410502  1704 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:15.412000  8499 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.401258  8371 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:15.412954  8371 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:15.413336  8371 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:15.414111  8192 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:15.414577  8192 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:15.414336  8371 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.17, Last appended by leader: 17, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.415827  8634 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:15.415638  8192 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.416492  8634 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:15.415876  8371 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:15.399166  8404 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:15.423099  2234 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:15.424535  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:15.426062  8569 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:15.426787  8569 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:15.427126  8569 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.427448  8569 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:15.402982  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:15.403820  1705 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 22: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:15.363670  8602 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.436488  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.437111  1626 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:02:15.437753  8602 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.438179  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:15.440223  8602 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.440945  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.441339  1702 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:15.442305  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:15.442349  8576 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:15.443503  8576 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:15.440258  1704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2804) took 1543 ms (client timeout 1954 ms). Trace:
I20260709 13:02:15.444931  1702 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:15.417549  8634 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:15.445307  1704 rpcz_store.cc:269] 0709 13:02:13.896952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.897366 (+   414us) service_pool.cc:224] Handling call
0709 13:02:15.440018 (+1542652us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54001c3ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:15.440192 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3405783424}
I20260709 13:02:15.447942  1702 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:15.452032  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 170048us
I20260709 13:02:15.441427  8590 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.399991  8484 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:15.396263  8599 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:15.396034  8621 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:15.464447  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.465337  2269 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 19: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:15.467125  8602 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:15.475342  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:15.468075  2264 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:15.476789  1705 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:15.365161  8466 consensus_queue.cc:1059] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:02:15.472699  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:15.481153  1706 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:15.481353  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.475780  8602 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:15.483567  8511 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.484726  8404 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.488958  8576 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.490581  8590 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.491587  8566 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:15.493435  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:15.494326  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:15.495261  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:15.518626  1557 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 21: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:15.495494  8484 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.495277  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:15.514676  8602 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.501040  8599 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.502195  1556 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:15.504987  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:15.523998  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.471169  8621 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:15.505870  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.505923  1673 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:15.506959  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 53727.5us
W20260709 13:02:15.508189  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.509886  1558 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 23.
W20260709 13:02:15.528242  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 125323us
W20260709 13:02:15.510804  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.512208  1635 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:02:15.514153  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.529116  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.530687  1631 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 23.
I20260709 13:02:15.462981  8583 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:15.527691  1626 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
W20260709 13:02:15.543907  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.545115  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.535097  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:15.511951  8512 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.042s	sys 0.043s
I20260709 13:02:15.564656  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:15.577463  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:15.522553  8511 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.579541  2271 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:15.571723  8512 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.043s	sys 0.044s
I20260709 13:02:15.579866  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.581406  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:15.580158  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.581945  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:15.582463  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.584052  8484 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.606153  8583 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.584422  8404 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:15.609527  8583 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:15.610154  8376 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.038s	user 0.011s	sys 0.017s
I20260709 13:02:15.581481  8566 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:15.610618  8376 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.610764  8569 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.612828  8376 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.612948  8569 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.613550  2270 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 23: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:15.580453  7940 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:15.614966  7940 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.617194  7940 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:15.587544  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:15.623041  1635 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 23.
I20260709 13:02:15.588804  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:15.593647  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:15.594249  2235 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.934s (SENT) [suppressed 3 similar messages]
I20260709 13:02:15.594901  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:15.624833  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 96444.5us
I20260709 13:02:15.600337  1627 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:15.604494  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:15.626366  1632 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:15.597133  8535 consensus_meta.cc:287] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.771s	user 0.029s	sys 0.018s
I20260709 13:02:15.631246  8535 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.632565  1703 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:15.627897  1554 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:15.628746  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:15.633631  8535 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.634913  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:15.639485  1632 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:15.640640  8192 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:15.642484  8511 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.642834  8484 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:15.643460  8484 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:15.644335  8484 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:15.619768  8551 consensus_meta.cc:287] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.948s	user 0.016s	sys 0.005s
I20260709 13:02:15.646203  8510 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:15.629319  8334 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:15.646449  8551 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.647285  8334 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:15.648168  1554 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42098 (request call id 2910) took 1803 ms (client timeout 1875 ms). Trace:
I20260709 13:02:15.648350  8334 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.648895  8551 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:15.649334  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 60647.4us
I20260709 13:02:15.650313  1707 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 21: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:15.650429  7950 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:15.650880  7950 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:15.651262  7950 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:15.651809  8416 raft_consensus.cc:3055] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:15.652175  8416 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:15.653131  8416 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:15.654322  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 148526us
I20260709 13:02:15.655160  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:15.657117  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:15.660761  1526 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:15.648677  1554 rpcz_store.cc:269] 0709 13:02:13.844339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.844466 (+   127us) service_pool.cc:224] Handling call
0709 13:02:15.647889 (+1803423us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400311ad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:15.648070 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3968924416}
I20260709 13:02:15.662393  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:15.664765  8466 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:15.665472  8466 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:15.666133  1674 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:15.666500  8466 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:15.666921  8466 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:15.668069  8466 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.669410  8466 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:15.534343  8599 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.670267  8566 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:15.670846  8566 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 23 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:15.671882  8566 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.674247  8510 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:15.674706  8510 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:15.675114  8631 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:15.675693  8376 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:15.676273  8376 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.675765  8631 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.676687  8376 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:15.675202  8510 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:15.677208  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:15.678587  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:15.680172  8631 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.681449  8335 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:15.682526  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 56996us
I20260709 13:02:15.684031  1601 leader_election.cc:400] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 22. Current term is 23.
I20260709 13:02:15.684382  1601 leader_election.cc:403] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:02:15.685168  8503 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 22. Current term is 23.
I20260709 13:02:15.633949  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1313) took 1727 ms. Trace:
I20260709 13:02:15.689543  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:15.687167  1703 rpcz_store.cc:276] 0709 13:02:13.906111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.246188 (+340077us) service_pool.cc:224] Handling call
0709 13:02:14.246492 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.632963 (+1386471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.633641 (+   678us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54003a0554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:15.633872 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3187160832}
W20260709 13:02:15.694626  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 44653.8us
I20260709 13:02:15.697994  2268 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:15.699034  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:15.697945  2265 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 24.
I20260709 13:02:15.699052  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:15.704236  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:15.705256  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:15.711488  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:15.712136  1627 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:15.721328  1601 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:15.719645  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:15.739646  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:15.740608  1558 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:15.741237  1628 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 23.
I20260709 13:02:15.716893  7940 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:15.716952  8599 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.700376  8503 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:02:15.779650  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:15.721719  8416 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:15.706970  8640 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:02:15.724057  8377 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:15.784264  8602 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.726826  8320 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:02:15.789664  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:15.726960  8499 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.796387  1706 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:15.752326  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:15.724141  8631 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:02:15.799027  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:15.802142  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 103200us
I20260709 13:02:15.805338  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:15.749789  7940 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:15.801498  1554 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
W20260709 13:02:15.796099  8363 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.004s
I20260709 13:02:15.808935  1704 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:15.779838  8404 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:15.813498  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:15.743058  8588 consensus_queue.cc:1059] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:02:15.815901  1703 pending_rounds.cc:85] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 12
I20260709 13:02:15.816272  1703 pending_rounds.cc:107] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:02:15.816560  1703 raft_consensus.cc:2889] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:15.816749  8657 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:02:15.818200  8617 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:15.826778  7950 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.829046  7950 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.830358  2236 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:15.832408  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:15.794010  8583 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:15.811053  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.837426  8583 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.838775  1705 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:15.808589  8499 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.841619  8499 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.811581  7940 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.850382  8404 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:15.851577  8404 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.830183  8551 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:15.878332  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.878456  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.879271  1700 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:15.880115  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.880847  1700 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:15.881601  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.857300  8363 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.884583  8621 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.856212  8638 raft_consensus.cc:3055] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:15.898591  8638 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:15.899554  8638 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.900799  8638 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.870240  1560 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
W20260709 13:02:15.871001  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 57586.7us
I20260709 13:02:15.902457  8583 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.871364  8589 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:15.903012  8510 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:15.872426  8599 raft_consensus.cc:2764] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:02:15.876015  1558 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:15.885064  8363 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:15.885558  8418 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:15.885716  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.924755  8602 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.925207  1704 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 19: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:15.925904  8510 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.926092  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.886075  8495 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:15.886693  8511 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:02:15.887127  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 54815.9us
I20260709 13:02:15.811529  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:15.891649  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.928099  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.861325  1633 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:15.860181  1600 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:15.903412  8589 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:15.871588  8588 raft_consensus.cc:3055] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:02:15.929699  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 69612.5us
I20260709 13:02:15.903467  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:15.905028  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.911932  8621 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:15.852276  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:15.912425  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 160205us
I20260709 13:02:15.914813  1700 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:15.917358  1627 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:15.936439  1557 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:15.896293  8637 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.933471  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:15.941558  1558 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:02:15.934391  2266 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:15.928740  2268 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
W20260709 13:02:15.929265  1708 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 13:02:15.954380  1708 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
W20260709 13:02:15.959883  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 365692us
I20260709 13:02:15.961140  1702 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:02:15.966547  1551 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:15.972245  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.972898  1700 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 13.
I20260709 13:02:15.973937  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:15.975364  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.932242  8588 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:15.978672  1704 raft_consensus.cc:2393] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:15.979039  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:15.979431  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:15.980103  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.935276  8418 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:15.938329  8617 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:15.975944  1560 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:15.983314  1558 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
W20260709 13:02:15.989506  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 86451.9us
I20260709 13:02:15.967795  8535 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:15.966006  8192 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.994180  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:15.968638  8377 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:15.975095  8495 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.971721  8511 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:16.000363  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:16.001525  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.980834  8602 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:15.982677  8418 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:16.003454  1704 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:16.011982  1700 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 23: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:02:16.013000  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.988766  8335 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:15.984968  8617 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:16.019762  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:15.994225  8566 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:16.023228  1705 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:16.024385  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:15.983986  8621 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 13:02:16.031584  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 67775.1us
I20260709 13:02:16.027653  1702 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:16.035673  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:15.998450  8604 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 13:02:16.041864  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.038379  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.017398  8634 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.998549  8496 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.027s
I20260709 13:02:16.042493  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.048234  1558 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
W20260709 13:02:16.046423  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 247277us
I20260709 13:02:16.025699  8617 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:16.050518  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44829.1us
I20260709 13:02:16.055341  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:16.011539  8376 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.005486  8192 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.062239  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:16.070686  1551 raft_consensus.cc:2368] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:16.073635  8192 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.074157  8588 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:15.988451  8589 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:16.084163  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.056566  8551 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:16.029904  8495 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.088855  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.102053  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.063704  8569 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:16.050348  8634 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.130790  8634 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.132580  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.133356  1554 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:16.064518  8070 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:16.102916  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:16.102816  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.106492  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 48958.5us
I20260709 13:02:16.109018  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.135742  1558 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:16.113091  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:16.115821  8499 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:16.075395  8418 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.118927  1556 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:16.122308  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 71572.1us
I20260709 13:02:16.123045  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:16.123694  8637 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.063256  8511 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.124662  8679 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:16.090613  8551 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:16.158152  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:16.159452  1705 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:16.128159  8495 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:16.139297  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.155822  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:16.161113  1558 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 22: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:16.160991  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:16.161839  1702 raft_consensus.cc:2393] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:16.163902  1701 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:16.137326  8588 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:16.137624  8569 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.150322  8334 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:16.150148  8377 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:16.166837  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:16.167646  1555 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:16.154405  7940 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:16.174448  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.189853  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:16.164047  8551 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:16.155427  8679 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:02:16.175076  8678 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:16.190943  8569 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.211500  8376 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.213388  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:16.163403  8070 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:16.201181  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:16.217805  1704 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:16.219466  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:16.221170  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.169055  8334 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.269134  8334 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:16.174305  8618 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:16.271442  8618 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:16.272367  8618 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:16.273666  8618 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:16.175248  8602 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:16.274899  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 55526us
I20260709 13:02:16.274624  8070 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.179440  8589 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:16.177618  7940 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:16.215776  8512 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:02:16.241137  8363 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:16.217514  7950 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:16.247570  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46468.6us
I20260709 13:02:16.297633  1560 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:16.248194  8484 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:16.250257  8496 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:16.251588  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:16.251894  8604 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.252310  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:16.316148  1635 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:16.252524  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:16.316561  1634 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:16.256172  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:16.262748  8684 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:02:16.267520  8371 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:16.217988  8495 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:16.303112  8583 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:16.279102  1557 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:16.224258  1558 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:16.203614  8377 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:16.296311  2235 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:16.302234  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 189236us
I20260709 13:02:16.304028  1552 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:16.298133  1526 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.239172  8416 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.305716  1555 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:02:16.283339  8418 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:16.316949  1633 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:16.303354  7950 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:16.305366  8499 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:02:16.346526  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 62695.7us
W20260709 13:02:16.348785  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 50813.7us
I20260709 13:02:16.352051  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:16.346884  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:02:16.319682  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63579.7us
I20260709 13:02:16.319034  8604 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:16.319355  8496 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.353804   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:16.391564  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:16.487129  1601 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:16.402496  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:16.386245  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 172929us
W20260709 13:02:16.416247  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 61816.3us
W20260709 13:02:16.440610  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 89608.8us
I20260709 13:02:16.531831  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:16.365137  1635 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:16.530602  1633 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
W20260709 13:02:16.483449  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 124187us
I20260709 13:02:16.533129  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:16.340593  8687 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:16.350502  7950 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:16.317910  8404 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.350207  8499 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:16.542376  2235 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:16.543612  8512 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:16.352748  8371 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:16.544308  8404 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:16.550658  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63616.8us
I20260709 13:02:16.402712  8637 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:16.389019  8688 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:02:16.353494  8511 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:02:16.555675  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 400079us
I20260709 13:02:16.314311  8617 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.552850  2234 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:16.544927  8693 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:16.560331  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.355499  8320 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.206s
I20260709 13:02:16.558133  8634 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:16.587908  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:16.589294  1526 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:16.352171  8640 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.198s
I20260709 13:02:16.561620  8694 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:16.402458  8583 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:16.562541  8604 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:16.358764  8495 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:16.564252  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:16.392066  7940 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.401149  8569 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:16.486287  8682 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:16.351429  8484 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:16.562546  8499 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.350481  8416 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.364039  8531 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.193s
I20260709 13:02:16.568672  1707 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:02:16.570345  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.575241  1704 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:16.575601  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:16.576109  1705 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:16.511942  1458 catalog_manager.cc:5697] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 12 to 17, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:16.637730  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:16.593515  8602 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:16.493079  8503 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.413502  8363 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:16.583063  1701 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:16.584388  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.500139  8192 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:02:16.493547  8535 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:02:16.574452  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:16.362865  8631 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.219s
I20260709 13:02:16.590781  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:16.516049  8334 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.574589  8576 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.577162  8496 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.593676  8376 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:16.601416  8466 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:16.649499  8602 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.568274  8566 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:16.611043  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 219558us
I20260709 13:02:16.614656  8512 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:16.390407  8377 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:16.626200  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.578317  8551 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.641215  1709 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
W20260709 13:02:16.683689  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 92978.1us
W20260709 13:02:16.681891  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 129129us
I20260709 13:02:16.566264  2235 leader_election.cc:400] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:16.599752  8495 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.593747  8335 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:16.654570  1703 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:16.689489  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:16.664875  8701 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:16.665385  1453 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35556 (request call id 321) took 30732 ms (client timeout 15000 ms). Trace:
I20260709 13:02:16.667289  8404 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:16.668334  8696 log.cc:927] Time spent T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:02:16.670325  8576 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.607954  8371 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:16.602391  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 71128.3us
I20260709 13:02:16.680964  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.683887  8499 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:16.662771  8192 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:16.673955  8334 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.655475  8687 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:16.738396  8687 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.707067  8363 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:16.614104  7940 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.690555  1458 catalog_manager.cc:5697] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 18, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:16.743978  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.743462  1458 catalog_manager.cc:5697] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 15, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:16.703529  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.701792  8495 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:16.645262  8484 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:16.747757  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:16.747622  8484 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:16.748337  2268 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:16.652611  8503 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:16.707487  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:16.751792  8679 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.691685  2235 leader_election.cc:403] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:02:16.754182  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 189349us
I20260709 13:02:16.753571  8512 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.754922  2235 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:16.756984  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:16.757794  8569 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:16.758011  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:16.760905  8416 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:16.704291  1453 rpcz_store.cc:269] 0709 13:01:45.910715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.910943 (+   228us) service_pool.cc:224] Handling call
0709 13:02:16.615274 (+30704331us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:12.930222 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:12.930750 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:12.930786 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:02:12.930803 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:12.932260 (+  1457us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:12.932338 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:12.943996 (+ 11658us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:02:13.017983 (+ 73987us) tablet.cc:701] Row locks acquired
0709 13:02:13.018004 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:02:13.018169 (+   165us) write_op.cc:270] Start()
0709 13:02:13.018287 (+   118us) write_op.cc:276] Timestamp: P: 1783602133018119 usec, L: 0
0709 13:02:13.018308 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:02:13.018949 (+   641us) log.cc:844] Serialized 6051 byte log entry
0709 13:02:13.920675 (+901726us) op_driver.cc:464] REPLICATION: finished
0709 13:02:14.571330 (+650655us) write_op.cc:301] APPLY: starting
0709 13:02:14.571422 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:14.935144 (+363722us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:14.960455 (+ 25311us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:15.502656 (+542201us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:15.503066 (+   410us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:02:15.503142 (+    76us) write_op.cc:312] APPLY: finished
0709 13:02:15.503753 (+   611us) log.cc:844] Serialized 139 byte log entry
0709 13:02:15.602362 (+ 98609us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:15.602711 (+   349us) write_op.cc:454] Released schema lock
0709 13:02:15.602812 (+   101us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:15.779622 (+176810us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:15.786609 (+  6987us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9442,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":632230,"apply.run_cpu_time_us":39394,"apply.run_wall_time_us":1147440,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66797,"num_ops":15,"prepare.queue_time_us":183322,"prepare.run_cpu_time_us":34625,"prepare.run_wall_time_us":197908,"raft.queue_time_us":228424,"raft.run_cpu_time_us":24657,"raft.run_wall_time_us":672745,"replication_time_us":859933,"thread_start_us":954547,"threads_started":5,"wal-append.queue_time_us":393589,"wal-append.run_cpu_time_us":76048,"wal-append.run_wall_time_us":2395428}]]}
I20260709 13:02:16.647864  8682 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.782482  8682 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.780876  2268 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:16.784852  8070 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:16.785408  8070 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.786388  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.786794  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:16.787408  2270 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:16.788188  8070 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:16.788267  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:16.789202  1701 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 17: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:16.790315  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:16.791491  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:16.792167  1709 raft_consensus.cc:2368] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:16.791882  8495 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.719352  8404 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:16.793181  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:16.793756  2264 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:16.719832  8418 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:16.795091  8706 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:16.795346  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:16.796082  1704 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:16.713979  8192 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:16.797360  8192 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.798523  8192 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:16.799254  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:16.723440  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.803423  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:16.804775  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:16.804932  2264 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:16.721597  8576 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.679284  8694 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:16.806803  8694 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:16.808851  8694 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:16.735991  8604 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:16.809415  8604 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:16.809484  8589 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:16.754465  8703 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:16.810396  8682 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:16.810789  8682 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:16.810520  8604 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:16.756806  1627 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:16.730937  8551 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.754947  8363 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:16.701835  8510 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:16.705541  8566 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:16.809852  2270 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:16.770706  8687 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.771322  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:16.745455  1458 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:16.772039  8371 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:16.772349  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:16.814612  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:16.816864  2269 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:16.773221  8617 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.774482  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:16.811277  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:16.773907  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:16.775354  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:16.774519  2265 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:02:16.684979  8602 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:16.778990  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:16.779527  7940 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:16.780447  8503 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:16.714478  1551 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:16.811643  8682 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.786361  8334 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:16.850198  8682 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:16.850952  1559 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:16.756453  1633 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:16.709725  8583 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.852005  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.853058  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.853554  1559 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:16.674188  8704 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:16.854643  8704 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.854487  1458 catalog_manager.cc:5697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:16.841572  8363 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:16.855086  8704 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:16.795490  8706 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:16.856076  8363 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:16.857160  8706 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.822587  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:16.820336  1635 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:16.837447  2262 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 14.
I20260709 13:02:16.753572  8679 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:16.849227  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.850646  8334 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:16.870169  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 220780us
I20260709 13:02:16.817148  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.854861  8687 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:16.810056  8495 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:16.805855  7950 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:16.841917  8376 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:16.842917  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.880795  1553 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:02:16.734808  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 96778.6us
I20260709 13:02:16.856249  1458 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 15, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:16.847847  1558 raft_consensus.cc:2368] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:16.847013  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:16.865129  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.814182  8566 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:16.868443  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:16.817121  1626 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:16.871145  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 54072.9us
I20260709 13:02:16.876303  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:16.877496  2268 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 17. (term mismatch)
I20260709 13:02:16.884878  1707 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:16.881619  1526 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.879076  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:16.885123  2268 pending_rounds.cc:85] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 16
I20260709 13:02:16.886989  2268 pending_rounds.cc:107] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 18.17
I20260709 13:02:16.887288  2268 raft_consensus.cc:2889] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:16.878316  1709 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:02:16.878924  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:16.888657  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:16.889063  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:16.889209  1703 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:16.889370  2270 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
W20260709 13:02:16.889501  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 67005us
I20260709 13:02:16.890288  1673 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:16.891170  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:16.886237  8694 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:16.885665  8706 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:16.893441  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:16.892998  1458 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 10 to 12, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:16.863894  8503 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:16.896236  1555 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:16.905985  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:16.906388  2266 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 22: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:16.906651  1709 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:16.900885  2265 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:16.901675  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:16.867805  8418 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:16.901989  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:16.907366  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.907547  2269 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:16.904040  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:16.908504  2271 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:16.903980  1554 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:16.904886  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:16.909297  1704 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:02:16.905694  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:16.897516  2235 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.902853  1701 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:16.910594  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:16.911510  1704 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 23: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:16.911579  7940 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:16.911996  7940 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.912313  7940 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:16.913448  1674 leader_election.cc:400] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:16.913877  1674 leader_election.cc:403] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:02:16.904649  1600 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.915300  1707 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 22: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:16.916245  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:16.917461  8418 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.918232  7950 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:16.901685  8320 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:16.919425  2270 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:02:16.895567  8576 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:16.919881  8418 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:16.920166  8576 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.920609  8576 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:16.884881  8416 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:16.922686  8503 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:16.924738  8503 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:16.895434  8621 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.925769  1458 catalog_manager.cc:5697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 11 to 15, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:16.926764  8621 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:16.927265  1458 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 10 to 16, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:16.929062  8621 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.905463  8335 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:16.933015  1709 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:16.934425  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:16.935622  8693 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:16.937515  8334 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:16.938653  1633 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:16.944206  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 59798.9us
I20260709 13:02:16.945019  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.886376  8618 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:16.946951  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:02:16.957448  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45338.1us
I20260709 13:02:16.958647  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:16.929303  1458 catalog_manager.cc:5697] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 13 to 14, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 14 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:16.948729  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46461.3us
I20260709 13:02:16.962110  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:16.961239  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:16.968250  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:16.977468  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:16.954869  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:16.957144  1558 raft_consensus.cc:2376] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19. Re-sending same reply.
I20260709 13:02:16.991355  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:16.992785  1673 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:16.995173  1700 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:16.995270  1458 catalog_manager.cc:5697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:16.908097  8566 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:16.998394  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:17.001395  1703 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:16.997643  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:16.914535  8694 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:17.008018  1458 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 16 to 17, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:17.005635  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:17.006466  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:16.965926  8551 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:16.978838  8416 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
W20260709 13:02:17.014271  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 53097.7us
I20260709 13:02:17.015324  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:16.998155  8418 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:16.966495  8320 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:16.957440  8335 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:17.010133  1558 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 21: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:16.977342  8404 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:16.977478  8334 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:17.017287  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:16.967409  8693 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:02:17.020184  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:17.024173  1559 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:02:17.026283  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.020694  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:17.011642  8466 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:17.030102  1551 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:17.015543  1458 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:17.030848  2236 leader_election.cc:400] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:17.036098  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:17.010449  8510 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:17.040274  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 49003us
I20260709 13:02:17.028321  7940 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.011372  8551 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:16.978588  8618 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.045260  2236 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:17.059701  1601 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:17.045802  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:17.046892  1673 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:17.019523  8566 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.027096  8495 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:17.019165  8320 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.066722  1601 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:17.074227  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:17.074841  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:17.075198  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:17.003583  7950 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:02:17.035437  8617 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:17.078989  1633 raft_consensus.cc:2393] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 23: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:17.082357  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:17.083489  1558 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:17.042759  8466 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.085537  1552 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 22. Current term is 23. Ops: []
W20260709 13:02:17.089504  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.092818  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:17.019150  8682 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:02:17.093468  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:17.065807  8551 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:17.107851  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:17.036800  8621 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:02:17.109347  1458 catalog_manager.cc:5697] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 10 to 15, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:17.113603  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:17.084225  8320 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.046444  8503 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:02:17.117038  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:17.139810  8363 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:17.108816  8511 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:17.140589  8363 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:17.141953  1631 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:17.142958  1458 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:17.042222  8634 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.052s
I20260709 13:02:17.144723  8377 raft_consensus.cc:3055] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:17.145066  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:17.145275  8377 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:17.079557  8531 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:17.145874  8531 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.146318  8531 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.148466  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:17.117449  1703 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:17.143007  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:17.149986  1633 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:02:17.156227  1633 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:02:17.157094  8377 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.162972  1635 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:17.144788  1458 catalog_manager.cc:5697] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 17, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:17.125221  1673 connection.cc:256] RPC call timeout handler was delayed by -1.8705257599999641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 13:02:17.106458  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:17.126300  2267 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:17.164460  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:17.096323  8466 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:17.084744  8617 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.086242  8535 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:17.084499  8589 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:17.127151  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:17.197134  2268 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:17.104861  8376 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:02:17.195253  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:17.130141  1627 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:02:17.131868  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:17.138311  8335 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:17.202322  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 146476us
I20260709 13:02:17.104777  8693 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:17.116736  8701 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:02:17.143872  8602 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.096269  8510 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 13:02:17.164693  1673 connection.cc:256] RPC call timeout handler was delayed by -1.8165257599999904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
I20260709 13:02:17.171501  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:17.096216  8583 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:17.194700  8334 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:17.176143  1700 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:17.170212  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:17.162773  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:17.249763  2266 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
W20260709 13:02:17.249994  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 79910us
I20260709 13:02:17.179209  8709 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:17.179715  8707 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:17.263048  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:17.180044  2263 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:17.183874  8531 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:17.184779  1458 catalog_manager.cc:5697] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 17, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:17.187584  8535 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 23 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:17.179057  8705 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:17.193466  8710 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:02:17.204452  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:17.080951  8566 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:17.206734  7940 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:17.207549  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.128542  8694 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.272779  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:17.220942  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:17.200232  8708 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:17.177635  8617 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:17.240551  1626 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:17.106604  8680 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.295s
I20260709 13:02:17.194973  8589 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:17.243314  1673 connection.cc:256] RPC call timeout handler was delayed by -1.815625759999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
I20260709 13:02:17.299547  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:17.247893  1630 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:17.205087  8532 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:17.179004  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:17.248298  8499 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:17.257189  1555 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:17.175773  1628 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:17.267400  8634 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:17.268425  1701 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:17.305845  1701 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:17.261159  8704 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.212121  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:17.212834  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:17.319962  1709 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.294118  2268 raft_consensus.cc:2368] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:17.320878  1634 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:17.296140  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:17.300046  1673 connection.cc:256] RPC call timeout handler was delayed by -1.8003257599999642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 13:02:17.270933  8705 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.303072  2271 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:17.305096  8499 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:17.305683  1458 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 16, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:17.309590  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:17.310174  8720 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:17.267099  8583 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:17.341190  2262 raft_consensus.cc:2368] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:17.315730  1701 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.268200  8682 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:17.294050  1560 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:17.321650  1673 connection.cc:256] RPC call timeout handler was delayed by -1.7004257599999733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260709 13:02:17.350322  1673 connection.cc:256] RPC call timeout handler was delayed by -1.6716257599999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
I20260709 13:02:17.263185  8701 consensus_queue.cc:1243] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 4f1725fe36e349ac85405627f9c93d95 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:02:17.328322  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 116282us
I20260709 13:02:17.302414  8589 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.330015  1708 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 13: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:17.330430  1706 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:17.270393  8679 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:02:17.267201  8503 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:17.336295  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 223530us
W20260709 13:02:17.350672  1673 connection.cc:256] RPC call timeout handler was delayed by -1.6554257599999573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
I20260709 13:02:17.350461  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:17.349793  8682 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:17.362823  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:17.363066  1701 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.378686  1524 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:17.380095  1599 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:17.381407  1709 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:17.331295  8621 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:17.387496  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44951.6us
I20260709 13:02:17.388370  1458 catalog_manager.cc:5697] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:17.390578  2266 raft_consensus.cc:2410] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 20 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 15.
I20260709 13:02:17.307772  8718 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:02:17.331640  8705 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:17.377231  8371 consensus_meta.cc:287] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.537s	user 0.001s	sys 0.010s
I20260709 13:02:17.406615  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:17.447459  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 245285us
I20260709 13:02:17.341935  8500 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.341470  8703 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.465926  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:17.468739  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:17.376979  8618 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:17.472661  1701 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:02:17.390103  8682 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.473760  1701 pending_rounds.cc:85] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 14
I20260709 13:02:17.475893  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:17.479415  1701 pending_rounds.cc:107] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:02:17.480688  1701 raft_consensus.cc:2889] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:17.483004  1708 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
W20260709 13:02:17.466723  8731 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:02:17.485986  2266 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 22: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:02:17.497103  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 90611.7us
I20260709 13:02:17.506969  1458 catalog_manager.cc:5697] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 11 to 17, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:17.511637  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 133056us
I20260709 13:02:17.377414  8720 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:17.335137  8334 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.515481  1458 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 12 to 15, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:17.490502  8576 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.569s	user 0.005s	sys 0.005s
I20260709 13:02:17.513497  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:17.519246  2266 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:02:17.539709  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 77393.2us
I20260709 13:02:17.487202  8496 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:17.541134  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:17.447062  8503 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.391986  8535 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:17.509778  8416 raft_consensus.cc:2764] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:02:17.581974  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:17.567741  1458 catalog_manager.cc:5697] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:17.473563  8500 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:17.510859  8726 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:17.517756  8679 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:17.590984  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49986.2us
I20260709 13:02:17.599598  1524 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:17.573416  8711 log.cc:927] Time spent T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:17.605123  2266 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:02:17.544486  8602 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:17.606691  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:17.483955  8703 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.609081  2266 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:17.608693  1458 catalog_manager.cc:5697] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 17, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:17.605654  8726 raft_consensus.cc:697] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:17.613804  8726 consensus_queue.cc:237] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:17.520174  8484 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
W20260709 13:02:17.618932  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 158937us
I20260709 13:02:17.581677  8496 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.500277  8499 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.514101  8583 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:17.622419  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:17.579955  8701 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:02:17.626199  1708 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:17.542805  8576 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.627058  1458 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 12 to 17, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:17.605330  8740 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:17.630718  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.610898  8718 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:17.611392  8566 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:17.622586  8496 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:17.607043  8679 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:17.643159  1707 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:17.636611  8704 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:17.666662  1708 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:02:17.668437  8466 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:17.669709  8735 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:02:17.690907  8730 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:17.691359  8723 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:17.691747  8728 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:02:17.691769  8576 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:17.698325  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 67102.4us
I20260709 13:02:17.700357  8634 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:17.703195  8727 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:17.706918  8416 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.707543  8466 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:17.709672  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:17.710858  8418 consensus_meta.cc:287] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.000s
I20260709 13:02:17.712323  2266 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 15.
I20260709 13:02:17.716058  8617 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:17.748013  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 368070us
I20260709 13:02:17.719489  8730 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:17.746344  8416 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:17.744997  8706 consensus_meta.cc:287] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.832s	user 0.008s	sys 0.003s
W20260709 13:02:17.761368  8725 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:02:17.767131  1560 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:17.744772  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:17.772796  1629 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
W20260709 13:02:17.760521  8320 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.626s	user 0.007s	sys 0.002s
W20260709 13:02:17.744014  8551 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.000s
I20260709 13:02:17.737061  8747 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:17.770895  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.771598  8618 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.800405  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:17.801223  1552 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:17.792117  8466 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:02:17.792593  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.795250  8617 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:17.784206  8589 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.814752  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:17.815953  1628 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:02:17.797719  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.769295  8418 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:17.790506  1630 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:17.818887  2235 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:17.807495  1633 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:17.770188  8730 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.823719  1627 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:17.824007  2269 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:17.807570  8618 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:17.827687  1635 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:17.834306  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:17.826681  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:17.806228  8703 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:17.798700  8320 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:17.817312  8416 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:17.846642  8679 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:17.849048  8500 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:17.846712  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:17.853127  1556 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
W20260709 13:02:17.857309  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 112630us
I20260709 13:02:17.798871  8551 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:17.826274  8706 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:17.866513  1631 raft_consensus.cc:2368] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18.
I20260709 13:02:17.832156  8618 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:17.869732  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:17.869278  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:17.890421  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:17.892781  1703 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:17.860960  8500 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.861583  8706 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.805466  8747 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.877213  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:02:17.902000  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.905194  1553 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:17.896165  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:17.932497  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 64201.1us
I20260709 13:02:17.936415  2270 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:17.832965  8705 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.860874  8484 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:02:17.956132  8589 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:17.956408  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:17.957374  1558 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:17.958320  8739 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:17.958787  8739 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:17.960668  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1334) took 1001 ms. Trace:
I20260709 13:02:17.961079  1707 rpcz_store.cc:276] 0709 13:02:16.959646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.963706 (+  4060us) service_pool.cc:224] Handling call
0709 13:02:16.963962 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.646803 (+682841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.953931 (+307128us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54001def54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:17.960609 (+  6678us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561430784}
I20260709 13:02:17.963304  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:17.941748  1553 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:17.944087  8418 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:17.944661  8503 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:17.945729  8531 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:17.953090  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1551) took 1180 ms. Trace:
I20260709 13:02:17.932066  8706 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.972904  8418 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.983512  8496 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.971815  8718 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:17.984637  8730 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:17.985522  8418 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:17.986963  1554 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:02:17.987082  8730 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:17.987563  8747 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:17.895620  8723 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.076s
I20260709 13:02:17.988481  8551 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:17.991195  8705 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:17.991469  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:17.987604  2263 raft_consensus.cc:2393] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:02:17.993191  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 54597.2us
I20260709 13:02:17.936326  8416 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:17.980756  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:17.973973  2267 rpcz_store.cc:276] 0709 13:02:16.772932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.773047 (+   115us) service_pool.cc:224] Handling call
0709 13:02:16.773336 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.177032 (+403696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.952831 (+775799us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400566b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:17.952999 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617309440}
I20260709 13:02:17.979270  8320 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:17.983371  8727 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:17.944650  8758 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.135s
I20260709 13:02:17.985867  8496 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:18.023232  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.023970  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.024641  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:18.018574  1553 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.932377  8500 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:18.029378  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.100714  1708 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:02:18.065394  2236 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:18.065922  1701 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:18.105365  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7e99891af85f4b10aa1cc2da6aa33082 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:18.065182  8418 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:18.109614  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44308.3us
I20260709 13:02:18.110767  8727 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:18.111346  8727 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:02:18.114557  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.106612  8418 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.117614  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:18.119814  2266 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:18.120509  1707 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:18.121413  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:18.123445  8760 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:02:18.123943  8418 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:17.970878  8739 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:18.119381  8495 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
W20260709 13:02:18.125602  8757 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:18.126060  8495 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:18.126462  8495 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:18.127261  8495 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.128449  8495 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:18.124544  8750 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:02:18.121996  2267 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 13.
I20260709 13:02:18.136665  1599 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:18.141971  1553 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:18.143584  1701 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:18.145401  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:18.145431  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.148530  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:18.149148  1708 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:18.144876  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:18.117424  8703 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:02:18.142700  8531 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:18.162459  8531 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:18.163054  8531 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:18.166126  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:18.166917  1553 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
W20260709 13:02:18.171443  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 311336us
W20260709 13:02:18.146847  8682 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.660s	user 0.005s	sys 0.006s
I20260709 13:02:18.155287  8748 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:18.156035  8500 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:18.160615  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 1358) took 1204 ms. Trace:
W20260709 13:02:18.180768  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.153986  2266 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:18.176573  1708 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:18.177954  8363 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.177188  2236 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:18.180212  1555 rpcz_store.cc:276] 0709 13:02:16.953494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.013014 (+ 59520us) service_pool.cc:224] Handling call
0709 13:02:18.157849 (+1144835us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54001ff9d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:18.157989 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486741248}
I20260709 13:02:18.172511  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:18.187003  2236 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:02:18.187541  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.189695  8719 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:18.189795  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:18.190200  8719 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:18.191037  8719 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:18.191994  8758 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:18.192525  8758 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:18.192914  2266 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:02:18.193410  8758 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.197481  8363 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:18.199681  8363 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:18.200423  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:18.201025  1635 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:18.204002  8512 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:18.204552  8512 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:18.205400  8512 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.180426  8748 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.210848  8748 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.213539  8499 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:18.215068  8739 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:18.217008  8741 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:18.217692  8745 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:18.218603  8741 raft_consensus.cc:3055] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:18.218973  8741 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:18.219859  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2838) took 1053 ms. Trace:
I20260709 13:02:18.219782  8741 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.220319  1703 rpcz_store.cc:276] 0709 13:02:17.166370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.166807 (+   437us) service_pool.cc:224] Handling call
0709 13:02:17.167051 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.893412 (+726361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.219621 (+326209us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b54001ab8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:18.219801 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668721920}
I20260709 13:02:18.221963  1635 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:18.222666  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1421) took 1036 ms. Trace:
I20260709 13:02:18.223024  2269 rpcz_store.cc:276] 0709 13:02:17.186319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.709385 (+523066us) service_pool.cc:224] Handling call
0709 13:02:18.222513 (+513128us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b540005ee54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:18.222614 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66569984}
I20260709 13:02:18.224828  8720 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:18.228511  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1411) took 1357 ms. Trace:
I20260709 13:02:18.228921  2262 rpcz_store.cc:276] 0709 13:02:16.870769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.878686 (+  7917us) service_pool.cc:224] Handling call
0709 13:02:18.228296 (+1349610us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540039d854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:18.228429 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029319424}
I20260709 13:02:18.235069  8377 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:18.237949  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1417) took 1126 ms. Trace:
I20260709 13:02:18.238181  8741 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:18.238516  2270 rpcz_store.cc:276] 0709 13:02:17.111397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.111739 (+   342us) service_pool.cc:224] Handling call
0709 13:02:18.237753 (+1126014us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b540063f954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:18.237878 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1554136832}
W20260709 13:02:18.239969  1634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2882) took 1483 ms (client timeout 1656 ms). Trace:
W20260709 13:02:18.240494  1634 rpcz_store.cc:269] 0709 13:02:16.756194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.756737 (+   543us) service_pool.cc:224] Handling call
0709 13:02:18.239770 (+1483033us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b540007f3d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:18.239897 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018178944}
I20260709 13:02:18.243628  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.139245  8727 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.246361  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.245832  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:18.249014  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2724) took 1106 ms. Trace:
I20260709 13:02:18.249423  1631 rpcz_store.cc:276] 0709 13:02:17.142470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.142746 (+   276us) service_pool.cc:224] Handling call
0709 13:02:18.248830 (+1106084us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b540034dfd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:18.248959 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630419840}
I20260709 13:02:18.253012  8693 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:18.253496  8693 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:18.254408  8693 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.255447  8604 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:18.255627  8706 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.256376  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.256970  1709 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:18.183310  8682 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.259859  8682 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:18.266855  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:18.266741  8599 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:18.270675  8719 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:18.276889  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.278015  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:18.278839  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 91901.2us
I20260709 13:02:18.279204  1632 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:18.283146  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:18.283517  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:18.284267  2266 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:18.255784  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.280246  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:18.286346  1700 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:18.300657  1703 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21. Ops: []
W20260709 13:02:18.304785  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.306939  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:18.307788  2264 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
W20260709 13:02:18.300902  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 90699.2us
I20260709 13:02:18.312005  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:18.320147  1599 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:18.320859  1628 raft_consensus.cc:1240] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:18.323427  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 296766us
I20260709 13:02:18.324956  2266 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:18.325507  1709 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:02:18.322365  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:18.327296  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:18.325317  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.328642  1704 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:18.330165  2235 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.331913  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:18.332489  1707 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:18.333767  1634 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:02:18.335583  1704 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:18.301033  8703 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:18.336622  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:18.341233  1631 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:02:18.337028  1709 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:18.337265  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:18.342381  1627 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:18.342494  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.337340  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:18.300858  8694 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:18.368111  8694 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.368722  8694 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:18.338282  1626 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:18.340399  8738 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:18.345108  8583 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.005s
I20260709 13:02:18.324028  8723 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:18.345691  1632 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2887) took 1570 ms (client timeout 1754 ms). Trace:
I20260709 13:02:18.346410  8736 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:18.347386  8706 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:18.347772  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.327093  8599 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:02:18.351161  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.352239  8729 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:18.352770  8748 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:18.388904  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 68861.2us
I20260709 13:02:18.388741  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:18.353183  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:18.338557  7950 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:18.354049  8728 consensus_queue.cc:1059] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:18.354452  8693 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:18.362612  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.372845  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:18.400700  1703 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:02:18.379249  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 69437us
I20260709 13:02:18.381769  1709 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:02:18.382200  1632 rpcz_store.cc:269] 0709 13:02:16.774789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.775145 (+   356us) service_pool.cc:224] Handling call
0709 13:02:18.345533 (+1570388us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400088ed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:18.345634 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3288913152}
I20260709 13:02:18.340801  8499 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:18.383845  1701 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:02:18.384649  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.369696  8531 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.384990  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:18.403514  1555 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:18.398016  1556 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21. Ops: []
W20260709 13:02:18.400679  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 47575.1us
I20260709 13:02:18.343123  1704 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:18.399530  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:18.415246  1702 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:18.415457  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 51547.4us
I20260709 13:02:18.417939  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:18.418280  1626 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:18.418663  1560 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:18.421787  1673 leader_election.cc:400] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:18.423156  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.383472  8703 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:18.429734  1554 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:02:18.380887  8707 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:18.431802  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.379702  8510 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:02:18.437173  1555 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:18.436250  1629 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 13.
I20260709 13:02:18.392268  8723 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.442202  8765 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:18.442888  8723 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:18.425079  8631 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.443673  8631 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.414973  8618 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:02:18.448782  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 55566.3us
I20260709 13:02:18.451715  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:18.384377  8363 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:02:18.428434  8551 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:18.453135  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 51650.4us
I20260709 13:02:18.449482  1599 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:18.459362  1600 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.455499  1703 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:18.427626  8495 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:18.424175  7950 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:18.453929  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.424403  8729 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:18.457381  1673 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.447589  8738 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:18.474927  2266 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:02:18.465539  1600 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:18.449159  8618 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.490818  1601 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.471302  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.458703  8751 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:18.473001  1524 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:18.429405  8576 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:02:18.487879  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:18.497329  2269 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:18.459585  8583 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:18.436662  8726 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:02:18.506745  8718 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:18.508965  8712 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.487789  8599 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:18.510226  8416 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:18.488003  8604 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:18.510803  8416 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:18.474356  8404 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:18.511801  8416 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.512287  8738 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.514138  8729 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.467381  8588 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:18.518347  8512 raft_consensus.cc:3055] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:18.518779  8512 raft_consensus.cc:740] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:18.496578  8679 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:18.522118  8726 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:18.464870  8371 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:18.523021  8371 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.523425  8371 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:18.525357  8774 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:18.526376  7950 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.528461  8631 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:18.456902  8747 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:02:18.492229  8618 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:18.496843  8751 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:18.534742  8751 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:18.536126  8751 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:18.536314  8703 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.475783  8758 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:02:18.509565  8712 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.541706  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:18.518824  8531 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:18.522375  2235 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:18.488926  2263 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:18.461128  8730 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:02:18.466957  8499 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:02:18.497999  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:18.531453  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:18.532116  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.532822  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:18.542291  1632 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.556233  2269 raft_consensus.cc:2368] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14.
I20260709 13:02:18.556411  2266 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:02:18.543860  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:18.459007  8551 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:18.557142  8551 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:18.498981  8723 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:18.558342  8723 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:18.558929  8363 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:18.559373  8363 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.559264  8723 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:18.554481  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63733.8us
I20260709 13:02:18.562857  1599 leader_election.cc:400] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14.
I20260709 13:02:18.563187  1599 leader_election.cc:403] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:02:18.564014  2266 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:18.559780  8363 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:18.446820  8707 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:18.564064  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:18.567545  1632 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:02:18.518375  8588 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:18.539424  8617 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:18.519757  8512 consensus_queue.cc:260] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.536154  8748 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:18.579270  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:18.548853  8466 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:18.551954  8747 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:18.574446  8589 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:18.588732  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 90810.6us
I20260709 13:02:18.542830  8741 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:02:18.510447  8599 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:18.589504  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:18.548202  8602 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:02:18.583253  8768 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14.
I20260709 13:02:18.590266  8705 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:18.613409  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.576989  8726 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:02:18.601897  8737 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:18.615592  1702 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
W20260709 13:02:18.614288  8772 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:18.603235  8602 consensus_queue.cc:1243] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer 6923294c847b48ebb577e0935d316aa3 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:02:18.581952  8740 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:02:18.603374  8747 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:18.652172  1708 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.646651  8371 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.647449  8705 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:18.650904  8599 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:18.685992  1631 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:18.624967  8737 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:18.707265  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 236047us
I20260709 13:02:18.708227  1673 leader_election.cc:400] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:18.708583  1673 leader_election.cc:403] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:02:18.710661  1707 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:18.711320  1551 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:02:18.665640  8334 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:18.717461  1708 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 14.
I20260709 13:02:18.686775  8682 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.694834  8737 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:18.728399  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.710003  8707 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:18.721808  8765 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:18.735198  8776 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:02:18.740967  8512 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:18.742372  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:18.763459  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:18.767046  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1365) took 1110 ms. Trace:
I20260709 13:02:18.725210  8736 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:18.767443  1551 rpcz_store.cc:276] 0709 13:02:17.635213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.636046 (+   833us) service_pool.cc:224] Handling call
0709 13:02:17.636460 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.711684 (+1075224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.744541 (+ 32857us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400182254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:18.744726 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2471459584}
I20260709 13:02:18.707805  8588 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.720441  8334 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.783097  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:18.787369  2263 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:18.726281  8682 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.792999  8682 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:18.770403  8780 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:02:18.794447  1554 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:18.795964  8712 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:18.799952  8740 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.800618  8719 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:18.801085  8719 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:18.802064  8719 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:18.803458  8719 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:18.804033  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:18.805181  1556 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 21: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:18.806365  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:18.807169  2268 raft_consensus.cc:2410] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:02:18.807665  8335 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:18.785668  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:18.819949  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.822726  2262 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:02:18.825076  8371 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:18.825289  2264 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:02:18.827332  2268 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260709 13:02:18.827749  8334 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:18.828137  8787 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:02:18.829348  2269 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:18.732666  8747 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.831629  8551 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.745079  8705 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.833112  1703 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:18.841601  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:18.808386  8335 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:18.847100  8784 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.840415  8617 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:18.847980  8589 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:18.800673  8740 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:18.844563  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 269501us
I20260709 13:02:18.863821  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:18.864152  1601 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.785058  8416 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:18.852770  1704 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:18.822916  8583 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
W20260709 13:02:18.854436  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.854580  8730 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:18.855372  8634 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.822564  8736 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
W20260709 13:02:18.857662  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 268239us
I20260709 13:02:18.857709  8709 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:18.862663  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.866410  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:18.840229  8781 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.892617  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:18.894270  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:18.895861  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:18.904745  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:18.908166  1553 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
W20260709 13:02:18.906139  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.864895  8589 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:18.897665  8788 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:02:18.949174  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 86813.4us
I20260709 13:02:18.968003  2263 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:18.969651  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:18.898180  8576 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:18.913049  8682 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:18.898491  8709 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.000881  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:18.989087  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:18.989971  8755 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.993659  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:18.996374  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:18.898676  8416 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:18.987558  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:19.008423  1628 raft_consensus.cc:2393] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:18.913385  8371 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.860070  8618 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.008839  2263 pending_rounds.cc:85] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 13
I20260709 13:02:18.997852  8679 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.003821  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:19.005519  1633 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:18.894923  8748 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:02:19.001653  1632 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:19.009205  2263 pending_rounds.cc:107] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:02:19.015920  2263 raft_consensus.cc:2889] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:18.898550  8730 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.867725  8784 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.022511  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:18.898779  8693 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 13:02:18.899889  8634 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:18.919586  8781 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.003686  8709 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:19.010434  8793 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.001209  8576 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.035497  8416 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.041913  2264 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:19.047762  8618 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.048956  8363 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.050537  8730 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.041144  8768 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:19.018194  8371 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.018625  8679 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.055095  1632 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:02:19.065652  8583 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:19.056137  8634 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:18.916555  8617 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.059914  1630 raft_consensus.cc:3060] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:19.065232  1634 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:19.066648  1633 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:19.036769  8532 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:19.080974  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:19.010739  8755 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:19.082273  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 129823us
W20260709 13:02:19.072134  8694 consensus_meta.cc:287] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.699s	user 0.004s	sys 0.007s
I20260709 13:02:19.087886  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:19.114410  2269 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:19.093375  8335 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:19.117226  8784 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.117658  8755 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:19.117813  8784 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:02:19.067539  8793 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.120893  8793 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:19.123046  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:19.125384  8794 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:02:19.071295  8707 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:02:19.127418  8765 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:19.101183  8781 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.104609  8737 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.136881  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:19.112370  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:19.115202  1629 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:19.085434  8730 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:19.097224  8589 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.130263  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:19.150749  2269 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:19.109222  2264 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:19.109901  8363 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.146471  1703 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:19.146770  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:19.153087  1705 raft_consensus.cc:2368] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14.
I20260709 13:02:19.147336  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:19.153980  1702 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:19.110491  8768 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.148064  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:19.108651  8532 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.149495  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:19.159650  2265 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:19.147616  1630 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:19.161062  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:19.162710  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 50412.9us
I20260709 13:02:19.163646  1673 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:19.170845  1626 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:19.172461  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:19.172894  1705 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:19.173168  1708 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:02:19.173403  1705 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:19.176785  1705 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.177699  1705 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:19.179148  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:19.180300  1524 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:19.138082  8335 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:19.189159  1700 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 21: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:19.190547  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:19.131110  8740 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.142488  8755 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.201920  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:19.202670  1708 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:19.128579  8694 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.157748  8793 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:19.168470  8532 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:19.155407  8781 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:19.238459  8781 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.223034  8634 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
W20260709 13:02:19.239805  8796 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:02:19.240453  8634 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:19.240828  8781 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:19.241765  8798 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:02:19.242429  8371 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:19.242810  1634 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:19.240859  8634 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:19.205633  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:19.246248  1708 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:02:19.251648  1705 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:02:19.252393  1705 pending_rounds.cc:85] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 12
W20260709 13:02:19.212872  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49337us
I20260709 13:02:19.210515  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:02:19.254971  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44543.8us
I20260709 13:02:19.255368  1673 leader_election.cc:400] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18.
I20260709 13:02:19.255748  1673 leader_election.cc:403] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:19.230705  2269 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:19.256271  1601 leader_election.cc:400] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 13 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 13. Current term is 14.
I20260709 13:02:19.194633  8335 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:19.189577  8583 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:19.233345  8694 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:19.172086  8768 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.176566  8705 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 13:02:19.234457  8576 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:19.174813  8730 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.284307  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:19.152747  8512 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:02:19.253089  8510 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:19.257421  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:19.294569  2269 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:02:19.275496  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:19.296154  1634 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:19.215101  8740 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:19.255916  8797 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:19.253926  1705 pending_rounds.cc:107] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:02:19.291288  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:19.250464  8802 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:19.282594  8588 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:19.208616  8755 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.255565  8793 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:19.279523  8335 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:19.289018  8781 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18.
I20260709 13:02:19.361876  1705 raft_consensus.cc:2889] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:19.295269  8583 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:19.303853  8694 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:19.244575  8634 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.371773  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:19.376300  1634 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:19.293097  8803 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:19.304171  8740 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.298576  8510 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:19.388216  8740 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:19.388360  8510 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:19.399876  1704 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:19.401708  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:19.403357  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:19.287007  8709 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.355625  8588 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:19.379587  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 88394.5us
I20260709 13:02:19.381739  8694 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:19.384299  8793 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.386489  1551 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:19.386919  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:19.387563  8755 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.379247  1629 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:02:19.407601  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:19.414002  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:19.365906  8631 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.425122  1709 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:19.425963  8765 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.426422  8766 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.426735  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:19.426522  8765 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.427002  8766 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.428098  8602 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:19.414634  1700 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:19.366556  8802 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:19.422573  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:19.438431  1627 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: []
W20260709 13:02:19.423723  8777 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:19.410128  8804 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:02:19.413916  8588 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:19.378507  8679 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:19.440678  8416 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:19.447640  8806 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:19.447861  8334 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.428645  8363 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:19.450608  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:19.452961  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:19.454491  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:19.459324  1702 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:19.430410  1673 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:19.440939  8599 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.463932  8576 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:19.463778  8599 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.453464  8416 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:19.465757  8416 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:19.461248  8334 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.468549  8599 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.451471  8634 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:19.428683  8602 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.447706  8765 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:19.480376  1634 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:19.486996  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:19.437530  8631 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.488643  1709 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:19.489439  1700 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:19.489928  1634 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:19.490177   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:19.515990  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:19.516657  1558 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:19.467041  8589 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:19.461515  8737 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:19.462947  8679 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:02:19.492328  8576 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.502722  8334 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:19.503927  8709 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:19.508668  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:19.550992  1551 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:19.509415  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:19.510332  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:19.551820  1555 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 21: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:19.473095  8583 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.475108  8758 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:19.511204  8783 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.741s	user 0.001s	sys 0.003s
I20260709 13:02:19.514217  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:19.691869  1559 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:19.517709  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:19.473733  8766 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.548789  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:19.551891  1552 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
I20260709 13:02:19.686658  8631 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.687829  8730 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.689327  8602 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.690678  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:19.697206  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:19.707854  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:19.712076  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:19.712888  2269 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:19.714071  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:19.714071  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:19.716707  1555 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:19.718010  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:19.724465  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:19.730762  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:19.731599  1634 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:19.548220  8784 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.478125  8694 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.722573  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:19.781006  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 58530.3us
I20260709 13:02:19.782078  1600 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:19.783108  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:02:19.784032  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 52188.6us
I20260709 13:02:19.785413  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:02:19.785626  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 44064us
I20260709 13:02:19.785396  1555 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:19.721577  8730 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:19.796568  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:19.791706  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:19.800376  1634 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:19.807060  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:19.678632  8576 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.782814  8723 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.788262  8709 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:19.785689  8689 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:19.798429  8783 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:02:19.820478  1709 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:19.789103  8617 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:19.511619  8802 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.793386  8803 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:19.798054  8466 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:02:19.824719  1634 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:19.712438  8758 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:19.830524  8805 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.339s	user 0.000s	sys 0.000s
I20260709 13:02:19.831153  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2861) took 1299 ms. Trace:
I20260709 13:02:19.788305  8334 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
W20260709 13:02:19.833606  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.813211  8737 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:19.841493  1701 rpcz_store.cc:276] 0709 13:02:18.531751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.533702 (+  1951us) service_pool.cc:224] Handling call
0709 13:02:18.538377 (+  4675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.538724 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:18.539027 (+   303us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.700111 (+161084us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.709673 (+  9562us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.709820 (+   147us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:18.709852 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.709916 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.790547 (+ 80631us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b1800065020. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2522 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:02:19.109289 (+318742us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b1800065020. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:02:19.473762 (+364473us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:19.830897 (+357135us) raft_consensus.cc:1685] finished
0709 13:02:19.830921 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.831084 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48813,"prepare.queue_time_us":545,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":13940,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":17080,"spinlock_wait_cycles":91226496,"thread_start_us":147935,"threads_started":1,"wal-append.queue_time_us":171656}
I20260709 13:02:19.821827  8709 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.854128  8466 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:02:19.859184  8812 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
W20260709 13:02:19.859741  8779 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 1.171s	user 0.003s	sys 0.010s
I20260709 13:02:19.860096  8758 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.860546  8740 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.863905  8335 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.821106  8723 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.788920  8784 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.870419  8830 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:19.872991  1559 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 24.
I20260709 13:02:19.848366  8766 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:19.813588  8804 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 13:02:19.924669  8804 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:19.925055  8804 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:19.926182  8576 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.925942  8804 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.927260  8804 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:19.832553  8828 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:19.879498  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:19.930420  2269 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:19.930290  8828 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.882824  1551 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:02:19.883152  8334 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.932564  8828 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:19.923007  8532 consensus_meta.cc:287] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.669s	user 0.011s	sys 0.000s
I20260709 13:02:19.933465  8741 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.933667  8532 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.934070  8741 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.886845  1629 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:19.823876  8781 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:02:19.892819  8765 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:19.888770  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:19.894147  1524 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:19.937103  1706 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
W20260709 13:02:19.937597  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 43582.9us
I20260709 13:02:19.923353  8766 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:19.938431  8766 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:19.938472  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:19.939831  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:19.941298  8758 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:19.877246  8737 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:19.942411  8829 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:19.943064  8829 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.942860  8737 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.902254  8466 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:19.941964  8758 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:19.944679  8466 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.944833  8758 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.902976  8709 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:19.946058  8466 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:19.921252  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:19.924327  8830 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:19.943529  8829 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:19.932651  8334 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.853313  8510 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.956391  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:19.832401  8617 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.949498  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:19.950650  1600 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:19.898192  1705 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:19.952394  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:19.959918  1559 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:19.953140  1556 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:19.906591  8827 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:02:19.958335  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:19.968822  8712 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:19.969343  8712 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.969759  8712 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:19.966953  8679 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:19.975875  8679 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:19.977031  8679 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:19.980738  8784 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.982550  8723 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:19.984741  8335 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.986716  8334 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.988307  8740 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.990563  8510 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.953994  8531 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:02:19.991281  8634 consensus_meta.cc:287] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.000s
I20260709 13:02:19.991389  8531 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:19.992669  1559 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 24.
I20260709 13:02:19.955054  8765 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:19.994243  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 201530us
I20260709 13:02:19.959746  8617 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:19.968549  8416 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.003s
I20260709 13:02:19.967437  8828 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:20.002604  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.965179  8532 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:19.975556  8830 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:20.008628  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.010648  1673 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:20.009442  8828 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.011693  8531 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.020565  8784 raft_consensus.cc:2804] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:20.010254  8416 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.034634  8828 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:20.056272  8588 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.001s
I20260709 13:02:20.053857  8510 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.057034  8784 raft_consensus.cc:697] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:02:20.067272  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 103916us
I20260709 13:02:20.077157  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.082904  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.083549  1629 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:20.084407  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:20.086376  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:20.070752  8551 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.087740  1629 raft_consensus.cc:2393] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:20.069340  8510 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.066944  8588 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.119748  1560 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:02:20.120894  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.120465  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.131498  1555 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 24: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:20.125813  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:20.082216  8694 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:02:20.167260  1628 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20. Ops: []
W20260709 13:02:20.164245  8837 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:02:20.162400  8712 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.164996  8617 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.164296  8709 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.300712  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.301144  1556 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:20.131546  8736 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:20.138389  8766 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.138208  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.092772  8842 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:20.304039  8765 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.300065  8827 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:20.345549  1552 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:20.328169  8740 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:20.137187  8829 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:20.413831  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.361734  8839 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:02:20.355398  8551 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:20.367856  8712 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:20.369352  8617 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:20.335021  8736 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:20.370675  8841 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:02:20.358611  8765 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.346673  8842 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.108433  8784 consensus_queue.cc:237] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.377347  8740 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.385000  8510 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:20.390269  8416 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:20.392735  8827 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.397326  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:20.403023  8588 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.380805  8709 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:20.411198  8768 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.411695  8766 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.355026  8404 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:20.427676  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.446446  1631 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:20.428932  8551 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.413585  8583 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:20.435449  8765 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:20.437367  8736 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.443281  1635 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:20.433358  8842 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:20.450012  8466 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:20.454345  8583 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.442598  8712 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.453132  8404 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.459933  8466 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.466573  1635 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:20.470013  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.457681  8804 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.458670  8416 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:20.509514  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:20.511286  1524 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:20.469038  8712 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.522943  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:20.528080  1631 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:20.515197  8723 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:20.517917  8836 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:20.537583  8827 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.539266  8334 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:20.570847  8836 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.571326  8334 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.519255  8766 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:20.558248  8723 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.574540  8766 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:20.519073  8416 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.591524  8766 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.593490  8416 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:20.573995  8836 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:20.575317  8740 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.575492  8709 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:20.551602  8583 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:20.566215  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.596019  8709 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.577788  8712 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.579481  8404 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:20.609985  8828 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.002s
I20260709 13:02:20.610491  8828 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.613807  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2730) took 1747 ms. Trace:
I20260709 13:02:20.614225  1626 rpcz_store.cc:276] 0709 13:02:18.866153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.866276 (+   123us) service_pool.cc:224] Handling call
0709 13:02:18.866596 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.171254 (+304658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.613569 (+1442315us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400355f54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:20.613751 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699304192}
I20260709 13:02:20.580036  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.617641  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2726) took 1757 ms. Trace:
I20260709 13:02:20.618209  1631 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:20.618867  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.619063  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.619494  1632 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:20.580638  8551 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:20.581696  8466 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.578536  8723 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:20.623065  1554 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:20.624534  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.626528  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.626580  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.606281  8709 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.627591  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.607043  8334 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:20.579329  8849 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:20.628086  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.628621  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.629076  1552 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:02:20.601725  8829 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:20.629679  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.630079  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.630362  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.631057  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:02:20.631283  8819 log.cc:927] Time spent T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.808s	user 0.003s	sys 0.003s
I20260709 13:02:20.631043  1552 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:20.633020  8781 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.641443  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:20.679726  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.643601  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:20.681166  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:20.681774  1709 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:20.682564  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:20.644341  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:20.683781  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:20.683897  1526 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:20.684739  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:20.646727  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:20.685577  1704 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:20.647377  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:20.648046  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:20.648900  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:20.686807  1702 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:20.650102  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1577) took 1558 ms. Trace:
I20260709 13:02:20.687657  2270 rpcz_store.cc:276] 0709 13:02:19.091384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.091515 (+   131us) service_pool.cc:224] Handling call
0709 13:02:19.099674 (+  8159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.099928 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:02:19.345105 (+245177us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.372653 (+ 27548us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.649456 (+1276803us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b18003988c0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:02:20.649638 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.649715 (+    77us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:02:20.649779 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.649863 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.650013 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1285691,"prepare.queue_time_us":342502,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":1294839,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":8411,"spinlock_wait_cycles":14865664,"thread_start_us":244714,"threads_started":1}
I20260709 13:02:20.650326  8599 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:20.617986  1630 rpcz_store.cc:276] 0709 13:02:18.864813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.866155 (+  1342us) service_pool.cc:224] Handling call
0709 13:02:20.617489 (+1751334us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540006ccd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:20.617591 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369343360}
I20260709 13:02:20.619572  1631 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:20.653944  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2731) took 1760 ms. Trace:
I20260709 13:02:20.654143  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:20.655619  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1552) took 1366 ms. Trace:
I20260709 13:02:20.620317  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.660022  1556 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:20.699404  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.699802  1626 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:20.700111  1630 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 24: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:20.664556  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:20.508111  8804 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.676476  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:20.702543  1560 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:20.677932  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:20.703120  1558 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:20.679133  1551 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:20.690605  1707 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:20.691939  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:20.698446  1627 rpcz_store.cc:276] 0709 13:02:18.893736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.893865 (+   129us) service_pool.cc:224] Handling call
0709 13:02:18.894160 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.440714 (+546554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.653644 (+1212930us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54000893d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:20.653861 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251419904}
I20260709 13:02:20.701496  1628 rpcz_store.cc:276] 0709 13:02:19.289359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.884513 (+595154us) service_pool.cc:224] Handling call
0709 13:02:19.884763 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.167708 (+282945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.655343 (+487635us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400355a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:20.655549 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649309056}
I20260709 13:02:20.709946  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:20.712579  8765 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:02:20.714654  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 50199.6us
I20260709 13:02:20.718501  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:20.719321  1703 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:20.724361  1627 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:02:20.675601  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:20.736542  1700 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:02:20.737174  1700 pending_rounds.cc:85] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 14
I20260709 13:02:20.737537  1700 pending_rounds.cc:107] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:02:20.737887  1700 raft_consensus.cc:2889] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:20.714279  8192 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.722918  8828 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.739893  8192 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.746729  8842 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.749506  8842 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:20.724336  8740 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:20.751156  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:20.751231  8748 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:20.752065  8748 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.708058  8709 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.754339  8748 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:20.751554  8804 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.754480  8709 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.756811  8709 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.709103  1634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05f358a33737477ba11488ec75b16050"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:02:20.759492  1634 raft_consensus.cc:606] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:20.759954  1634 raft_consensus.cc:614] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:20.761475  1634 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:20.652498  8466 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
W20260709 13:02:20.763072  8826 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.933s	user 0.000s	sys 0.007s
I20260709 13:02:20.733908  8531 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:20.764575  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1582) took 1461 ms. Trace:
W20260709 13:02:20.764668  8825 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 1.040s	user 0.004s	sys 0.005s
I20260709 13:02:20.764705  8531 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.766212  8531 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:20.767299  2234 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:20.767843  8741 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:20.768899  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:20.766151  8704 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:20.769558  2267 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:20.770957  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:20.694801  8495 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.771704  8748 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:20.772352  8495 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.773396  8748 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:20.775053  8495 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:20.769946  8704 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.770371  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:20.777225  1554 raft_consensus.cc:2368] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:20.679359  8512 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.662940  8693 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:20.789234  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:20.777588  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 102078us
I20260709 13:02:20.698673  8599 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:20.754324  1553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 2943) took 1247 ms. Trace:
I20260709 13:02:20.715034  8718 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:02:20.796883  8836 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:20.670595  8551 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:02:20.808414  8599 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.809540  8599 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:20.784324  8192 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:20.670928  8583 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.112s
I20260709 13:02:20.796470  1553 rpcz_store.cc:276] 0709 13:02:19.506668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.509957 (+  3289us) service_pool.cc:224] Handling call
0709 13:02:19.510332 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.866386 (+356054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.866415 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.866454 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:19.866491 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.754085 (+887594us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400177d54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:20.754140 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.754267 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818519680}
I20260709 13:02:20.813297  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:20.778918  1709 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:20.764968  2264 rpcz_store.cc:276] 0709 13:02:19.302766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.303016 (+   250us) service_pool.cc:224] Handling call
0709 13:02:19.364366 (+ 61350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.364742 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.364783 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.423747 (+ 58964us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.494442 (+ 70695us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:19.494494 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.494592 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.107044 (+612452us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b48002613d8. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:02:20.762431 (+655387us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:20.764372 (+  1941us) raft_consensus.cc:1685] finished
0709 13:02:20.764394 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.764520 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":607629,"raft.queue_time_us":102,"raft.run_cpu_time_us":43315,"raft.run_wall_time_us":739268,"spinlock_wait_cycles":13837952,"thread_start_us":50273,"threads_started":1,"wal-append.queue_time_us":367917}
I20260709 13:02:20.773798  8748 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.780165  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.787240  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.823444  1557 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:20.708264  8737 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.792624  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:20.825058  1700 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:20.708423  8730 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:20.777523  2265 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:20.797885  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.746608  1626 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:20.814525  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:20.828842  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.831759  1628 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:02:20.794562  8588 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:20.773808  1627 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20. Ops: [19.17-19.17]
I20260709 13:02:20.785287  8704 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:20.761915  8723 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.815323  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:20.849748  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.852672  2267 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:20.795936  8693 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.709125  8781 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.695044  8404 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.121s
I20260709 13:02:20.834618  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.835652  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:20.883384  1700 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:20.842759  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:20.797631  8836 consensus_queue.cc:1243] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:20.847595  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:20.819145  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:20.891875  1630 raft_consensus.cc:2368] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22.
I20260709 13:02:20.851608  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.827505  8748 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:20.871228  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:20.873311  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:20.811172  8618 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:02:20.927100  1707 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:20.876504  1703 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:20.879108  2265 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
W20260709 13:02:20.879637  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.793192  8512 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.929739  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:20.891052  1557 raft_consensus.cc:2410] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:02:20.849921  1702 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:20.930781  1706 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:20.930480  1703 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:20.880859  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:20.894987  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:20.932008  1700 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:20.898974  1704 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 24.
I20260709 13:02:20.899438  1558 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:20.934453  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:20.822607  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.931048  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:20.939952  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.940930  1631 raft_consensus.cc:2368] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 15. Current term is 16.
W20260709 13:02:20.900043  8845 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:02:20.943150  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 62410.3us
I20260709 13:02:20.844091  8730 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:20.927906  2266 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:20.919610  8694 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:20.971873  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.973136  1635 raft_consensus.cc:2393] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:02:20.966630  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 254673us
I20260709 13:02:20.833483  8737 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:20.975497  2264 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
W20260709 13:02:20.986538  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.977897  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:20.930514  8416 raft_consensus.cc:2764] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:02:21.002135  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.002976  2266 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:21.008143  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.008477  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:21.009011  1707 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:21.005861  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:20.967962  8823 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:21.029505  1524 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:21.040726  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:20.923878  8531 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.041055  1705 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:02:21.011547  8851 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:21.045933  1705 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:21.047806  1705 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:21.048369  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:21.048895  1705 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:21.052126  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.016821  8765 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:21.022787  8718 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:21.022965  8823 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:21.024283  8751 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:21.074222  2265 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:21.074864  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.087234  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.078665  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:21.091418  2271 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:02:21.092406  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.092963  2271 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 14.
I20260709 13:02:21.047392  8793 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.040367  8631 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:21.044734  8070 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:21.087980  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.107093  2269 raft_consensus.cc:2410] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:02:21.093843  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.053181  8727 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.981863  8694 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.051208  8589 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:21.126082  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:21.056632  8495 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:21.058907  8500 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.100253  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.067499  8719 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:21.127385  1635 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:21.089689  8823 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:21.094849  8828 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:21.089032  8768 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:21.071290  8718 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.127948  1705 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 15. (term mismatch)
I20260709 13:02:21.138652  1705 pending_rounds.cc:85] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 14
I20260709 13:02:21.138969  1705 pending_rounds.cc:107] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260709 13:02:21.139247  1705 raft_consensus.cc:2889] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:21.090297  8751 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:21.129238  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:21.142771  2265 raft_consensus.cc:2368] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22.
I20260709 13:02:21.109176  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:21.140179  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.143590  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:21.144222  2271 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:21.143764  1635 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:21.148521  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.147742  8751 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:21.152935  8512 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:21.153407  8737 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.153992  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.125801  8631 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.156157  8631 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.139838  8719 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:21.157572  2267 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:21.158226  8719 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.134635  8589 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.143200  8371 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:02:21.148419  8828 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:21.163157  8828 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.166661  8730 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:21.166919  8728 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:21.167168  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:21.167966  8728 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:02:21.168291  8853 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:02:21.168903  1674 leader_election.cc:400] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:21.169202  1674 leader_election.cc:403] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:21.169632  8531 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.170254  8531 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:21.170671  8531 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:21.154179  8693 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:21.172513  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:21.173940  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.176481  2269 raft_consensus.cc:2393] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 21: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:21.171499  8531 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:21.177296  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:21.177863  2269 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:21.182410  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 73329.1us
I20260709 13:02:21.183523  1526 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:21.188589  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:21.191978  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:21.137323  8500 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.142462  8768 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:21.149919  8466 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 13:02:21.123186  8793 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.196348  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:21.197993  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.140836  8718 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:21.207069  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.194065  1631 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 24: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:21.208840  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.126091  8070 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:21.225217  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 86140.1us
W20260709 13:02:21.227825  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.228048  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:02:21.249713  1627 raft_consensus.cc:606] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:21.249838  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:21.128855  8727 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.134931  8495 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.168319  8728 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:21.205284  8720 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:21.244413  2265 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:21.206256  8741 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:21.250268  1627 raft_consensus.cc:614] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:21.209729  8723 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:21.236464  2269 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 24.
W20260709 13:02:21.256351  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 60039us
W20260709 13:02:21.284759  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.212112  8631 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:21.257601  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:21.259502  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.262979  8758 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:21.278960  8751 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.281350  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1584) took 1772 ms. Trace:
I20260709 13:02:21.208439  8551 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:21.290366  1702 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:02:21.292491  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.299603  2263 rpcz_store.cc:276] 0709 13:02:19.509158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.509277 (+   119us) service_pool.cc:224] Handling call
0709 13:02:19.509581 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.509773 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:02:19.510110 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.041115 (+1531005us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.281005 (+239890us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.281058 (+    53us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:21.281099 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.281162 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.281293 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1214625,"prepare.queue_time_us":443062,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":75,"raft.queue_time_us":1215771,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":18585,"thread_start_us":569350,"threads_started":2}
I20260709 13:02:21.303170  1704 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:21.273248  8583 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:02:21.241655  8404 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:21.317440  8768 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.307317  8859 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:21.317925  8589 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.302628  8758 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:21.311071  8551 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.326308  8871 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:21.328600  8751 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.334625  1552 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:21.336402  8823 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.337150  8864 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:21.341142  8781 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.260762  8720 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.301973  8862 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:02:21.349282  8495 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:21.350549  2263 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:21.353377  8727 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:21.354888  8707 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:21.356807  8500 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.362287  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.523373  8758 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:21.367332  8694 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.368903  1635 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:21.370091  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:21.607458  2264 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:21.370656  8728 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.369810  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:21.372725  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:21.373530  8599 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.564s	user 0.003s	sys 0.008s
I20260709 13:02:21.302145  8512 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.072s
W20260709 13:02:21.378530  8704 consensus_meta.cc:287] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:02:21.380568  8748 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.381029  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.381609  1559 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:21.384020  1551 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:02:21.623916  1555 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:21.624585  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.625173  1555 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:21.625716  1551 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:02:21.385159  1556 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:02:21.626986  1555 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:02:21.386359  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.387959  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.630683  1553 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:21.310284  8631 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.357626  8793 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:21.386394  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:21.388995  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.639494  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 138115us
I20260709 13:02:21.389196  8070 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:21.394845  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1591) took 1513 ms. Trace:
W20260709 13:02:21.387979  8858 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:02:21.393721  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:21.641533  2262 rpcz_store.cc:276] 0709 13:02:19.881907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.882071 (+   164us) service_pool.cc:224] Handling call
0709 13:02:19.882359 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.709881 (+827522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.709927 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.714394 (+  4467us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.141283 (+426889us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:21.141349 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.141436 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.394627 (+253191us) raft_consensus.cc:1685] finished
0709 13:02:21.394647 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.394776 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":880277,"raft.queue_time_us":840829,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7654,"thread_start_us":348193,"threads_started":1,"wal-append.queue_time_us":531613}
I20260709 13:02:21.647440  1709 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:21.399582  8730 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:21.403990  8877 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:21.406574  8784 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:21.406661  1601 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:21.407501  8736 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:21.413056  8836 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:21.415498  1558 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:21.416915  8739 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.418567  1628 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:21.419296  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:21.663458  8895 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:02:21.552722  8871 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:21.419559  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:21.674743  1626 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:21.675266  8871 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:21.675730  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:21.676389  1626 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:02:21.421442  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:21.473168  1672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.000s	sys 0.008s
W20260709 13:02:21.678396  1672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.001s	sys 0.008s
I20260709 13:02:21.678841  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:02:21.679458  1627 raft_consensus.cc:606] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:21.490336  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:21.679760  1627 raft_consensus.cc:614] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:21.492486  1599 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:21.670272  8739 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:21.682416  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 190014us
I20260709 13:02:21.594730  8864 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.683068  1599 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:21.671075  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:21.493580  2271 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:02:21.684547  8864 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:21.684715  1628 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:21.685225  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.685529  1634 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:21.686199  8737 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:21.686357  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.686741  8737 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:21.687490  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.497488  8872 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:21.689473  8870 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.689265  8872 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.639216  8500 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:02:21.500933  1706 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:21.503214  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.503818  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.517556  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.546382  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.550175  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:21.550947  8889 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:21.563683  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.555341  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:21.574565  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.366580  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:21.608386  1629 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:21.517112  8404 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.607769  1526 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:21.609643  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:21.575465  8885 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:02:21.611334  1632 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:21.612476  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:21.594199  8873 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:21.616144  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:21.610504  8719 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:02:21.552120  8804 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:21.385211  8718 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:21.554658  8894 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:21.625197  1559 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:21.628789  1600 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:21.634526  1555 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:02:21.638638  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:21.611306  8727 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.641027  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.643379  1551 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:21.617507  8720 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:21.640985  8617 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:02:21.625216  8704 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.641098  8781 consensus_queue.cc:1059] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:02:21.733940  1700 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:02:21.593864  8618 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:02:21.648438  2268 raft_consensus.cc:2368] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 22. Current term is 23.
I20260709 13:02:21.690183  8869 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.535882  8859 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.735091  8618 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:21.735528  8618 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:21.735149  8869 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.736351  8618 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.737020  8859 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:21.737398  8869 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.608708  8707 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:21.660367  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 253798us
I20260709 13:02:21.639243  8495 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:21.659955  8736 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:21.638717  8901 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:21.663285  8836 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:21.639550  8747 consensus_queue.cc:1059] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:02:21.498009  8880 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.809747  8901 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.688746  8709 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:21.689980  8870 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.734189  8781 raft_consensus.cc:3055] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:21.654901  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.810225  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:21.696518  8748 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:21.785884  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.649638  8887 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:02:21.687671  8737 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.751067  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.756032  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.753391  8894 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.737706  8804 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:21.754776  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 147099us
W20260709 13:02:21.752449  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 385965us
I20260709 13:02:21.649787  8730 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:21.744168  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3242) took 1104 ms. Trace:
W20260709 13:02:21.786275  1458 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 236) took 12574 ms (client timeout 15000 ms). Trace:
I20260709 13:02:21.740352  1554 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:02:21.812526  8859 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:21.810495  8495 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.828552  8859 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:21.703770  8823 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.771061  8719 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:21.770242  1630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:02:21.774340  2265 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:02:21.691512  8872 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.739813  8718 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:21.739108  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.703367  8768 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:21.740821  1555 pending_rounds.cc:85] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 13
W20260709 13:02:21.739931  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 185948us
I20260709 13:02:21.738006  1704 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 14.
I20260709 13:02:21.772565  8739 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.788221  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:21.748661  8404 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.754438  8631 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:21.741262  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 112604us
I20260709 13:02:21.751068  2268 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:21.743541  2270 raft_consensus.cc:2368] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19.
I20260709 13:02:21.744282  8727 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.743018  8704 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:21.698894  8551 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.743902  1560 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:21.658056  8784 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:21.715111  2234 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:21.794703  1626 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 25.
I20260709 13:02:21.741415  8589 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:21.715893  8728 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:21.741072  1552 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 24: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:21.737596  8618 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:21.748310  1703 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:21.749898  2269 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:21.795759  1632 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:21.644137  2264 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:21.783427  1709 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 25.
I20260709 13:02:21.829663  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.880425  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.880681  8768 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:21.881210  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:21.882212  1555 pending_rounds.cc:107] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:02:21.882535  1555 raft_consensus.cc:2889] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:21.824647  8599 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:02:21.820187  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.824219  8836 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.886499  2264 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:02:21.823613  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:21.809939  8192 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:02:21.887480  2266 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:21.888005  8617 consensus_queue.cc:1059] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:21.888990  8617 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:21.889343  8617 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:21.889444  8500 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:21.814193  8781 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:21.891021  8781 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:21.872826  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.881264  1702 raft_consensus.cc:2410] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
W20260709 13:02:21.892071  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.892406  8781 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:21.892764  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.812762  8709 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.893420  1702 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:21.886803  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.816197  8887 consensus_queue.cc:1243] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 87144ea1a4a14ab8b942fb426159f031 log is divergent from this leader: its last log entry 21.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:21.918709  1631 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 23: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:21.818216  1551 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:02:21.815019  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:21.831514  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:21.852854  1627 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:02:21.820676  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.909475  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.820323  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.823479  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:21.848242  1628 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:21.825510  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:21.893021  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:21.830638  2271 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:21.916083  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.820626  1706 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:21.785461  8758 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:21.950136  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 124717us
I20260709 13:02:21.881294  1630 raft_consensus.cc:606] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:21.950927  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.951700  1704 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 24: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:02:21.935613  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.947520  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 116042us
I20260709 13:02:21.927785  2269 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:02:21.918511  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 203504us
I20260709 13:02:21.949191  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:21.948989  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 56050.2us
I20260709 13:02:21.889361  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.953533  1560 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:21.951788  1709 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:21.953935  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:21.905591  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.826545  1708 rpcz_store.cc:276] 0709 13:02:20.640224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.645226 (+  5002us) service_pool.cc:224] Handling call
0709 13:02:20.645561 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.645953 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:20.970938 (+324985us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.491182 (+520244us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.491401 (+   219us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.491967 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.492119 (+   152us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:21.492314 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.492377 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.743922 (+251545us) raft_consensus.cc:1685] finished
0709 13:02:21.743949 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.744093 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":505658,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":3878,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":361,"thread_start_us":787704,"threads_started":2,"wal-append.queue_time_us":517265}
I20260709 13:02:21.956144  1554 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:21.960467  2234 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:21.945793  1701 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:21.961884  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:21.808802  1700 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:02:21.963438  1708 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 13:02:21.960467  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 137062us
I20260709 13:02:21.966663  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 1593) took 1197 ms. Trace:
I20260709 13:02:21.967105  2270 rpcz_store.cc:276] 0709 13:02:20.768772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.789713 (+ 20941us) service_pool.cc:224] Handling call
0709 13:02:21.966489 (+1176776us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b5400730354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:21.966611 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2137896192}
I20260709 13:02:21.961505  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:21.952943  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:02:21.970014  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 159916us
I20260709 13:02:21.970196  1709 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:02:21.886826  8836 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:21.943310  8709 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:21.975211  1673 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:21.977277  1702 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 17. (term mismatch)
I20260709 13:02:21.977366  1557 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:21.988788  1702 pending_rounds.cc:85] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 16
I20260709 13:02:21.973114  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:21.943325  8404 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.846922  8804 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.956028  8896 raft_consensus.cc:2764] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:02:21.966873  8551 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:21.969558  8617 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:21.949856  8500 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:21.825628  8707 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:21.980404  8877 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:21.980794  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:21.977782  8531 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:21.984635  8793 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:21.985327  8864 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:02:21.946657  1458 rpcz_store.cc:269] 0709 13:02:09.212195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.212405 (+   210us) service_pool.cc:224] Handling call
0709 13:02:21.786173 (+12573768us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:18.453257 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:18.507739 (+ 54482us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:18.507787 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:02:18.507806 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:18.509669 (+  1863us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:18.509782 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:18.509815 (+    33us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:02:18.649977 (+140162us) tablet.cc:701] Row locks acquired
0709 13:02:18.650048 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:02:18.650213 (+   165us) write_op.cc:270] Start()
0709 13:02:18.650405 (+   192us) write_op.cc:276] Timestamp: P: 1783602138650146 usec, L: 0
0709 13:02:18.650443 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:02:18.651234 (+   791us) log.cc:844] Serialized 9535 byte log entry
0709 13:02:19.504756 (+853522us) op_driver.cc:464] REPLICATION: finished
0709 13:02:19.821254 (+316498us) write_op.cc:301] APPLY: starting
0709 13:02:19.840318 (+ 19064us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:20.165912 (+325594us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:20.166019 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:21.361125 (+1195106us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:21.361444 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 13:02:21.361489 (+    45us) write_op.cc:312] APPLY: finished
0709 13:02:21.361938 (+   449us) log.cc:844] Serialized 212 byte log entry
0709 13:02:21.505857 (+143919us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:21.506115 (+   258us) write_op.cc:454] Released schema lock
0709 13:02:21.506188 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:21.537564 (+ 31376us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:21.551905 (+ 14341us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":625927,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":289272,"apply.run_cpu_time_us":51629,"apply.run_wall_time_us":1706889,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104399,"num_ops":24,"prepare.queue_time_us":410670,"prepare.run_cpu_time_us":26027,"prepare.run_wall_time_us":544279,"raft.queue_time_us":250264,"raft.run_cpu_time_us":10677,"raft.run_wall_time_us":186645,"replication_time_us":854130,"thread_start_us":1057638,"threads_started":5,"wal-append.queue_time_us":620179,"wal-append.run_cpu_time_us":32618,"wal-append.run_wall_time_us":1307337}]]}
I20260709 13:02:21.806440  8881 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.168s
I20260709 13:02:21.952173  8889 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:21.893988  8589 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:21.842443  8495 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:21.891582  8727 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:21.899291  8583 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:21.989094  1702 pending_rounds.cc:107] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 19.17
I20260709 13:02:22.053194  1702 raft_consensus.cc:2889] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:21.945016  8719 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.831964  1455 catalog_manager.cc:5697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 12 to 17, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:21.965727  8895 raft_consensus.cc:2764] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:02:21.830514  8870 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.822526  8894 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:21.997786  1673 leader_election.cc:400] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22.
I20260709 13:02:21.966487  8599 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:21.987989  1601 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:21.968918  1705 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:21.805094  8871 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.164s
I20260709 13:02:21.813974  8901 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:21.970352  8828 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:21.971307  8872 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:21.972442  8869 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:22.010500  2236 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:22.012418  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.980947  8704 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:21.988499  8739 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:21.812381  8880 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:21.999434  8893 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:21.826205  8730 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:22.096614  8730 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:22.096825  8887 consensus_queue.cc:1175] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7e99891af85f4b10aa1cc2da6aa33082" responder_term: 18 status { last_received { term: 16 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:22.097167  8736 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:22.098470  8736 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:22.015635  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:21.881644  8768 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:21.829775  8859 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.052008  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:22.111158  1704 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:02:22.111359  1627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:02:22.064167  1673 leader_election.cc:403] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:02:22.032510  8617 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.001144  8404 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.072834  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:22.051082  8192 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:22.064549  1455 catalog_manager.cc:5697] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 11 to 16, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
W20260709 13:02:22.079241  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 91348us
I20260709 13:02:22.115753  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:22.028934  8889 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:22.020665  8631 consensus_queue.cc:1175] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f1725fe36e349ac85405627f9c93d95" responder_term: 18 status { last_received { term: 16 index: 10 } last_committed_idx: 10 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:22.083884  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:22.118528  1630 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:22.084506  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:22.119364  1631 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.087440  8828 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.086809  8704 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.089257  1701 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:02:22.055740  8589 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:22.090546  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80190.5us
I20260709 13:02:22.095729  8901 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:22.062268  8719 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:22.113204  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 123812us
I20260709 13:02:22.152855  1673 leader_election.cc:400] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 15. Current term is 16.
I20260709 13:02:22.153960  1673 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.117107  1707 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:22.085618  8758 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:22.091336  8599 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:22.141602  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 162641us
I20260709 13:02:22.142423  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:22.145346  8737 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:02:22.146118  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 186177us
I20260709 13:02:22.140625  8704 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.123180  8889 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:22.124796  8828 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:22.200646  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:22.162567  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 189524us
W20260709 13:02:22.171240  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 203988us
W20260709 13:02:22.205878  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 83853.9us
I20260709 13:02:22.173498  1673 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.111699  8739 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:22.175115  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:22.194178  8737 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.195550  8920 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:22.194195  8784 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.213696  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.198351  8631 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:02:22.218741  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 43722.8us
I20260709 13:02:22.114960  8192 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.204835  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:22.138938  8869 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22.
W20260709 13:02:22.200510  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 58212.2us
I20260709 13:02:22.224771  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:22.227217  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.226015  1455 catalog_manager.cc:5697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 16 to 18, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 18 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:22.229135  8500 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:22.229550  8895 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:22.225996  8192 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.234539  8739 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.224959  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:22.177083  8887 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:22.240294  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:22.242956  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:22.248677  2236 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:22.215814  8512 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:22.216768  8694 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:22.213894  8737 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.251063  1455 catalog_manager.cc:5697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 15 to 16, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:22.225142  8893 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:22.220844  8551 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:22.252322  1631 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:22.238653  8901 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:22.244120  8872 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:22.256827  1708 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:02:22.277220  1708 pending_rounds.cc:85] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 10
I20260709 13:02:22.277590  1708 pending_rounds.cc:107] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 20.11
W20260709 13:02:22.267796  1673 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.943s (SENT) [suppressed 1 similar messages]
I20260709 13:02:22.246592  8727 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:22.218317  8720 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:22.278782  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.254679  8784 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:22.255020  8793 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:22.250092  8748 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:22.277880  1708 raft_consensus.cc:2889] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:22.253268  8694 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:22.256798  8495 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:22.271202  8901 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:22.284217  8758 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:22.299950  1455 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 15 to 18, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 18 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:22.316581  1553 raft_consensus.cc:1240] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:22.282608  8727 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:22.291525  8877 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:22.325166  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 118606us
I20260709 13:02:22.292766  8793 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:22.329162  1601 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:22.308033  8694 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:22.318553  8901 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:22.319665  8920 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:22.327183  8727 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:22.342103  8924 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:02:22.337152  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 69408.1us
I20260709 13:02:22.350577  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:22.300806  8512 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:02:22.325538  8495 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:22.338280  8793 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:22.362615  1703 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:02:22.365103  1703 pending_rounds.cc:85] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 10
I20260709 13:02:22.365504  1703 pending_rounds.cc:107] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:02:22.365746  1703 raft_consensus.cc:2889] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:22.341938  8902 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:22.329550  8758 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 25 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:22.342280  8906 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:02:22.321065  1455 catalog_manager.cc:5697] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 16 to 19, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:22.361150  1673 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.373190  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:22.351743  8918 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:02:22.341527  8913 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:02:22.358008  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 96527.3us
I20260709 13:02:22.355285  8880 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.374917  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:22.336259  8877 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:22.322484  8599 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.379293  8500 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:22.366695  8495 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.355078  8920 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:22.371132  8902 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:22.382714  8909 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:02:22.400552  8872 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:22.430371  8872 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:22.430781  8872 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.376863  8748 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:22.383379  2267 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:02:22.384332  8919 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:22.348368  8910 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:02:22.361970  8836 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:22.399317  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.436067  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.338644  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:22.410156  1627 raft_consensus.cc:606] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:22.386427  8730 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:22.416615  8500 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.416705  8931 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:02:22.423368  8495 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:22.424189  8921 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:22.425415  8920 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:22.425623  8859 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:22.386235  8927 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:22.486295  8927 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:22.486805  8927 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:22.444640  8880 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:22.452525  8893 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:22.426148  8720 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.496842  8500 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.501667  8928 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:02:22.503221  8896 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.503885  8896 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:22.510129  8680 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:22.510495  8371 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:22.510663  8680 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:22.510932  8371 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:22.511593  8680 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:22.511811  8371 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.513012  8371 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:22.515691  8864 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:22.516260  8864 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:22.518302  2267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 1567) took 1292 ms (client timeout 1542 ms). Trace:
I20260709 13:02:22.518357  8758 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:22.427814  8902 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:22.393914  8551 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:22.519814  8551 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:22.520293  8551 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:22.437870  1627 raft_consensus.cc:614] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:22.522162  8823 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:22.523862  8618 consensus_meta.cc:287] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.001s
I20260709 13:02:22.400264  8728 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
W20260709 13:02:22.526013  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.432394  8748 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.532437  8748 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:22.533564  8589 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.392700  8404 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.420298  1455 catalog_manager.cc:5697] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:22.489355  8192 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.446316  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:22.474520  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 218838us
W20260709 13:02:22.518817  2267 rpcz_store.cc:269] 0709 13:02:21.226267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.244688 (+ 18421us) service_pool.cc:224] Handling call
0709 13:02:22.518121 (+1273433us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540039d854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:22.518246 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2496456064}
I20260709 13:02:22.534440  8877 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:22.534780  8896 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:22.535547  8864 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:22.576076  8551 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.578843  8551 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.580222  8500 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.587008  8694 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.536052  8889 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.590224  8404 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:22.592000  8889 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:22.453992  8836 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.592818  8589 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.427187  8911 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:22.438696  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 100129us
I20260709 13:02:22.594156  1633 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:22.548667  1635 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
W20260709 13:02:22.595783  1635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2948) took 1169 ms (client timeout 1522 ms). Trace:
W20260709 13:02:22.596125  1635 rpcz_store.cc:269] 0709 13:02:21.426626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.609372 (+182746us) service_pool.cc:224] Handling call
0709 13:02:22.595601 (+986229us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b5400089dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:22.595729 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798094592}
I20260709 13:02:22.449329  8768 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:22.596704  8719 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.597975  8768 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:22.599154  8768 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.600271  1703 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
W20260709 13:02:22.567715  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.602363  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.602226  8737 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.604832  8737 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.594399  8836 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.606235  8828 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:22.571054  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 124826us
I20260709 13:02:22.610960  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1567) took 1190 ms. Trace:
I20260709 13:02:22.614612  1673 leader_election.cc:400] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22.
I20260709 13:02:22.615147  1673 leader_election.cc:403] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:02:22.616715  1673 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.599385  8704 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.594174  8911 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:22.574164  8709 consensus_meta.cc:287] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.003s
I20260709 13:02:22.611414  1633 rpcz_store.cc:276] 0709 13:02:21.420871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.680464 (+259593us) service_pool.cc:224] Handling call
0709 13:02:21.789006 (+108542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.594633 (+805627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.610711 (+ 16078us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b540034d5d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:22.610893 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1851286912}
I20260709 13:02:22.630977  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:22.632750  1551 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:02:22.633507  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:22.638520  1706 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:22.645493  1708 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.640892  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:22.646796  1702 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:22.608939  8828 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.642120  1455 catalog_manager.cc:5697] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 11 to 18, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.651928  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:22.671523  1708 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 15.
W20260709 13:02:22.677569  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 281694us
I20260709 13:02:22.632370  8836 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22.
I20260709 13:02:22.640254  8404 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:22.681221  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:22.690749  8371 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:22.691217  8371 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.691682  8371 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:22.696240  8871 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.696877  8871 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:22.697506  8864 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.698203  8864 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.700003  8871 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:22.707041  8728 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.707798  8728 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.710779  8728 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:22.711439  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:22.711861  8864 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:22.712949  8694 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.715389  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:22.716194  2265 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:22.720137  1455 catalog_manager.cc:5697] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 15 to 18, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:22.728332  1455 catalog_manager.cc:5697] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 14 to 18, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:22.736014  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:22.737684  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 64709.7us
I20260709 13:02:22.736897  1551 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
W20260709 13:02:22.680675  8617 consensus_meta.cc:287] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.002s
I20260709 13:02:22.752074  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:22.754845  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:22.757555  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:22.581840  8872 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.585913  8927 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:22.746210  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 499010us
I20260709 13:02:22.674836  8823 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.643141  8551 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 13:02:22.770037  2267 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:02:22.777741  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 427895us
I20260709 13:02:22.659935  8709 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.759610  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:22.785284  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 388345us
I20260709 13:02:22.788936  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:22.789328  8730 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:22.792580  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:22.789810  8730 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.803432  8728 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:22.803561  8730 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:22.804172  8728 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:22.805066  8728 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.805936  8911 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:22.807358  8404 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.807871  8404 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:22.811148  8784 consensus_meta.cc:287] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 13:02:22.811301  8192 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.746429  8618 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:02:22.779305  8922 consensus_queue.cc:1059] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:02:22.815399  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:22.816663  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.780572  8823 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:22.819211  8823 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:22.819247  8719 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.819658  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:22.821913  8704 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:22.822611  8720 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:22.823953  8720 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:22.824667  8922 raft_consensus.cc:3055] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:22.825104  8922 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:22.826172  2267 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:22.827075  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:22.827680  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:22.827858  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 176042us
I20260709 13:02:22.828359  1702 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.828933  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:22.831758  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:22.832226  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:22.833911  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:22.834278  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 418700us
I20260709 13:02:22.837141  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:22.837471  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.837842  1555 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:22.838613  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:22.762554  8739 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.841006  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:22.841840  2269 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:22.849875  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:22.851106  2269 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:02:22.843080  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:22.844877  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:22.841568  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:22.850912  1455 catalog_manager.cc:5697] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 14 to 15, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.847895  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:22.848934  1551 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:22.852372  1705 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:22.853417  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:22.854689  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:22.855329  1709 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.858928  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:22.860550  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:22.861877  8869 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:22.862766  8869 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:22.863188  8869 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:22.863616  8869 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:22.869652  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:22.870383  1705 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:22.871132  1673 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.874349  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.876956  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:22.877246  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:22.877756  2266 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:22.877990  2271 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:22.878000  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:22.878908  2267 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:22.879383  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:22.880395  2265 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 19: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:22.880501  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.887261  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:22.895654  1551 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:22.895866  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:22.896612  1556 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:22.896900  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:22.883030  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:22.896651  2270 raft_consensus.cc:2368] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 22. Current term is 23.
I20260709 13:02:22.897753  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:22.898561  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:22.898640  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:22.899329  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:22.866439  8704 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:02:22.908243  8371 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.819826  8823 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:02:22.926723  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:22.876637  8934 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:22.930116  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:22.822018  8709 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:22.914777  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:22.929203  1455 catalog_manager.cc:5697] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 8 to 15, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.929116  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:22.922740  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:22.934454  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 60174.1us
I20260709 13:02:22.935361  1633 raft_consensus.cc:1240] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:22.938714  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.934464  1631 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:22.912472  1709 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:22.835114  8404 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:22.913147  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:22.815639  8901 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.900640  8192 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:22.901165  8618 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:22.942857  1635 raft_consensus.cc:1275] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:22.945590  1702 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:22.945868  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:22.952698  1560 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:22.954936  1627 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:02:22.907127  8784 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:22.947077  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:22.947383  1634 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:22.948397  1455 catalog_manager.cc:5697] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 11 to 14, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.949301  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:22.928349  8902 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.969625  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:22.956167  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:22.964452  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:22.971467  1629 raft_consensus.cc:2410] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:02:22.972749  1556 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:02:22.877492  8748 consensus_queue.cc:1059] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 13:02:22.943737  8551 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:23.004921  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:22.944151  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.937235  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:22.964102  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:22.903785  8631 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:22.901631  8880 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
W20260709 13:02:22.975299  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 146448us
I20260709 13:02:22.955231  8934 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:22.969025  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:23.067713  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:22.944044  8727 consensus_meta.cc:287] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.575s	user 0.005s	sys 0.005s
I20260709 13:02:22.941847  8926 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:23.002511   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:22.879700  8739 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.867617  8922 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:22.959578  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:22.950474  8618 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:23.007701  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:22.977830  8913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.021s	sys 0.025s
I20260709 13:02:23.162906  8927 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:23.091244  8709 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
W20260709 13:02:23.090732  8793 consensus_meta.cc:287] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.001s
I20260709 13:02:23.166421  8793 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:23.169004  8793 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:23.169598  8704 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.027071  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.987562  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:23.172868  1628 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:23.173316  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:23.173550  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:23.174202  1632 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:23.174125  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:23.159770  8913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.021s	sys 0.025s
I20260709 13:02:23.173678  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:23.175824  2262 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:23.174295  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1576) took 1023 ms. Trace:
I20260709 13:02:23.088323  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:23.089640  1558 raft_consensus.cc:1240] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:02:23.178350  1627 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:02:23.071309  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 134313us
I20260709 13:02:23.077342   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:23.002804  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:23.080593  1560 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:22.948477  8836 consensus_queue.cc:1059] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:02:22.962366  8784 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:23.079700  8926 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:23.085875  8739 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:23.086380  8946 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:23.087069  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:23.160259  8618 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:23.001992  8747 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 13:02:23.002135  8192 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:23.152750  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:23.155334  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:23.156126  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:23.241120  1705 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
W20260709 13:02:23.159119  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 60287.7us
I20260709 13:02:23.180930  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:23.242311  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:23.005376  8718 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:23.182981  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 113913us
I20260709 13:02:23.187767  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:23.087416  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:23.243893  1633 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:23.002681  8902 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:23.195006  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 73624us
I20260709 13:02:23.199972  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:23.204522  1701 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.013s	sys 0.052s
I20260709 13:02:23.080250  8404 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:23.246239  1701 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.014s	sys 0.052s
I20260709 13:02:23.242579  2271 raft_consensus.cc:2393] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 19: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:23.176954  1630 rpcz_store.cc:276] 0709 13:02:22.151429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.152013 (+   584us) service_pool.cc:224] Handling call
0709 13:02:22.198569 (+ 46556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.322551 (+123982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.322585 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.323035 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:02:22.775565 (+452530us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:22.775609 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.775675 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.174099 (+398424us) raft_consensus.cc:1685] finished
0709 13:02:23.174120 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.174244 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59721,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":15278,"thread_start_us":536710,"threads_started":2,"wal-append.queue_time_us":820221}
W20260709 13:02:23.069798  8758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.012s
W20260709 13:02:23.244547  1707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.017s	sys 0.013s
I20260709 13:02:23.243177  1705 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:23.248085  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:23.255262  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:23.255702  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:23.180662  8913 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:23.257709  1707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.017s	sys 0.013s
I20260709 13:02:23.261037  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:23.264573  8945 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:02:23.080799  8727 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:23.265725  8680 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:23.267539  8936 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:02:23.268958  8727 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:23.190274  8926 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:23.257258  1705 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:23.191484  8784 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:23.170228  8704 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:23.277652  1600 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:23.282222  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:23.283239  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:23.284569  1554 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:23.286589  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:23.287297  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:23.243870  8929 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:02:23.259688  8758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.000s	sys 0.023s
W20260709 13:02:23.292186  1703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.014s	sys 0.024s
I20260709 13:02:23.245039  8940 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.294811  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:23.250995  8718 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:23.246377  8872 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:23.297163  1703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.015s	sys 0.025s
I20260709 13:02:23.252126  8404 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:23.271111  8719 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.297883  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:23.270740  8880 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:23.275749  8864 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:23.196326  8946 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:23.274909  1705 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:23.300297  8923 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:23.293088  8929 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:02:23.297775  8889 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.021s	sys 0.038s
I20260709 13:02:23.301491  8404 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:23.290006  8747 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:02:23.302203  8718 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:23.306970  8727 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:23.304425  8864 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:23.414224  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:23.307838  8631 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:23.327668  1704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.025s	sys 0.036s
I20260709 13:02:23.412170  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:23.421320  8730 consensus_meta.cc:287] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.001s
W20260709 13:02:23.423223  8869 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
I20260709 13:02:23.309206  8872 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:23.325877  8768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.015s	sys 0.014s
W20260709 13:02:23.425830  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:23.446772  1704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.026s	sys 0.037s
I20260709 13:02:23.412679  1634 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
W20260709 13:02:23.403244  8889 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.026s	sys 0.038s
I20260709 13:02:23.307683  8938 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:23.370932  8923 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:23.460161  1706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.014s	sys 0.016s
W20260709 13:02:23.575697  1706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.014s	sys 0.016s
I20260709 13:02:23.321558  8371 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:23.460255  1700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.014s	sys 0.018s
W20260709 13:02:23.576463  1700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.014s	sys 0.018s
I20260709 13:02:23.321818  8901 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:23.508232  2265 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:23.308918  8719 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:23.451687  8727 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.291785  8934 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:23.466199  8768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.020s	sys 0.014s
I20260709 13:02:23.591709  2263 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:02:23.580461  8728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.028s	sys 0.033s
I20260709 13:02:23.574447  8942 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.581074  8923 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:23.606415  1553 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:02:23.582955  8727 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:23.461879  8631 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:23.461970  8730 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:23.375649  8192 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:23.618149  1455 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.009s
I20260709 13:02:23.465413  8869 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:23.304168  8940 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:23.604449  8728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.029s	sys 0.033s
W20260709 13:02:23.625368  1455 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.007s	sys 0.009s
I20260709 13:02:23.631067  1702 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 13:02:23.621032  8500 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.007s	sys 0.007s
I20260709 13:02:23.378755  8913 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:23.639657  8500 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.008s	sys 0.008s
W20260709 13:02:23.656286  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 384134us
I20260709 13:02:23.616221  8942 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:23.658876  1708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.045s	sys 0.081s
W20260709 13:02:23.660619  1708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.045s	sys 0.081s
I20260709 13:02:23.643537  8902 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:23.667855  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 394846us
W20260709 13:02:23.666543  2235 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.011s	sys 0.010s
W20260709 13:02:23.668763  2235 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.011s	sys 0.010s
W20260709 13:02:23.669101  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 509941us
I20260709 13:02:23.669927  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:23.673413  2234 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:23.666008  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:23.685976  8937 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:23.613500  8864 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:23.698307  8704 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:23.687527  8896 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.014s
W20260709 13:02:23.710657  2264 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.010s	sys 0.012s
W20260709 13:02:23.711108  2264 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.010s	sys 0.012s
W20260709 13:02:23.711721  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 468217us
I20260709 13:02:23.678407  8728 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:23.698660  8946 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:23.719172  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 435997us
W20260709 13:02:23.720432  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 464840us
W20260709 13:02:23.713409  1555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.009s	sys 0.017s
W20260709 13:02:23.727998  1555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.009s	sys 0.018s
I20260709 13:02:23.708981  8937 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:23.765017  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 96089.3us
W20260709 13:02:23.770638  8954 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:02:23.771412  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1380) took 1021 ms. Trace:
I20260709 13:02:23.732203  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:23.771862  1706 rpcz_store.cc:276] 0709 13:02:22.749734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.750236 (+   502us) service_pool.cc:224] Handling call
0709 13:02:22.750613 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:22.765095 (+ 14482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.765140 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:22.777405 (+ 12265us) log.cc:844] Serialized 52 byte log entry
0709 13:02:23.576091 (+798686us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:23.597041 (+ 20950us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.597278 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.597373 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.771170 (+173797us) raft_consensus.cc:1685] finished
0709 13:02:23.771191 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.771351 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13939,"prepare.queue_time_us":29952,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":15536,"spinlock_wait_cycles":11241344,"thread_start_us":755599,"threads_started":1,"wal-append.queue_time_us":918877}
I20260709 13:02:23.773701  1524 leader_election.cc:400] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19.
I20260709 13:02:23.774003  1524 leader_election.cc:403] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:02:23.775373  8680 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.004s
I20260709 13:02:23.776217  8937 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:23.779924  8618 consensus_meta.cc:287] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.001s
I20260709 13:02:23.780364  8618 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:23.781368  8730 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:23.782491  1633 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:23.766115  2234 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:02:23.787861  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 116406us
I20260709 13:02:23.789626  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:23.732728  8952 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:02:23.798161  8371 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:23.800115  1635 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:02:23.794114  8949 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:02:23.788192  8747 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:23.806011  8953 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:02:23.824381  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.803273  8371 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:23.806732  8869 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:23.846261  2235 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:23.803633  8631 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:23.786784  8902 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
W20260709 13:02:23.858336  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 84756.6us
I20260709 13:02:23.801911  8784 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:23.860913  8618 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:23.830667  8940 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:23.858325  8869 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:23.862391  8784 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:23.862681  8869 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:23.864861  8869 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:23.865875  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3266) took 1258 ms. Trace:
I20260709 13:02:23.866283  1703 rpcz_store.cc:276] 0709 13:02:22.607459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.614261 (+  6802us) service_pool.cc:224] Handling call
0709 13:02:22.650510 (+ 36249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.650916 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.650955 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.651469 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.300276 (+648807us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:23.300318 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.300391 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.865650 (+565259us) raft_consensus.cc:1685] finished
0709 13:02:23.865674 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.865815 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20501,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":11303,"thread_start_us":648495,"threads_started":1,"wal-append.queue_time_us":985388}
I20260709 13:02:23.867465  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:23.868240  2263 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:02:23.850418  8371 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:23.869150  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:23.869679  2263 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:23.868139  1703 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:02:23.874547  1703 pending_rounds.cc:85] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 11
I20260709 13:02:23.874791  1703 pending_rounds.cc:107] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:02:23.876227  1703 raft_consensus.cc:2889] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:23.825592  8966 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:23.853441  8967 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:23.882375  2271 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.003s	sys 0.023s
W20260709 13:02:23.882085  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 152092us
W20260709 13:02:23.883684  2271 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.003s	sys 0.023s
I20260709 13:02:23.853672  8728 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:23.886917  8942 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:23.887267  8958 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:02:23.888731  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2906) took 1064 ms. Trace:
I20260709 13:02:23.889087  1700 rpcz_store.cc:276] 0709 13:02:22.824312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.824469 (+   157us) service_pool.cc:224] Handling call
0709 13:02:22.824817 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.825187 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.825228 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.825694 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.576863 (+751169us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:23.576901 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.576967 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.888467 (+311500us) raft_consensus.cc:1685] finished
0709 13:02:23.888488 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.888652 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1170,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":30306,"thread_start_us":750895,"threads_started":1,"wal-append.queue_time_us":883114}
I20260709 13:02:23.894515  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3272) took 1282 ms. Trace:
I20260709 13:02:23.894935  1704 rpcz_store.cc:276] 0709 13:02:22.612437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.612585 (+   148us) service_pool.cc:224] Handling call
0709 13:02:22.651856 (+ 39271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.671631 (+ 19775us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:22.671673 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.672227 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.494273 (+822046us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:23.494341 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.494462 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.894326 (+399864us) raft_consensus.cc:1685] finished
0709 13:02:23.894351 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.894461 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27963,"raft.queue_time_us":20598,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":9203,"thread_start_us":729463,"threads_started":1,"wal-append.queue_time_us":927689}
I20260709 13:02:23.896979  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:23.900120  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:23.880592  8896 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19.
I20260709 13:02:23.905236  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3271) took 1294 ms. Trace:
I20260709 13:02:23.935972  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:23.907039  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:23.938794  2263 raft_consensus.cc:2410] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:02:23.874428  8404 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:23.858628  8965 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:02:23.884910  8966 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:23.891768  8730 consensus_queue.cc:1059] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
W20260709 13:02:23.946571  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 82804.5us
I20260709 13:02:23.954392  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:23.960427  1703 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:23.943780  1701 rpcz_store.cc:276] 0709 13:02:22.611138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.612102 (+   964us) service_pool.cc:224] Handling call
0709 13:02:22.649627 (+ 37525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:22.649831 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:23.246986 (+597155us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.904755 (+657769us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:23.904834 (+    79us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:23.904913 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.905003 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.905159 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":445,"prepare.queue_time_us":764831,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":2286,"raft.queue_time_us":118510,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":15726,"thread_start_us":1241235,"threads_started":3,"wal-append.queue_time_us":561839}
I20260709 13:02:23.973965  1524 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:23.907958  8869 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:23.983860  8869 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.984524  8869 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:23.985020  8974 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:02:23.986122  8972 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:02:23.987800  8966 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:23.989500  8718 consensus_meta.cc:287] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 13:02:23.990370  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3280) took 1133 ms. Trace:
I20260709 13:02:23.991360  8991 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:02:23.991813  8956 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:02:23.991642  8727 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:23.990820  1705 rpcz_store.cc:276] 0709 13:02:22.856925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.399670 (+542745us) service_pool.cc:224] Handling call
0709 13:02:23.446369 (+ 46699us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.446782 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.446808 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.447409 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.825082 (+377673us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:23.825141 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.825233 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:23.990114 (+164881us) raft_consensus.cc:1685] finished
0709 13:02:23.990138 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:23.990303 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":335178,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":364226,"threads_started":1,"wal-append.queue_time_us":429423}
I20260709 13:02:24.004907  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:23.959515  8913 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:02:24.004042  8926 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.004s
I20260709 13:02:23.896301  8728 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:23.982653  8730 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:24.016764  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:23.966164  8371 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.004190  8896 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:23.989904  8718 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.038228  1552 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:24.024984  1524 connection.cc:256] RPC call timeout handler was delayed by -1.2788021509999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 13:02:24.011137  8913 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.039304  8718 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.040880  8913 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.042382  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1381) took 1292 ms. Trace:
I20260709 13:02:24.013098  8926 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.028410  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:24.045341  2267 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:02:24.033672  8404 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.019511  8983 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.037379  8730 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:24.043655  8694 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.042752  1708 rpcz_store.cc:276] 0709 13:02:22.753583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.753770 (+   187us) service_pool.cc:224] Handling call
0709 13:02:22.754160 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.765783 (+ 11623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.765824 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:22.766384 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.661737 (+895353us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:23.661779 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.661845 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.038011 (+376166us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b24001f5548. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dad689c4 00007f06dad66acb 00007f06daf21dc9 00007f06daf21a55 00007f06daf20fb0 00007f06ddb97488 00007f06ddb97be8 00007f06ddb6f398 00007f06ddb6a76a 00007f06ddb69bb6
0709 13:02:24.042102 (+  4091us) raft_consensus.cc:1685] finished
0709 13:02:24.042124 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.042325 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11195,"raft.queue_time_us":15179,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2747,"spinlock_wait_cycles":18566400,"thread_start_us":871322,"threads_started":1,"wal-append.queue_time_us":959013}
I20260709 13:02:24.045280  1524 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:24.046228  2265 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:24.047874  2267 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:02:24.065248  2267 pending_rounds.cc:85] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 13
I20260709 13:02:24.065529  2267 pending_rounds.cc:107] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:02:24.065781  2267 raft_consensus.cc:2889] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:24.033313  8929 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.049206  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:24.035454  8923 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.068925  8913 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:24.073895  8727 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:24.066432  8983 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.079159  8983 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.066572  8730 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.081542  8551 raft_consensus.cc:3055] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:24.081969  8551 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:24.082352  8929 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:24.082594  8730 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:24.082834  8551 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.067776  8694 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.084290  8551 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:24.060482  1707 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:02:24.086419  8869 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.066680  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:24.067984  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:24.045456  8926 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.080506  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.066833  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:24.109014  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1585) took 1263 ms. Trace:
I20260709 13:02:24.089118  8896 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:02:24.093751  2265 raft_consensus.cc:2368] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19.
I20260709 13:02:24.056668  1552 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:24.085804  8694 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.183946  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:24.184841  1707 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:24.129585  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:24.188884  1634 raft_consensus.cc:2368] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19.
I20260709 13:02:24.189993  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:24.191287  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.193915  1634 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:24.198710  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:24.127821  8981 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:24.127687  8947 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:02:24.131795  8869 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:24.134485  8965 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:02:24.227737  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.135876  2267 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:02:24.139386  8923 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:24.142545  2265 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:02:24.142453  8984 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:24.156677  8730 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:24.234232  8730 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:24.203593  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.235723  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.206063  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 2916) took 1050 ms. Trace:
I20260709 13:02:24.241358  1707 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:24.246541  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.247602  1554 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:24.237226  1702 rpcz_store.cc:276] 0709 13:02:23.155428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.651042 (+495614us) service_pool.cc:224] Handling call
0709 13:02:23.664857 (+ 13815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.847415 (+182558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.847463 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.848153 (+   690us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.953285 (+105132us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:23.953343 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.953439 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.205772 (+252333us) raft_consensus.cc:1685] finished
0709 13:02:24.205800 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.205974 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136696,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":7160,"thread_start_us":283939,"threads_started":2,"wal-append.queue_time_us":355953}
I20260709 13:02:24.249657  8617 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:24.251317  8617 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.256127  8617 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.269519  1634 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:02:24.270278  8730 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:24.210953  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:24.211270  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:24.275955  1626 raft_consensus.cc:2410] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:02:24.214389  8931 raft_consensus.cc:3055] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:24.276952  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2950) took 1367 ms. Trace:
I20260709 13:02:24.277315  1626 rpcz_store.cc:276] 0709 13:02:22.909280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.410645 (+501365us) service_pool.cc:224] Handling call
0709 13:02:24.211121 (+800476us) spinlock_profiling.cc:243] Waited 885 us on lock 0x7b5800062a98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaeee 0000000000375939 00007f06e2f1e1e0 00007f06e2fe70c4 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:02:24.276877 (+ 65756us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2034944}
W20260709 13:02:24.279300  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 170608us
I20260709 13:02:24.109654  2271 rpcz_store.cc:276] 0709 13:02:22.845293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.265755 (+420462us) service_pool.cc:224] Handling call
0709 13:02:23.266163 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.884064 (+617901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.884095 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.896316 (+ 12221us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.967531 (+ 71215us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:23.967689 (+   158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.967893 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.108669 (+140776us) raft_consensus.cc:1685] finished
0709 13:02:24.108702 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.108927 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11468,"raft.queue_time_us":14697,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":6213,"thread_start_us":676198,"threads_started":2,"wal-append.queue_time_us":182389}
W20260709 13:02:24.220400  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.221258  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2761) took 1267 ms. Trace:
I20260709 13:02:24.280740  1635 rpcz_store.cc:276] 0709 13:02:22.953918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.969377 (+ 15459us) service_pool.cc:224] Handling call
0709 13:02:24.221074 (+1251697us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b540006d1d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:24.221205 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908222848}
I20260709 13:02:24.282542  1635 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:24.224846  1557 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:24.224845  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.226105  1559 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:02:24.226069  1627 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:24.231098  8965 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:24.232633  8981 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.233403  8869 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.173978  1524 leader_election.cc:400] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19.
I20260709 13:02:24.290467  1524 leader_election.cc:403] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:02:24.279484  1626 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:24.286922  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:24.214550  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.274174  8730 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:24.291075  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 117329us
I20260709 13:02:24.296795  1524 leader_election.cc:400] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19.
I20260709 13:02:24.276635  8931 raft_consensus.cc:740] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:02:24.303537  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.304751  1630 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:24.297398  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:24.286262  8965 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:24.295230  8984 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19.
I20260709 13:02:24.290104  8929 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:24.305135  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:24.323609  8192 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:24.324365  8192 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.324813  8192 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:24.300426  8730 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.328604  8730 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.329246  8694 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.329792  8694 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.305613  8996 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:02:24.332230  8694 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:24.303895  8737 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.333002  8737 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.343783  8730 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:24.344735  8730 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.346104  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:24.346860  1702 raft_consensus.cc:2393] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 17: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:24.346784  8404 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:24.347445  8404 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.302480  8911 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:02:24.347957  8730 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.360196  8965 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.348248  8929 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.361670  8965 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:24.364539  8929 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.295198  8617 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:02:24.298578  8923 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:24.367390  8923 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:24.368324  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 63245.9us
I20260709 13:02:24.300653  8983 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:24.370903  8983 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.372821  8983 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:24.305153  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.379228  8192 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.380662  1707 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:24.381798  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:24.382532  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:24.385507  1632 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:24.389472  1555 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:24.377779  8942 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.392196  8192 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:24.386961  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.394112  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.395150  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:24.380514  8923 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.401801  1553 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:24.355203  8981 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:24.412273  1553 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:24.412616  1707 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:24.419464  8737 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:24.421772  8404 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.380877  8589 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:02:24.358620  8869 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:24.437389  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:24.439523  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:24.440775  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:24.441917  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.444250  1600 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:24.445652  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:24.446815  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.446895  8910 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:24.449625  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.450868  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.451435  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.452158  1630 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:24.452884  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:24.453804  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.454435  1630 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:24.455124  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.456887  1554 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 21: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:24.457619  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.460564  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:24.460670  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 69339us
I20260709 13:02:24.461333  1555 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:24.463372  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.463325  1673 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:24.466017  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.468806  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.434428  8942 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.432221  8929 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:02:24.357337  8931 consensus_queue.cc:260] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.469254  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:24.469520  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.476501  1632 raft_consensus.cc:2368] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:24.449863  8631 raft_consensus.cc:2804] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:24.480743  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:24.485898  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 165857us
I20260709 13:02:24.470201  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.470772  1526 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:24.488008  8910 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:24.488421  8984 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:24.491017  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:24.492256  8896 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:24.492849  8896 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:24.494464  8923 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:24.494701  8991 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:24.496078  8923 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:24.496363  8923 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:24.498533  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:24.500274  1630 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:24.468461  8869 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:24.514406  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:24.507202  8631 raft_consensus.cc:697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:24.504721  8922 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:24.517113  8631 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.520516  8719 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.508394  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.528429  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2955) took 1118 ms. Trace:
I20260709 13:02:24.528806  1629 rpcz_store.cc:276] 0709 13:02:23.409882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.410077 (+   195us) service_pool.cc:224] Handling call
0709 13:02:24.088197 (+678120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.088334 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.088351 (+    17us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.088383 (+    32us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:24.088401 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.088435 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.528245 (+439810us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b5400079c50. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:24.528368 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558834560}
I20260709 13:02:24.530002  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.534566  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:24.541127  1629 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:24.509596  8931 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:24.544956  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:24.550618  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.523756  8718 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:24.551908  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:24.530409  8404 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:24.493695  8896 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.559341  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:24.541950  8981 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:24.565436  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:24.558312  8836 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.248s	user 0.016s	sys 0.030s
W20260709 13:02:24.574560  8836 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.267s	user 0.016s	sys 0.030s
I20260709 13:02:24.575232  8964 consensus_queue.cc:1048] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:24.557966  8551 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:24.555505  8887 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:24.579717  1673 leader_election.cc:336] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.943s (SENT)
I20260709 13:02:24.571595  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:24.587586  1631 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:24.588591  8192 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.589241  8192 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.565696  8404 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:24.592921  8942 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.584262  8981 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:24.569214  8983 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.594354  8983 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.596369  8748 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:24.596560  8983 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.596824  8748 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:24.559422  8718 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.597852  8748 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.598973  8748 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:24.600430  8718 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.538053  8923 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.607028  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.610695  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:24.624056  1555 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:24.627945  1600 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:24.591208  8730 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:24.662595  8923 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:24.634680  8942 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:24.666502  8942 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.667016  8942 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:24.690076  9014 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:02:24.701120  8869 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:24.705021  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2953) took 1295 ms. Trace:
I20260709 13:02:24.705468  1627 rpcz_store.cc:276] 0709 13:02:23.409309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.410256 (+   947us) service_pool.cc:224] Handling call
0709 13:02:24.221640 (+811384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.284901 (+ 63261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.704815 (+419914us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b540006d1d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:24.704957 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865379072}
I20260709 13:02:24.710196  1707 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:02:24.711087  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2952) took 1302 ms. Trace:
I20260709 13:02:24.711223  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:24.711764  1700 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:24.712352  8784 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.712828  8784 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.714939  8784 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:24.715372  8784 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:24.721303  8836 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:24.711516  1633 rpcz_store.cc:276] 0709 13:02:23.409024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.411924 (+  2900us) service_pool.cc:224] Handling call
0709 13:02:24.710946 (+1299022us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b540018ecd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:24.711038 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":756961664}
I20260709 13:02:24.724129  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:24.725090  1601 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:24.726835  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.728778  8192 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.729525  8192 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:24.721913  8836 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.730650  8192 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:24.733853  1706 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:02:24.735117  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:24.736340  1700 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:24.738786  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.731786  8192 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.740391  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:24.741042  1627 raft_consensus.cc:2376] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21. Re-sending same reply.
I20260709 13:02:24.742404  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.723814  8631 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:24.709523  8404 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:24.746197  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:24.743983  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:24.724792  8911 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:24.754376  1708 raft_consensus.cc:2410] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:02:24.640458  8877 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.550s	user 0.018s	sys 0.011s
I20260709 13:02:24.756420  1706 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:02:24.715775  8784 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.757457  1635 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:24.758303  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.760485  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:24.761085  1700 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:24.740097  8589 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:02:24.756354  8877 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.666s	user 0.018s	sys 0.012s
I20260709 13:02:24.763144  1706 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:02:24.770846  8784 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:24.773109  8617 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:24.773541  8617 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:24.754830  8631 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.774333  8617 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.775456  8617 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:24.775607  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.776402  8631 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.766849  8589 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:24.753019  8694 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:24.778230  8589 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:24.778687  8694 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.781137  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.782851  1705 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:24.783927  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:24.785175  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:24.786567  9017 consensus_queue.cc:1059] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:24.786918  8984 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:24.790233  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:24.793985  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:24.795682  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1583) took 1951 ms. Trace:
I20260709 13:02:24.796113  2269 rpcz_store.cc:276] 0709 13:02:22.844751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.877216 (+ 32465us) service_pool.cc:224] Handling call
0709 13:02:24.794968 (+1917752us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 13:02:24.795155 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.795352 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.795379 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.795422 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:24.795460 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.795515 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.795621 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23983488}
I20260709 13:02:24.756878  8371 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:24.802584  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:24.799170  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:24.799849  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:24.803206  1705 raft_consensus.cc:3060] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:24.809544  1706 raft_consensus.cc:2410] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:02:24.811342  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:24.745352  8925 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:02:24.757031  8991 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:02:24.797225  8913 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:24.821137  1705 raft_consensus.cc:2410] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:02:24.801494  8828 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:24.757441  8911 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:24.834450  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.835220  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.831327  8911 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:24.814581  8965 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:24.822458  8836 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.815701  8910 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:02:24.849835  8694 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.841300  9024 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:24.839000  8913 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:24.858071  1631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2764) took 1903 ms (client timeout 1762 ms). Trace:
W20260709 13:02:24.858779  1631 rpcz_store.cc:269] 0709 13:02:22.954859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.955743 (+   884us) service_pool.cc:224] Handling call
0709 13:02:24.857796 (+1902053us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54002fa8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:24.857953 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3579914112}
W20260709 13:02:24.860548  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 119585us
W20260709 13:02:24.863464  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.864764  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.842846  8965 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.852849  9024 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:24.851306  8942 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.877566  8913 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.883342  8965 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:24.870245  8836 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:24.888773  9024 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.890283  9024 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:24.890669  8896 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:24.891225  8896 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:24.892318  8896 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.911127  8589 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:24.912889  8589 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:24.914296  8942 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:24.915176  8728 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:24.898326  8836 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:24.919318  8896 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:24.920249  8902 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:24.981266  1599 leader_election.cc:336] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.542s (SENT)
I20260709 13:02:24.983336  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:24.993424  1626 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:24.995851  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:24.918606  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 1.06615e+06us
I20260709 13:02:24.918113  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1586) took 2072 ms. Trace:
I20260709 13:02:25.011860  8404 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:25.010462  2262 rpcz_store.cc:276] 0709 13:02:22.845551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.451200 (+605649us) service_pool.cc:224] Handling call
0709 13:02:23.502551 (+ 51351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.503449 (+   898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.503479 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.581610 (+ 78131us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.818162 (+236552us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:23.836223 (+ 18061us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.917451 (+1081228us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b18004cee20. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:02:24.917648 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.917727 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.917773 (+    46us) raft_consensus.cc:1685] finished
0709 13:02:24.917882 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.918049 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16207,"prepare.queue_time_us":17801,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":12390,"raft.queue_time_us":1165758,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":4209,"spinlock_wait_cycles":9677568,"thread_start_us":200771,"threads_started":1,"wal-append.queue_time_us":335274}
I20260709 13:02:25.012866  8404 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:25.015844  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 1.16958e+06us
I20260709 13:02:25.018903  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.016616  8404 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:25.044641  8404 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:25.049137  8680 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:02:25.052479  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 48746us
W20260709 13:02:25.060725  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.061458  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.061525  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 301838us
I20260709 13:02:25.062582  8982 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.063393  8404 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.063688  8982 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.066665  8836 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:25.067135  8404 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:25.067454  8823 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.075873  8984 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:25.078859  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:25.079341  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.081069  2269 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22. Ops: []
W20260709 13:02:25.084218  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 73616.4us
I20260709 13:02:25.085630  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.086141  2267 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:25.086452  9039 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:25.079625  2262 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:25.088982  8941 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:25.078576  8747 consensus_queue.cc:1059] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:25.091001  8512 raft_consensus.cc:3055] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:25.091463  8512 raft_consensus.cc:740] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:25.091971  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.094231  2270 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:02:25.084365  8823 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.088232  9039 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:25.095119  8982 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:25.095364  9039 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:25.096946  8823 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:25.098479  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 63699us
I20260709 13:02:25.099749  2235 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:25.101828  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.103152  8902 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:25.104025  8902 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:25.104425  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.105520  2270 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:25.105185  8902 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.097047  9039 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.110440  9018 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:25.111645  9018 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:25.110476  8902 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:25.111953  9039 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:25.121301  9018 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:25.132613  8943 raft_consensus.cc:3055] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:25.129490  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:25.141569  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.133122  8943 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:25.152101  8943 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:25.153707  8943 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:25.150537  8404 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:25.178508  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2962) took 1130 ms. Trace:
I20260709 13:02:25.180111  1634 rpcz_store.cc:276] 0709 13:02:24.041775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.198473 (+156698us) service_pool.cc:224] Handling call
0709 13:02:25.146592 (+948119us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b540007b054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:25.171733 (+ 25141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106619648}
W20260709 13:02:25.182183  1552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 1401) took 2097 ms (client timeout 1929 ms). Trace:
W20260709 13:02:25.182885  1552 rpcz_store.cc:269] 0709 13:02:23.084302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.090867 (+  6565us) service_pool.cc:224] Handling call
0709 13:02:25.181575 (+2090708us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54001d38d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:25.181832 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832524544}
I20260709 13:02:25.186419  8404 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:25.199012  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 69774.5us
I20260709 13:02:25.201697  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.199957  8901 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:25.212898  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.224449  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:25.232019  2235 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:25.240149  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.318342  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.245296  8902 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:25.245543  8404 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:25.325628  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.331014  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:25.333387  1601 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:25.337008  8922 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:25.338439  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:25.338699  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.339399  8922 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:25.339708  8911 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:25.340442  8911 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:25.342353  8929 consensus_queue.cc:1059] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:25.347703  8902 raft_consensus.cc:697] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:25.352792  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:25.354099  9025 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:25.214280   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:25.356343  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.369096  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:25.372241  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:25.349143  8902 consensus_queue.cc:237] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.368057  8929 raft_consensus.cc:3055] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:25.376634  8404 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:25.386400  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.369710  8922 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:25.381934  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 81288.6us
I20260709 13:02:25.392004  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:25.389637  2270 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:25.341779  8911 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.385871  8929 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:25.402822  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.403858  2267 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:25.405761  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 53188.1us
I20260709 13:02:25.399452  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.415781  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.417454  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.418601  2265 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:25.418788  8864 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:25.421000  2262 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
W20260709 13:02:25.414606  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 46052.7us
I20260709 13:02:25.424600  2268 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:25.407706  8901 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.429104  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.399219  8404 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.436908  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.439895  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.442065  2262 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:25.424400  9039 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:25.446305  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.447486  2270 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 23: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:25.443748  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.449760  8982 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:25.450212  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:25.450601  8982 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.454270  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:25.456257  2265 raft_consensus.cc:2410] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
W20260709 13:02:25.455756  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.455564  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.455775  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.458391  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.460095  1599 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:25.458735  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1584) took 2612 ms. Trace:
I20260709 13:02:25.459427  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.466794  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:25.468429  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:25.469393  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.469882  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.431991  8922 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.494868  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.473840  8982 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:25.504376  8880 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:25.507099  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:25.510193  8964 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:25.512705  8929 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:25.461771  2264 rpcz_store.cc:276] 0709 13:02:22.845022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.876572 (+ 31550us) service_pool.cc:224] Handling call
0709 13:02:22.876899 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:22.902760 (+ 25861us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:23.711520 (+808760us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.066702 (+1355182us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:25.067748 (+  1046us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.088263 (+ 20515us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:25.088337 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.088491 (+   154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.454928 (+366437us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b540045b120. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddf44dbe 00007f06ddf4f930 00007f06ddf4f8d8 00007f06ddf4f858 00007f06ddf4f813 00007f06ddf4ea9c 00007f06e3e3a626 00007f06e3e34dd8 00007f06ddf8b7cb 00007f06ddf8e2c0
0709 13:02:25.455283 (+   355us) raft_consensus.cc:1685] finished
0709 13:02:25.455391 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.457469 (+  2078us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1132172,"prepare.queue_time_us":714977,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":1165863,"raft.run_cpu_time_us":458,"raft.run_wall_time_us":24793,"spinlock_wait_cycles":32328448,"thread_start_us":937841,"threads_started":2,"wal-append.queue_time_us":461706}
I20260709 13:02:25.479956  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.515051  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.502102  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.480844  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.480530  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:25.500834  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:25.522235  1557 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:25.500290  8747 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.452692  8901 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:25.533767  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 62227.9us
I20260709 13:02:25.492086  9039 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.539949  1552 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:25.541172  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.540571  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.481527  8985 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:25.545794  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:25.546710  1706 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:25.541807  8941 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:25.551676  8941 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:25.552083  8941 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:25.556990  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.519569  8823 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:25.559840  2270 raft_consensus.cc:2410] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:02:25.562791  1557 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
W20260709 13:02:25.564117  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 126279us
I20260709 13:02:25.566187  9025 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:25.566887  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:25.567327  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:25.568190  1707 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 16: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:25.568365  8589 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:25.572397  2269 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 23.
I20260709 13:02:25.573330  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.577925  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:25.480705  8512 consensus_queue.cc:260] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.582864  8512 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:25.583781  8748 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:25.584415  8748 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.586329  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.587947  2264 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:25.594216  8880 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.553531  8747 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:25.598863  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.600080  8747 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:25.600950  2265 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 23.
I20260709 13:02:25.603114  2263 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:25.571604  8964 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.606364  8929 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:25.571553  9045 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 13:02:25.612376  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 180322us
I20260709 13:02:25.611639  2262 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:25.613657  2271 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:25.617396  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.581841  8941 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.629333  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:25.635691  2263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 1615) took 1624 ms (client timeout 2153 ms). Trace:
W20260709 13:02:25.636093  2263 rpcz_store.cc:269] 0709 13:02:24.011672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.014435 (+  2763us) service_pool.cc:224] Handling call
0709 13:02:25.635501 (+1621066us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540064c8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:25.635623 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3624663936}
I20260709 13:02:25.636633  8748 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:25.638164  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:25.639021  2268 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:25.640599  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:25.641618  9042 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.212s	user 0.001s	sys 0.003s
I20260709 13:02:25.643994  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:25.626387  9043 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:02:25.643188  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:25.633436  2234 leader_election.cc:400] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:25.647735  2234 leader_election.cc:403] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:02:25.655341  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:25.656042  1702 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:25.656677  1707 raft_consensus.cc:2368] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
W20260709 13:02:25.657313  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 95001.6us
I20260709 13:02:25.666751  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:25.669543  1627 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:02:25.670017  1627 pending_rounds.cc:85] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 11
I20260709 13:02:25.675216  1705 raft_consensus.cc:2410] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:02:25.678014  2264 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:02:25.679406  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.681209  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.682741  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:25.683058  1633 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:25.664424  8911 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:25.671900  1627 pending_rounds.cc:107] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:02:25.630688  8985 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.686474  1627 raft_consensus.cc:2889] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:25.670264  8512 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:25.682749  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.693277  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:25.697090  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:25.687933  8911 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:25.702117  1560 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:02:25.699815  1705 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:25.702977  1700 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:25.701310  2266 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:02:25.705920  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:25.708153  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 169142us
I20260709 13:02:25.708348  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:25.709318  2268 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:25.698527  8941 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:25.704813  8911 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:25.719571  9049 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:02:25.689848  8589 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:02:25.716914  9039 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:25.728209  9025 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:02:25.734014  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.739326  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.738628  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.747334  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:25.736295  8896 consensus_meta.cc:287] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.006s
I20260709 13:02:25.750504  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.751274  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.751596  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:25.753328  8880 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:25.757476  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.756827  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:25.768810  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.771737  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.781932  1553 raft_consensus.cc:2393] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:25.782444  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.778187  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.787081  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.791743  1556 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 24: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:25.791770  1627 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:25.793704  8922 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:25.793258  1559 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:25.796782  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.799294  8718 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:02:25.770218  8404 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:25.783521  2266 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:25.808696  1705 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:02:25.769704  8964 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:25.768299  8901 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:25.829942  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 58576.7us
I20260709 13:02:25.840466  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:25.842825  1600 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:25.849056  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:25.849992  1558 raft_consensus.cc:2393] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:02:25.853616  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.854679  2235 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:25.847546  1599 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:25.857430  1706 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:25.864332  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.866508  1633 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:25.847805  8964 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:25.872571  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.876297  8902 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:25.879307  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.880880  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.882419  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.887095  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.885643  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:25.887907  1633 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:25.890748  8911 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:25.894366  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.894690  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:25.895134  1626 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:25.895275  2271 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
W20260709 13:02:25.896518  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 57903.6us
I20260709 13:02:25.897254  8911 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:25.897379  2235 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:25.902158  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 71252.2us
I20260709 13:02:25.839600  8943 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:02:25.904721  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:25.908067  1706 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
W20260709 13:02:25.917392  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.874426  8964 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:25.922224  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:25.920482  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:25.936348  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:25.937731  1700 raft_consensus.cc:2410] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:02:25.912482  8823 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:25.973739  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:25.915522  8512 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
W20260709 13:02:25.980049  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 49442.7us
W20260709 13:02:25.980816  2267 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.001s
I20260709 13:02:25.981227  2267 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:25.970705  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:25.998485  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 167294us
I20260709 13:02:25.994604  1627 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:25.932911  8902 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:25.935770  8964 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:25.937131  9025 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:25.936992  8680 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:26.020068  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:25.923594  8718 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.081s
W20260709 13:02:26.030764  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 173971us
W20260709 13:02:26.035230  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 98547us
I20260709 13:02:26.036264  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:26.009733  8901 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:25.935402  8933 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.156s
I20260709 13:02:26.002511  8880 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:26.040517  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 121360us
I20260709 13:02:26.039608  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:26.009531  8985 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:26.041684  1599 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.026674  8902 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:26.043699  8864 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:26.028362  9025 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:26.030419  8404 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:26.041154  8901 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:26.081442  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 52876.4us
I20260709 13:02:26.034672  8836 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:26.084477  2235 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.052270  8864 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.063865  9039 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:26.095539  9039 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:26.095993  9039 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.100498  8737 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.101329  8737 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:26.104858  1456 catalog_manager.cc:5697] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 11 to 18, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:26.111264  1709 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:26.113435  8589 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:26.118904  9025 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.121958  8966 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:26.122622  8966 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:26.126150  8836 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:26.128392  8836 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:26.104313  8737 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:26.132510  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.142418  8982 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:26.084084  8901 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:26.155638  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 287845us
W20260709 13:02:26.156723  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 65131.3us
I20260709 13:02:26.062932  8984 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 13:02:26.162370  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.098660  8864 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:26.083105  8911 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:26.179642  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 150319us
I20260709 13:02:26.179344  8747 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:26.188292  1705 raft_consensus.cc:1240] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:26.189211  8589 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:26.145677  8404 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.197104  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.204490  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:26.207262  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 54879us
I20260709 13:02:26.209853  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:26.210546  1709 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:26.212622  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:26.215021  8966 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.216415  8966 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:02:26.218127  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 162151us
I20260709 13:02:26.220013  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:26.222074  9065 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:26.222661  9065 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:26.223132  9065 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:26.226044  8964 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.226557  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:26.239148  8984 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:26.239244  9064 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:02:26.240777  9064 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:26.241279  9064 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:26.240772  1708 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: []
W20260709 13:02:26.237854  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 182556us
I20260709 13:02:26.249446  2235 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.256173  1706 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:02:26.260392  2235 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.284066  8704 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:26.284811  8836 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:26.285256  8836 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.285607  8836 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:26.290133  8880 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:26.246053  8982 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:26.294935  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.275974  8747 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:26.278426  8985 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:26.296977  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:26.297627  8985 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:26.298282  1524 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:26.299537  8896 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:26.299902  8985 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:26.300190  8896 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:26.300732  8896 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:26.301079  8896 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:26.300994  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:26.298411  1626 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:26.305405  9018 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.306912  1703 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:26.307834  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:26.310216  8880 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:26.310773  8748 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:02:26.311806  8748 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:26.312143  8748 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:26.312610  8880 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:26.313144  8748 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.315678  1627 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:02:26.319752  8512 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:26.322979  9039 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.325242  9039 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:26.251330  8902 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.327895  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:26.328153  9061 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:26.328599  9061 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:26.330004  8929 consensus_meta.cc:287] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.003s
I20260709 13:02:26.332417  8964 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:26.335848  2263 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:26.343853  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:26.344465  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.200276  8911 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:26.354866  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 172241us
I20260709 13:02:26.251634  8943 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:26.359149  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.364143  9039 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.329490  9061 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.346107  8747 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.364684  2264 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:26.381541  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:26.383379  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:26.384373  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:26.345525  8823 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:02:26.371912  8964 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:26.378425  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:26.381342  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:26.380977  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:26.384476  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:26.377632  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:26.395516  1630 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:26.372258  8680 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:26.384433  8880 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.390540  8985 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.383291  8748 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:26.377911  8737 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:26.415458  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.383595  8512 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:26.381608  8929 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:26.418203  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 74467.7us
W20260709 13:02:26.426434  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.426764  9081 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:26.428370  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.352787  9064 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:26.431111  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 251283us
I20260709 13:02:26.407776  9061 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:26.419157  8737 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:26.458283  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 89858.6us
I20260709 13:02:26.395161  8943 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.401060  8747 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.407148  8718 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.404639  8964 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:26.399130  8896 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:26.472234  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 43945.2us
I20260709 13:02:26.473064  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.410055  9039 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.460062  8737 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:26.474255  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.485044  1674 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:26.485925  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 81878.8us
W20260709 13:02:26.485792  9070 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:02:26.421115  8880 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:26.492228  1560 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 24. Current term is 25. Ops: []
I20260709 13:02:26.425284  8985 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:26.473862  9058 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:02:26.482414  8404 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:26.495883  8911 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:26.486210  9074 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:02:26.491305  2236 leader_election.cc:400] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19.
I20260709 13:02:26.499747  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:26.465061  9081 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:26.428049  8680 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:26.472431  8982 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:26.510562  1674 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.512115  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:26.514242  9057 log.cc:927] Time spent T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.311s	user 0.005s	sys 0.000s
I20260709 13:02:26.471433  8718 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.516140  8985 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:26.516901  8896 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:26.522162  9066 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:26.523116  1456 catalog_manager.cc:5697] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 16 to 18, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.529779  9083 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:26.530568  8911 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:26.530709  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 68793us
I20260709 13:02:26.531226  9080 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.546459  1553 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:26.531116  9082 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:02:26.533066  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 225335us
I20260709 13:02:26.541261  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:26.538121  9070 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:02:26.556156  9080 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:26.556888  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46479.6us
I20260709 13:02:26.557585  1674 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.559048  8929 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:26.560468  8929 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:26.560817  8964 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:26.561010  1627 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:26.561403  8964 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.561844  8964 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.562340  9066 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:26.563120  9066 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:26.563689  9066 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:26.563877  8964 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:26.564661  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 72914.3us
I20260709 13:02:26.565491  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.541245  8902 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:26.586422  8737 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.559341  8718 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:26.570814  8747 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:26.571106  9075 log.cc:927] Time spent T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:02:26.571341  8836 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.589437  9080 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:26.572700  8943 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:26.591477  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.591921  8836 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:26.589453  1599 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.575449  8680 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:26.578362  8880 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:26.578629  8982 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:26.580310  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:26.581475  1456 catalog_manager.cc:5697] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 10 to 15, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.582546  9081 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.583853  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:26.588361  9039 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:26.610790  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:26.611006  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 82707.1us
I20260709 13:02:26.591581  9082 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:26.576475  9064 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:26.612543  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 55037us
I20260709 13:02:26.615456  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:26.619112  8864 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.620935  8880 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.621570  9090 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:26.622112  8823 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.613114  8704 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:26.614903  9082 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:26.644914  1674 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.625252  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:26.651314  1456 catalog_manager.cc:5697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 11 to 22, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 22 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.592686  8911 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:02:26.654699  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:26.609519  8747 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:26.656702  1630 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:26.658443  2263 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 13:02:26.659619  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 70254.9us
I20260709 13:02:26.623746  8982 consensus_queue.cc:1243] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:26.660847  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:26.661423  9077 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:26.643401  8836 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:26.647814  9039 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:26.671180  1701 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:26.704983  1673 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.668918  1599 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:26.671257  1456 catalog_manager.cc:5697] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 18 to 20, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.602864  9065 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.655462  8902 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:26.717010  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 105134us
I20260709 13:02:26.670631  8737 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:26.733919  1456 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 14 to 21. New cstate: current_term: 21 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:26.711468  9073 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.251s	user 0.000s	sys 0.002s
I20260709 13:02:26.653012  8880 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.674222  8748 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:26.749214  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:26.704741  8836 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:26.751487  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:26.712010  8982 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:26.753937  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:26.751869  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:26.752449  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 93783.3us
I20260709 13:02:26.753448  2264 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:26.725827  9090 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:26.759202  2266 raft_consensus.cc:2410] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:02:26.718505  9083 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:26.725772  8404 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:26.755460  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:26.734966  9039 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:26.756389  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:26.733891  8747 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:26.763609  1456 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:26.764947  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 106029us
I20260709 13:02:26.763101  2269 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:26.753997  8836 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:26.774442  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:26.775318  1704 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 19: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:26.774565  1456 catalog_manager.cc:5697] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 11 to 16, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:26.777319  1456 catalog_manager.cc:5697] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 14 to 23, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 23 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:26.768893  8747 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.780180  8747 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:26.781054  9088 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 13:02:26.782526  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 157064us
I20260709 13:02:26.783519  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:26.786125  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.787905  9086 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:26.788463  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:26.788556  9086 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:26.789289  9086 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:26.789747  9093 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:26.790249  9093 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.790563  9093 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:26.795496  1455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35556 (request call id 322) took 21209 ms (client timeout 15000 ms). Trace:
I20260709 13:02:26.756249  8748 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.798513  8748 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:26.716640  9082 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.799883  9082 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:26.802034  8896 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.802670  8896 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.804988  8896 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:26.805348  8836 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:26.806674  9084 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:02:26.807119  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 94292.7us
I20260709 13:02:26.810388  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:26.811980  8748 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:26.779589  1456 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.820003  9093 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:26.864451  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.820413  8941 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:02:26.824872  9085 log.cc:927] Time spent T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.174s	user 0.002s	sys 0.000s
I20260709 13:02:26.826462  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:26.827971  9039 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.747606  8902 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.835392  9065 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:26.760139  8982 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.836903  9064 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:26.842211  8864 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:26.842182  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:26.734550  9077 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:26.847121  2234 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:02:26.848316  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.858060  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 72038.1us
I20260709 13:02:26.867517  1456 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 18 to 20, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.887532  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:26.914361  2266 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:26.893862  1703 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:26.897055  1708 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:26.898458  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 150285us
I20260709 13:02:26.897179  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:26.766619  8737 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:26.904042  1707 raft_consensus.cc:1240] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:02:26.860526  8404 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:26.927910  8737 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.928493  8737 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:26.929618  1456 catalog_manager.cc:5697] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 8 to 16, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:26.931381  1702 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:02:26.931813  1702 pending_rounds.cc:85] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 10
I20260709 13:02:26.932053  1702 pending_rounds.cc:107] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:02:26.932291  1702 raft_consensus.cc:2889] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:26.934661  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 87561.6us
I20260709 13:02:26.916728  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:26.932247  1456 catalog_manager.cc:5697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 15 to 16, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 16 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.868907  8941 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:26.920377  9091 raft_consensus.cc:2764] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:02:26.920589  8836 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:26.943557  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:26.947592  2270 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:26.767480  9083 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:26.946434  2268 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:26.945572  1456 catalog_manager.cc:5697] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 11 to 19, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:26.919174  1526 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:26.953723  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:26.954746  1634 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:02:26.901073  9064 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:26.890363  8933 consensus_queue.cc:1059] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:02:26.888952  8748 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:26.961472  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:26.962296  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:26.948771  9074 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:02:26.966763  1700 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:26.967497  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:26.944272  8704 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:26.906090  8718 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:02:26.914994  9067 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:02:26.963920  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:26.959115  8404 raft_consensus.cc:2764] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:02:26.956735  9065 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:26.964360  8901 consensus_meta.cc:287] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.789s	user 0.007s	sys 0.005s
I20260709 13:02:26.961295  9064 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:26.961436  8911 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.992437  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:26.970330  8704 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.996019  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:27.005860  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.006572  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.006778  1704 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
W20260709 13:02:27.018965  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 192669us
W20260709 13:02:26.796098  1455 rpcz_store.cc:269] 0709 13:02:05.441870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.443073 (+  1203us) service_pool.cc:224] Handling call
0709 13:02:26.648170 (+21205097us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:23.747655 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:23.808321 (+ 60666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:23.808364 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:02:23.808385 (+    21us) tablet.cc:662] Decoding operations
0709 13:02:23.809788 (+  1403us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:23.809848 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:23.809878 (+    30us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:02:23.890634 (+ 80756us) tablet.cc:701] Row locks acquired
0709 13:02:23.890656 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:02:23.890808 (+   152us) write_op.cc:270] Start()
0709 13:02:23.890932 (+   124us) write_op.cc:276] Timestamp: P: 1783602143890756 usec, L: 0
0709 13:02:23.890951 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:02:23.891652 (+   701us) log.cc:844] Serialized 5179 byte log entry
0709 13:02:24.468367 (+576715us) op_driver.cc:464] REPLICATION: finished
0709 13:02:24.487305 (+ 18938us) write_op.cc:301] APPLY: starting
0709 13:02:24.487401 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:24.503654 (+ 16253us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:24.503790 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:24.593334 (+ 89544us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:24.593680 (+   346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:02:24.593734 (+    54us) write_op.cc:312] APPLY: finished
0709 13:02:24.594112 (+   378us) log.cc:844] Serialized 121 byte log entry
0709 13:02:24.594277 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:24.594436 (+   159us) write_op.cc:454] Released schema lock
0709 13:02:24.594496 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:24.594876 (+   380us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:24.594911 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":101991,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":17561,"apply.run_cpu_time_us":20254,"apply.run_wall_time_us":107545,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58441,"num_ops":13,"prepare.queue_time_us":654923,"prepare.run_cpu_time_us":47618,"prepare.run_wall_time_us":261675,"raft.queue_time_us":211194,"raft.run_cpu_time_us":4834,"raft.run_wall_time_us":22624,"replication_time_us":575301,"thread_start_us":787451,"threads_started":4,"wal-append.queue_time_us":310475,"wal-append.run_cpu_time_us":74935,"wal-append.run_wall_time_us":1395548}]]}
I20260709 13:02:27.030933  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:27.031813  1700 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:27.001425  8704 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:26.980283  8864 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:02:27.034292  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:27.036564  1704 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 15: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:27.033314  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:27.037287  1559 raft_consensus.cc:2410] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:02:26.987094  9080 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:02:27.037110  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:27.042191  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.042598  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:27.022161  9090 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.046221  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.042734  1701 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:27.005613  8911 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:27.002259  8901 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.056586  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.058303  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.118490  9102 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.119486  1634 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:27.119251  9102 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:27.120282  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 59980.5us
I20260709 13:02:27.046243  8864 consensus_queue.cc:1243] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:27.040915  8880 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:27.121456  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63252.9us
I20260709 13:02:27.122506  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.124176  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:27.127243  1558 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 24. Current term is 25. Ops: []
I20260709 13:02:27.130113  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.130926  1704 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:27.131384  2267 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:27.133343  1558 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:27.128547  1703 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:27.138514  1626 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:27.138525  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:27.148703  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:27.150345  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:27.150995  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.155200  1700 raft_consensus.cc:2410] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:02:27.151484  1559 raft_consensus.cc:1275] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:02:27.131160  9093 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:27.164076  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:27.164865  2268 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:27.165675  1634 pending_rounds.cc:85] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 10
I20260709 13:02:27.165977  1634 pending_rounds.cc:107] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:02:27.166227  1634 raft_consensus.cc:2889] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:27.166772  8823 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:27.168082  9094 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:27.168514  9094 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:27.164304  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:27.168883  9094 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:27.164079  1556 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 13:02:27.170128  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:27.167539  8823 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.171330  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.174423  9078 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.126s
I20260709 13:02:27.174700  1700 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 13:02:27.178508  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:27.161602  2236 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:27.055660  9090 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:27.203410  1704 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:27.149962  8880 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:27.211078  2270 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:27.214833  2268 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:27.159842  8982 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:27.231279  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 181990us
I20260709 13:02:27.232937  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.160792  8896 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:27.243368  1701 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:27.193883  8933 raft_consensus.cc:3055] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:27.205111  9097 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:27.192600  9025 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:02:27.253046  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 115267us
I20260709 13:02:27.261799  1702 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:27.198273  8512 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
I20260709 13:02:27.243263  9083 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.151787  8941 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.245239  8902 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:27.250006  9097 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:27.248265  8933 raft_consensus.cc:740] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:27.252727  9025 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:27.249933  8896 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:27.284929  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.269411  8982 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.271190  8748 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.271377  8747 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:27.280723  9101 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:02:27.281503  9097 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:27.292227  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 157937us
I20260709 13:02:27.281230  8864 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:27.300024  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:27.302017  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:27.310329  1702 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:27.300139  9106 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:02:27.313584  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:27.332157  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:27.337186  1632 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:27.309968  8748 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.338181  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:27.338711  8748 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.339407  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:27.333765  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:27.340927  8748 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:27.314342  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:27.314605  1552 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:27.335522  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.286453  8902 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:02:27.319705  8911 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.320796  8901 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:27.306413  8982 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.326282  8933 consensus_queue.cc:260] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.342133  1551 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:27.330323  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:27.353859  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:27.358345  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 89787.5us
I20260709 13:02:27.356247  1553 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:27.331851  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.360381  1674 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:27.315052  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:27.333953  1601 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.343978  2266 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:27.334298  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:27.308254  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:27.364187  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 56040.5us
I20260709 13:02:27.388633  2265 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:02:27.390638  1707 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:27.335088  9090 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:27.411698  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 57941.9us
W20260709 13:02:27.413690  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 61140.9us
I20260709 13:02:27.414832  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.412845  1599 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:27.415403  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:27.416015  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.416112  1705 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:27.418337  2269 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:27.343847  8704 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.419050  9082 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:27.419493  9082 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:27.419821  8896 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.420506  9105 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:27.420364  9082 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.388882  9091 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:27.415469  1709 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
W20260709 13:02:27.413190  9088 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:27.420392  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:27.391434  9080 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:27.424340  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 139828us
I20260709 13:02:27.390182  8748 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:27.357499  8737 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.417480  9110 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:27.424909  9091 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.434796  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.437518  8836 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:27.438989  9120 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.439517  9120 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.441712  9120 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:27.413338  9065 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:02:27.330351  9025 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.411605  9081 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:02:27.428891  8680 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:02:27.447974  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 114119us
I20260709 13:02:27.448009  1630 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:27.434418  8748 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.505349  8748 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.447558  8737 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:27.467881  9097 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.430152  9080 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.473860  1702 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:27.442270  9096 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:27.508363  1601 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:27.476369  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:27.432389  9082 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:27.452407  9091 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:27.515924  9097 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.512369  9080 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:27.518273  2266 raft_consensus.cc:1240] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:27.519006  9120 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:27.519209  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:27.519446  9120 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:27.519867  1703 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:27.522710  9091 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:27.523023  9102 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.524887  9091 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:27.526911  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:27.527498  1552 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:27.530143  9119 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.530750  9119 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.531777  8864 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:27.532238  8864 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:27.533149  9119 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:27.534754  9118 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:02:27.541710  1552 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:27.546725  1674 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:27.560335  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:27.559078  1703 raft_consensus.cc:2410] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:02:27.448547  8880 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:27.447602  8982 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.446622  8902 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.448407  8901 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.567162  8404 raft_consensus.cc:2804] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:27.574494  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:27.558490  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 132271us
I20260709 13:02:27.475955  9067 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.109s
W20260709 13:02:27.574796  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 137197us
I20260709 13:02:27.584766  9128 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:27.586807  8680 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:27.579131  8922 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:02:27.579335  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 164563us
W20260709 13:02:27.588088  9064 consensus_meta.cc:287] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.003s
I20260709 13:02:27.558709  9091 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:27.590957  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:27.632632  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.635159  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.635926  1702 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:27.641376  1554 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:02:27.615933  9086 consensus_meta.cc:287] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.826s	user 0.008s	sys 0.004s
I20260709 13:02:27.615815  9102 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:27.648166  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:27.559777  9120 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:27.649116  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:27.650103  9120 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:27.577832  9080 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.646664  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:27.615561  9128 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.649132  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:27.651602  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 143466us
I20260709 13:02:27.631932  9105 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:27.655752  2269 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 19: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:27.633702  8922 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:27.591584  8902 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.660815  1702 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:27.592227  8901 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.647415  9096 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.654459  9097 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:27.638695  9064 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:27.669281  9105 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.677736  8404 raft_consensus.cc:697] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:27.654706  9128 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:27.680253  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 48457.4us
I20260709 13:02:27.638221  9094 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.664265  9091 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:27.647710  9086 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.679111  9097 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.719178  1555 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:27.718659  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45401.4us
W20260709 13:02:27.723740  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.731838  1703 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:27.733510  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:27.693524  9091 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:27.673278  9096 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:27.728125  9130 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.097s
I20260709 13:02:27.759690  9096 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.694451  8680 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.755442  9105 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:27.763008  8922 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.764827  8922 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:27.771449  9064 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.771881  8902 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.773766  9141 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:27.774791  9091 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:27.774665  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:27.751860  9086 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:27.775846  9086 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:27.775970  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 46150us
I20260709 13:02:27.776263  9086 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:27.776400  9080 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:27.773936  9094 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.724864  9097 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:27.777472  1673 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.778393  9139 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:27.778707  8901 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.776726  9086 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:27.778884  9139 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:27.780418  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:27.782933  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 55741.5us
W20260709 13:02:27.783695  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.779649  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 116222us
I20260709 13:02:27.785691  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:27.786662  1553 raft_consensus.cc:2393] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 21: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:27.786877  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.792410  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:27.792831  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:27.729563  9122 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:02:27.751816  9135 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:02:27.805248  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.806409  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:27.815959  1700 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:27.822284  1627 raft_consensus.cc:2393] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:27.815361  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:27.735879  8943 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.827288  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.792380  8880 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:27.840670  1702 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
W20260709 13:02:27.854633  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 69510.4us
W20260709 13:02:27.845372  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 58550.2us
I20260709 13:02:27.785740  9139 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:27.756508  8864 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.856137   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:27.837905  9094 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:27.792083  8911 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:02:27.859018  9128 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:27.860399  8512 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:27.860782  8512 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:27.861528  9128 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:27.862190  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 75876.3us
I20260709 13:02:27.864341  1635 raft_consensus.cc:1240] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:02:27.864499  1601 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.868489  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.873389  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:27.878476  2269 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 22: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:27.883471  8864 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:27.883679  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:27.884176  2262 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:27.884496  1553 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:27.887832  8911 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:27.889232  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:27.861655  8512 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.890601  9144 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:27.891289  8512 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:27.891700  9140 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:27.854230  8404 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:27.892251  9140 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:27.872766  8880 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:27.893502  9140 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.896525  9140 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:27.905174  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:27.909171  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1621) took 1006 ms. Trace:
I20260709 13:02:27.909673  2264 rpcz_store.cc:276] 0709 13:02:26.903028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.903144 (+   116us) service_pool.cc:224] Handling call
0709 13:02:26.926377 (+ 23233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.986832 (+ 60455us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:02:27.182228 (+195396us) log.cc:844] Serialized 14 byte log entry
0709 13:02:27.303974 (+121746us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:27.304023 (+    49us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:27.304072 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.908913 (+604841us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b5400289bd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:27.908967 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.909106 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":273092,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3598,"raft.queue_time_us":18428,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":138519424,"thread_start_us":271933,"threads_started":2,"wal-append.queue_time_us":230740}
I20260709 13:02:27.913611  2235 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.916414  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.917002  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.918223  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:27.919631  1553 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:27.920018  1700 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:27.921973  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:27.841424  8943 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:27.924003  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.917081  1707 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:27.941426  1707 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:02:27.948202  2235 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.957141  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:27.957888  1632 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:27.958019  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:27.958215  8943 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:27.924314  1554 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:27.961294  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:27.962215  9095 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:27.962662  9102 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:27.964099  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.965531  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:27.966480  2262 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:02:27.965572  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:27.967288  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 102873us
I20260709 13:02:27.967829  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.971715  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.942279  1600 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:27.977963  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.978444  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:27.975685  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:27.987251  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45050.8us
I20260709 13:02:27.992110  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:27.996166  1707 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 19: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:27.998273  1708 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
W20260709 13:02:28.037267  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 69456.5us
I20260709 13:02:27.974762  8880 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:28.038228  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.970109  9082 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:28.046506  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:28.048087  1601 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.975263  9095 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:27.975441  8864 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:28.006043  8680 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:27.966554  8901 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:02:28.001390  9102 raft_consensus.cc:2804] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:27.995872  9065 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.996217  9120 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.990132  8902 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:28.001219  8896 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:28.060845  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:27.961913  9086 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:28.064400  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 195932us
I20260709 13:02:28.058115  8589 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:28.001646  9094 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.061s
I20260709 13:02:28.060768  9105 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:28.058595  8880 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:02:28.109753  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.119480  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:28.078473  9128 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:28.125183  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:28.085899  8589 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.124827  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:28.132266  2269 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 21: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:28.122226  2264 raft_consensus.cc:2376] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20. Re-sending same reply.
I20260709 13:02:28.057826  9097 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.059329  9082 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.064821  8911 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 13:02:28.088388  9105 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:28.135092  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 95572.2us
I20260709 13:02:28.092062  9078 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.141420  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 71458.7us
I20260709 13:02:28.071165  9120 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.145401  1601 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.071364  9065 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.125896  8404 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:28.147357  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.149070  2270 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:02:28.127280  8901 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:28.135838  8589 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:28.147873  9078 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.156287  9132 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:28.145130  9105 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:28.193367  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 204541us
I20260709 13:02:28.156536  9128 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:28.162879  9145 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:28.200078  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:28.202235  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:28.202695  1553 raft_consensus.cc:2368] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20.
I20260709 13:02:28.200888  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:28.203914  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:28.204636  1553 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:28.205600  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:28.206216  2235 leader_election.cc:400] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20.
I20260709 13:02:28.206453  1553 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 24: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:28.206665  2235 leader_election.cc:403] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.207736  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:28.208834  2235 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:28.186169  9151 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:28.214540  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.215708  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.214612  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:28.217200  1556 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 25: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:28.199110  8718 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.223094  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.199334  9136 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:28.177698  9082 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.220757  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:28.164376  8404 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.166368  8901 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.199978  9145 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:28.214365  8902 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:28.230986  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.215057  9128 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.154561  9121 consensus_queue.cc:1048] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.191s
I20260709 13:02:28.237702  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.238739  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.155045  9138 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.172s
I20260709 13:02:28.241663  2262 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:28.233914  9145 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:28.155658  9142 consensus_queue.cc:1059] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.265s
I20260709 13:02:28.244508  9161 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:28.245241  9153 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:02:28.246886  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.234982  8902 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.262539  1630 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:28.253621  1632 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:28.060389  9095 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.218111  9151 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.264446  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.243320  9094 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20.
I20260709 13:02:28.266970  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:28.288064  1634 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
W20260709 13:02:28.269362  8922 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.003s
I20260709 13:02:28.269878  9025 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:28.264546  9161 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.243909  9086 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.279076  8404 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:28.280670  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 3052) took 1493 ms. Trace:
I20260709 13:02:28.200713  8880 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.223366  9091 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.285269  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:28.228519  8718 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.296587  9151 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:28.297029  8941 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:28.298147  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.298516  9095 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:28.298951  9149 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:02:28.299111  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.300001  9039 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.300640  9146 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:02:28.302217  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2995) took 1246 ms. Trace:
I20260709 13:02:28.302459  2266 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:28.303020  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:28.303117  9078 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.303761  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.303967  8704 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.305887  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.388198  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.234114  9158 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:02:28.297785  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:28.281153  8902 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:28.323920  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.326990  9173 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.241083  9128 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.351532  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:28.393898  1701 raft_consensus.cc:3060] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:28.360371  2268 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:28.355861  1673 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.324195  9142 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.307811  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.372520  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.371604  1555 rpcz_store.cc:276] 0709 13:02:26.787119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.787351 (+   232us) service_pool.cc:224] Handling call
0709 13:02:26.787716 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.721080 (+933364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.280377 (+559297us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b540031ea54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:28.280586 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2086873856}
I20260709 13:02:28.375088  2262 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:28.372846  9097 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.380043  1560 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:28.369079  9120 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.388129  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.380163  1631 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:28.371332  9102 raft_consensus.cc:697] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:28.389420  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:28.305228  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.386181  1635 rpcz_store.cc:276] 0709 13:02:27.055765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.055882 (+   117us) service_pool.cc:224] Handling call
0709 13:02:27.864129 (+808247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.866612 (+  2483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.302004 (+435392us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b5400089dd0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:28.302144 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698978176}
I20260709 13:02:28.398762  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:28.396052  1524 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:28.401610  9173 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.400753  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:28.407248  8718 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.407342  9173 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.389218  9039 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.409828  9039 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.411042  9091 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.412608  9102 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.416635  9161 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:02:28.417403  9078 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:28.418078  9078 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:28.418205  9142 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.419255  9078 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.420356  9142 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.421247  9097 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:28.421797  9097 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.422544  9128 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.422624  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:28.423964  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 68199us
I20260709 13:02:28.424238  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:28.425259  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.425678  9175 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:28.426874  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1631) took 1061 ms. Trace:
I20260709 13:02:28.427109  9175 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:28.427251  2263 rpcz_store.cc:276] 0709 13:02:27.365393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.365518 (+   125us) service_pool.cc:224] Handling call
0709 13:02:27.407114 (+ 41596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.638983 (+231869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.639018 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:27.663450 (+ 24432us) log.cc:844] Serialized 26 byte log entry
0709 13:02:27.835686 (+172236us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:27.835738 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.835816 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.426669 (+590853us) raft_consensus.cc:1685] finished
0709 13:02:28.426688 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.426801 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6003,"raft.queue_time_us":38889,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":366183,"threads_started":2,"wal-append.queue_time_us":332811}
I20260709 13:02:28.404788  9120 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:28.429664  9120 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:28.430581  9120 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.431447  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:28.432538  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:28.433223  9077 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.434398  1633 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:28.424504  9097 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.436414  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:28.425644  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.437420  1707 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:02:28.437573  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.438391  1701 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:28.439129  2234 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:28.439393  9065 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.439692  8896 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:28.440798  9018 consensus_queue.cc:1059] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:28.446434  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.497232  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:28.449605  1601 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.449738  2266 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
W20260709 13:02:28.498888  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 49324.9us
I20260709 13:02:28.500109  8737 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:28.500624  8737 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:28.501068  8737 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:28.449605  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:28.452665  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:28.503007  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 53444us
I20260709 13:02:28.503703  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:28.504341  1635 raft_consensus.cc:3060] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:28.437353  8901 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.452997  9171 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:28.505131  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 66052.8us
I20260709 13:02:28.503769  1673 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.521652  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.527638  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.529441  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:28.532399  1632 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:28.540068  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.506837  9090 raft_consensus.cc:2764] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 13:02:28.550055  9139 consensus_meta.cc:287] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.004s
I20260709 13:02:28.541700  2234 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.533352  8896 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:28.534507  9173 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:28.559137  9090 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:28.559973  9090 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.508857  9105 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.548403  8901 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:28.545899  9172 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:28.558396  9094 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:28.576640  2271 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:02:28.579448  2271 pending_rounds.cc:85] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 11
I20260709 13:02:28.579708  2271 pending_rounds.cc:107] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:02:28.579926  2271 raft_consensus.cc:2889] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.556089  9139 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.620764  1632 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:28.625219  2234 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:02:28.586606  9140 consensus_meta.cc:287] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.001s
I20260709 13:02:28.642045  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.618156  8941 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.643038  1632 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 15.
I20260709 13:02:28.616775  8823 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.622617  9172 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:28.646384  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 212461us
I20260709 13:02:28.638677  8901 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:28.641916  9156 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:28.655479  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:28.655524  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:28.663704  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:28.664625  2268 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:02:28.664775  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:28.668975  9154 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.486s	user 0.000s	sys 0.004s
I20260709 13:02:28.671140  9139 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.671777  8902 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.673492  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.652997  9172 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.686620  9172 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.688997  1629 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 25.
I20260709 13:02:28.678870  8880 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:28.674458  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:28.691071  8589 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.002s
I20260709 13:02:28.691377  2263 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:28.691519  8589 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.692195  8880 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.693495  8880 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:28.650595  8941 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.690573  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.674355  2262 raft_consensus.cc:2410] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 13:02:28.697297  1628 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:28.697502  1635 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:28.675307  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:28.698884  8911 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:28.701249  8737 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.704231  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.705722  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.664331  8901 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:28.706555  1632 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 22: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:28.707167  8901 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.707532  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:28.710459  1634 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 24. Current term is 25.
I20260709 13:02:28.710354  8737 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.708873  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.679392  9090 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:28.714322  1632 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:02:28.650676  8896 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.715906  1632 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:28.717504  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:28.724570  9155 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:02:28.723677  9082 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:28.729674  9082 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.730103  9082 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:28.734401  8747 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:28.734963  8747 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:28.739982  9064 raft_consensus.cc:3055] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:28.740518  9064 raft_consensus.cc:740] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:28.742431  9119 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.742947  9119 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.743341  8902 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.745047  9119 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.745565  9145 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.718624  9187 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:28.741394  9064 consensus_queue.cc:260] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.762395  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 3060) took 1449 ms. Trace:
I20260709 13:02:28.762846  1559 rpcz_store.cc:276] 0709 13:02:27.312785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.312914 (+   129us) service_pool.cc:224] Handling call
0709 13:02:27.313201 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.341720 (+ 28519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.341763 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:27.341820 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:27.341859 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.762169 (+1420310us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b5400182c54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:28.762214 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.762334 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65100032}
I20260709 13:02:28.768126  9119 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.768685  9119 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.769651  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:28.770397  1559 raft_consensus.cc:2393] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 19: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:28.771104  9145 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.771291  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:28.772835  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:28.774408  8896 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:28.774992  8896 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.775409  9094 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:28.776932  9119 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.766427  9064 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:28.778466  8589 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.779089  8589 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:28.765623  9187 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:28.781980  9187 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.783027  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1622) took 1879 ms. Trace:
I20260709 13:02:28.783418  2265 rpcz_store.cc:276] 0709 13:02:26.903352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.903452 (+   100us) service_pool.cc:224] Handling call
0709 13:02:27.362981 (+459529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.394276 (+ 31295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.782839 (+1388563us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54005933d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:28.782972 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003072768}
I20260709 13:02:28.784148  9187 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.777056  8896 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.785926  1560 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:28.786499  1632 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:02:28.777064  8941 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:28.787629  8941 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:28.788268  8941 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.790951  8941 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.793045  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.793699  1627 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:28.797735  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1627) took 1887 ms. Trace:
I20260709 13:02:28.798154  2271 rpcz_store.cc:276] 0709 13:02:26.910826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.130200 (+219374us) service_pool.cc:224] Handling call
0709 13:02:27.141123 (+ 10923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.583770 (+1442647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.797504 (+213734us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400730354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:28.797677 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3295052544}
I20260709 13:02:28.779572  8589 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.802383  8589 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.803979  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:28.805038  1551 raft_consensus.cc:2393] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:28.804250  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:28.806180  8880 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.806557  1559 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 24.
I20260709 13:02:28.803674  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:28.808983  1560 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:28.810576  8982 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.811079  8982 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.813140  8982 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.815339  9136 raft_consensus.cc:3055] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:28.815734  9136 raft_consensus.cc:740] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:28.816071  9082 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.816519  9136 consensus_queue.cc:260] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.818396  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:28.819104  1555 raft_consensus.cc:2393] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 25: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:28.822444  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.823650  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.824299  9172 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:28.824996  9172 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:28.826083  2235 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:28.827929  9119 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:28.828297  9119 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.828606  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:28.833823  9166 consensus_queue.cc:1059] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:28.828649  9119 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:28.835579  1631 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:28.835829  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.836580  1634 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 25: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:28.836615  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.833981  1628 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:28.834087  9145 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:28.838840  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:28.839367  1628 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:02:28.839654  9178 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:28.840039  9178 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:28.840991  9081 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:28.840855  9178 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.841794  9081 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:28.842571  9081 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:28.842869  9081 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:28.842972  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 3004) took 1519 ms. Trace:
I20260709 13:02:28.843331  1629 rpcz_store.cc:276] 0709 13:02:27.323697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.333918 (+ 10221us) service_pool.cc:224] Handling call
0709 13:02:28.842800 (+1508882us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540018e7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:28.842895 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3027903872}
I20260709 13:02:28.843748  9081 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.844862  9081 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:28.846179  8943 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:28.846570  8943 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:28.847350  8943 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:28.848491  8943 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:28.849318  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.853120  9105 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:28.838641  9145 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.817898  9136 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:28.837775  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.872706  9178 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:28.872666  9082 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.906400  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 3070) took 1122 ms. Trace:
I20260709 13:02:28.908039  1628 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:28.908113  1627 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
W20260709 13:02:28.909574  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 81016.5us
I20260709 13:02:28.919332  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:28.920142  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:28.907164  1554 rpcz_store.cc:276] 0709 13:02:27.784341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.792105 (+  7764us) service_pool.cc:224] Handling call
0709 13:02:28.850620 (+1058515us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540030af54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:28.906313 (+ 55693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300982016}
I20260709 13:02:28.910343  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:28.912348  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:28.900517  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:28.914280  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:28.915174  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:28.936875  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:28.938859  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:28.921532  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:28.972021  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:28.974220  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:28.988153  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 66660.5us
I20260709 13:02:28.979941  1630 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:28.991463  1560 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:28.995715  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:28.996176  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:28.915390  9139 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:02:28.912896  8941 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:28.997469  8941 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:28.998575  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:28.998996  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:28.999469  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:28.999660  8941 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:28.996794  2265 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:29.001121  9083 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:29.001641  9187 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:29.002210  9187 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.001705  9083 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.002554  9187 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:29.004069  8880 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:29.004622  9083 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:29.005208  9083 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:29.006315  9169 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:29.006675  9169 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:29.007452  9169 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:29.009008  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.009367  2265 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:29.010231  9187 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.012434  9187 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:29.013744  9169 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:29.014190  9166 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:29.014724  9166 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 23 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:29.015560  9166 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.017438  1560 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 25.
I20260709 13:02:29.019495  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:29.020690  1526 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:29.021466  8943 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:29.022197  8943 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:02:29.026986  9145 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:28.915076  9173 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:29.042641  9173 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:29.044509  9156 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:29.044977  9087 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:29.048952  9119 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.001008  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:29.050504  1708 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:29.054827  8747 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.009487  9018 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.061702  9018 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.062914  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:29.063802  9018 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:29.064002  8836 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:28.976833  9094 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.065716  8836 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.066501  9094 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.068254  8836 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:29.068660  9094 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:29.069254  8836 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:29.070003  8836 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:28.946609  8589 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:29.071193  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 151038us
I20260709 13:02:29.072352  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:29.073251  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.076216  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 96656.2us
I20260709 13:02:29.077088  2262 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:29.079530  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:29.080065  2262 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:28.938124  9172 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:28.987625  9111 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:29.072434  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 91802.2us
W20260709 13:02:29.087296  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 173040us
I20260709 13:02:29.090799  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:29.091464  1633 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:29.092819  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 69424.9us
I20260709 13:02:29.093801  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:29.099943  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 108760us
W20260709 13:02:29.106284  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.106933  2236 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:29.109972  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:29.110574  1700 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:29.114441  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:29.115272  2265 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:29.117393  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.128155  2262 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 25.
I20260709 13:02:29.135017  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:29.136870  1706 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:29.139019  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:29.140388  2263 raft_consensus.cc:1240] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:29.057183  8747 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:29.154912  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.070616  8836 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:29.146093  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.163384  1560 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:29.146795  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:29.148772  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:29.164928  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:29.165633  2265 raft_consensus.cc:2393] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:29.165019  1703 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:29.149433  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:29.156517  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:29.156539  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 54844.6us
I20260709 13:02:29.158692  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:29.159068  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.159457  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.172936  1709 raft_consensus.cc:2410] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:02:29.161229  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:29.173530  2264 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:29.179389  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:29.180058  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:29.116727  9182 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:29.083741  9172 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:29.185338  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:29.185475  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.148229  9064 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:29.186403  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:29.167239  8929 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:02:29.185384  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:29.231019  2262 raft_consensus.cc:2368] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20.
I20260709 13:02:29.189633  1556 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:29.133936  9187 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:02:29.190241  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:29.190642  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:29.235702  2265 raft_consensus.cc:2368] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18.
I20260709 13:02:29.192546  2264 raft_consensus.cc:2410] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:02:29.194489  9082 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:29.194661  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 59696.8us
W20260709 13:02:29.195422  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.235703  2268 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 17: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:29.143502  9139 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:29.147989  9156 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:29.185582  2270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:02:29.222231  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.221092  1705 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:29.224069  9130 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:29.221323  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:29.228272  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.229065  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.238216  1526 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:29.150177  9025 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.077s
I20260709 13:02:29.135842  8589 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:29.246328  1709 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:29.223078  9172 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:29.263756  1600 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:29.247654  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.265105  1706 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 23: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:29.250075  9156 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.250830  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:29.252125  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.256688  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.261112  2263 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:29.143905  9111 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.265937  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:29.271961  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:29.276746  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.277828  1706 raft_consensus.cc:2410] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:02:29.239239  9182 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.280589  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.282379  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:29.283283  2263 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 25.
I20260709 13:02:29.285979  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.287279  1706 raft_consensus.cc:2410] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 13:02:29.288584  1551 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:29.291318  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:29.292552  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:29.295037  2236 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:29.297555  1700 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:29.376021  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.143361  1708 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 25.
I20260709 13:02:29.406801  1700 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:29.275573  9156 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:29.305087  9153 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:02:29.410820  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.278796  9064 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:29.424844  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:29.461349  2269 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 19: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:29.435962  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:29.463034  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.275290  9096 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:29.428732  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.451995  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:29.470657  2263 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 24: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:29.282130  9078 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:02:29.451620  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 171516us
I20260709 13:02:29.307173  8512 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:29.309227  8933 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:29.474408  1703 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 25: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:29.304237  8747 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:29.424018  8737 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:29.463673  1706 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:29.433676  1700 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:02:29.482733  1635 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.011s	sys 0.003s
W20260709 13:02:29.483134  1635 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.011s	sys 0.003s
I20260709 13:02:29.485564  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:29.458950  9173 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:29.412565  9093 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 13:02:29.408555  9094 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.071s
W20260709 13:02:29.467752  8982 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.012s	sys 0.002s
I20260709 13:02:29.410084  9182 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.498468  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:29.499905  1526 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:29.501264  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:29.502928  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:29.485708  8902 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:29.514117  9082 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:29.514555  9082 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.487234  8737 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:29.514916  9082 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:29.476649  9119 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:29.506979  9182 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:29.507867  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.555953  1557 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 24: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:29.514744  1705 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:29.505931  2269 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:29.515841  9187 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:29.537997  8737 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.515422  9064 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:29.544209  8836 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:29.545199  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:29.514935  8589 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:29.570904  2266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.028s	sys 0.021s
W20260709 13:02:29.578279  2266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.029s	sys 0.021s
W20260709 13:02:29.575045  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 72169.5us
W20260709 13:02:29.479761  9120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.002s	sys 0.011s
W20260709 13:02:29.579063  8982 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.013s	sys 0.002s
I20260709 13:02:29.599246  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.599711  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.600648  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.605647  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.606379  1560 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 24: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:29.601857  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.607396  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.577311  8966 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:29.577442  9173 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:29.604019  2269 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:29.558386  9090 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:29.608866  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:02:29.609431  1707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.011s	sys 0.006s
W20260709 13:02:29.683943  1707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.011s	sys 0.006s
W20260709 13:02:29.581228  9178 consensus_meta.cc:287] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.708s	user 0.006s	sys 0.010s
I20260709 13:02:29.590147  9139 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:29.715710  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.573678  9182 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:29.682588  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.683432  1560 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:29.727607  9172 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:29.731621  8836 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:02:29.732275  8836 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:29.732380  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 187166us
I20260709 13:02:29.732837  8836 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:29.733162  1673 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:29.735149  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:29.737565  1709 raft_consensus.cc:1240] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 24. Current term is 25. Ops: []
I20260709 13:02:29.738747  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:29.740545  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:29.741367  1556 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:29.743705  9138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.015s	sys 0.029s
W20260709 13:02:29.744127  9138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.015s	sys 0.029s
I20260709 13:02:29.605118  9171 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:29.763460  1560 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:29.752146  1556 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
W20260709 13:02:29.590174  9120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.003s	sys 0.011s
I20260709 13:02:29.780937  9139 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:29.781721  9171 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:29.815006  9171 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:29.731541  9194 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
W20260709 13:02:29.765306  9166 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.013s	sys 0.012s
I20260709 13:02:29.719822  9090 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.823447  9139 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:29.824194  9090 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:29.824867  9090 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:29.795039  1633 consensus_meta.cc:287] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.656s	user 0.009s	sys 0.003s
I20260709 13:02:29.804214  9172 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:29.809520  1555 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:29.763617  8880 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:29.720432  9173 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:29.773370  1554 raft_consensus.cc:2410] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:02:29.770334  9182 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.829178  8880 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.832834  8880 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:29.835456  9173 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:29.839565  1552 raft_consensus.cc:2410] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:02:29.840056  9065 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.840654  9065 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.855238  8836 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:29.857878  8902 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:29.858490  8902 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:29.859555  8902 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.861140  8902 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:29.880604  9182 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:29.826339  1633 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
W20260709 13:02:29.827731  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.020s	sys 0.014s
W20260709 13:02:29.887112  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.021s	sys 0.014s
W20260709 13:02:29.887527  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 623495us
I20260709 13:02:29.890956  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:29.896193  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:29.902207  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.903074  1707 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:29.899736  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:29.905139  2234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.001s	sys 0.009s
W20260709 13:02:29.905632  2234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.001s	sys 0.009s
W20260709 13:02:29.905953  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 766382us
W20260709 13:02:29.886303  9102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.027s	sys 0.102s
W20260709 13:02:29.911264  1553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.000s	sys 0.011s
W20260709 13:02:29.917536  1553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.000s	sys 0.011s
I20260709 13:02:29.824930  9139 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:29.908052  2234 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:29.926349  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:29.928700  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:29.903951  9178 raft_consensus.cc:2764] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
W20260709 13:02:29.932206  2236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.001s	sys 0.013s
W20260709 13:02:29.917284  9102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.027s	sys 0.102s
I20260709 13:02:29.927574  2235 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:29.931493  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:29.916625  8747 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:29.932597  2236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.001s	sys 0.013s
I20260709 13:02:29.885591  9082 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:29.955514  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.920288  9182 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:29.956123  2234 leader_election.cc:400] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 24. Current term is 25.
I20260709 13:02:29.956586  1701 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:02:29.962118  2234 leader_election.cc:403] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
W20260709 13:02:29.930717  9130 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.004s	sys 0.009s
W20260709 13:02:29.928985  1600 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.644s (SENT) [suppressed 20 similar messages]
I20260709 13:02:29.934891  1633 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:02:29.953811  1601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.017s	sys 0.046s
W20260709 13:02:29.957929  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 662570us
I20260709 13:02:29.964058  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.971782  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:29.972595  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:29.973929  1703 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:29.972680  2234 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:29.979076  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:29.964407  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 229198us
I20260709 13:02:29.980302  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:29.983354  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:29.984210  1701 raft_consensus.cc:3060] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:29.984771  1557 raft_consensus.cc:2368] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21.
I20260709 13:02:29.954769  8589 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:29.987305  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:29.967671  9130 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.004s	sys 0.010s
I20260709 13:02:29.925740  9136 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:29.993824  1601 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:30.010718  1701 raft_consensus.cc:2468] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:29.983978  9094 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:29.987912  9182 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:30.003933  9173 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:30.014104  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:30.014873  1673 leader_election.cc:400] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18.
I20260709 13:02:30.015482  1673 leader_election.cc:403] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:02:30.017277  2235 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:29.972421  9210 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:29.925033  9156 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.015354  1633 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:02:30.019732  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:29.985005  8982 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 24. Current term is 25.
I20260709 13:02:29.990126  8836 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:30.024456  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:30.026724  9157 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:30.033628  1673 leader_election.cc:400] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20.
I20260709 13:02:30.039458  1673 leader_election.cc:403] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:02:30.002799  9136 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:30.025846  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:30.012884  9082 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:29.986598  8966 consensus_queue.cc:1059] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:02:30.055968  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:30.013204  8589 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:02:30.052785  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 73764.6us
W20260709 13:02:30.119642  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 63795.2us
I20260709 13:02:30.120573  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:30.080318  2270 raft_consensus.cc:606] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:30.121970  2270 raft_consensus.cc:614] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:30.116503  9171 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20.
I20260709 13:02:30.123570  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:30.123800  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:30.124195  1634 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:30.125013  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:30.125296  9204 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:02:30.126256  2271 raft_consensus.cc:2393] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 21: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:30.128059  1629 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:30.128203  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 1639) took 1053 ms. Trace:
I20260709 13:02:30.128609  2271 rpcz_store.cc:276] 0709 13:02:29.074593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.074731 (+   138us) service_pool.cc:224] Handling call
0709 13:02:30.128020 (+1053289us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b540039d854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:30.128140 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259175808}
I20260709 13:02:30.129243  1630 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:02:30.053795  9173 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:30.125311  9138 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 13:02:30.026048  1635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.006s	sys 0.014s
W20260709 13:02:30.132297  1635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.007s	sys 0.015s
I20260709 13:02:30.132505  9182 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:30.133019  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 3023) took 1300 ms. Trace:
I20260709 13:02:30.133376  1635 rpcz_store.cc:276] 0709 13:02:28.832427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.837381 (+  4954us) service_pool.cc:224] Handling call
0709 13:02:28.837634 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.837856 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:29.483657 (+645801us) log.cc:844] Serialized 14 byte log entry
0709 13:02:30.132696 (+649039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:30.132745 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:30.132794 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.132864 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.132968 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":206380,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":116,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":1294091,"threads_started":2}
I20260709 13:02:30.138782  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2814) took 1490 ms. Trace:
I20260709 13:02:30.139218  1632 rpcz_store.cc:276] 0709 13:02:28.648635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.723910 (+ 75275us) service_pool.cc:224] Handling call
0709 13:02:28.724134 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.786849 (+ 62715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.138509 (+1351660us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b540006d1d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:30.138701 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142627200}
I20260709 13:02:30.140070  8747 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:30.146646  1551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 3081) took 1246 ms. Trace:
I20260709 13:02:30.147089  1551 rpcz_store.cc:276] 0709 13:02:28.900172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.900277 (+   105us) service_pool.cc:224] Handling call
0709 13:02:30.146473 (+1246196us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002db9d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:30.146584 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299062144}
I20260709 13:02:30.015784  9169 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
I20260709 13:02:30.004261  9178 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:02:30.023590  9187 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:30.038815  9157 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.160060  9157 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:30.166370  9130 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:30.023041  8737 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:30.169507  9216 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.170156  9216 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.172379  9216 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:30.040256  9217 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 17. Current term is 18.
I20260709 13:02:30.023257  9211 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:30.175122  9211 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:30.175555  9211 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:30.179227  8941 raft_consensus.cc:2804] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:30.179745  8941 raft_consensus.cc:697] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:30.180519  8941 consensus_queue.cc:237] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.182062  9120 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:02:30.184309  9128 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:30.184757  9128 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:30.185549  9128 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.186813  9128 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.191210  8589 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:30.172866  9216 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:30.213955  9214 log.cc:927] Time spent T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.059s	user 0.006s	sys 0.015s
I20260709 13:02:30.216528  9156 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:30.217427  8747 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.219170  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 98660.3us
I20260709 13:02:30.246894  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:30.079847  9136 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:30.247093  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:30.249213  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.118993  8880 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:30.238302  9221 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.096s	user 0.003s	sys 0.001s
W20260709 13:02:30.245702  9222 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.084s	user 0.001s	sys 0.003s
I20260709 13:02:30.238655  8836 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:30.258278  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:30.254598  8747 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:30.245551  9218 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.090s	user 0.000s	sys 0.004s
I20260709 13:02:30.247613  8982 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:30.260533  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:30.260546  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:30.273357  2262 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:30.245610  9171 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:30.259433  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:30.261123  9227 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.259464  9156 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:30.256326  9216 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:30.281155  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:30.283950  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:30.288719  1631 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 22: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:30.288800  1635 raft_consensus.cc:2393] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 22: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:30.289878  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:30.290657  1634 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:30.291360  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:30.284726  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:30.292526  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:30.292611  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:30.284925  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:30.287802  2262 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:02:30.295409  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 366247us
W20260709 13:02:30.296705  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 181808us
I20260709 13:02:30.299938  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:30.291571  9224 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.137s	user 0.004s	sys 0.021s
I20260709 13:02:30.309149  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:30.309953  2262 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:30.311941  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:30.312745  1632 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:30.314551  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:30.315056  1632 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:30.318621  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:30.319478  1628 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:30.277567  8836 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:02:30.264910  8880 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.329583  2268 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:30.294919  2236 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:30.294561  9171 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:30.296837  9173 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:30.323125  9207 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.318266  9187 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.317960  9182 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:30.283646  8982 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.282450  9220 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:02:30.324841  9105 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:30.322517  9094 raft_consensus.cc:697] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:30.298329  9216 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.489287  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3335) took 2189 ms. Trace:
I20260709 13:02:30.490675  8512 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:30.328680  9210 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 24 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:30.297892  9156 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.425760  8911 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.297770  9227 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.486830  1630 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:02:30.565181  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 270191us
I20260709 13:02:30.456343  9078 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:30.456794  9155 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:30.564132  1702 rpcz_store.cc:276] 0709 13:02:28.299810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.380127 (+ 80317us) service_pool.cc:224] Handling call
0709 13:02:28.390531 (+ 10404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:28.390909 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:28.390943 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:28.391382 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:02:28.508493 (+117111us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:28.547891 (+ 39398us) log.cc:844] Serialized 14 byte log entry
0709 13:02:28.552706 (+  4815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.552780 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.810161 (+257381us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b18004228c0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1
0709 13:02:30.322362 (+1512201us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b18004228c0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:02:30.489024 (+166662us) raft_consensus.cc:1685] finished
0709 13:02:30.489050 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:30.489201 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4561,"prepare.queue_time_us":41774,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":45,"raft.queue_time_us":5750,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":13905,"spinlock_wait_cycles":19609088,"thread_start_us":114660,"threads_started":1,"wal-append.queue_time_us":162331}
I20260709 13:02:30.492233  8836 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:30.575467  8747 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:30.575706  9216 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:30.577324  2268 raft_consensus.cc:1240] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:30.448307  1632 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:30.458511  9228 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:30.424701  9157 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:30.581147  8902 consensus_meta.cc:287] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.006s
I20260709 13:02:30.467072  9173 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.501394  9207 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.541527  2262 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:30.506006  9187 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.591303  9172 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:30.567759  8512 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:30.582477  2235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.020s	sys 0.025s
W20260709 13:02:30.617034  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 316971us
I20260709 13:02:30.532377  9182 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:30.628888  2235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.021s	sys 0.025s
W20260709 13:02:30.629498  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 611951us
I20260709 13:02:30.630584  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:30.631893  8902 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:30.632627  8902 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.633170  8902 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:30.626936  9178 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.634902  9178 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:30.643673  9178 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:30.641734  9182 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:30.650939  9182 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:30.651635  9182 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:30.654628  8512 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:30.659276  9216 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:30.660053  9216 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.660133  9182 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:30.563416  9105 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.628602  2262 raft_consensus.cc:1275] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:02:30.499102  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 384656us
I20260709 13:02:30.615882  8836 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:30.613755  9236 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:30.611505  9155 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:30.675169  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:30.590915  8911 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.598309  9078 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:30.671612  9182 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:30.685199  8589 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.701248  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:30.700071  8737 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.695910  9128 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:02:30.739147  8941 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.668856  9094 consensus_queue.cc:237] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.777000  8836 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.778995  9243 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.779589  9243 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.625144  9171 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.750150  8747 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:30.753080  9246 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:02:30.762068  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 172866us
I20260709 13:02:30.754377  9216 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:30.782352  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 118526us
I20260709 13:02:30.796730  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:30.783756  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 82546.1us
I20260709 13:02:30.760003  9220 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.758749  9209 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.784319  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 118640us
I20260709 13:02:30.695339  9210 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.760011  9178 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:30.809159  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:30.810571  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:30.806799  8941 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.776615  8880 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:30.876840  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:30.747759  9182 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.750007  8589 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.756927  8737 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.890638  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:30.898576  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:30.899463  2262 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 24: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:02:30.891474  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 92467.5us
I20260709 13:02:30.900170  1703 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:30.904839  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:30.807518  9237 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:30.792317  9246 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:30.806720  8982 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:30.813217  9236 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:30.906154  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:30.782140  9244 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.133s
W20260709 13:02:30.951782  9234 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:02:31.019611  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.024611  1551 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:02:30.911907  9242 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.151s	user 0.001s	sys 0.001s
W20260709 13:02:30.964901  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 2980) took 1840 ms (client timeout 2182 ms). Trace:
I20260709 13:02:31.032059  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.032863  1627 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
W20260709 13:02:30.946554  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 45993.9us
I20260709 13:02:31.028594  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:30.878201  9220 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.905647  8880 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:31.035972  1632 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:31.036954  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:31.034176  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:31.032160  1705 rpcz_store.cc:269] 0709 13:02:29.124298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.274909 (+150611us) service_pool.cc:224] Handling call
0709 13:02:30.964726 (+1689817us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b540005d554. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:30.964824 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136876928}
I20260709 13:02:30.897696  9156 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.034358  2234 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:30.813403  9209 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:31.041751  2262 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:31.043807  2234 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:31.045650  9216 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:31.030133  9173 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.076254  9216 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.076838  9216 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:31.030262  9207 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.077854  9244 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:31.078301  9244 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:31.078665  9244 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:31.046581  9249 log.cc:927] Time spent T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:02:31.043046  9213 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:31.046952  9220 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.047513  9248 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.082594  9213 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:31.050060  9155 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.050410  9243 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:31.051093  2269 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260709 13:02:31.051330  9240 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 13:02:30.922178  9157 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:30.929282  9231 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:30.964888  8737 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:30.929158  9227 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:30.957024  8911 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:30.966521  8941 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.059087  8880 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.063169  8589 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.134660  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.135792  1631 raft_consensus.cc:2410] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:02:30.890805  9178 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:31.066995  9254 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:31.136880  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.137493  1705 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:30.967250  9250 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.171s
I20260709 13:02:31.072961  8512 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.075767  9209 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.083304  9248 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:31.048130  9247 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:31.029855  9089 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:31.025674  9235 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:31.086539  9255 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:31.043860  9128 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:02:30.952721  9232 log.cc:927] Time spent T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:31.153853  2262 raft_consensus.cc:1240] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:02:30.963232  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3353) took 1826 ms. Trace:
I20260709 13:02:30.955381  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.156636  2267 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:30.953604  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:30.961071  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37992 (request call id 14) took 1824 ms. Trace:
I20260709 13:02:31.096873  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.076587  9173 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:30.967883  9239 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:31.087850  9244 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.103472  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.113799  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.167011  1627 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:31.131351  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.168064  1706 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:31.067781  9182 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.068887  9078 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.098130  9207 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.169468  9207 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:31.172245  9207 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:31.116621  9211 consensus_meta.cc:287] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.941s	user 0.008s	sys 0.003s
I20260709 13:02:31.173147  9211 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.175891  9211 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:31.140925  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.176873  1628 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:31.177906  2268 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:31.142187  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.140210  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.179167  2269 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:31.125077  9164 raft_consensus.cc:3055] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:31.146296  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:31.180047  9164 raft_consensus.cc:740] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:30.951301  9187 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.126315  9231 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:30.958199  9217 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:31.090010  8902 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.181185  9164 consensus_queue.cc:260] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.182421  9231 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.155076  1709 rpcz_store.cc:276] 0709 13:02:29.136594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.426633 (+290039us) service_pool.cc:224] Handling call
0709 13:02:29.462944 (+ 36311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.737988 (+275044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.962994 (+1225006us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54001fcf54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:30.963147 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630823808}
I20260709 13:02:31.099821  9105 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.183151  9164 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:31.157840  2270 rpcz_store.cc:276] 0709 13:02:29.145460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.161701 (+ 16241us) service_pool.cc:224] Handling call
0709 13:02:30.960871 (+1799170us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b540039d854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfc9853 00007f06e2f9760a 00007f06dc51d7d4 00007f06dc51d762 00007f06dc51d691 00007f06dc51d60c 00007f06dc51c8c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:30.960984 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922872704}
I20260709 13:02:31.190140  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:31.195225  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:31.197479  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:31.198269  1628 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:31.208778  1628 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:02:31.214906  2234 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:31.115760  9216 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.165171  9255 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:31.141453  9254 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:31.235093  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:31.235683  1553 raft_consensus.cc:2376] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22. Re-sending same reply.
I20260709 13:02:31.231961  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.125552  9246 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.236799  1554 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
W20260709 13:02:31.226497  9136 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.965s	user 0.009s	sys 0.002s
I20260709 13:02:31.150418  9247 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:31.221788  9211 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:31.209801  9173 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.231659  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:31.159235  9128 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:31.218940  8747 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:31.158944  9235 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:31.248426  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.152755  9089 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.239763  9207 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:31.213824  9239 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.244179  9211 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.245008  9246 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:31.271566  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.247777  8747 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.272768  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.273535  1556 raft_consensus.cc:2410] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:02:31.274133  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.274276  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.257951  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.244983  9258 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.250017  9250 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:31.274379  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:02:31.260213  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 223248us
I20260709 13:02:31.277149  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:31.267490  9102 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:31.267632  9239 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.268612  8512 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.269654  9178 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.258574  9094 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:31.274945  1556 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:31.290424  9094 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.291177  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:31.291467  9259 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:31.291742  1556 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:31.292698  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.292878  9094 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:31.293378  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.260001  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.294178  1553 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 16.
I20260709 13:02:31.294972  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.295626  1553 raft_consensus.cc:2393] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 22: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:31.296330  9217 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:31.296609  9257 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:31.296965  9217 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:31.297106  9257 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:31.296355  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.290429  9173 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.272210  1559 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:31.300032  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.300256  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.300911  1559 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 22: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:31.301085  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.280838  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:31.302188  9258 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.284020  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:31.286412  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.287173  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.305312  9258 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.285321  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:31.305800  1706 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:31.306133  9173 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:02:31.243983  9136 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.307698  9235 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.308089  9136 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.308704  1630 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:31.308449  9255 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.288225  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.274789  9211 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:31.310220  9171 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:31.313160  9248 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:31.313758  9248 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:31.314574  9248 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:31.315300  9248 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:31.306070  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.318120  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.319875  1701 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:02:31.321784  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.322415  1708 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:31.323431  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.324515  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.326875  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.327628  1632 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:31.315622  9248 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:31.276371  9261 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.285332  9102 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:31.350549  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.359738  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.259410  9207 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.351220  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.271006  9227 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.276516  8747 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:31.317533  9250 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 22 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:02:31.391888  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 60807.3us
I20260709 13:02:31.383968  1709 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:31.360375  1705 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 24.
I20260709 13:02:31.389420  9227 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.404873  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:31.395915  9128 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.412650  9265 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:31.403632  9087 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:31.413501  9087 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.414606  9265 consensus_queue.cc:1059] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:31.415568  9087 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.415885  9265 raft_consensus.cc:3055] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:31.416369  9265 raft_consensus.cc:740] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:31.418504  1634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:02:31.419113  1634 raft_consensus.cc:606] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:31.419476  1634 raft_consensus.cc:614] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:31.419215  9265 consensus_queue.cc:260] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.421166  9265 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:31.424078  8902 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.425158  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:31.426239  9233 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:31.426872  9233 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:31.395419  9258 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:02:31.427529  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:31.356199  9144 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.428911  9081 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.429005  9144 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.429567  9081 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:31.430796  1557 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44176 (request call id 1437) took 1832 ms (client timeout 2221 ms). Trace:
I20260709 13:02:31.431411  9144 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.431524  9081 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:31.429275  1552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42086 (request call id 3067) took 3789 ms (client timeout 1644 ms). Trace:
W20260709 13:02:31.432580  1552 rpcz_store.cc:269] 0709 13:02:27.640286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.640432 (+   146us) service_pool.cc:224] Handling call
0709 13:02:31.428987 (+3788555us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b5400178754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:31.429159 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5033407232}
I20260709 13:02:31.427742  9233 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:31.431325  1557 rpcz_store.cc:269] 0709 13:02:29.597991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.599415 (+  1424us) service_pool.cc:224] Handling call
0709 13:02:31.430566 (+1831151us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54002cb854. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:31.430725 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870302464}
I20260709 13:02:31.436141  9257 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:31.393868  9120 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.437122  9120 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.439164  8901 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:31.439257  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:31.439697  8901 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.440143  8901 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:31.440305  9211 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.440941  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 3031) took 2269 ms. Trace:
I20260709 13:02:31.441327  1626 rpcz_store.cc:276] 0709 13:02:29.171488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.171632 (+   144us) service_pool.cc:224] Handling call
0709 13:02:29.225518 (+ 53886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.313489 (+ 87971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:29.313549 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:29.313611 (+    62us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:29.313657 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.440695 (+2127038us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b54003377d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:31.440740 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.440859 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201576192}
I20260709 13:02:31.356287  8589 consensus_queue.cc:1059] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.086s
I20260709 13:02:31.442224  9128 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:31.442655  9128 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.442822  8589 raft_consensus.cc:3055] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:02:31.443032  9128 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:31.443249  8589 raft_consensus.cc:740] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:31.444175  8589 consensus_queue.cc:260] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:31.445338  8589 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:31.445413  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:31.446122  1626 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:31.446755  9136 consensus_queue.cc:1175] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "87144ea1a4a14ab8b942fb426159f031" responder_term: 24 status { last_received { term: 24 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 24 index: 15 } }
I20260709 13:02:31.448652  8880 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.449810  9111 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.452561  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1678) took 1195 ms. Trace:
I20260709 13:02:31.452919  2271 rpcz_store.cc:276] 0709 13:02:30.256746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.256877 (+   131us) service_pool.cc:224] Handling call
0709 13:02:30.262718 (+  5841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.578791 (+316073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:30.578835 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:30.578889 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:30.578930 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.452349 (+873419us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400598dd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:31.452394 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:31.452508 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726656896}
I20260709 13:02:31.454926  1626 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:31.455076  9089 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.455236  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:31.456058  2234 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:31.456410  9244 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.456815  9238 raft_consensus.cc:2804] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:31.457459  9238 raft_consensus.cc:697] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:31.458674  9238 consensus_queue.cc:237] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.459906  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.460704  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.457471  9216 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:31.461270  9247 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:31.461977  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.463888  1557 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:31.462412  9217 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:31.465613  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:31.466231  1704 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:02:31.357015  9213 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.467772  1626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:02:31.468858  8911 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:31.469259  8911 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:31.469625  8911 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:31.472440  9254 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:31.409482  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1686) took 1108 ms. Trace:
I20260709 13:02:31.473296  2268 rpcz_store.cc:276] 0709 13:02:30.301430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:30.639210 (+337780us) service_pool.cc:224] Handling call
0709 13:02:30.639598 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.178441 (+538843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.409170 (+230729us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b540064c8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:31.409406 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236843392}
I20260709 13:02:31.473614  9120 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.474613  9102 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.475366  1707 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:02:31.475701  9102 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:31.476727  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.477707  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:31.478257  1630 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:31.479539  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:31.480219  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.480434  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.475718  1707 pending_rounds.cc:85] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 12
I20260709 13:02:31.481390  1707 pending_rounds.cc:107] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:02:31.481654  1707 raft_consensus.cc:2889] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:31.490554  1554 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:31.493686  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.494536  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.495337  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.495697  1674 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:31.496320  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.497023  2264 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:31.497166  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.500222  2268 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:02:31.500716  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.501469  2263 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 25.
I20260709 13:02:31.502612  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.504742  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.456079  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:31.506785  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50737.2us
W20260709 13:02:31.509519  9241 log.cc:927] Time spent T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.716s	user 0.003s	sys 0.000s
I20260709 13:02:31.510126  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:31.513392  9065 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.513528  1704 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:02:31.494937  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.514564  2271 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:31.514590  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.516495  1558 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:31.520561  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.521574  1705 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:31.539664  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:31.540719  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:31.562067  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.563273  2270 raft_consensus.cc:2410] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:02:31.566481  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:31.567973  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.570582  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:31.562333  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 66757.8us
I20260709 13:02:31.573256  1674 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:31.575251  1557 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:02:31.575146  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.576586  2262 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:31.568825  1558 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 25.
I20260709 13:02:31.581401  1674 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:31.537196  9144 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:31.585647  1555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3049) took 2202 ms. Trace:
I20260709 13:02:31.587572  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:31.587729  1555 rpcz_store.cc:276] 0709 13:02:29.373127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.373330 (+   203us) service_pool.cc:224] Handling call
0709 13:02:29.430193 (+ 56863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.827434 (+397241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:31.574816 (+1747382us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400311ad4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:31.574996 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":868448000}
W20260709 13:02:31.584669  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 324534us
W20260709 13:02:31.590338  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 49701.8us
I20260709 13:02:31.591320  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:31.592511  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.593189  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:31.594177  1554 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:02:31.601431  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:31.515650  8902 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:31.607291  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:31.611321  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:31.617527  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.589183  9217 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:31.582762  9277 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:31.360769  9261 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.592448  9254 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:31.586541  9144 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.620282  1703 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:31.595758  9172 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:31.598553  9236 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:31.605396  8902 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.629120  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.629381  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.631907  1556 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:31.630267  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.664904  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:31.649730  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 322447us
I20260709 13:02:31.618376  8512 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:31.668123  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.669734  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:31.671206  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.618837  8941 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.661087  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.617004  9211 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.542393  9248 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.677002  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:31.626586  9254 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:31.634972  9144 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:31.694545  2271 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:02:31.694828  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.695588  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:31.677511  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:31.696224  2263 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:31.635540  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.685096  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.626291  9277 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:31.630367  9155 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.687016  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.608795  9130 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:02:31.695674  2268 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:31.697363  2270 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 21: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:31.661871  9138 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:31.662688  9236 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:31.704850  9236 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.704787  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.706841  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.707427  2271 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:31.708279  1555 raft_consensus.cc:2410] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:02:31.709335  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:31.711175  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.713096  1703 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:02:31.625979  9105 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:02:31.715619  8901 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.716604  8911 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.717603  1634 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:31.718132  9272 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:31.718637  9272 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.719050  9272 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:31.718185  9217 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:31.722114  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.675477  8512 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:31.721849  9247 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:31.726651  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.717785  8901 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:31.723459  2264 raft_consensus.cc:2368] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20.
I20260709 13:02:31.713704  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:31.722857  2271 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 26 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:02:31.700704  9254 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:31.727700  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:31.728471  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.735450  1704 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
W20260709 13:02:31.738814  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.728684  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:31.725921  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 132723us
I20260709 13:02:31.618664  9250 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.704582  9138 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.732200  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:31.722169  9262 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:02:31.737534  1673 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:31.703807  9277 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:31.739519  1524 connection.cc:256] RPC call timeout handler was delayed by -1.1526956979999454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
I20260709 13:02:31.724723  9182 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:31.683981  8941 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.755769  2263 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
W20260709 13:02:31.752592  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 145293us
I20260709 13:02:31.729892  8512 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:31.754959  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.757303  1704 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 25.
I20260709 13:02:31.733991  9248 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:31.493435  9178 consensus_queue.cc:1175] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6923294c847b48ebb577e0935d316aa3" responder_term: 21 status { last_received { term: 19 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: [20.16-20.16]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:31.738361  9217 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:31.750891  9138 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:02:31.820534  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 62011us
I20260709 13:02:31.820870  2262 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:02:31.827886  2262 pending_rounds.cc:85] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 13
I20260709 13:02:31.828136  2262 pending_rounds.cc:107] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:02:31.828478  2262 raft_consensus.cc:2889] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:31.722909  9155 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:31.826926  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.828056  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:31.815850  9171 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.002s
I20260709 13:02:31.831312  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:31.838307  1632 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:31.749838  9262 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.810570  9239 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.738942  9128 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:31.840723  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.851675  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.836239  1635 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:02:31.852694  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 120491us
W20260709 13:02:31.851203  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 171100us
I20260709 13:02:31.856002  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.860225  1633 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:31.818054  9142 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.862476  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.819471  9207 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:31.863519  1560 raft_consensus.cc:2368] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21.
I20260709 13:02:31.864508  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.865136  1635 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 16.
I20260709 13:02:31.865350  1630 raft_consensus.cc:2468] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:31.865788  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:31.866165  1631 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
W20260709 13:02:31.866282  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 128779us
I20260709 13:02:31.866588  1560 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:31.810603  9227 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:31.875038  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.875635  1703 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:31.867197  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:31.868184  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:31.869956  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:31.876693  1701 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:31.870970  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.877113  1630 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:31.871270  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:31.872278  1558 raft_consensus.cc:1275] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:31.879115  1632 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:31.879511  1555 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:31.882812  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.885423  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:31.831764  9217 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:31.889950  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:31.936058  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 108025us
I20260709 13:02:31.936525  1703 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:31.890663  1554 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21. Ops: []
W20260709 13:02:31.937674  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.938397  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:31.939041  1558 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:31.888571  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.859344  9171 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:31.856524  9262 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:31.891077  9287 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:31.928759  9120 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:31.891098  9081 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 13:02:31.873711  9239 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:31.862018  9182 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:31.931921  1701 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
W20260709 13:02:31.942314  9177 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 2.390s	user 0.009s	sys 0.014s
I20260709 13:02:31.932363  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.032310  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:32.032873  1709 raft_consensus.cc:3060] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:32.033171  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.935055  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.034835  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.035621  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.856886  9260 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:31.941627  1524 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:31.886516  9173 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:31.942871  1632 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:32.045451  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.046154  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.046598  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.943125  9207 raft_consensus.cc:2764] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:02:32.047679  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.853405  9130 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:02:31.946491  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:32.023381  9276 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 13:02:31.995879  9093 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:02:32.045457  9171 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:02:31.886595  9142 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:32.060806  9284 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:02:32.061945  9142 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.002948  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:32.062608  9279 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:02:31.886436  9282 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:32.004908  2234 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:31.934312  1560 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
W20260709 13:02:32.064610  9273 log.cc:927] Time spent T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.382s	user 0.001s	sys 0.000s
I20260709 13:02:32.065207  9128 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.066633  9155 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.068646  8941 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.069916  8911 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.072165  9272 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.073534  1627 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:32.045313  9173 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:32.075526  9173 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:32.079641  9281 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 13:02:32.042459  9182 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.082628  9182 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:32.085662  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.025112  9261 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:32.030583  8982 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 13:02:32.090370  9239 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:32.053238  9287 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:32.094174  8589 consensus_meta.cc:287] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.004s
W20260709 13:02:32.095288  9278 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:02:31.936875  9286 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:32.042716  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:31.884713  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:32.052522  1707 raft_consensus.cc:2410] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 26 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
W20260709 13:02:32.053102  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 111528us
W20260709 13:02:32.097002  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 92146.2us
I20260709 13:02:32.058884  8902 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.095363  9087 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:32.108354  1524 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:32.097680  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:32.036978  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:32.080757  9217 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:32.099363  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 214650us
I20260709 13:02:32.124320  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:32.094221  9287 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.120443  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.137167  1634 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:32.139251  9272 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.121104  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.115443  9286 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.122552  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.145175  1629 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:32.111826  1630 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:32.124331  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.147047  1632 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:32.101729  1633 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
I20260709 13:02:32.129835  9172 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:32.131963  9102 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.632s	user 0.008s	sys 0.000s
I20260709 13:02:32.133059  9138 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.160877  1626 raft_consensus.cc:606] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
W20260709 13:02:32.133972  8747 consensus_meta.cc:287] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.744s	user 0.007s	sys 0.003s
I20260709 13:02:32.134737  8902 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:32.135210  8982 consensus_queue.cc:1059] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:32.117340  9228 raft_consensus.cc:2804] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:32.115463  8512 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.118117  9220 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:32.136584  9263 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:32.142849  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.149276  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:32.155890  1709 raft_consensus.cc:2468] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
W20260709 13:02:32.133669  9246 consensus_meta.cc:287] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.851s	user 0.008s	sys 0.001s
I20260709 13:02:32.161509  1626 raft_consensus.cc:614] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:32.164167  9277 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.169050  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:32.201066  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 51897.4us
W20260709 13:02:32.169636  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 135566us
I20260709 13:02:32.172170  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:32.151554  9155 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:02:32.180160  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.181907  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:32.202653  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:32.208771  1553 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:32.182855  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:32.189855  1628 raft_consensus.cc:1240] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:02:32.191759  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:32.194506  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 51702.7us
I20260709 13:02:32.205195  9277 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:32.206198  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 169439us
I20260709 13:02:32.165253  9087 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:32.201388  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:32.160091  9247 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:02:32.175282  9082 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:32.160607  9231 consensus_queue.cc:1048] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:02:32.191931  8902 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:32.168952  9111 consensus_queue.cc:1059] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:02:32.214423  1673 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.169440  8747 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.203208  9172 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:32.242041  1524 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:32.215958  2234 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:32.215329  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:32.222793  1600 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:32.244350  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.195392  9287 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:32.176831  9144 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.197268  9228 raft_consensus.cc:697] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:32.190929  9215 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:32.172806  9089 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.052s
I20260709 13:02:32.190480  9263 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:32.252010  1553 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:32.230780  8982 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:32.251719  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.211563  9262 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.252812  9261 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.205207  9018 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:32.208847  9216 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:02:32.246241  9233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.014s	sys 0.019s
I20260709 13:02:32.251719  1673 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.268626  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:32.266058  9293 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:02:32.278244  2268 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:32.253708  9239 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:32.279621  9239 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.280126  9239 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:32.282277  9261 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.247224  9246 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:32.286509  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.286674  9261 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.260571  9287 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.289039  9287 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.290956  9213 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:32.291229  9144 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.291577  9213 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:32.292181  9213 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:32.292461  9286 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.294332  8902 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:32.295571  9236 consensus_meta.cc:287] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.571s	user 0.004s	sys 0.005s
I20260709 13:02:32.295778  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:32.296000  9236 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.296366  1633 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:32.249689  9220 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:32.303256  8512 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.303870  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:32.304973  9138 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.237212  9182 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.308887  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:32.309121  9277 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:32.309619  1555 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:32.309698  9277 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:32.310318  9277 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:32.312994  9254 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.000s
I20260709 13:02:32.313555  9254 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.314685  9228 consensus_queue.cc:237] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.317286  9216 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.317338  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:32.317920  9216 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:32.319444  9231 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:32.319945  9231 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:32.320880  9231 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.242617  9082 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:32.326545  1554 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:32.247992  9172 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:32.333273  9172 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:32.336373  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 129433us
W20260709 13:02:32.331830  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 63274.2us
I20260709 13:02:32.261133  9102 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:32.336467  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 84762.3us
I20260709 13:02:32.281674  9262 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.264957  9263 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:32.338965  1674 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:32.330806  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 79866.3us
W20260709 13:02:32.324739  9233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.015s	sys 0.019s
I20260709 13:02:32.340646  1633 raft_consensus.cc:2468] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:32.341343  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:32.357643  1630 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:32.342474  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:32.267524  8982 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.268890  9018 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.294492  8747 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:32.308915  9182 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:32.356961  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 114938us
I20260709 13:02:32.358400  2234 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:32.361943  1673 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.331507  9082 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:32.361229  1632 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:32.372778  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:32.367708  1601 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:32.339447  9282 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:32.261824  9215 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.382045  1526 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:32.383226  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.386865  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:32.344631  9102 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:32.356158  9144 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:32.362679  9246 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:32.359601  9275 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:32.359848  9155 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:32.360668  9236 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.398284  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:32.373059  9018 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:32.362871  8982 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:32.384267  8512 raft_consensus.cc:2804] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:32.407558  1707 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:32.414731  9233 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:32.415257  9233 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:32.415627  9233 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:32.415748  9304 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:32.416303  9304 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:32.416694  9304 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:32.418629  9155 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.420392  8933 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:32.360145  9173 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.392742  9182 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:32.393709  9282 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:32.397111  9102 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:32.434628  1601 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:32.427675  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 65786.9us
I20260709 13:02:32.444427  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:32.451058  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.453387  9220 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:32.400820  9294 raft_consensus.cc:2764] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:02:32.461520  1600 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:32.423952  9246 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:32.464555  1700 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:32.470607  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.360469  9087 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.440236  8512 raft_consensus.cc:697] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:32.478242  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.443082  9254 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.490381  9142 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:32.496209  9142 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:32.496650  9142 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:32.499220  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:32.500310  9298 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:32.503836  9294 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:32.410845  9275 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.509742  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:32.511747  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:32.526954  1558 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:32.507905  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:32.511394  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:32.519168  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:32.528353  1702 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:32.479097  9286 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:32.538902  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:32.519677  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:32.510994  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:32.529675  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:32.507532  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:32.511870  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:32.542615  1553 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:32.468130  9144 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:02:32.547415  1706 raft_consensus.cc:2393] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:32.528379  1701 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:32.550460  1554 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:02:32.581573  1702 raft_consensus.cc:1275] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:02:32.584461  9246 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.587733  9216 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.495613  9293 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:02:32.506961  9297 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:02:32.594619  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 216409us
I20260709 13:02:32.515056  9173 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.594365  9105 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:32.592914  1553 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:02:32.602895  1600 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:32.591315  9285 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:32.601056  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:32.516501  9172 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.513916  9277 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.505959  9304 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.600225  9293 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:32.622921  1701 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 26.
I20260709 13:02:32.622915  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:32.624615  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:32.584478  8512 consensus_queue.cc:237] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.623723  9155 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:32.635864  9304 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.638375  9277 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:32.638944  1706 raft_consensus.cc:1240] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:32.607790  9285 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:32.639696  9293 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.640233  9285 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:32.640411  9172 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:32.635744  9213 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.643584  9213 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.620240  9265 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:32.644436  9082 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.645838  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:32.646368  8747 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.646710  9239 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.646925  8747 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.648720  9239 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:32.650314  2263 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 13:02:32.651124  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 1659) took 1152 ms. Trace:
I20260709 13:02:32.651178  9082 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.514235  9282 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.651561  2264 rpcz_store.cc:276] 0709 13:02:31.498956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.499099 (+   143us) service_pool.cc:224] Handling call
0709 13:02:32.650916 (+1151817us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400590954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:32.651055 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488436096}
I20260709 13:02:32.644310  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.646137  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57634 (request call id 46) took 1178 ms. Trace:
I20260709 13:02:32.644224  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:32.683756  1626 rpcz_store.cc:276] 0709 13:02:31.467489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.467632 (+   143us) service_pool.cc:224] Handling call
0709 13:02:32.645926 (+1178294us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54002fb7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfc9853 00007f06e2f9760a 00007f06dc51d7d4 00007f06dc51d762 00007f06dc51d691 00007f06dc51d60c 00007f06dc51c8c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:32.646061 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591752960}
I20260709 13:02:32.687125  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.691905  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.696738  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:32.698451  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 76708.7us
I20260709 13:02:32.699545  1702 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:02:32.699681  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:32.610438  9262 consensus_queue.cc:1048] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.072s
W20260709 13:02:32.704041  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45269.2us
I20260709 13:02:32.648751  8747 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.646163  9265 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:32.679418  9120 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:32.685891  9268 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:32.717559  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:32.693763  9250 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:32.679804  1701 raft_consensus.cc:1275] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:32.754182  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:32.755832  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:32.757300  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:32.685413  9227 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:32.694897  8902 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:32.725685  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:32.670677  1558 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 26.
I20260709 13:02:32.722723  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:32.696775  9172 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:32.704963  9082 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:32.704792  9304 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:32.777446  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:32.782251  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:32.780239  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:32.714764  9215 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.782325  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:32.724536  8933 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.690763  9018 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.784669  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:32.786216  1702 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:02:32.786700  1702 pending_rounds.cc:85] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 13
I20260709 13:02:32.786947  1702 pending_rounds.cc:107] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:02:32.787177  1702 raft_consensus.cc:2889] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:32.761373  9272 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.786329  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.793031  1701 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:32.800585  1701 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
W20260709 13:02:32.775113  9139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.358s	user 0.022s	sys 0.029s
I20260709 13:02:32.711140  8982 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.761219  8747 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.784579  8512 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:32.760875  9120 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.802320  9215 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:02:32.820218  9265 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.821030  9215 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:32.802676  9144 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:32.821945  9215 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.788218  9172 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.833928  9173 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.834158  9172 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.809293  9231 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:32.834499  9173 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.834806  9231 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.836520  9173 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.836735  9231 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:32.803563  9139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.386s	user 0.022s	sys 0.029s
I20260709 13:02:32.811388  9082 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:32.837903  9082 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.782150  9227 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.846634  9102 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.847553  9227 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:32.848744  9102 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.849812  9142 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.851857  9142 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.803399  9210 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:32.840695  9082 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.806828  9272 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:32.841269  9018 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.841499  9171 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:32.822541  9216 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:32.842878  9275 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:32.844604  8982 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.788924  9263 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.845561  9295 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.847458  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:32.858721  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:32.903669  1553 raft_consensus.cc:2368] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:32.807529  1558 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:32.859612  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:32.860281  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:32.829560  1599 leader_election.cc:336] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.569s (SENT)
I20260709 13:02:32.878393  1634 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 21: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:32.905817  1600 leader_election.cc:400] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:32.907197  1600 leader_election.cc:403] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:02:32.824167  8902 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:32.885064  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 100934us
I20260709 13:02:32.881552  9210 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.804275  8933 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.907557  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:32.820312  9327 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:02:32.815323  8747 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.920063  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:32.926560  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 96964.7us
I20260709 13:02:32.927094  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:32.826715  9233 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.883839  9171 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:32.929476  9142 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:32.934255  8982 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:32.937451  9216 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:32.939630  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:32.940506  2267 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:32.920595  9275 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.954326  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.954633  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.955602  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:32.956485  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.943059  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:32.943334  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:32.943619  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:32.957789  2268 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 24: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:32.942370  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:32.958963  2263 raft_consensus.cc:2368] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:32.959684  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:32.928076  9287 raft_consensus.cc:3060] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:32.958174  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.961555  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:32.963838  2271 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:32.958128  1555 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 24.
I20260709 13:02:32.954799  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:32.950701  1708 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:32.967484  1632 raft_consensus.cc:2393] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:32.960315  2263 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:32.946957  9138 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.965993  1600 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:32.947216  9294 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:32.973682  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:32.986987  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:32.987560  8589 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:32.990932  9260 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:32.992062  9138 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.994473  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:32.995519  9233 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:32.996053  9171 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:32.998045  8747 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:32.969831  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:33.022993  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 57090.8us
I20260709 13:02:33.023391  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.047009  9265 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:02:32.963691  9275 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.025381  2268 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 19: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:32.924438  9295 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:33.022758  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 330758us
I20260709 13:02:33.032500  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.041189  2263 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 26.
I20260709 13:02:33.001034  9272 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:33.059904  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:33.027258  9018 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.069747  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:33.067198  1632 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:33.072499  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:33.072782  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.073340  2263 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:33.080946  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:33.047847  8589 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:33.074215  1708 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:33.082141  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:33.088521  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:33.088924  2235 leader_election.cc:400] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21.
I20260709 13:02:33.089406  2235 leader_election.cc:403] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:33.090631  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:33.090716  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:33.072172  9265 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.096217  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:33.097069  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.097440  1599 leader_election.cc:400] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20.
I20260709 13:02:33.098232  9329 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:33.099385  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:33.100389  9329 consensus_queue.cc:1048] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:33.100561  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.103744  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.104449  1558 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:33.080529  9171 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:33.106081  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.125468  1555 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:33.063460  9260 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.126809  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.106833  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.106662  9265 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:33.107160  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:33.129338  1558 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:33.107493  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.130446  9295 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:33.108242  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:33.131287  1559 raft_consensus.cc:3060] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:33.109145  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:33.094820  9304 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:33.105002  9216 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21.
I20260709 13:02:33.083595  9018 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.137362  9018 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.110597  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:33.137523  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:33.071764  9285 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:33.138804  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:33.139185  9296 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.747s	user 0.001s	sys 0.002s
I20260709 13:02:33.139483  2270 raft_consensus.cc:2368] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:33.140144  9285 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:33.112934  8941 raft_consensus.cc:3055] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:33.141167  8941 raft_consensus.cc:740] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:33.075023  9263 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.105569  9102 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:33.115651  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:33.152413  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 74773us
I20260709 13:02:33.118781  9329 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:33.119688  8933 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.119814  9275 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.120141  9261 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.122735  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 3012) took 1090 ms. Trace:
I20260709 13:02:33.123456  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 3040) took 1292 ms. Trace:
I20260709 13:02:33.127717  9260 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.144704  2267 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:33.149533  1559 raft_consensus.cc:2410] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:02:33.141976  8941 consensus_queue.cc:260] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.115873  2268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca"
dest_uuid: "6923294c847b48ebb577e0935d316aa3"
mode: GRACEFUL
new_leader_uuid: "87144ea1a4a14ab8b942fb426159f031"
 from {username='slave'} at 127.0.0.1:37992
I20260709 13:02:33.156383  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:33.093832  8747 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:33.161561  2235 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.166647  1556 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 24. Current term is 25. Ops: []
I20260709 13:02:33.157534  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.177409  1558 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:33.170836  1631 rpcz_store.cc:276] 0709 13:02:31.831108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.831864 (+   756us) service_pool.cc:224] Handling call
0709 13:02:31.865863 (+ 33999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:31.866628 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.123258 (+1256630us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b540035d250. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:33.123398 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77227776}
I20260709 13:02:33.169798  1700 rpcz_store.cc:276] 0709 13:02:32.032047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.037370 (+  5323us) service_pool.cc:224] Handling call
0709 13:02:32.037583 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.465169 (+427586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.122486 (+657317us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54001c52d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:33.122672 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980951296}
I20260709 13:02:33.180070  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.105801  9155 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:33.180694  1700 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:33.182262  2268 raft_consensus.cc:606] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Received request to transfer leadership to TS 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.182659  2268 raft_consensus.cc:614] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:33.184788  1700 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:33.165797  9268 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:33.172636  9263 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.197149  2271 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:33.198140  2263 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:33.203841  1708 raft_consensus.cc:2410] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:02:33.185510  8941 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:33.167935  9102 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:33.183003  9238 consensus_queue.cc:1175] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "87144ea1a4a14ab8b942fb426159f031" responder_term: 16 status { last_received { term: 16 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 16 index: 15 } }
I20260709 13:02:33.172259  9329 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.177807  9261 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:33.204581  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 97987.3us
I20260709 13:02:33.192858  8589 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:33.219934  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.192955  9272 consensus_queue.cc:1059] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.017s
I20260709 13:02:33.222057  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:33.208343  9211 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:33.204783  9263 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.233696  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 3039) took 1419 ms. Trace:
I20260709 13:02:33.234126  1628 rpcz_store.cc:276] 0709 13:02:31.814494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.830824 (+ 16330us) service_pool.cc:224] Handling call
0709 13:02:31.861586 (+ 30762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.210945 (+349359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.233462 (+1022517us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b540034eed4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:33.233640 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753792384}
I20260709 13:02:33.233213  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1519) took 1549 ms. Trace:
I20260709 13:02:33.236186  1599 leader_election.cc:400] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:33.236457  2262 rpcz_store.cc:276] 0709 13:02:31.683944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.684150 (+   206us) service_pool.cc:224] Handling call
0709 13:02:31.684426 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.829016 (+144590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.232954 (+1403938us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400416754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:33.233153 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312832384}
I20260709 13:02:33.237074  1599 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.229696  9287 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635) with higher term. Message: Invalid argument: T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:33.246793  1635 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:33.239727  9142 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:02:33.252729  9144 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:33.254667  9142 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:33.255038  9142 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:33.255894  9142 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.257102  9142 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:33.259305  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3067) took 1800 ms. Trace:
I20260709 13:02:33.259754  1552 rpcz_store.cc:276] 0709 13:02:31.458595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.462127 (+  3532us) service_pool.cc:224] Handling call
0709 13:02:31.462455 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:31.462704 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:31.702152 (+239448us) log.cc:844] Serialized 14 byte log entry
0709 13:02:33.258701 (+1556549us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b18003ed640. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddb774bc 00007f06daec548b 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f23a
0709 13:02:33.258908 (+   207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:33.258963 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:33.259014 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.259102 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.259245 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":348201,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":5952,"spinlock_wait_cycles":2511616,"thread_start_us":359534,"threads_started":2,"wal-append.queue_time_us":295894,"wal-append.run_cpu_time_us":1244,"wal-append.run_wall_time_us":1097848}
I20260709 13:02:33.262123  9231 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:33.262748  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.262673  9231 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:33.266312  9178 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:33.267797  1704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 3007) took 1384 ms. Trace:
I20260709 13:02:33.268232  1704 rpcz_store.cc:276] 0709 13:02:31.883059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.883283 (+   224us) service_pool.cc:224] Handling call
0709 13:02:31.883607 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.203065 (+319458us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:32.203109 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:32.203164 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:32.203206 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.267581 (+1064375us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54000b6b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:33.267629 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.267741 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3305,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3059,"spinlock_wait_cycles":733563776}
I20260709 13:02:33.273674  1633 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:33.275985  1599 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.277271  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.281934  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.286173  1599 leader_election.cc:400] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:33.287231  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:33.246698  8589 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:33.288836  1524 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:33.336650  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 47871.2us
I20260709 13:02:33.290936  8737 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:33.290515  9215 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:33.286922  9287 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:33.283159  9207 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:33.337730  8737 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:33.340508  9082 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:33.349437  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.291311  9265 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:33.349257  9337 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:02:33.351212  9082 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:33.416306  1704 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:02:33.418879  1704 pending_rounds.cc:85] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 14
I20260709 13:02:33.419296  1704 pending_rounds.cc:107] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:02:33.419579  1704 raft_consensus.cc:2889] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:33.373982  9265 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:33.426890  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.430703  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.353346  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.431366  1556 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:33.435510  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.436821  1557 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:02:33.439448  1556 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:02:33.432722  2235 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:33.442667  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.443353  1633 raft_consensus.cc:2368] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 25. Current term is 26.
W20260709 13:02:33.444792  9341 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:02:33.446636  9347 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:02:33.442507  9305 consensus_queue.cc:1059] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:33.448251  9087 raft_consensus.cc:3055] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:33.448621  9087 raft_consensus.cc:740] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:33.449441  9087 consensus_queue.cc:260] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.450678  9087 raft_consensus.cc:3060] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:33.451527  9243 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:33.451983  9243 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.438752  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:33.363337  9089 raft_consensus.cc:3055] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:33.352391  9231 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:33.379820  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:33.378363  9082 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:33.355473  9102 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:33.437909  9248 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.011s	sys 0.010s
W20260709 13:02:33.472139  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.478869  1524 leader_election.cc:400] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 25. Current term is 26.
I20260709 13:02:33.482908  1524 leader_election.cc:403] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:33.476712  1554 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:02:33.374212  9329 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:33.441828  9265 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.360392  9309 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:33.441218  9277 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:33.477355  9243 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:33.372608  9178 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:02:33.496359  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:33.482262  9248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.011s	sys 0.011s
I20260709 13:02:33.476070  9089 raft_consensus.cc:740] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:33.481415  9263 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:33.500839  9228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.007s	sys 0.007s
I20260709 13:02:33.513432  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.543336  1705 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:33.516069  9089 consensus_queue.cc:260] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.489760  9102 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.531415  1554 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 26.
I20260709 13:02:33.373179  8737 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:33.564333  1526 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.498333  9261 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:33.574607  1635 raft_consensus.cc:1240] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 16. Current term is 17. Ops: []
W20260709 13:02:33.549682  1456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35568 (request call id 325) took 17956 ms (client timeout 15000 ms). Trace:
I20260709 13:02:33.499801  9277 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:33.479465  9303 consensus_queue.cc:1059] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:02:33.540493  9246 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:33.499393  9309 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:33.486415  9231 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:02:33.558059  9287 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:33.561159  9210 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:33.575784  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:33.580000  1632 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:33.594807  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:33.581471  2234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.588090  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.589454  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:33.500061  9155 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:33.542884  9228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.007s	sys 0.013s
I20260709 13:02:33.593487  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:33.598425  9246 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.601332  9309 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:33.602165  2263 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:33.602632  1634 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:33.606526  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.496217  9265 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.578296  8933 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 25. Current term is 26.
I20260709 13:02:33.608403  2269 raft_consensus.cc:1240] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:02:33.609033  2266 raft_consensus.cc:1240] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:33.609655  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.591840  9089 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:33.616735  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:33.612669  1627 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:33.613281  1632 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 24. Current term is 25. Ops: []
I20260709 13:02:33.618975  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:33.620780  9277 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:33.631778  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:33.637933  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:33.638536  1628 raft_consensus.cc:2410] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:02:33.640312  1629 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:33.643249  2263 raft_consensus.cc:2393] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:02:33.575295  1456 rpcz_store.cc:269] 0709 13:02:15.584488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.597685 (+ 13197us) service_pool.cc:224] Handling call
0709 13:02:33.540310 (+17942625us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:27.327131 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:27.327805 (+   674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:27.327855 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:02:27.327873 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:27.329187 (+  1314us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:27.329277 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:27.329307 (+    30us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:02:27.510545 (+181238us) tablet.cc:701] Row locks acquired
0709 13:02:27.536066 (+ 25521us) write_op.cc:260] PREPARE: finished
0709 13:02:27.536247 (+   181us) write_op.cc:270] Start()
0709 13:02:27.536399 (+   152us) write_op.cc:276] Timestamp: P: 1783602147536180 usec, L: 0
0709 13:02:27.536440 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:02:27.537156 (+   716us) log.cc:844] Serialized 5614 byte log entry
0709 13:02:27.791114 (+253958us) op_driver.cc:464] REPLICATION: finished
0709 13:02:27.822847 (+ 31733us) write_op.cc:301] APPLY: starting
0709 13:02:27.825555 (+  2708us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:28.744401 (+918846us) spinlock_profiling.cc:243] Waited 7.64 ms on lock 0x7b18001d9f20. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddd0e0ec 00007f06ddd5ac0a 00007f06ddd5a4f7 00007f06ddd5a490 00007f06ddd05754 00007f06e1a25f13 00007f06e1a26532 00007f06e1a6db93 00007f06e191ade3
0709 13:02:29.059803 (+315402us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:29.059863 (+    60us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:29.870725 (+810862us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:29.871180 (+   455us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:02:29.871268 (+    88us) write_op.cc:312] APPLY: finished
0709 13:02:29.872040 (+   772us) log.cc:844] Serialized 129 byte log entry
0709 13:02:30.017020 (+144980us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:30.037358 (+ 20338us) write_op.cc:454] Released schema lock
0709 13:02:30.115540 (+ 78182us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:30.125106 (+  9566us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:30.125170 (+    64us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":517400,"reported_tablets":47,"spinlock_wait_cycles":11392,"child_traces":[["op",{"apply.queue_time_us":4830,"apply.run_cpu_time_us":51933,"apply.run_wall_time_us":2315212,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62619,"num_ops":14,"prepare.queue_time_us":202009,"prepare.run_cpu_time_us":21270,"prepare.run_wall_time_us":324688,"raft.queue_time_us":30186,"raft.run_cpu_time_us":1318,"raft.run_wall_time_us":28007,"replication_time_us":254474,"spinlock_wait_cycles":17568128,"thread_start_us":414486,"threads_started":5,"wal-append.queue_time_us":466590,"wal-append.run_cpu_time_us":30990,"wal-append.run_wall_time_us":2251449}]]}
I20260709 13:02:33.586360  9213 consensus_queue.cc:1059] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 13:02:33.651990  1629 raft_consensus.cc:1275] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:33.582950  9102 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.662454  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:33.662946  2266 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:02:33.663558  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.657876  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:33.656541  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.669945  9102 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.607497  9155 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.672302  9155 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.674655  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:33.676014  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:33.679193  2271 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:02:33.680766  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:33.681371  2270 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:02:33.681645  1551 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:33.682200  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:33.682832  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:33.718766  1635 raft_consensus.cc:2468] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:33.685870  9082 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:33.680784  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:33.691368  9138 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.692080  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.692310  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:33.692790  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.693991  8747 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:33.695109  9236 consensus_queue.cc:1048] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:33.696360  9120 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:33.696630  9282 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:33.697651  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.740875  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.697922  9309 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.699055  9263 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.707592  9265 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.711649  9246 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.713948  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:33.722347  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.755263  1559 raft_consensus.cc:2410] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:02:33.723395  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.724102  1554 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:33.734480  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.737847  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:33.739614  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.741779  1560 raft_consensus.cc:1240] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 23. Current term is 24. Ops: []
I20260709 13:02:33.744364  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:33.744549  2234 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:33.734553  9281 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:02:33.745474  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.758814  1555 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:33.720590  9155 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:33.763787  1553 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:33.764600  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.765439  1634 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:33.765683  1632 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:33.770313  1629 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:33.771061  1628 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:02:33.772567  8941 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.006s
I20260709 13:02:33.768177  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.770308  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.777341  9231 raft_consensus.cc:3055] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:33.777845  9231 raft_consensus.cc:740] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:33.777886  1634 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:33.777000  9243 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.751691  9282 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.751053  9251 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:02:33.784060  1633 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:02:33.785890  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:33.791268  9251 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:33.791658  9251 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.791962  9251 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:33.802145  9082 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:33.754237  9309 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.804792  9309 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.762888  9246 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:02:33.810477  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 65969.9us
W20260709 13:02:33.812616  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 117679us
I20260709 13:02:33.813222  2262 raft_consensus.cc:2393] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 24: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:33.813876  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:33.753593  9269 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:02:33.816797  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.817651  8901 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:33.818399  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:33.757241  9263 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.812510  9216 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:02:33.782985  9155 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:33.824848  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:33.830500  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:33.800392  9251 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:33.832475  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 91699us
I20260709 13:02:33.833261  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.822075  9228 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:33.836992  2234 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.826426  8941 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:33.839462  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.835711  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.843036  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3390) took 1252 ms. Trace:
I20260709 13:02:33.832011  9269 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:33.835017  8747 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:33.831348  9277 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.863631  1703 rpcz_store.cc:276] 0709 13:02:32.590834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.591735 (+   901us) service_pool.cc:224] Handling call
0709 13:02:32.592037 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:32.592389 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:32.592418 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:32.592877 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:02:33.703790 (+1110913us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18003e47c0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:02:33.783617 (+ 79827us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:33.783651 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.783711 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:33.842755 (+ 59044us) raft_consensus.cc:1685] finished
0709 13:02:33.842776 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.842977 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3356,"spinlock_wait_cycles":2984320,"thread_start_us":79646,"threads_started":1,"wal-append.queue_time_us":1232035}
I20260709 13:02:33.828567  9350 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:02:33.827212  9309 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:02:33.838279  9333 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:33.827796  9248 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:02:33.843442  8941 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.906337  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.907009  1635 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:33.831848  9210 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:02:33.867592  2234 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:33.900699  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 65014.4us
I20260709 13:02:33.866581  9269 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:33.908601  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:33.909228  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:33.912209  1633 raft_consensus.cc:2393] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 25: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:33.890411  8901 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:33.932946  9065 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:33.933509  9065 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:33.925869  9282 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.933884  9216 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:02:33.936017  9261 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:33.942433  9065 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:33.853222  9329 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
W20260709 13:02:33.917732  9358 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:02:33.915198  8747 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:33.919335  9210 raft_consensus.cc:2804] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:33.919572  9293 raft_consensus.cc:3055] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:02:33.920843  9364 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:02:33.922713  9363 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:33.898536  9277 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.923758  9243 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:33.913619  9309 consensus_queue.cc:1243] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:02:33.924715  9300 raft_consensus.cc:3055] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:33.953171  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.955680  1706 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:33.914099  9269 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:33.927459  9155 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:33.929486  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:33.929774  9268 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:33.946061  9293 raft_consensus.cc:740] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:33.864992  9250 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:02:33.980101  9293 consensus_queue.cc:260] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:33.979521  9269 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:33.980756  8901 consensus_queue.cc:1048] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:33.932704  9333 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:33.981222  9293 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:33.910163  8941 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:33.981580  1707 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:33.942934  9251 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.943823  9065 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:33.918617  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 51074.1us
W20260709 13:02:33.945370  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 105954us
I20260709 13:02:33.985954  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.981244  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 3013) took 1593 ms. Trace:
I20260709 13:02:33.986483  1709 rpcz_store.cc:276] 0709 13:02:32.387842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.387995 (+   153us) service_pool.cc:224] Handling call
0709 13:02:32.388262 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:32.589700 (+201438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:32.589745 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:32.589801 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:32.589845 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.981000 (+1391155us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54001ac2d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:33.981050 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:33.981187 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462508928}
I20260709 13:02:33.987119  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.987751  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.988325  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.989544  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:33.993856  1709 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:33.951562  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:33.994817  1702 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:33.952306  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.953250  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:33.913892  9366 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:33.957221  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.959779  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.961390  9277 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:33.995414  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:33.961300  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:34.004101  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 94800.2us
I20260709 13:02:33.962232  9370 consensus_queue.cc:1059] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:33.961937  9243 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:33.946689  9364 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:33.955281  9300 raft_consensus.cc:740] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:33.975077  1601 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:33.989737  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:33.990305  2269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1701) took 1612 ms. Trace:
I20260709 13:02:33.991696  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:33.992514  8747 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:02:33.993218  9333 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.947599  1703 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:34.019919  1704 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:34.007133  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:34.007906  1701 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 21: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:34.022863  1629 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:34.010943  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:34.024627  1709 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 26.
I20260709 13:02:34.024770  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:33.958112  9210 raft_consensus.cc:697] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:34.015143  1673 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:34.026983  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:34.019052  2269 rpcz_store.cc:276] 0709 13:02:32.377710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.377858 (+   148us) service_pool.cc:224] Handling call
0709 13:02:32.391380 (+ 13522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.612293 (+1220913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.990054 (+377761us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400269154. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:33.990246 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2796881152}
W20260709 13:02:34.028215  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 51021.1us
I20260709 13:02:34.027582  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:34.031716  1702 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 25.
I20260709 13:02:34.008301  9182 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:34.047070  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:34.001446  9369 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:34.017872  9251 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:34.047008  9246 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:34.123306  9350 consensus_queue.cc:1243] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer 7e99891af85f4b10aa1cc2da6aa33082 log is divergent from this leader: its last log entry 23.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:02:34.125944  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 98537.4us
I20260709 13:02:34.044697  9277 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:34.010257  9368 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:34.045246  9342 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:34.028573  9329 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:34.129318  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 82305.3us
I20260709 13:02:34.130283  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:34.132206  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:34.139890  1601 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:34.142261  1556 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:34.018057  9366 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.113s
I20260709 13:02:34.152496  1601 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:34.129086  9238 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.043982  9333 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.148100  8941 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.127497  9251 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:34.026428  9282 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.105s
W20260709 13:02:34.147424  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 132336us
I20260709 13:02:34.217545  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:34.130980  9277 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:34.154098  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:34.131255  9105 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:34.126000  9246 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:34.159231  9138 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:34.139101  9369 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:34.138177  9342 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.141794  9350 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:34.185026  9263 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:34.238487  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:34.239748  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.187947  9231 consensus_queue.cc:260] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.190577  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:34.240324  1630 raft_consensus.cc:1240] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:34.130568  9171 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:02:34.204313  1628 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 24. Current term is 25. Ops: []
I20260709 13:02:34.151567  9269 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:34.156561  9207 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:02:34.166430  9268 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:34.160490  8911 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
W20260709 13:02:34.224151  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 70110.8us
I20260709 13:02:34.210641  9304 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:34.163980  9238 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.232780  2269 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:34.233052  9342 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:34.233832  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.236181  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:34.220635  9277 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:34.220737  9251 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:34.264595  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 47129.1us
I20260709 13:02:34.139858  9300 consensus_queue.cc:260] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.225874  9138 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.307927  9138 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:34.298338  9350 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:34.310632  9246 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.312071  9246 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:34.314939  9378 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:34.263319  9182 consensus_queue.cc:1059] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:02:34.298657  9231 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:34.307467  1702 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:34.319630  1702 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:34.320521  1702 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:34.321610  1702 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:34.285607  9093 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.322515  9093 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.324571  9093 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:34.325315  9268 raft_consensus.cc:3055] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:34.325753  9268 raft_consensus.cc:740] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:34.326574  9268 consensus_queue.cc:260] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:34.327877  1707 raft_consensus.cc:1240] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:02:34.328800  9350 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:34.329056  9368 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:34.329334  9350 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:34.329725  9368 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:34.331451  9350 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:34.332114  9368 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:34.253383  1626 raft_consensus.cc:1240] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 23. Current term is 24. Ops: []
W20260709 13:02:34.234186  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 1470) took 1137 ms (client timeout 1502 ms). Trace:
I20260709 13:02:34.266937  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:34.267168  9333 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:34.333259  1708 rpcz_store.cc:269] 0709 13:02:33.096668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.096811 (+   143us) service_pool.cc:224] Handling call
0709 13:02:34.233883 (+1137072us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54000a82d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:34.234089 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239093632}
I20260709 13:02:34.197992  9210 consensus_queue.cc:237] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.269865  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.270682  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.271893  2262 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:02:34.271754  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:34.272586  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.273885  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.274428  2268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37992 (request call id 15) took 1171 ms. Trace:
I20260709 13:02:34.344729  2264 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:34.344657  2268 rpcz_store.cc:276] 0709 13:02:33.108086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.108229 (+   143us) service_pool.cc:224] Handling call
0709 13:02:34.274228 (+1165999us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b540064c8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfc9853 00007f06e2f9760a 00007f06dc51d7d4 00007f06dc51d762 00007f06dc51d691 00007f06dc51d60c 00007f06dc51c8c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:34.274347 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21858048}
I20260709 13:02:34.345577  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:34.278214  9315 consensus_queue.cc:1059] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:34.346429  1560 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:34.284731  9082 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:34.285526  1706 raft_consensus.cc:3060] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:34.290555  9369 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:34.292570  9269 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:34.248790  8901 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.095s
I20260709 13:02:34.247855  9258 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:34.299757  1555 raft_consensus.cc:1240] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 24. Current term is 25. Ops: []
I20260709 13:02:34.303478  1558 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:34.307351  8941 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:34.336181  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80273.3us
I20260709 13:02:34.338219  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:34.338639  1553 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:34.338987  1702 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:02:34.371337  1702 pending_rounds.cc:85] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 11
I20260709 13:02:34.371706  1702 pending_rounds.cc:107] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:02:34.372030  1702 raft_consensus.cc:2889] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:34.269796  1701 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:02:34.283563  8966 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:34.346928  2265 raft_consensus.cc:2393] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:34.261693  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:34.349859  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.383741  2262 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:34.355871  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:34.263986  9155 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.262565  9207 raft_consensus.cc:697] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:34.292701  9211 raft_consensus.cc:3055] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:34.362754  2268 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:02:34.366698  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.389810  2270 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
W20260709 13:02:34.385182  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 123521us
I20260709 13:02:34.402773  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:34.404982  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:34.265977  9304 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:34.425807  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 69979.7us
I20260709 13:02:34.433614  1701 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:34.444556  1706 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:34.446281  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:34.447322  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:34.367729  9269 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.445609  8941 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:34.466038  8941 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.467514  9269 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:34.468035  8941 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:34.450583  9376 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:34.468760  9207 consensus_queue.cc:237] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:34.468950  9376 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.478974  2269 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
W20260709 13:02:34.407037  9248 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
I20260709 13:02:34.387831  9305 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:02:34.406625  9211 raft_consensus.cc:740] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:34.359598  9082 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:34.425806  9087 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:34.406400  8966 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:34.502635  9087 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:34.503060  9293 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.003s
I20260709 13:02:34.361639  9369 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.497649  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:34.499017  1631 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:34.505185  1553 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:02:34.505867  1553 pending_rounds.cc:85] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 12
I20260709 13:02:34.506212  1553 pending_rounds.cc:107] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:02:34.506788  1553 raft_consensus.cc:2889] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:34.508220  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:34.426445  9155 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:34.504228  8966 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:34.516495  9368 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:34.544571  1560 raft_consensus.cc:2468] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:34.514811  9377 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:34.551055  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:34.551625  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:34.558910  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:34.558912  1628 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 25.
I20260709 13:02:34.561520  1631 raft_consensus.cc:1275] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:34.563350  1631 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:02:34.565891  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:34.568779  1630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d"
dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
mode: GRACEFUL
new_leader_uuid: "4f1725fe36e349ac85405627f9c93d95"
 from {username='slave'} at 127.0.0.1:57634
I20260709 13:02:34.569631  1630 raft_consensus.cc:606] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Received request to transfer leadership to TS 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:34.570071  1630 raft_consensus.cc:614] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:34.573386  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:34.517263  9282 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
W20260709 13:02:34.576582  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.579767  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:34.538662  9368 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.582429   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:02:34.588865  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 391245us
I20260709 13:02:34.566681  9258 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:34.588945   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:34.593604  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:34.598999  1600 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:34.575057  9369 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:34.581347  9238 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:34.583410  9269 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:34.584473  9368 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:34.586316  8747 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:34.585608  9377 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:34.619432  2271 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 13:02:34.646111  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.620183  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.630339  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:34.631801  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:34.650617  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:34.633605  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:34.536815  9211 consensus_queue.cc:260] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.641393  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.653590  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:34.616242  9315 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:34.594637  8901 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:02:34.595715  9282 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:02:34.664260  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:34.667701  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:34.642788  8737 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:02:34.700183  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.642647  8747 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:34.644409  9377 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:34.703377  8966 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:34.719660  8966 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:34.720266  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52651.5us
W20260709 13:02:34.719676  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.721866  9373 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:02:34.722537  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.722468  8966 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:34.723141  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.723529  9350 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.724035  9350 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.726171  9380 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.726697  9380 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.728909  9380 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:34.730463  9350 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:34.732259  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:34.644239  9130 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:02:34.659659  9272 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:02:34.697434  9144 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:02:34.709478  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 262157us
I20260709 13:02:34.758008  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:34.708698  8941 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.705185  9094 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:34.710255  8747 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:34.703598  9369 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:34.762064  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:34.717124  9082 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:34.671605  9315 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.768594  9305 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:34.750223  9379 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:34.775791  8966 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:02:34.784415  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.812503  9385 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:34.813151  9385 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:34.815215  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 229580us
W20260709 13:02:34.778805  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 373737us
I20260709 13:02:34.716790  9376 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:34.782191  9155 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:34.716250  9258 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.771306  8941 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:34.838141  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.832650  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:34.803695  9282 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:34.773690  9094 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.852164  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:34.821601  9366 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.781890  9369 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:34.834714  9251 consensus_meta.cc:287] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 13:02:34.853744  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:34.855135  1707 raft_consensus.cc:2368] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 25. Current term is 26.
W20260709 13:02:34.861464  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 241691us
I20260709 13:02:34.858516  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:34.857245  9385 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:34.864001  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:34.863718  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 220340us
I20260709 13:02:34.834678  9384 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:34.865226  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:34.861123  9277 consensus_meta.cc:287] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.002s
I20260709 13:02:34.783253  9377 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.881904  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:34.891245  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.894201  2263 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:02:34.897927  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:34.898277  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.898833  2263 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:34.892961  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.900184  2268 raft_consensus.cc:2393] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 16: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:34.872334  9384 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.902132  9364 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.902593  9384 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:34.867561  9018 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:02:34.873335  9246 consensus_meta.cc:287] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.561s	user 0.013s	sys 0.000s
I20260709 13:02:34.905162  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:34.870070  8901 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:34.906090  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.910387  1629 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:34.910524  2268 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:34.913319  1708 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:02:34.913798  1708 pending_rounds.cc:85] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 15
I20260709 13:02:34.914628  1708 pending_rounds.cc:107] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:02:34.914981  1708 raft_consensus.cc:2889] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:34.917550  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.896145  9385 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:34.860225  9282 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.923069  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:34.924727  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 325623us
I20260709 13:02:34.870299  9082 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:02:34.904166  9087 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:34.926945  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:34.911531  9291 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.917896  8901 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.892804  9155 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:02:34.939656  2268 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 24.
W20260709 13:02:34.959054  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 186109us
I20260709 13:02:34.942397  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:34.943260  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:34.922783  9384 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.933194  9138 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.625s	user 0.006s	sys 0.002s
I20260709 13:02:34.938618  8966 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:34.952472  9342 consensus_meta.cc:287] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.000s
I20260709 13:02:34.929847  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:34.954236  9369 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:34.903622  9231 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
W20260709 13:02:34.981730  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52417.5us
I20260709 13:02:34.968977  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:34.954928  9333 consensus_queue.cc:1059] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:34.874727  9277 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.868537  9251 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:34.949671  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.986410  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:34.928782  9210 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.971658  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 54934.2us
I20260709 13:02:34.863723  9366 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.905546  9269 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:34.970646  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:34.939060  8941 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:34.990170  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:34.989960  1633 raft_consensus.cc:2393] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:34.945752  9233 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:34.941731  9282 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:34.970136  9182 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:35.007514  1703 raft_consensus.cc:1240] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21. Ops: []
W20260709 13:02:35.016655  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 116995us
I20260709 13:02:35.019847  1707 raft_consensus.cc:1240] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:35.026597  1706 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:35.032274  9372 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:34.939309  9315 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.036950  2236 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:35.039109  9094 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:35.039776  9094 raft_consensus.cc:2804] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:35.040290  9094 raft_consensus.cc:697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 24 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:35.041201  9094 consensus_queue.cc:237] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.021719  9018 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:02:34.987787  9342 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.047272  9277 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.047854  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:35.048198  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:35.048449  9386 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.049283  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:35.050693  2271 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:02:35.052980  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:35.055071  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:35.056823  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:34.981508  9138 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:34.939687  9291 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.061817  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:35.061964  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:35.009441  9182 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.980847  9384 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.011080  9233 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:35.073709  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:34.986328  8966 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.059278  8911 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:35.002543  9210 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.010272  9407 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:02:35.023684  9411 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:35.084126  1632 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 22. Current term is 23. Ops: [22.18-22.18]
I20260709 13:02:35.010068  9128 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:02:35.063069  9130 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:35.089883  9414 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.094671  9093 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:35.136585  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:35.134366  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:35.074714  9182 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:35.059407  9269 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:35.140069  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 73551.7us
I20260709 13:02:35.169920  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:35.121480  9268 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:35.146409  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 86228.2us
I20260709 13:02:35.109848  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:35.128482  9400 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.188s	user 0.002s	sys 0.000s
I20260709 13:02:35.150496  1455 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.165073  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:35.049134  9082 consensus_queue.cc:1059] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:02:35.178755  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:35.170795  2265 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:35.188421  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:35.065651  9386 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.141459  9416 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:35.149374  9265 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.195644  1455 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 22 to 24, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 24 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:35.216526  1455 catalog_manager.cc:5697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 18 to 19, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:35.197245  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:35.208688  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.153795  9093 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:35.217918  1455 catalog_manager.cc:5697] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 21, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:35.297288  1455 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 18 to 22, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 22 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:35.192844  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:35.300490  1703 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:35.205220  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.248383  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 258787us
I20260709 13:02:35.134112  9155 consensus_queue.cc:1059] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:02:35.303562  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:35.309252  1702 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 13:02:35.311192  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 96034.4us
W20260709 13:02:35.314126  1675 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.334645  1629 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 24. Current term is 25. Ops: []
I20260709 13:02:35.337002  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:35.337966  1633 raft_consensus.cc:2368] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
W20260709 13:02:35.338179  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 140945us
I20260709 13:02:35.171976  9333 consensus_queue.cc:1059] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 20.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.141s
I20260709 13:02:35.194681  9411 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:35.342998  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.214289  9350 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:35.214114  8941 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:35.297526  9373 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:35.166880  9414 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:35.337423  9315 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:35.348383  9369 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:35.329116  9209 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:02:35.355185  9082 raft_consensus.cc:2764] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:02:35.297865  9416 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.367506  9105 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.312690  9265 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.366726  8941 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.371147  9373 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.395267  9315 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.438232  9291 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.425240  9138 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.433625  9432 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:35.472782  9413 raft_consensus.cc:3055] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:02:35.473111  9421 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:35.473330  9413 raft_consensus.cc:740] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:35.474269  9432 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:35.475773  9417 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
W20260709 13:02:35.476650  9418 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:02:35.476784  9304 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.477658  9366 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:35.480865  9423 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:02:35.461293  9415 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
W20260709 13:02:35.470498  9368 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.817s	user 0.011s	sys 0.002s
I20260709 13:02:35.490360  9413 consensus_queue.cc:260] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.508196  9405 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:35.508962  9405 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:02:35.511399  9403 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.572s	user 0.002s	sys 0.000s
I20260709 13:02:35.512161  9384 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.513379  9379 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:35.514407  9432 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:35.517129  9399 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.579s	user 0.002s	sys 0.008s
I20260709 13:02:35.519279  9416 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:35.500993  9386 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.496337  9368 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.521737  9342 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.523733  9364 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:35.530854  9368 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.531167  9397 raft_consensus.cc:3055] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:35.531847  9397 raft_consensus.cc:740] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:35.535394  9394 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.700s	user 0.002s	sys 0.000s
I20260709 13:02:35.536403  9369 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:35.537993  9379 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:35.541213  9373 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.508989  9414 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:35.544451  9408 log.cc:927] Time spent T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.614s	user 0.001s	sys 0.002s
I20260709 13:02:35.533087  9397 consensus_queue.cc:260] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:35.546937  9397 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:35.547431  9379 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.547857  9377 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:35.549746  9379 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.299090  1455 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:35.594581  1455 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:35.601686  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.597388  1455 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 12 to 15, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 15 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:35.603957  1455 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.607437  1455 catalog_manager.cc:5697] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:35.610841  1455 catalog_manager.cc:5697] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 15 to 17, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:35.613379  1455 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 17 to 23, leader changed from <none> to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 23 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:35.617096  1455 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:35.619750  1560 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42098 (request call id 3095) took 1005 ms. Trace:
I20260709 13:02:35.668257  1560 rpcz_store.cc:276] 0709 13:02:34.614203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.614393 (+   190us) service_pool.cc:224] Handling call
0709 13:02:34.614826 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.615235 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.615261 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.615774 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.878354 (+262580us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:34.878388 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.878448 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.127781 (+249333us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:35.618658 (+490877us) raft_consensus.cc:1685] finished
0709 13:02:35.618756 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.619420 (+   664us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1128,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":96,"spinlock_wait_cycles":9902976,"thread_start_us":262283,"threads_started":1,"wal-append.queue_time_us":324059}
I20260709 13:02:35.623378  1630 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:35.624688  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1703) took 1287 ms. Trace:
I20260709 13:02:35.628238  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:35.631304  1701 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 23: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:35.678063  1455 catalog_manager.cc:5697] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.679837  8901 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:35.680507  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36040 (request call id 1486) took 1044 ms. Trace:
I20260709 13:02:35.680861  8941 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:35.680956  1701 rpcz_store.cc:276] 0709 13:02:34.635720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.653347 (+ 17627us) service_pool.cc:224] Handling call
0709 13:02:35.680166 (+1026819us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54001def54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:35.680374 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231448320}
I20260709 13:02:35.632400  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:35.684167  1551 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 26.
W20260709 13:02:35.633271  1706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.034s	sys 0.092s
I20260709 13:02:35.635862  1559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 3157) took 1337 ms. Trace:
W20260709 13:02:35.685422  1706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.035s	sys 0.093s
I20260709 13:02:35.678292  1634 rpcz_store.cc:276] 0709 13:02:34.337367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.339543 (+  2176us) service_pool.cc:224] Handling call
0709 13:02:34.339817 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.341928 (+  2111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.341959 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.342428 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.591949 (+249521us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:34.592007 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.592097 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.534538 (+942441us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:35.624002 (+ 89464us) raft_consensus.cc:1685] finished
0709 13:02:35.624061 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.624489 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1747,"raft.queue_time_us":207602,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":247465856,"thread_start_us":216446,"threads_started":1,"wal-append.queue_time_us":419970}
I20260709 13:02:35.685438  1559 rpcz_store.cc:276] 0709 13:02:34.298792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.298921 (+   129us) service_pool.cc:224] Handling call
0709 13:02:34.299195 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.510705 (+211510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.510732 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.510770 (+    38us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:34.510799 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.635189 (+1124390us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400178254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:35.635309 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.635625 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485731584}
I20260709 13:02:35.640409  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1482) took 1499 ms. Trace:
I20260709 13:02:35.688971  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59260 (request call id 1702) took 1353 ms. Trace:
I20260709 13:02:35.689139  8966 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.689401  1632 rpcz_store.cc:276] 0709 13:02:34.335044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.336463 (+  1419us) service_pool.cc:224] Handling call
0709 13:02:34.336818 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:35.140329 (+803511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.688433 (+548104us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b540006bdd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:35.688791 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714675968}
I20260709 13:02:35.689342  1709 rpcz_store.cc:276] 0709 13:02:34.141332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.290392 (+149060us) service_pool.cc:224] Handling call
0709 13:02:34.290747 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.345052 (+ 54305us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:02:35.099501 (+754449us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b180034c660. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddb774bc 00007f06daec548b 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daedf455 00007f06e19c73c7 00007f06ddfd99a7 00007f06ddfe90bf
0709 13:02:35.099694 (+   193us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.353002 (+253308us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:35.364533 (+ 11531us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.364672 (+   139us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:02:35.364887 (+   215us) log.cc:844] Serialized 14 byte log entry
0709 13:02:35.365098 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.529533 (+164435us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b180034c660. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:02:35.639272 (+109739us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b180034c660. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419
0709 13:02:35.639763 (+   491us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b54001ac7d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:35.639839 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.639921 (+    82us) raft_consensus.cc:1685] finished
0709 13:02:35.639938 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.640223 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":337998,"prepare.queue_time_us":21631,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":105,"raft.queue_time_us":12498,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":329996,"spinlock_wait_cycles":199399552,"thread_start_us":556395,"threads_started":2,"wal-append.queue_time_us":326661}
I20260709 13:02:35.655696  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42086 (request call id 3160) took 1355 ms. Trace:
I20260709 13:02:35.663012  1556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1488) took 1377 ms. Trace:
I20260709 13:02:35.630973  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:35.654628  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3414) took 1281 ms. Trace:
I20260709 13:02:35.681773  1455 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.692319  1554 rpcz_store.cc:276] 0709 13:02:34.299897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.302243 (+  2346us) service_pool.cc:224] Handling call
0709 13:02:34.302624 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.504532 (+201908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.504569 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.504624 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:34.504658 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.655149 (+1150491us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400373054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:35.655237 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.655516 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463584000}
I20260709 13:02:35.692983  1708 rpcz_store.cc:276] 0709 13:02:34.372985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.373672 (+   687us) service_pool.cc:224] Handling call
0709 13:02:34.432253 (+ 58581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.915469 (+483216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.653931 (+738462us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54003f3254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:35.654410 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104780160}
I20260709 13:02:35.692633  1556 rpcz_store.cc:276] 0709 13:02:34.285737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.337139 (+ 51402us) service_pool.cc:224] Handling call
0709 13:02:34.337432 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:34.501694 (+164262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.501727 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:34.501770 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:34.501800 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.662341 (+1160541us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400181d54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:35.662445 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.662736 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377128704}
I20260709 13:02:35.396453  9093 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.724570  9416 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.725804  9416 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:35.726670  2271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.013s
W20260709 13:02:35.727185  2271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.000s	sys 0.013s
I20260709 13:02:35.729132  9416 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:35.729245  9368 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:35.730563  9368 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.731897  9369 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:35.732982  9369 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.734336  9384 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.735325  9384 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.737326  9370 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.407084  9105 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.745293  9105 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.748699  9315 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:35.752306  1599 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38311 timed out after 1.569s (SENT) [suppressed 10 similar messages]
I20260709 13:02:35.464417  9210 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:35.755159  9372 raft_consensus.cc:3055] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:35.755775  9372 raft_consensus.cc:740] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:35.762275  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:35.764297  9413 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:35.764597  9265 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.757398  9372 consensus_queue.cc:260] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.18, Last appended by leader: 18, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:35.776441  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 442853us
I20260709 13:02:35.781242  9211 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:35.782805  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.788630  9231 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:35.789227  9231 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:35.789703  9231 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:35.792092  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:35.796733  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:35.741564  9233 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.798229  9370 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.799401  1526 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:35.799604  9233 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:35.802646  9414 consensus_queue.cc:1059] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:35.801592  9370 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:35.807055  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 54992.7us
I20260709 13:02:35.797855  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:35.824977  9437 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:35.825139  8747 consensus_meta.cc:287] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.038s	user 0.013s	sys 0.017s
I20260709 13:02:35.825938  8747 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:35.828248  1703 consensus_meta.cc:287] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.527s	user 0.012s	sys 0.009s
I20260709 13:02:35.828693  1703 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:35.829797  8747 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:35.830492  9269 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:35.835213  9269 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.841503  9018 raft_consensus.cc:3055] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:35.842162  9315 raft_consensus.cc:3055] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:35.842672  9315 raft_consensus.cc:740] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:35.843268  9369 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.813838  9300 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:35.840633  1455 catalog_manager.cc:5697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 15 to 16, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:35.844992  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 51469.3us
W20260709 13:02:35.824096  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 463356us
I20260709 13:02:35.848686  1673 leader_election.cc:400] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:35.849278  1673 leader_election.cc:403] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:02:35.844201  9082 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.851632  9082 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.854655  9373 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:35.860065  1673 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:35.860359  9368 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.845899  9018 raft_consensus.cc:740] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:35.863543  9411 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:35.863370  9405 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:35.864442  9018 consensus_queue.cc:260] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:35.870443  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.871814  9315 consensus_queue.cc:260] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:35.874208  9251 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.873677  9315 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:35.855111  1455 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.876451  9405 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:35.864439  9411 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.879174  9414 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.877508  9155 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:35.882907  9414 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.883023  9155 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:35.884115  9411 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.885202  9414 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.885358  9155 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:35.886271  9372 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:35.886937  9309 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:35.867512  9082 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.889889  9093 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:35.891688  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 71451.7us
I20260709 13:02:35.896333  9018 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:35.897064  9087 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:35.897603  9087 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:35.920368  9366 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.921283  9366 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:35.867640  9369 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:02:35.918758  8747 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:35.928231  9082 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:02:35.938658  9130 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:35.939208  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:35.939757  9435 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:35.926112  9065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.006s	sys 0.006s
I20260709 13:02:35.955276  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:35.957108  9130 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:35.958243  9065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.007s	sys 0.006s
I20260709 13:02:35.957839  1455 catalog_manager.cc:5697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 15 to 22. New cstate: current_term: 22 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:35.959275  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 99366.6us
I20260709 13:02:35.952512  9435 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:35.963032  9377 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.963699  9377 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.964545  9435 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:35.956276  1556 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 25.
I20260709 13:02:35.965714  9377 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.968498  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:35.966228  9182 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.784s	user 0.007s	sys 0.012s
I20260709 13:02:35.979417  9182 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.981943  9269 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.970860  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:35.982688  9251 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:35.983189  9251 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:35.966231  9369 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.983547  9384 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:35.984004  9369 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.984513  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:35.984344  9251 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.984997  1706 raft_consensus.cc:1240] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:35.985145  1701 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:35.967368  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:35.986300  8941 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.986560  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:35.986829  1703 raft_consensus.cc:2410] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 25 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:02:35.986900  8941 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.987555  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:35.988282  1700 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:02:35.987017  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:35.989784  1708 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 22: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:35.990298  1673 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:35.986186  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:35.994837   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:35.995157  1709 raft_consensus.cc:2393] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 21: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:35.990639  2267 raft_consensus.cc:2410] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:02:35.998198  9406 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.998335  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:35.998600  2267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58716 (request call id 1539) took 1728 ms (client timeout 2228 ms). Trace:
I20260709 13:02:35.998958  9406 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.999886  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:36.000483  1702 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:36.001327  9406 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:35.999115  2267 rpcz_store.cc:269] 0709 13:02:34.269821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.272243 (+  2422us) service_pool.cc:224] Handling call
0709 13:02:34.641257 (+369014us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaeee 0000000000375939 00007f06e2f1e1e0 00007f06e2fe70c4 00007f06e2fe7131 00007f06e2f950a0 00007f06e2f94984 00007f06dc50f6d4 00007f06dc50f662
0709 13:02:35.998373 (+1357116us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540045c754. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:35.998531 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3143584768}
I20260709 13:02:36.001808  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:36.002777  1628 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 23: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:35.994094  9243 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:36.003669  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.003468  9243 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:35.999094  1700 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 15.
I20260709 13:02:35.994444  1705 raft_consensus.cc:2393] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:36.006500  9094 consensus_queue.cc:1059] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:02:36.007337  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.007962  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:36.007998  2265 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:36.008360  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.008646  2268 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:36.002676  9377 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:36.009297  2271 raft_consensus.cc:2410] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:02:36.010461  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.010815  9236 raft_consensus.cc:3055] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:35.967482  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.009548  9377 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:36.011235  9236 raft_consensus.cc:740] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:36.012369  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:35.976397  1526 leader_election.cc:400] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 25. Current term is 26.
W20260709 13:02:36.021329  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 73321.3us
I20260709 13:02:36.012243  9236 consensus_queue.cc:260] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.021898  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.022315  9094 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:36.022503  9236 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:36.022800  9094 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:36.023239  9094 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:36.026291  9333 consensus_queue.cc:1175] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4f1725fe36e349ac85405627f9c93d95" responder_term: 23 status { last_received { term: 22 index: 18 } last_committed_idx: 17 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 22. Current term is 23. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:02:36.027840  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.029222  9087 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:35.948051  8747 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.014385  9436 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:36.008013  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:36.011267  1634 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:36.018146  2268 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:35.991256  9366 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:36.018461  9269 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:36.018774  9369 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:36.018469  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.019760  1555 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:36.019687  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.013052  9377 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:36.019711  1673 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:36.031927  1552 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:36.033243  1560 raft_consensus.cc:1275] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:02:35.981870  9182 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:36.033480  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:36.105240  1705 raft_consensus.cc:2393] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 23: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:36.035857  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:35.959522  1455 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 17 to 20, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 20 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:36.038089  1702 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
W20260709 13:02:36.038470  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.048066  9231 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.051496  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.054044  1632 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:36.106189  1700 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:36.055401  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.058348  8941 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:36.058255  9384 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.137354  9384 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:36.060989  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:36.059022  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:36.138530  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 77613.9us
I20260709 13:02:36.138962  1635 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:35.985839  9251 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:36.119781  9370 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.122495  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.063549  8747 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:36.126387  8941 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.127234  1559 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:02:36.127655  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.130616  1629 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 23: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:36.143297  1556 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:36.141738  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:36.130959  9450 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:02:36.132210  9265 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:36.132747  9243 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:36.134618  9435 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:36.135785  1708 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:02:36.136329  2267 raft_consensus.cc:2410] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 23 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:02:36.137681  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.155992  2271 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:36.106662  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:36.124140  9231 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:36.131035  1630 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:36.141738  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.157860  2268 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:36.158336  1626 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:36.159447  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:36.159963  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 137888us
I20260709 13:02:36.160187  1560 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:36.160907  1526 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:36.161638  1702 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:02:36.162413  9231 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:36.162704  2236 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:36.163261  9231 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:36.164333  9243 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:36.164767  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:02:36.153709  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 134041us
I20260709 13:02:36.166790  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:36.167796  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.168540  1635 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:36.169473  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.169625  9211 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:36.170130  9211 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.170490  9211 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:36.171296  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.172462  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.172860  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.173442  1631 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:36.104419  9333 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:36.172462  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.174767  9333 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.173913  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.173415  1628 raft_consensus.cc:2410] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:02:36.176882  9333 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:36.178131  1635 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:36.180305  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.180691  9265 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:36.181274  9265 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:36.150506  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.183290  2265 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:36.165692  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:36.188174  1601 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:36.199780  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:36.203035  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.211697  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 60805.6us
I20260709 13:02:36.212538  1634 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 25.
W20260709 13:02:36.213018  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.214799  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:36.190071  9333 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:36.215803  2268 raft_consensus.cc:2368] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:36.201668  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:36.215200  2234 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:36.208192  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.235697  9238 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:36.230747  8941 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.238003  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:36.238962  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.239782  8941 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:36.206612  9377 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:36.240648  9377 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.241164  9377 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:36.242249  9233 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:36.243750  9396 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:36.150969  9436 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.244781  1554 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:36.244239  9396 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.246714  9396 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:36.247825  9436 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:36.203572  9373 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:36.240072  9144 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:36.250558  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:36.251381  1558 raft_consensus.cc:2410] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:02:36.252188  9093 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:36.252640  9093 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:36.252976  9268 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.062s	user 0.008s	sys 0.011s
I20260709 13:02:36.257261  9210 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:36.257841  9210 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:36.258337  9210 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:36.258818  9087 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:36.182571  9370 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.249933  9144 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:36.263042  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 96335.3us
I20260709 13:02:36.263962  1673 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:36.265131  9144 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:36.265506  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:36.268620  2263 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:36.253028  9093 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:02:36.275620  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 74373.9us
W20260709 13:02:36.285194  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 70055.2us
I20260709 13:02:36.286377  2234 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:36.229223  9333 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:36.289556  2233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.293569  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:36.297276  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.298251  9236 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:36.294536  9233 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:02:36.294708  9413 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.529s	user 0.013s	sys 0.001s
I20260709 13:02:36.305471  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:36.298894  9236 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.284499  9373 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:36.309561  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.295377  9333 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:36.316033  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 50599.3us
W20260709 13:02:36.316118  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 53743.7us
I20260709 13:02:36.320662  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:36.321288  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 94406.3us
I20260709 13:02:36.333209  2265 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 26.
I20260709 13:02:36.323614  9171 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:36.342823  9261 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:36.343411  1557 raft_consensus.cc:1240] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:36.345479  9300 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:36.346069  9300 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:36.346516  9300 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:36.349192  9093 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.350579  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.293987  9094 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.352969  9093 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:36.314512  9236 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:36.283668  9130 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:36.367146  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.314862  9373 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:36.362428  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.378460  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.380594  1553 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 25: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:02:36.357985  9445 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:02:36.390425  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:36.384418  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:36.395635  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.396286  1635 raft_consensus.cc:2410] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:02:36.393827  1557 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:36.376053  9261 raft_consensus.cc:697] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 25 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:36.377704  9373 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:36.401716  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:36.402323  9460 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:02:36.402417  2264 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:36.359513  9262 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:02:36.410957  9094 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:36.380780  9171 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.411623  1704 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:36.411706  9171 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:36.413100  1704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 3034) took 1751 ms (client timeout 1579 ms). Trace:
I20260709 13:02:36.385453  9384 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:36.360956  9435 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
W20260709 13:02:36.413458  1704 rpcz_store.cc:269] 0709 13:02:34.661403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.832374 (+170971us) service_pool.cc:224] Handling call
0709 13:02:36.412891 (+1580517us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400129b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:36.413015 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3236707200}
I20260709 13:02:36.414167  9182 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.429895  9379 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:36.430258  9182 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:36.432156  9243 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:36.434700  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.435665  2264 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 25.
I20260709 13:02:36.398281  9265 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:36.414000  9171 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:36.438663  9405 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.000s
I20260709 13:02:36.413801  9258 consensus_queue.cc:1048] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.108s
I20260709 13:02:36.468343  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.443737  9269 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:36.413690  9211 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.479099  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.433913  9261 consensus_queue.cc:237] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:36.485533  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 107341us
I20260709 13:02:36.486588  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:36.488054  1673 leader_election.cc:400] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19.
I20260709 13:02:36.490792  9130 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:36.493712  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.496762  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.497752  2264 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:36.499111  2269 raft_consensus.cc:2368] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21.
I20260709 13:02:36.506590  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.509392  9364 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.471310  9233 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.510089  9364 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.513743  1558 raft_consensus.cc:2393] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 24: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:36.503227  9171 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:36.506516  2270 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:02:36.491551  8941 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:02:36.522346  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.523180  2265 raft_consensus.cc:2393] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 25: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:36.524173  9437 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.524726  9437 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.526458  9370 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:36.526834  9437 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:36.530634  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 171709us
I20260709 13:02:36.539336  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.540467  1558 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 25: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:36.529443  8966 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.542186  2235 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:36.542661  8966 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:36.543234  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44549.3us
I20260709 13:02:36.544281  8941 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:36.544971  8966 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:36.542215  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 54270.4us
I20260709 13:02:36.546350  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:36.550210  9370 consensus_queue.cc:1048] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:36.550351  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.552119  8941 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:36.552902  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:36.556200  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.558120  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 221141us
I20260709 13:02:36.552798  9171 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:36.552912  9269 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:36.570408  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:36.575690  9211 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:36.583837  9210 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.591205  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:36.592185  9456 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:36.588191  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:36.608337  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:36.609586  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 51644.6us
I20260709 13:02:36.609239  1558 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
W20260709 13:02:36.615875  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 63037.7us
I20260709 13:02:36.565606  9368 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:02:36.624377  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.587139  9377 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.612075  9171 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:36.630764  9470 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:36.631415  9470 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.631812  9470 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:36.635135  9287 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:36.636052  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.636243  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.636948  1553 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:36.638182  9130 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:36.638868  9130 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.641484  9130 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:36.645578  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:36.646706  1704 raft_consensus.cc:2393] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:36.635345  8737 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:36.677132  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.656864  1554 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:36.678711  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.675499  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:36.656044  9468 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:36.660856  1557 raft_consensus.cc:1275] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:36.690228  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:36.692301  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 43633.8us
I20260709 13:02:36.686129  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:36.697306  1705 raft_consensus.cc:2393] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 24: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:36.698215  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:36.663070  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:36.652624  9287 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.702241  1700 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:36.699488  9379 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:02:36.715900  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.718482  1554 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:36.676121  9251 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:36.651599  9396 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.714367  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.749054  1553 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 20: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:36.749475  9396 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:36.719313  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.750222  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.750700  2267 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 25.
I20260709 13:02:36.750706  1635 raft_consensus.cc:1240] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:36.753168  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.753888  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:36.725028  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:36.730540  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:36.710821  9287 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:36.734454  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.735138  9472 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:36.738377  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.739040  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.755800  2270 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:36.756515  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:36.742969  9236 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.746217  9251 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:36.753201  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:36.717363  9087 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.714640  9369 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:36.762598  1554 raft_consensus.cc:2393] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 25: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:36.723384  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:36.765898  1560 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:02:36.767164  1704 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:36.766969  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.717955  9379 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.765749  9469 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.766181  9471 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:36.770323  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.768893  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.773672  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.766865  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:36.772800  1557 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 16.
I20260709 13:02:36.776763  2270 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:02:36.780622  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:36.782617  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:36.776455  2268 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:36.783892  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:36.771260  9379 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:02:36.795570  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:36.780740  9396 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.775862  9384 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:36.798612  2267 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:36.874814  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:36.796382  9333 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.776069  9369 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:36.801671  9438 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:36.781755  9469 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:36.784224  9471 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.793960  9300 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:36.962486  9476 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:02:36.840772  9087 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.890563  9396 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.941687  9377 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:37.002082  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 219272us
I20260709 13:02:37.203574  9236 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:36.794791  9268 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:37.206779  8747 consensus_meta.cc:287] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 1.016s	user 0.009s	sys 0.010s
I20260709 13:02:36.780438  9472 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:37.208220  9287 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:37.209188  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.209914  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:37.210455  9477 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.320s	user 0.005s	sys 0.004s
I20260709 13:02:37.211887  9384 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:36.881749  8737 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:02:37.224768  9466 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.693s	user 0.004s	sys 0.000s
I20260709 13:02:37.226380  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 1726) took 1435 ms. Trace:
W20260709 13:02:37.228765  9455 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.811s	user 0.000s	sys 0.001s
I20260709 13:02:37.237980  2265 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:37.254721  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:37.265676  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 61126us
W20260709 13:02:37.255897  9373 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.838s	user 0.005s	sys 0.013s
I20260709 13:02:37.251276  8966 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.277338  1559 raft_consensus.cc:1240] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:37.254675  9438 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:37.282742  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:37.265733  9406 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:37.290342  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
W20260709 13:02:37.287770  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 562486us
I20260709 13:02:37.309614  1700 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
W20260709 13:02:37.317984  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.291569  9469 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:37.295393  2263 rpcz_store.cc:276] 0709 13:02:35.790662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.796313 (+  5651us) service_pool.cc:224] Handling call
0709 13:02:37.226160 (+1429847us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540056bb54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:37.226318 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082934016}
I20260709 13:02:37.312870  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.277936  9472 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:37.327965  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 61578.1us
I20260709 13:02:37.295069  8737 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.331015  1558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:37.327665  1524 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:37.331763  1558 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
W20260709 13:02:37.334925  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.315771  9438 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:37.338351  1556 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:37.324355  9287 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.015s
I20260709 13:02:37.340345  9384 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.324052  8966 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.342559  9379 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.280710  8747 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.348528  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:37.331489  9472 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:37.366227  9087 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.367816  9333 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:37.368310  1557 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:37.334241  8737 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:37.363353  9369 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:37.310616  9373 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.386334  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:37.371579  9251 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:37.433148  1708 raft_consensus.cc:1240] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 26. Current term is 27. Ops: [26.14-26.14]
I20260709 13:02:37.435498  2266 raft_consensus.cc:2368] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18.
I20260709 13:02:37.331015  9406 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:37.407583  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 59140.5us
W20260709 13:02:37.440889  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 54622.8us
I20260709 13:02:37.442292  1600 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:37.440634  1552 pending_rounds.cc:85] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Aborting all ops after (but not including) 13
I20260709 13:02:37.445763  1552 pending_rounds.cc:107] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:02:37.446079  1552 raft_consensus.cc:2889] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:37.447894  8966 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.449018  9300 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.395489  9368 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:37.452189  1626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 1714) took 2384 ms (client timeout 1901 ms). Trace:
I20260709 13:02:37.432866  9384 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:37.461472  1558 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:02:37.462757  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:37.463387  1551 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:37.466480  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:37.470293  9182 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:37.473872  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:37.474540  1700 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:37.474538  1551 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:37.476049  2235 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:37.477030  9238 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:37.480198  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.481551  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.482753  9210 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:37.482404  1700 raft_consensus.cc:2468] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:37.484797  9379 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.458822  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:37.487116  1560 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:37.488336  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:37.490803  9171 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:37.492244  2266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58718 (request call id 1734) took 1308 ms (client timeout 1526 ms). Trace:
W20260709 13:02:37.492758  2266 rpcz_store.cc:269] 0709 13:02:36.184274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.184410 (+   136us) service_pool.cc:224] Handling call
0709 13:02:37.492003 (+1307593us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400566b54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:37.492162 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2676896512}
I20260709 13:02:37.453652  9396 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.452525  9287 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:37.495493  9287 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.495841  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:37.496661  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.497400  1709 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 19: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:37.497509  9469 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:37.498013  9469 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.498464  9469 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:37.498595  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.458246  9406 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.458796  9368 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:37.460948  8747 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:37.495954  9287 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:37.458132  9258 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:37.504693  8941 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:37.505125  9258 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.505709  9258 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:37.505285  8941 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.506234  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.507061  1701 raft_consensus.cc:2410] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
W20260709 13:02:37.454574  1626 rpcz_store.cc:269] 0709 13:02:35.067432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.074864 (+  7432us) service_pool.cc:224] Handling call
0709 13:02:37.450364 (+2375500us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b54003372d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:37.452062 (+  1698us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2275217152}
W20260709 13:02:37.508224  9489 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:37.508309  8941 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:37.508920  8747 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.509435  8747 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.511445  8747 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:37.512413  2266 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:37.516244  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.516861  1703 raft_consensus.cc:1275] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:02:37.477895  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:37.519407  8941 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:37.519940  8941 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:37.520598  8941 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:37.522418  9364 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:37.522679  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:37.523259  1702 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:02:37.529150  9406 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.529848  9406 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:37.532490  9406 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:37.533844  9471 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.534353  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.535285  1705 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:37.536890  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.537251  9364 consensus_queue.cc:1048] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:37.543474  9368 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:02:37.537348  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
W20260709 13:02:37.553632  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 234280us
I20260709 13:02:37.555985  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:37.557279  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.396329  9087 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:02:37.559284  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 117816us
I20260709 13:02:37.558151  1630 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:37.560519  2271 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:37.561009  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.390941  9405 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.164s
W20260709 13:02:37.557530  9470 consensus_meta.cc:287] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.923s	user 0.008s	sys 0.010s
I20260709 13:02:37.567039  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:37.574112  2264 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:37.568059  1630 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:37.566731  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:37.571848  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.572762  2235 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:37.576007  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.541669  9438 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.575923  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.572237  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:37.553574  9396 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:37.578558  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.582530  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.587633  1628 raft_consensus.cc:2410] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:02:37.562374  9087 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.638113  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:37.638917  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:37.613186  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.614740  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:37.654270  1629 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:37.615211  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:37.593904  1627 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
W20260709 13:02:37.663717  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 86533us
I20260709 13:02:37.639164  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:37.592730  9471 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:37.586936  9300 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:37.675021  9228 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.092s
I20260709 13:02:37.669878  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:37.668838  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 93210.2us
I20260709 13:02:37.676472  1709 raft_consensus.cc:1240] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:02:37.673943  1524 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:37.611708  9364 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:37.677098  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:37.681115  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:37.671736  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:37.682247  2265 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:37.660621  9087 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:37.587162  9370 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:37.577522  9470 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.710770  9438 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.676488  9368 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:37.710978  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:37.712267  9368 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:37.716785  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:37.717080  9258 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.718384  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.718851  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:37.714795  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:37.655804  9490 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.592722  9396 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:37.712728  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:37.684314  1633 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:37.706653  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.686789  1673 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:37.712357  1557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:37.718976  1628 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
W20260709 13:02:37.737668  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 60172.8us
I20260709 13:02:37.738797  1524 leader_election.cc:400] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18.
I20260709 13:02:37.739177  1524 leader_election.cc:403] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:02:37.721760  2263 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:37.719022  1702 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:37.683241  9364 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:37.667155  9210 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.723032  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.722858  9396 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:37.741760  9210 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.743120  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:37.743904  2263 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:37.744248  9210 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:37.744936  9364 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:37.745661  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:37.691529  8737 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.683898  9300 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:37.694382  9128 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:37.695005  8747 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:37.695425  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.696336  2235 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:37.696790  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.676371  9269 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:37.698910  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.741609  9171 raft_consensus.cc:2764] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:02:37.702528  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:37.702911  1700 pending_rounds.cc:85] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Aborting all ops after (but not including) 13
I20260709 13:02:37.801818  1700 pending_rounds.cc:107] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:02:37.802181  1700 raft_consensus.cc:2889] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:37.703994  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:37.689670  9182 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:37.708945  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:37.709537  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:37.687199  9384 consensus_queue.cc:1059] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:02:37.710278  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:37.817976  1556 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 24.
I20260709 13:02:37.818333  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.710562  9379 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:37.712553  9470 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.677425  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:37.719249  9258 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.724268  2267 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:37.727495  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:37.734786  1557 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 23: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
W20260709 13:02:37.688748  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 49659.6us
I20260709 13:02:37.747011  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:37.776755  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.720486  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:37.720636  2265 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 21: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:37.732501  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:37.837049  1553 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
W20260709 13:02:37.837257  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 104795us
I20260709 13:02:37.838160  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:37.719985  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:37.744696  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:37.749140  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:37.784680  2236 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:37.839119  2263 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:37.796741  1706 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 19: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:37.840296  1673 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:37.701557  1703 raft_consensus.cc:1240] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:37.840746  1630 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:37.796727  1702 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:02:37.797375  1701 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:37.796175  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:02:37.797362  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 101051us
I20260709 13:02:37.842481  1555 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:02:37.842887  2235 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:37.799752  8941 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.739773  9251 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:37.820199  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:37.721074  9287 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.706686  9373 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.819183  1628 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 23.
I20260709 13:02:37.735888  9438 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:37.884826  9438 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.785606  9396 raft_consensus.cc:3060] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:37.725313  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:37.716820  9368 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:37.830816  1627 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 21: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:37.886202  2269 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:37.796161  8747 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:37.886700  8747 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:37.887048  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:37.747753  9469 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:37.889470  9469 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:37.852015  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.800952  9128 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.892082  9128 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:37.848618  9369 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:02:37.896056  9369 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:37.896466  9369 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:37.897363  8747 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.854270  1560 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 23.
I20260709 13:02:37.849141  9491 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:02:37.820761  1626 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 22: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:37.899904  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:37.720858  9471 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.902612  9471 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:37.852653  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 68046.8us
I20260709 13:02:37.904579  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:37.838721  2233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.020s	sys 0.061s
I20260709 13:02:37.817808  9370 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:37.817350  9182 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:37.906101  2233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.020s	sys 0.061s
I20260709 13:02:37.864287  1707 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:02:37.864567  8941 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:37.865994  9238 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.860859  9210 raft_consensus.cc:2804] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:37.861044  9211 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:37.874136  2263 raft_consensus.cc:2410] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:02:37.875154  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:37.908726  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:37.877254  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:37.884042  9483 raft_consensus.cc:3055] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:37.720752  9490 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:37.858970  9268 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:37.913262  9268 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:37.905663  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:37.800777  9300 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 25 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:37.770941  9472 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:37.850471  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.907325  1631 raft_consensus.cc:2368] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18.
I20260709 13:02:37.819950  9269 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:37.909788  2267 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:37.852269  2268 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:37.910384  1555 raft_consensus.cc:2410] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 27 because replica has last-logged OpId of term: 26 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 13.
I20260709 13:02:37.860415  9251 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.917644  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:37.913669  9268 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:37.862262  9384 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:37.926522  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.927930  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:37.907142  9182 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:37.918169  2234 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:37.934697  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 438681us
I20260709 13:02:37.936461  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.942131  1635 raft_consensus.cc:2393] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 23: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:37.943117  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.944029  1630 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 23.
I20260709 13:02:37.920730  9251 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:37.912727  9483 raft_consensus.cc:740] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:37.960893  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.925868  9210 raft_consensus.cc:697] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:37.961772  1627 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
W20260709 13:02:37.963155  1552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.016s	sys 0.016s
W20260709 13:02:37.958244  1600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.021s	sys 0.015s
I20260709 13:02:37.913923  9238 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:37.971439  1600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.021s	sys 0.015s
I20260709 13:02:37.971983  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:37.972797  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 530312us
I20260709 13:02:37.950829  9287 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:37.980120  1552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.017s	sys 0.016s
I20260709 13:02:37.956368  9211 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:38.002221  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 84127.9us
I20260709 13:02:38.004896  1674 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:38.006000  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:38.006975  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:38.007756  1702 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 21: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:38.004988  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:38.009924  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 211595us
I20260709 13:02:38.011003  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:37.965910  9498 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:38.011700  1709 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:38.012328  1633 raft_consensus.cc:2410] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:02:38.014895  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:38.017297  1702 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 22: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:38.009465  1703 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
W20260709 13:02:38.019183  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 451897us
I20260709 13:02:38.019675  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:37.950877  9370 consensus_queue.cc:1048] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:02:38.021366  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:38.022338  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:38.020287  1627 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 25.
I20260709 13:02:38.022527  1674 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:38.023125  1628 raft_consensus.cc:2468] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 25.
I20260709 13:02:38.034231  8966 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:38.038404  1707 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:38.039903  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:38.040810  1706 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:38.042199  9272 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:38.043087  9272 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.046483  9228 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.047078  9228 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.047722  9494 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:38.048312  9494 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.049180  9490 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:38.049415  9228 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:38.053165  9262 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:38.053812  9262 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.054320  9210 consensus_queue.cc:237] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.055769  9287 consensus_queue.cc:1059] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:38.056269  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:38.057471  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:38.057821  8737 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:38.058531  8737 raft_consensus.cc:3055] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:38.058969  8737 raft_consensus.cc:740] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:38.059749  8737 consensus_queue.cc:260] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:38.060787  8737 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:38.060788  9262 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:38.058797  9494 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:38.062551  9494 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:38.063315  9494 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.063781  9438 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:38.064165  9238 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:38.064409  9438 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:38.015772  8941 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:38.065186  8941 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.065662  8941 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:38.066067  9494 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:38.062505  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:38.072597  9087 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:38.018880  9300 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.024863  9373 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:38.077939  9373 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.956836  9364 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.078424  9373 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:38.080444  9364 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:38.021692  9483 consensus_queue.cc:260] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:38.084033  9483 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:38.084822  9396 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18.
I20260709 13:02:38.020716  9498 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.091214  9272 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:38.097922  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 75485.2us
I20260709 13:02:38.126281  1628 raft_consensus.cc:1275] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:02:38.064925  9438 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:38.128086  1674 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:38.131346  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:37.975414  9469 consensus_queue.cc:1059] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.132s
I20260709 13:02:38.136817  1627 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:38.106856  1701 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 17.
I20260709 13:02:38.111267  1629 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 25.
I20260709 13:02:38.112421  2267 raft_consensus.cc:2410] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
W20260709 13:02:38.138536  9486 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.009s	sys 0.022s
I20260709 13:02:38.116204  9490 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:38.144347  9490 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.144758  9490 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:38.152909  9490 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:38.096660  9384 consensus_queue.cc:1175] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "87144ea1a4a14ab8b942fb426159f031" responder_term: 20 status { last_received { term: 20 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 20 index: 14 } }
I20260709 13:02:38.113131  9498 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:38.162516  1632 raft_consensus.cc:1240] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:38.137223  9438 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:38.156672  9486 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.009s	sys 0.022s
I20260709 13:02:38.143010  9262 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:38.154402  9236 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:02:38.180657  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 431429us
I20260709 13:02:38.179006  9368 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:38.185070  9269 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:38.189518  8747 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:38.192811  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 352383us
I20260709 13:02:38.189906  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:38.190423  9472 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:38.236253  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46388us
I20260709 13:02:38.239652  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:38.242674  2234 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:38.245493  1673 leader_election.cc:400] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21.
W20260709 13:02:38.249974  2271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.010s	sys 0.015s
I20260709 13:02:38.249845  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:38.258392  1630 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:38.196374  9368 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.261129  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:38.259366  2271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.012s	sys 0.015s
I20260709 13:02:38.262989  2267 raft_consensus.cc:1240] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 24. Current term is 25. Ops: []
W20260709 13:02:38.264991  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 327093us
I20260709 13:02:38.266153  2268 raft_consensus.cc:1240] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:38.266609  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:38.271867  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.249878  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:02:38.271083  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 213572us
I20260709 13:02:38.277779  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:38.280026  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:38.280710  1627 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:38.255868  9087 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:38.257710  9269 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:38.280714  1634 raft_consensus.cc:2393] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 23: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:38.286509  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:38.254726  9370 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:38.284142  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:38.261842  9333 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:38.298636  9333 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.298559  9370 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.300290  1600 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:38.300469  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:38.301378  9471 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:38.267192  9368 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:38.299458  9333 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:38.303710  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:38.275363  9211 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:38.310683  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:38.316182  1628 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 16.
W20260709 13:02:38.313962  9503 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:02:38.321987  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 226564us
I20260709 13:02:38.275573  9228 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.039s
W20260709 13:02:38.326140  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 198016us
I20260709 13:02:38.332226  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:38.306077  9512 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:38.315279  9171 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:38.279518  9369 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.302484  9469 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:02:38.303274  9182 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.301893  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:38.320175  9287 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:38.328962  9496 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:38.364805  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 56694.8us
I20260709 13:02:38.327509  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:38.384785  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:38.381810  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 45864.3us
W20260709 13:02:38.385025  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 57548.2us
I20260709 13:02:38.386309  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:38.386325  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:38.387668  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:38.387928  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:38.388230  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:38.386418  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:38.388929  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:38.322789  9513 raft_consensus.cc:2804] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:02:38.390653  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:38.395121  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:38.397168  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:38.342276  9238 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:38.396876  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:38.323410  9087 consensus_queue.cc:1059] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.061s
I20260709 13:02:38.333549  9300 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:02:38.416352  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 155381us
I20260709 13:02:38.428184  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:38.427532  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:38.336119  9370 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:38.409583  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:38.380229  8966 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:38.434665  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 132792us
I20260709 13:02:38.435374  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:38.426882  9491 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:38.395182  9513 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.436473  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:38.442153  2265 raft_consensus.cc:2393] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 22: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:38.327593  9396 consensus_queue.cc:1059] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:02:38.393525  9384 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:38.378531  9512 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:38.446193  2262 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 17: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:38.447248  2269 raft_consensus.cc:2393] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 18: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:02:38.453022  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 56185.2us
I20260709 13:02:38.340283  9490 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:38.410166  9269 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:02:38.447250  9501 log.cc:927] Time spent T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.259s	user 0.001s	sys 0.001s
I20260709 13:02:38.340230  9171 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:38.437582  9379 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:38.429613  9238 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.463043  1673 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:38.444394  1709 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:38.394199  9499 raft_consensus.cc:3055] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:02:38.468293  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:38.485289  1631 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:38.485510  1673 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:38.393376  9496 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:38.474587  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80729.8us
I20260709 13:02:38.454164  9491 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:38.445940  9272 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:38.487169  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:38.457523  9384 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:38.454977  9513 raft_consensus.cc:3060] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:38.493985  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:38.465610  9269 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:38.495739  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 59429.2us
W20260709 13:02:38.509020  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 113947us
I20260709 13:02:38.510251  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:38.496974  8737 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:38.510848  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:38.484247  9238 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:38.480528  9171 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:38.484759  9287 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:38.519207  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:38.520330  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:38.521020  1709 raft_consensus.cc:2368] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21.
I20260709 13:02:38.489125  9490 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:02:38.510902  8737 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.484543  9499 raft_consensus.cc:740] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:38.498478  9491 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:38.523262  8737 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:38.521751  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:38.525025  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:38.532629  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:38.542538  1709 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:02:38.542807  1701 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.543673  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:38.507793  9384 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:38.515722  9269 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:38.532696  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:38.466619  8966 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.547675  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:38.534265  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:38.549533  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 64115.1us
I20260709 13:02:38.498569  9524 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:38.555639  8737 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:38.552327  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:38.500502  9531 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:38.559890  1701 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:38.560763  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:38.561650  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:38.562788  1701 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:38.562940  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:38.555042  1707 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:02:38.565263  9518 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:38.565733  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:38.565666  9470 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:38.532825  9370 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.566938  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:38.567324  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:38.567516  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:38.534299  9497 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:38.554885  1526 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:38.569442  1556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:38.533000  9396 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:38.574353  1553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:38.568576  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:38.575325  1551 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:38.592435  1553 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:38.575368  1560 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:38.576368  8737 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:38.508033  9405 consensus_queue.cc:1059] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:02:38.544689  9523 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.584381  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:38.611136  1555 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
W20260709 13:02:38.573781  9505 log.cc:927] Time spent T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.249s	user 0.001s	sys 0.001s
W20260709 13:02:38.587587  9519 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:02:38.587774  9470 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:38.588057  9182 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:38.589228  9510 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:02:38.629582  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:38.585812  1601 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:38.586390  1556 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:38.591326  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:38.561709  9507 log.cc:927] Time spent T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 13:02:38.607249  9508 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.260s	user 0.002s	sys 0.000s
I20260709 13:02:38.548368  9364 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:38.567328  9500 log.cc:927] Time spent T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:02:38.562498  9300 raft_consensus.cc:3055] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:38.606803  8966 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:38.562539  9531 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.549223  9522 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:38.625854  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 100866us
I20260709 13:02:38.631309  1630 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:38.567725  9490 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:38.573625  9520 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:38.591192  9469 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:38.637017  1707 raft_consensus.cc:2368] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22.
I20260709 13:02:38.590574  9499 consensus_queue.cc:260] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:38.638470  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 52709.7us
I20260709 13:02:38.638581  8737 raft_consensus.cc:2804] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:38.648723  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1701) took 1031 ms. Trace:
W20260709 13:02:38.657938  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.727696  1601 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:38.607196  9529 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:38.643623  9528 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.666626  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:38.607684  9530 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:38.672406  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.620190  9497 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:38.565788  9518 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:38.722993  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
W20260709 13:02:38.667490  9514 log.cc:927] Time spent T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.318s	user 0.001s	sys 0.001s
I20260709 13:02:38.727713  8737 raft_consensus.cc:697] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:38.727617  2271 rpcz_store.cc:276] 0709 13:02:37.616865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.617008 (+   143us) service_pool.cc:224] Handling call
0709 13:02:37.720613 (+103605us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b5800155d98. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06daeaab71 00007f06daeaaa22 00007f06e3dc3c09 00007f06e2f1dee0 00007f06e2fe70ab 00007f06e2fe7131 00007f06e2fa8fc0 00007f06e2f93929 00007f06e2f933d2 00007f06dc50abd4
0709 13:02:37.720817 (+   204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.721211 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.721243 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.721707 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.263283 (+541576us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:38.263321 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.263380 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.648314 (+384934us) raft_consensus.cc:1685] finished
0709 13:02:38.648344 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.648645 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4598,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"spinlock_wait_cycles":7458048,"thread_start_us":541178,"threads_started":1,"wal-append.queue_time_us":693276}
I20260709 13:02:38.748013  2236 leader_election.cc:400] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21.
I20260709 13:02:38.733860  1631 raft_consensus.cc:1240] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:02:38.722558  9520 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:38.756937  1559 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 20: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:38.643582  9470 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:38.591041  9370 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.740649  1627 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:38.742564  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:38.668598  9300 raft_consensus.cc:740] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:38.754990  2236 leader_election.cc:403] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:02:38.609470  9483 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:38.748147  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:38.634967  9396 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:38.762763  1601 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.764554  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:38.718783  9511 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:38.727100  9469 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.720446  9531 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:38.771427  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:38.619771  9524 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.773177  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:38.776655  1555 raft_consensus.cc:3060] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:38.716408  9509 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 13:02:38.824988  1554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1516) took 1500 ms. Trace:
I20260709 13:02:38.779606  8737 consensus_queue.cc:237] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:38.784621  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:38.748430  8966 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:38.748104  9287 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:38.789949  9472 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:38.791294  2270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1707) took 1170 ms. Trace:
I20260709 13:02:38.792941  9499 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:02:38.798193  9495 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:38.798020  9513 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.904471  1552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44176 (request call id 1517) took 1528 ms. Trace:
I20260709 13:02:38.748009  9540 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:38.802680  9549 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.764796  9520 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:38.923170  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 186353us
W20260709 13:02:38.803934  9534 log.cc:927] Time spent T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:02:38.804057  9087 raft_consensus.cc:3055] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:38.805361  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 3047) took 1103 ms. Trace:
W20260709 13:02:38.805894  9251 consensus_meta.cc:287] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.834s	user 0.010s	sys 0.002s
I20260709 13:02:38.806546  9470 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:38.807648  8941 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.741s	user 0.011s	sys 0.000s
I20260709 13:02:38.807768  9182 consensus_queue.cc:1059] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:38.808141  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:38.671248  9364 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.782809  1601 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:38.937911  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 155106us
I20260709 13:02:38.815945  1701 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:02:38.817217  1560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:38.818485  9370 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:38.767961  9530 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:38.819007  9396 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:38.775143  9490 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.754002  9529 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:38.758270  9528 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:38.825163  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 279566us
I20260709 13:02:38.961127  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:38.855113  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 70515.8us
I20260709 13:02:38.963230  2236 leader_election.cc:400] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22.
I20260709 13:02:38.846136  1554 rpcz_store.cc:276] 0709 13:02:37.324241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.324416 (+   175us) service_pool.cc:224] Handling call
0709 13:02:37.337057 (+ 12641us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.555896 (+218839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.555948 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.560883 (+  4935us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.127605 (+566722us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:38.167207 (+ 39602us) log.cc:844] Serialized 14 byte log entry
0709 13:02:38.167437 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.167518 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.824791 (+657273us) raft_consensus.cc:1685] finished
0709 13:02:38.824810 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.824927 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8025,"prepare.queue_time_us":39386,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":227952,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":8652,"thread_start_us":689088,"threads_started":2,"wal-append.queue_time_us":664524}
I20260709 13:02:38.618232  9512 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.824406  9469 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:02:38.902249  2270 rpcz_store.cc:276] 0709 13:02:37.621136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.621266 (+   130us) service_pool.cc:224] Handling call
0709 13:02:37.665669 (+ 44403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.669126 (+  3457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.669179 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.684033 (+ 14854us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.143121 (+459088us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:38.143171 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.143253 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.791080 (+647827us) raft_consensus.cc:1685] finished
0709 13:02:38.791099 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.791220 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7032,"raft.queue_time_us":3052,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6361,"thread_start_us":444747,"threads_started":1,"wal-append.queue_time_us":559173}
I20260709 13:02:38.911741  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:38.814929  9228 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:02:38.825474  9333 consensus_meta.cc:287] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.502s	user 0.003s	sys 0.003s
W20260709 13:02:38.803089  9532 log.cc:927] Time spent T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:38.841317  9542 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:38.930882  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:38.908393  9210 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:38.910548  1552 rpcz_store.cc:276] 0709 13:02:37.376587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.376733 (+   146us) service_pool.cc:224] Handling call
0709 13:02:37.394790 (+ 18057us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.453352 (+ 58562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.453392 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.453883 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:02:37.996245 (+542362us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:38.026688 (+ 30443us) log.cc:844] Serialized 14 byte log entry
0709 13:02:38.026897 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.026989 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.904260 (+877271us) raft_consensus.cc:1685] finished
0709 13:02:38.904283 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.904408 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51538,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":99810,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2122,"thread_start_us":541924,"threads_started":1,"wal-append.queue_time_us":760582}
I20260709 13:02:38.933717  1551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:38.927659  1700 rpcz_store.cc:276] 0709 13:02:37.702140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.702381 (+   241us) service_pool.cc:224] Handling call
0709 13:02:37.702711 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.830603 (+127892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:37.830634 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.855382 (+ 24748us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.437744 (+582362us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b180035d460. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06ddb774bc 00007f06daec548b 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1
0709 13:02:38.437946 (+   202us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:38.532359 (+ 94413us) log.cc:844] Serialized 14 byte log entry
0709 13:02:38.532570 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.532635 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.805084 (+272449us) raft_consensus.cc:1685] finished
0709 13:02:38.805181 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.805305 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":221166,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":129119,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3843,"spinlock_wait_cycles":4834688,"thread_start_us":414036,"threads_started":2,"wal-append.queue_time_us":363097}
I20260709 13:02:38.845047  9483 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.940001  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:38.991016  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:38.926162  8966 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:38.945866  9498 consensus_meta.cc:287] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.775s	user 0.011s	sys 0.000s
I20260709 13:02:38.946946  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58714 (request call id 1700) took 1330 ms. Trace:
I20260709 13:02:38.930485  9300 consensus_queue.cc:260] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.950016  9491 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:38.951818  1555 raft_consensus.cc:2468] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:38.958057  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:38.958920  2265 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:38.977703  9547 consensus_queue.cc:1059] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:02:38.645159  9523 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.975246  9529 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:38.969550  9490 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.977509   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:39.008049  1704 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:38.953171  9472 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:38.908885  9511 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.984210  1554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031" is_pre_election: true
I20260709 13:02:38.983940  1526 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:38.987264  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:38.988391  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:38.944105  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:39.002424  9373 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.923s	user 0.013s	sys 0.000s
I20260709 13:02:38.993463  1628 raft_consensus.cc:2368] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18.
I20260709 13:02:38.993685  1559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:38.991695  1707 raft_consensus.cc:2376] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21. Re-sending same reply.
I20260709 13:02:38.932627  9087 raft_consensus.cc:740] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:38.996809  2264 rpcz_store.cc:276] 0709 13:02:37.616292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.616491 (+   199us) service_pool.cc:224] Handling call
0709 13:02:37.646577 (+ 30086us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:37.655045 (+  8468us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:37.655091 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:37.675957 (+ 20866us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.193369 (+517412us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:38.193413 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.237463 (+ 44050us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:38.946748 (+709285us) raft_consensus.cc:1685] finished
0709 13:02:38.946768 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:38.946890 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8577,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5760,"thread_start_us":486960,"threads_started":1,"wal-append.queue_time_us":615185}
I20260709 13:02:39.026247  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:38.934456  9251 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.000640  1552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:38.969960  9496 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:39.004777  8966 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:38.990397  9396 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:39.000375  9498 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.006134  9546 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.092s
I20260709 13:02:38.982311  9369 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:39.009088  9379 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.525s	user 0.004s	sys 0.006s
I20260709 13:02:39.010882  9522 raft_consensus.cc:3055] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:39.064808  1551 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:39.017428  9490 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.045830  9300 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:38.953126  8941 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.009505  1555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "87144ea1a4a14ab8b942fb426159f031"
I20260709 13:02:38.925144  9549 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.023358  1674 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:39.077608  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 54303.4us
I20260709 13:02:39.078517  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:38.981091  9528 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.028178  1627 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:39.027779  1552 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:39.025465  1600 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:39.041908  1553 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:38.998378  9210 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:02:39.041705  9238 consensus_meta.cc:287] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
W20260709 13:02:39.024286  9438 consensus_meta.cc:287] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.002s
I20260709 13:02:39.020875  9542 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.932260  9497 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.048906  1524 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:39.066401  9379 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:39.063715  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 102178us
I20260709 13:02:39.063935  1705 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 22: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:39.041965  9128 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:39.003034  9483 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.087875  9490 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:39.072260  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:39.073069  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:39.051582  9547 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:39.081473  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:39.074263  9554 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:02:39.043854  9373 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.064426  9522 raft_consensus.cc:740] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:39.066560  9496 raft_consensus.cc:3055] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:02:39.064263  9523 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.107705  1707 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 23. Current term is 24. Ops: []
W20260709 13:02:39.109155  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 60336.6us
I20260709 13:02:39.104265  9513 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.075397  9524 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.061831  9396 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.085999  9369 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:39.067610  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:39.116714  1526 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.117929  9551 consensus_queue.cc:1059] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 13:02:39.119949  9210 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.086371  9087 consensus_queue.cc:260] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.149030  9087 raft_consensus.cc:3060] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:39.150509  9396 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:39.113744  9364 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:39.154089  9502 raft_consensus.cc:3055] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:02:39.125200  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 43768.6us
I20260709 13:02:39.154489  9502 raft_consensus.cc:740] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:39.126854  1635 raft_consensus.cc:2410] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for term 18 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
W20260709 13:02:39.160871  9471 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.859s	user 0.005s	sys 0.007s
I20260709 13:02:39.161309  9471 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:39.164032  9551 raft_consensus.cc:3055] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:39.164544  9551 raft_consensus.cc:740] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:39.165218  9368 consensus_meta.cc:287] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.845s	user 0.006s	sys 0.002s
I20260709 13:02:39.165539  9551 consensus_queue.cc:260] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.111632  9438 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.105481  9406 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:39.133154  1524 leader_election.cc:400] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 17 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18.
I20260709 13:02:39.205945  1560 raft_consensus.cc:2468] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:39.110483  9238 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.113651  9540 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:39.128876  9182 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:39.147897  9535 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:39.224599  8941 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:39.224618  9535 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.113389  9542 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.225329  9502 consensus_queue.cc:260] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.226763  9502 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:39.227540  9542 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:39.085559  9518 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:39.227977  9535 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.124267  9490 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:39.175000  1705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 3043) took 1478 ms (client timeout 1888 ms). Trace:
W20260709 13:02:39.141929  9268 consensus_meta.cc:287] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.206s	user 0.005s	sys 0.009s
I20260709 13:02:39.188252  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:39.211174  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 78128.6us
I20260709 13:02:39.157820  9530 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:39.129140  9496 raft_consensus.cc:740] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:39.249066  9520 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.250496  1631 raft_consensus.cc:1240] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:39.251768  9520 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.174422  9087 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:39.216385  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 190878us
I20260709 13:02:39.189642  9522 consensus_queue.cc:260] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.254189  9522 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:39.255299  1600 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:39.256848  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:39.257519  2235 leader_election.cc:336] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.911s (SENT)
I20260709 13:02:39.189015  9549 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.180083  9498 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:39.189965  9384 consensus_meta.cc:287] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.000s
I20260709 13:02:39.258998  9384 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.261129  9384 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:39.220180  9238 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:39.221266  9540 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:39.222078  1704 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 25. Current term is 26. Ops: []
I20260709 13:02:39.149072  9373 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:39.223016  9511 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.223649  9544 raft_consensus.cc:3055] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:39.230336  9491 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
W20260709 13:02:39.174775  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 61965.8us
I20260709 13:02:39.211129  1552 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 26.
I20260709 13:02:39.277505  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:39.235404  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:38.990361  9333 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.236676  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:39.230923  1705 rpcz_store.cc:269] 0709 13:02:37.696396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.696540 (+   144us) service_pool.cc:224] Handling call
0709 13:02:39.174797 (+1478257us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540005d054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:39.174935 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2901656320}
I20260709 13:02:39.279439  1555 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 25. Current term is 26. Ops: []
W20260709 13:02:39.166967  9557 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:39.165616  9368 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.222843  9228 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21.
W20260709 13:02:39.263948  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 75731.1us
I20260709 13:02:39.296068  1600 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:39.174948  8966 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.264262  1701 raft_consensus.cc:1240] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:39.297192  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:39.230878  9490 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:39.139606  9369 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:39.266659  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:39.266850  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:39.183648  9483 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.210691  9406 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:39.267452  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:39.270073  1700 raft_consensus.cc:1275] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:39.270632  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:39.271457  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:39.272218  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:39.274675  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:39.315068  1629 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 27.
I20260709 13:02:39.275914  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:39.315965  1635 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:39.316134  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:39.266335  9551 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:39.290109  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:39.298261  9555 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.058s	user 0.001s	sys 0.003s
I20260709 13:02:39.292578  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:39.316931  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:39.317508  2265 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:39.243078  9182 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:39.269308  9520 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:39.299948  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.303460  2266 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:02:39.271127  9238 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:39.239872  9268 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.307490  1632 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:39.301038  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:39.310175  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:39.311259  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:39.312187  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.276443  9544 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:39.175648  9251 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:39.319640  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.262874  9540 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.324550  1633 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 21: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:39.309671  9369 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.293021  9511 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:39.330844  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:39.306947  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.335590  2271 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
W20260709 13:02:39.343797  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 65968.7us
I20260709 13:02:39.316231  9406 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:39.344281  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.313820  9518 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:02:39.328902  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:39.363262  1708 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:39.332617  9128 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:39.330564  9472 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:39.365507  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:39.309536  9556 consensus_queue.cc:1059] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
W20260709 13:02:39.374450  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45607.1us
I20260709 13:02:39.342448  9498 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:39.380865  2269 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:39.313335  8966 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:02:39.362012  9542 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:02:39.379606  9251 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.399773  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:39.412788  1630 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:39.402210  9537 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:39.389353  9548 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:39.389254  9494 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:39.407071  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:39.415756  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 87297.2us
W20260709 13:02:39.427361  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 57165.9us
I20260709 13:02:39.419008  2265 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:39.419416  1526 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.332276  9496 consensus_queue.cc:260] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.433084  1630 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:39.446120  9300 consensus_queue.cc:1059] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:39.446497  9493 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:39.446973  9493 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.447124  9238 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:02:39.446125  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 145147us
I20260709 13:02:39.447715  9228 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:39.448118  9238 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.450371  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:39.451033  2262 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:39.451306  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:39.452042  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.446991  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 134827us
W20260709 13:02:39.432142  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 49120.8us
W20260709 13:02:39.431260  9269 consensus_meta.cc:287] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.855s	user 0.012s	sys 0.000s
I20260709 13:02:39.457297  1600 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:39.450278  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:39.462805  2271 raft_consensus.cc:2410] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 24 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:02:39.463122  8941 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:39.463639  8941 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.465377  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:39.380439  9531 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.467285  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:39.460652  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:39.469100  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:39.473874  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:39.475889  1600 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:39.477419  1524 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:39.478962  1526 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.480212  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:39.481069  9272 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:39.481556  9272 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:39.482195  9552 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:39.482563  1600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.435624  8966 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:39.483513  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:39.482651  9552 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:39.490355  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:39.495503  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:39.496058  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.496970  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.447397  9493 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:39.499785  1634 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 22: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:39.503592  1709 raft_consensus.cc:2368] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:39.502609  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:39.504222  1633 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:39.493211  9548 raft_consensus.cc:2804] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:39.481938  9272 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:39.469419  9438 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:39.426733  9251 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.475351  9471 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.493404  9552 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:39.468904  9228 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.505240  9548 raft_consensus.cc:697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:39.513944  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.508375  1708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3459) took 1508 ms. Trace:
I20260709 13:02:39.515516  2234 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:39.504168  9512 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:39.424702  9537 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.499269  9211 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:39.505069  9513 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:39.499032  9087 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:39.470310  9269 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.529811  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:39.558566  1701 raft_consensus.cc:2368] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:39.422906  9544 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.522421  1524 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:39.468391  9300 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.049s
I20260709 13:02:39.505271  9384 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:39.432718  9182 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.521916  1708 rpcz_store.cc:276] 0709 13:02:38.000452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.009011 (+  8559us) service_pool.cc:224] Handling call
0709 13:02:38.021746 (+ 12735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:39.368284 (+1346538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.508136 (+139852us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003f3254. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:39.508305 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3083246976}
I20260709 13:02:39.533047  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:39.562655  1630 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:02:39.574155  8941 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:39.576530  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 53424.8us
W20260709 13:02:39.581149  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 102205us
I20260709 13:02:39.582243  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.526889  9228 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.525184  9530 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:39.519713  9368 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:39.595759  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 64681.1us
I20260709 13:02:39.530112  9512 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.555684  9364 raft_consensus.cc:2804] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:39.600031  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.570007  9211 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.606675  1599 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:39.576016  9087 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:39.576071  8966 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:39.524338  9471 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.523707  9333 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:39.613898  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:39.598433  9268 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.609107  9544 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:39.614552  9512 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:39.611445  9524 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:39.621671  9211 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:39.665707  9508 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:02:39.625102  8966 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.686734  1630 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:39.687543  1632 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:39.689783  9553 consensus_queue.cc:1059] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.139s
W20260709 13:02:39.696738  9572 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:02:39.699419  9522 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.664939  9548 consensus_queue.cc:237] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.699965  9522 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.685772  9530 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:02:39.705230  9087 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.707206  1709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 3476) took 1189 ms. Trace:
I20260709 13:02:39.707602  1709 rpcz_store.cc:276] 0709 13:02:38.517676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.543404 (+ 25728us) service_pool.cc:224] Handling call
0709 13:02:39.706990 (+1163586us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b54001fd954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:39.707146 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204814080}
I20260709 13:02:39.710376  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:39.710569  1673 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:39.711623  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.717296  9537 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:39.720894  9511 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:39.721364  9511 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:39.722060  8966 raft_consensus.cc:3060] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:39.690064  9573 consensus_queue.cc:1059] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.255s
W20260709 13:02:39.726796  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 216614us
I20260709 13:02:39.736371  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:39.737056  1709 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:39.738732  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:39.739415  1709 raft_consensus.cc:3060] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:39.762985  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:39.767542  1707 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:39.763468  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:39.774319  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:39.774917  1700 raft_consensus.cc:3060] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:39.775555  1709 raft_consensus.cc:2468] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:39.773645  1702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1523) took 1254 ms. Trace:
I20260709 13:02:39.741294  9539 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:02:39.792857  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 192826us
W20260709 13:02:39.757475  9545 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:02:39.782325  1702 rpcz_store.cc:276] 0709 13:02:38.519821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.931360 (+411539us) service_pool.cc:224] Handling call
0709 13:02:38.931684 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:39.111406 (+179722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.111440 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:39.112078 (+   638us) log.cc:844] Serialized 52 byte log entry
0709 13:02:39.330901 (+218823us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:39.367485 (+ 36584us) log.cc:844] Serialized 14 byte log entry
0709 13:02:39.477782 (+110297us) spinlock_profiling.cc:243] Waited 6.88 ms on lock 0x7b18001f5fa0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:02:39.478010 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.722436 (+244426us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b18001f5fa0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:02:39.773339 (+ 50903us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54000b7054. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:39.773393 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:39.773438 (+    45us) raft_consensus.cc:1685] finished
0709 13:02:39.773450 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.773589 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7661,"prepare.queue_time_us":36556,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":119779,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":200,"spinlock_wait_cycles":432756096,"thread_start_us":208031,"threads_started":1,"wal-append.queue_time_us":257363}
I20260709 13:02:39.749511  9368 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:39.749312  9258 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:39.757177  9483 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:02:39.815775  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 209074us
I20260709 13:02:39.757093  9563 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:39.785229  9537 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.779235  9535 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:39.744012  9511 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.833370  1700 raft_consensus.cc:2468] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:39.833953  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:39.834584  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:39.835299  1709 raft_consensus.cc:2393] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 22: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:39.837262  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:39.839347  1702 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 24: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:39.847257  1706 raft_consensus.cc:2368] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 24. Current term is 25.
I20260709 13:02:39.842381  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:39.847975  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:39.848280  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:39.848632  1709 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 26: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:39.854108  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:39.821221  9562 raft_consensus.cc:3055] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:39.852743  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:39.862989  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:39.828869  9490 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 13:02:39.854912  1702 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 27.
I20260709 13:02:39.825670  9539 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.872678  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:39.828015  9483 raft_consensus.cc:697] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:39.881956  1700 raft_consensus.cc:1240] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:39.882905  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:39.886107  1634 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:02:39.883026  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:39.845549  9531 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:39.816339  9368 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.894008  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:39.894853  1635 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:39.874807  9562 raft_consensus.cc:740] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:39.828297  9537 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.910333  1633 raft_consensus.cc:2468] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:39.857004  9405 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:02:39.830518  9535 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.887828  9511 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:02:39.943648  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 121830us
I20260709 13:02:39.878263  9490 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:39.959733  1709 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:39.958410  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:39.962105  1526 leader_election.cc:400] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 24. Current term is 25.
I20260709 13:02:39.962400  1526 leader_election.cc:403] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
W20260709 13:02:39.940269  9171 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 1.360s	user 0.005s	sys 0.008s
I20260709 13:02:39.905285  9269 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:39.885236  9539 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.968096  9562 consensus_queue.cc:260] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:39.974332  9579 log.cc:927] Time spent T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:02:39.974596  9562 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:39.978241  9585 raft_consensus.cc:3060] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:39.981235  9552 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:39.963907  9087 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:39.983424  1705 raft_consensus.cc:1240] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:39.948705  9228 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:39.987954  9537 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:39.990149  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.990475  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.015355  1705 raft_consensus.cc:2393] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:02:39.991222  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.982864  9483 consensus_queue.cc:237] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:40.017592  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 273947us
I20260709 13:02:39.982095  9471 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:39.994675  9515 raft_consensus.cc:3055] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:40.017910  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:40.025646  9469 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.035s	user 0.012s	sys 0.000s
I20260709 13:02:40.025684  9515 raft_consensus.cc:740] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:40.026154  9469 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.026774  9515 consensus_queue.cc:260] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.028101  9515 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:40.028370  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 66383.4us
I20260709 13:02:40.029165  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:39.999526  9535 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:40.000576  9551 consensus_meta.cc:287] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.670s	user 0.001s	sys 0.008s
I20260709 13:02:40.001324  9490 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:39.982663  9251 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.004014  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:40.007088  9369 consensus_meta.cc:287] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.001s
I20260709 13:02:40.008931  9496 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:40.012682  8737 raft_consensus.cc:3055] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:02:40.057317  8737 raft_consensus.cc:740] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:02:40.025063  9272 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260709 13:02:39.990531  9364 raft_consensus.cc:697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 24 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:39.968773  9171 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.030334  1626 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 24: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:40.041293  9542 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:40.038731  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.072345  1705 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 25.
W20260709 13:02:40.016908  9575 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:02:40.089514  1601 leader_election.cc:400] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:40.089954  1601 leader_election.cc:403] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:02:40.033567  1707 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:39.981959  8966 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.095656  1706 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
W20260709 13:02:40.037916  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44759.1us
I20260709 13:02:40.048344  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.048396  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.101481  2234 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:40.051791  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.052513  8941 consensus_queue.cc:1048] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:02:40.105748  2266 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:40.055675  1701 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
I20260709 13:02:40.057456  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.110159  1701 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:40.102736  9591 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:40.105542  9470 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 13:02:40.117795  9262 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:40.118225  9262 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:40.119057  9262 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.121326  9211 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.123494  9211 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:40.123710  9171 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:40.124321  9469 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:40.124547  9333 raft_consensus.cc:2804] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:40.125092  9333 raft_consensus.cc:697] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:40.126108  9333 consensus_queue.cc:237] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:40.128826  9493 consensus_meta.cc:287] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.000s
I20260709 13:02:40.129308  9493 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.131374  9493 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:40.133239  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.136677  9512 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.138698  1700 raft_consensus.cc:1240] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 23. Current term is 24. Ops: []
W20260709 13:02:40.096483  9406 consensus_meta.cc:287] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
I20260709 13:02:40.139751  9406 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.142168  1627 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:40.145455  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.155237  1633 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:40.160892  9585 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 24. Current term is 25.
I20260709 13:02:40.162078  8966 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:40.163180  1633 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:40.164232  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:40.164808  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:40.102978  9300 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:40.166179  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:40.073205  9551 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:40.166767  1629 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:40.058425  1634 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:39.998577  9368 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.167032  9551 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.169013  9551 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.032289  1526 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:40.169348  1635 raft_consensus.cc:2468] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 25.
I20260709 13:02:40.065033  8737 consensus_queue.cc:260] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.189831  8737 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:40.063444  9272 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.066783  9364 consensus_queue.cc:237] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.057016  9369 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.075328  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.205214  1705 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 19: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:40.061924  9251 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.037298  9228 consensus_queue.cc:1048] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:02:40.095721  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.103070  1601 leader_election.cc:400] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:40.103245  2270 raft_consensus.cc:2393] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 23: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:40.165923  9300 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.227388  1630 raft_consensus.cc:1240] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:40.030678  9513 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:40.169943  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:40.170125  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 137832us
W20260709 13:02:40.065172  9593 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:40.171085  9552 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.173499  9524 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:02:40.175464  2262 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:02:40.243203  1703 raft_consensus.cc:1240] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20. Ops: []
I20260709 13:02:40.176808  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:40.244009  1629 raft_consensus.cc:2368] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 23. Current term is 24.
I20260709 13:02:40.177346  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:40.185766  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:40.046530  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:40.195614  1627 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:02:40.200481  8941 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:40.245175  1633 raft_consensus.cc:2393] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 18: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:02:40.198091  1600 leader_election.cc:336] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:40.201570  1674 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.203778  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:40.214514  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:40.245776  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.246234  2265 raft_consensus.cc:2368] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:40.216346  1601 leader_election.cc:403] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:40.246869  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 69552.2us
I20260709 13:02:40.216311  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.217209  1707 raft_consensus.cc:2368] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:40.238859  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 3115) took 1287 ms. Trace:
I20260709 13:02:40.239964  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:40.248476  1626 rpcz_store.cc:276] 0709 13:02:38.943732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.943869 (+   137us) service_pool.cc:224] Handling call
0709 13:02:40.230846 (+1286977us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540018ecd4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:40.231002 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2316482304}
I20260709 13:02:40.249651  1526 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:40.250788  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:40.245126  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 198726us
W20260709 13:02:40.200675  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 148911us
W20260709 13:02:40.246100  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44556us
I20260709 13:02:40.247875  1673 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:40.202196  9211 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260709 13:02:40.258508  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:40.254355  1674 leader_election.cc:336] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:40.255903  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 156694us
I20260709 13:02:40.254242  1673 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:40.257282  9490 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:40.226734  9251 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.261049  1524 leader_election.cc:400] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:40.281814  1524 leader_election.cc:403] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
W20260709 13:02:40.262123  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 64050us
I20260709 13:02:40.279647  1701 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:02:40.260856  1674 leader_election.cc:336] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.285501  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.285965  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:40.287312  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:40.288100  1704 raft_consensus.cc:2368] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20.
I20260709 13:02:40.288437  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:40.261719  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:40.283905  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:02:40.282922  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.262442  9171 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:40.291987  9171 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:40.292158  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.292395  9171 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:40.293339  1600 leader_election.cc:336] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.251346  9524 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.295152  1673 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:40.295571  1601 leader_election.cc:400] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20.
I20260709 13:02:40.298190  1601 leader_election.cc:403] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:02:40.296234  1600 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.301090  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:40.301548  1674 leader_election.cc:336] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.301975  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.302064  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:40.303062  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:40.304281  1526 leader_election.cc:400] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:40.304447  1709 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 25. Current term is 26. Ops: []
I20260709 13:02:40.305913  8737 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 19. Current term is 20.
I20260709 13:02:40.254709  9493 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:02:40.270649  9599 log.cc:927] Time spent T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:02:40.307543  1702 raft_consensus.cc:2368] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:40.262404  9562 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:40.309242  1674 leader_election.cc:336] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.259277  9542 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:40.258266  9585 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:40.258148  9438 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18.
I20260709 13:02:40.281270  9498 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:40.276332  9512 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.306486  9524 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:02:40.264231  9287 consensus_queue.cc:1059] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:02:40.340917  9287 raft_consensus.cc:3055] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:40.341320  9287 raft_consensus.cc:740] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:40.342199  9287 consensus_queue.cc:260] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.336490  9498 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.344384  9498 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:40.345604  2270 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:02:40.317241  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:40.317490  9544 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:40.317701  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59260 (request call id 1762) took 1071 ms. Trace:
I20260709 13:02:40.318006  9563 raft_consensus.cc:2804] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:40.319232  1705 raft_consensus.cc:1240] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 25. Current term is 26. Ops: []
I20260709 13:02:40.320694  9300 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.323035  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.323414  9491 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:40.297258  9537 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:40.325169  1703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48138 (request call id 3484) took 1369 ms. Trace:
I20260709 13:02:40.261266  9268 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.077s
I20260709 13:02:40.314504  9272 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.265115  9211 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:40.275943  9251 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:40.277606  9597 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:02:40.273666  9539 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.313066  9540 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:40.294330  9269 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.346585  2263 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:40.347188  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63328us
I20260709 13:02:40.350538  9087 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:40.295452  9238 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:40.346709  1627 rpcz_store.cc:276] 0709 13:02:39.246145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.340103 (+ 93958us) service_pool.cc:224] Handling call
0709 13:02:40.317539 (+977436us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54001662d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:40.317646 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778791296}
I20260709 13:02:40.349902  9553 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:02:40.297439  9551 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:40.303541  9529 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:40.313123  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.308305  9384 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:40.311172  9493 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.261243  9182 raft_consensus.cc:2804] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:40.353668  1703 rpcz_store.cc:276] 0709 13:02:38.955492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:39.183558 (+228066us) service_pool.cc:224] Handling call
0709 13:02:39.183850 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.247148 (+1063298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:40.324951 (+ 77803us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400220454. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:40.325113 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432221568}
I20260709 13:02:40.390336  9493 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:40.377058  2235 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.380170  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:40.383644  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 74392.7us
W20260709 13:02:40.403656  1674 leader_election.cc:336] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.404079  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.407543  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:40.408447  2267 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 22: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:40.354530  9563 raft_consensus.cc:697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 25 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:02:40.374380  9600 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:02:40.350462  9544 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.368000  9211 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:40.354229  9562 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:02:40.372682  9438 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.427459  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 47331.3us
I20260709 13:02:40.418835  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.429800  2266 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:40.380544  9553 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.425145  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.378414  9551 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:40.430577  2268 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
W20260709 13:02:40.418102  1674 leader_election.cc:336] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.431402  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:40.432533  1674 leader_election.cc:336] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:40.434897  1674 leader_election.cc:336] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.435307  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.438843  2263 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
W20260709 13:02:40.443471  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 66407.3us
W20260709 13:02:40.444375  2235 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.444726  2235 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:40.445662  1674 leader_election.cc:336] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.409857  8966 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:40.446138  1674 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.412264  9512 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:40.414584  9515 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:40.448482  2235 leader_election.cc:336] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.407784  9300 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:40.369241  9585 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:02:40.411772  9182 raft_consensus.cc:697] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:40.424762  9251 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:02:40.413475  9384 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:40.384217  9269 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.411298  9580 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
W20260709 13:02:40.463006  1674 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.451514  9238 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:40.458602  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.467291  9515 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.475478  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:40.476258  1705 raft_consensus.cc:2393] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 22: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
W20260709 13:02:40.476361  2235 leader_election.cc:336] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.476867  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.477090  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:40.477640  1708 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:40.466988  9483 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:02:40.449222  9373 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:02:40.429169  9268 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:40.482517  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:40.485765  1526 leader_election.cc:400] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:40.482266  9364 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:40.462081  9499 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:02:40.440987  9551 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:40.447629  9490 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:40.442494  9553 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:40.469380  9300 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.465094  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:40.442305  9438 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.457828  8966 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.492385  9585 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:02:40.500757  9605 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:40.502100  9087 consensus_queue.cc:1059] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 25.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:40.483464  9228 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:40.510329  9547 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:40.511853  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.514312  9268 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:40.517355  9300 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.524596  9182 consensus_queue.cc:237] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.525868  1708 raft_consensus.cc:2468] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:40.507133  9544 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:40.529827  1674 leader_election.cc:336] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.533473  9384 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.539956  9469 consensus_queue.cc:1059] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:40.490079  9499 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:40.523134  9251 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:40.519610  9522 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.528492  9585 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.537595  9498 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:40.571755  1674 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.558044  8966 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.566730  9515 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:40.581207  9251 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.585110  9585 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:40.526652  9563 consensus_queue.cc:237] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.595196  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.551903  9547 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:40.606678  1674 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.607262  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:40.609079  1674 leader_election.cc:336] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.609656  9490 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:40.603046  9251 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:40.617652  2236 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:02:40.621281  1674 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.621533  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.608337  9544 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:40.586575  9524 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:40.633183  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.610186  9438 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:40.640043  1674 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.640535  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.640506  9300 raft_consensus.cc:3055] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:02:40.630964  9515 raft_consensus.cc:2804] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:02:40.645901  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.653362  1674 leader_election.cc:336] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:40.643489  9511 consensus_meta.cc:287] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.000s
I20260709 13:02:40.648257  9300 raft_consensus.cc:740] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:40.612030  9499 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.647549  9522 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:40.649052  9544 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:02:40.671425  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.685314  2235 leader_election.cc:336] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.682257  2270 raft_consensus.cc:1275] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:02:40.687451  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.721186  2235 leader_election.cc:336] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.722488  1673 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:40.718744  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 406896us
I20260709 13:02:40.726709  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:40.727279  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.727402  1708 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:40.728761  9469 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.729327  9469 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.675051  9553 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.731293  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.732286  9553 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:40.732388  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:40.732970  1707 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:02:40.734236  9469 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.668553  9211 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.735253  9211 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:40.736928  1708 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:40.671218  9499 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:40.740618  1703 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:40.741644  8966 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.742306  8966 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.686491  9522 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.743973  9087 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.744616  8966 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:40.744490  9087 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.745271  9522 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:40.705237  9498 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:40.746551  2235 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.746639  9087 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.747249  2235 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.717656  9524 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 28 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.737819  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:40.748867  2235 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:40.728876  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.758810  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.750347  1708 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:40.756702  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:40.759157  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.718989  9511 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.799423  9511 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.798602  9524 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:40.802839  9524 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:40.803845  9524 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.794379  9238 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:40.660035  9300 consensus_queue.cc:260] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.807770  9300 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:40.660339  9406 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.707295  9547 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.700929  9171 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.798475  9540 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:40.812630  9511 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.812815  9171 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:40.768241  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 45795.5us
I20260709 13:02:40.813119  9585 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:40.791529  1674 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 68 similar messages]
I20260709 13:02:40.814504  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.815739  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.816422  1708 raft_consensus.cc:2393] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 23: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:40.817199  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.817986  1673 leader_election.cc:400] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 23. Current term is 24.
I20260709 13:02:40.818114  9535 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:40.818514  1673 leader_election.cc:403] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:02:40.794657  9251 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.820833  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:40.822127  9511 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.822804  9368 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:40.823936  9598 log.cc:927] Time spent T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.708s	user 0.003s	sys 0.000s
I20260709 13:02:40.821651  9251 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.830502  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:40.831117  2270 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:40.832744  9551 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.658502  9515 raft_consensus.cc:697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:40.834944  9515 consensus_queue.cc:237] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.822912  9511 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.840708  9511 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.844834  2270 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:40.845394  9490 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:40.845525  1703 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
W20260709 13:02:40.762121  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.855765  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:40.696553  9562 raft_consensus.cc:3055] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:02:40.882225  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:40.882609  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 120518us
W20260709 13:02:40.883404  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:40.883949  2235 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.884070  9542 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:40.884327  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.882656  9562 raft_consensus.cc:740] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:40.886415  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.886749  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:40.887401  2271 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Advancing to term 28
I20260709 13:02:40.887745  9542 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.888273  9542 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.889153  9287 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:40.885762  9562 consensus_queue.cc:260] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:40.854413  9540 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:40.892158  2235 leader_election.cc:336] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.892424  9540 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:40.893088  2235 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.893471  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:40.856267  9258 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:40.894215  9258 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.894753  9540 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.798475  9493 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.854040  9511 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.895051  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.895684  9511 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.896881  9493 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:40.860327  9491 consensus_queue.cc:1048] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 13:02:40.897522  2234 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:40.866271  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:40.895133  1705 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:40.898483  9493 raft_consensus.cc:2804] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:40.898643  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.899163  9493 raft_consensus.cc:697] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:40.900262  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:40.901104  9547 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:40.901403  9272 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:40.900377  9493 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.901436  9087 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:40.869685  1599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.871098  9406 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.875095  9551 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:40.875330  9553 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:40.876365  9592 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:40.880057  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.881147  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.890457  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.947593  2262 raft_consensus.cc:2468] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:40.891371  9542 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:40.894259  8941 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:40.894821  9258 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:40.896668  9364 consensus_queue.cc:1059] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:40.902386  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:40.965075  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 62730.6us
I20260709 13:02:40.869030  9369 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:40.965343  9364 raft_consensus.cc:3055] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:40.852777  9300 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.965922  9364 raft_consensus.cc:740] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:40.966184  9300 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.967150  9364 consensus_queue.cc:260] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.968827  9364 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:40.968909  9300 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.873149  9238 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:40.970284  9238 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.970443  9574 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:40.972596  9238 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:40.903713  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.973318  2267 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:40.938582  9333 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:02:40.974232  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.974964  2267 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 26: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:40.926139  9470 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.975718  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.975632  9470 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.976922  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:40.904838  1708 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:02:40.905516  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:40.978467  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 72990us
I20260709 13:02:40.906270  1704 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:02:40.978914  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.907372  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:40.979900  1702 raft_consensus.cc:2368] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:40.980017  9542 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:40.980232  9551 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.980510  9542 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:40.907846  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.907708  2271 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 28.
I20260709 13:02:40.980818  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:40.980962  9542 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:40.982084  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:40.980973  9522 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:40.983615  9522 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:40.981173  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 73336.1us
I20260709 13:02:40.977954  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:40.989359  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.990803  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:40.991567  1706 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 25.
I20260709 13:02:40.863790  9529 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:40.858397  1673 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:02:40.937536  1674 leader_election.cc:336] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:41.001250  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 142883us
W20260709 13:02:40.943388  1600 leader_election.cc:336] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:40.897897  9511 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:40.953059  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:41.005119  1700 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:02:41.000470  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 62936.1us
I20260709 13:02:40.954443  1709 raft_consensus.cc:1275] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:02:40.959753  1627 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:02:40.690057  9269 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:40.945572  9553 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:40.962571  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:40.938259  9540 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:40.900292  1701 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:02:40.986677  2235 leader_election.cc:336] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:41.036674  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 50003.5us
W20260709 13:02:41.037469  2235 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:41.038498  2235 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:41.039631  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:41.040292  2235 leader_election.cc:336] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:41.040856  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:40.997098  1707 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 28.
I20260709 13:02:41.041741  1628 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:40.985896  1524 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:41.006912  8737 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:40.969831  9300 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:40.945705  9562 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:41.006210  1674 leader_election.cc:336] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:41.002625  1600 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:41.048365  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:40.768812  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.048971  1627 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:40.838009  9368 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 23. Current term is 24.
I20260709 13:02:41.042523  8737 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.043020  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:41.060043  1629 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:02:41.046353  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 60514.6us
I20260709 13:02:41.051082  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:41.051452  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:41.061400  1524 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:41.061617  2235 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:41.062117  2235 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:41.062412  2265 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:41.009373  9369 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:40.942327  9406 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.064481  9470 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.065157  8941 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:41.042524  9269 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.980837  9551 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.083230  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:41.065577  2235 leader_election.cc:336] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:41.083256  1700 raft_consensus.cc:2468] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 26.
W20260709 13:02:41.065014  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:41.068590  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.075120  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:41.015496  9405 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:02:41.107017  9405 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:41.107421  9405 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:41.087536  1627 raft_consensus.cc:2393] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 21: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:40.960706  9592 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.109890  9470 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:41.110685  9470 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.113344  9470 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.115877  9551 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.118124  8737 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.119556  9553 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:41.087117  9300 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:41.120816  9300 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:41.123914  9585 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:41.124509  9585 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:41.124962  9585 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.075824  9499 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:41.054667  9529 raft_consensus.cc:3060] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:41.086841  1628 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:41.078078  9262 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:41.080339  9087 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:41.102090  2269 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:02:41.225085  2269 pending_rounds.cc:85] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 15
I20260709 13:02:41.225360  2269 pending_rounds.cc:107] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:02:41.225622  2269 raft_consensus.cc:2889] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:41.102380  9522 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:41.108270  9405 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.047477  9540 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:41.131271  1674 leader_election.cc:336] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:41.134526  1630 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:02:41.135589  1629 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 28.
I20260709 13:02:41.142831  1524 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:41.143718  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:41.090188  9552 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.232146  2271 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 24: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:41.232620  9522 raft_consensus.cc:2804] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:41.233063  9522 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.088761  9269 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:41.153330  9300 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:41.186653  9542 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:41.189235  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:41.197083  9438 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:41.239236  9438 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:41.243913  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.200014  9592 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:41.201440  9469 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.211248  9585 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.212765  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.269044  1632 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:41.213456  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:41.218530  2265 raft_consensus.cc:1275] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:02:41.219141  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:41.271678  1634 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 24: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:41.272130  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:41.220186  2262 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 17. Current term is 18. Ops: [16.14-17.15]
I20260709 13:02:41.222115  9406 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.222875  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.288667  1627 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:41.085121  9369 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:02:41.232084  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 89353.5us
I20260709 13:02:41.290771  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:41.292785  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:41.230963  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 99669.9us
I20260709 13:02:41.233385  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:41.080063  9272 consensus_queue.cc:1048] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:02:41.233456  9522 raft_consensus.cc:3060] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:41.278853  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:41.297595  2236 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:41.302160  1526 leader_election.cc:400] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:41.307657  1526 leader_election.cc:403] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:02:41.243441  9540 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.244964  9499 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.307646  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:41.321027  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:41.342684  1700 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:41.344359  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 400781us
I20260709 13:02:41.321357  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.346279  1707 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 21: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:41.250900  9300 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:41.329017  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 242658us
W20260709 13:02:41.362039  2235 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:41.362495  2235 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:41.251423  9405 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.328696  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:41.245503  9438 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.381076  1709 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:02:41.381264  1600 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:41.381664  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:41.360411  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 58484.3us
I20260709 13:02:41.382616  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:41.383757  1526 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:41.373919  9269 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:41.374053  9524 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:41.375005  9611 log.cc:927] Time spent T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:41.329721  9238 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:02:41.330266  9087 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:41.376058  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 68494.9us
I20260709 13:02:41.232216  9552 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.387255  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:41.309345  9211 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.095s
I20260709 13:02:41.309190  9333 consensus_queue.cc:1059] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 13:02:41.387732  1700 raft_consensus.cc:2468] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:41.389247  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:41.392774  1600 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:41.393047  8737 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:02:41.302793  9469 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:41.402745  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.309142  9470 consensus_queue.cc:1048] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 13:02:41.442983  1702 raft_consensus.cc:2393] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 24: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:41.375720  9499 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.451401  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.402837  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.452346  1707 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 26: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:41.360532  9585 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:02:41.376648  9515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.016s	sys 0.028s
I20260709 13:02:41.393728  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.388326  9551 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.431782  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.394366  9592 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:02:41.395676  9540 raft_consensus.cc:2804] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:02:41.395871  8966 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:02:41.478725  8966 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 28 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:41.479851  8966 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.14, Last appended by leader: 14, Current term: 28, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.480521  8941 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:41.480911  8941 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:41.390654  9406 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:41.437821  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.482580  1634 raft_consensus.cc:2393] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 21: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
W20260709 13:02:41.430677  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:41.483381  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 52729.1us
W20260709 13:02:41.408221  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:41.449998  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:41.486231  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 78018.7us
I20260709 13:02:41.486673  1629 raft_consensus.cc:2368] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 27. Current term is 28.
I20260709 13:02:41.451309  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:41.487578  2235 leader_election.cc:336] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:41.487679  1630 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:41.328619  9483 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:41.488926  9483 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.420495  9087 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.454448  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.382719  9300 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.429888  9238 raft_consensus.cc:697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 26 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:41.456548  1704 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:41.458559  9585 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.442703  9563 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:41.468202  9552 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:41.458868  9515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.016s	sys 0.029s
I20260709 13:02:41.503290  1627 raft_consensus.cc:1275] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:02:41.468746  9551 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.469856  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:41.409793  9491 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:02:41.481647  8941 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.511268  8941 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:41.493533  1705 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:41.493067  9087 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:41.498876  9562 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.503291  1704 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:41.461712  9540 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.503038  9238 consensus_queue.cc:237] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:41.509294  1455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 237) took 13231 ms (client timeout 15000 ms). Trace:
I20260709 13:02:41.501616  9585 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:41.548897  9300 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.550691  9551 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.508780  9552 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:41.555328  9552 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:41.557555  9552 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:41.559880  9469 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:41.506099  9563 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.563050  9563 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.571165  9499 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.459486  9369 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:41.539386  9258 consensus_meta.cc:287] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
I20260709 13:02:41.511078  9493 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:02:41.574255  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.572458  9529 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:41.575124  1627 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:41.579241  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.581266  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.587791  1704 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:41.573076  9258 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.541486  9540 raft_consensus.cc:3060] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:41.589242  9556 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.605049  1628 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:41.596975  1601 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:41.610733  8737 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:41.611167  8737 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.611552  8737 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:41.594303  9542 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:41.540825  9562 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.610749  1454 catalog_manager.cc:5697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
W20260709 13:02:41.606786  9287 consensus_meta.cc:287] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.717s	user 0.012s	sys 0.000s
I20260709 13:02:41.658993  8737 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:41.606639  9499 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.674414  8737 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:41.674635  1700 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
W20260709 13:02:41.590518  9502 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.043s	sys 0.070s
I20260709 13:02:41.678138  1632 raft_consensus.cc:1275] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:02:41.678720  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:41.681286  1700 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:41.665387  9364 consensus_meta.cc:287] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.696s	user 0.014s	sys 0.000s
W20260709 13:02:41.679078  9502 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.043s	sys 0.070s
I20260709 13:02:41.659471  9287 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:41.659333  9269 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.693387  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:41.661303  9529 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:41.614499  9556 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:41.706557  1700 raft_consensus.cc:2468] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:41.698469  1524 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:41.539806  1455 rpcz_store.cc:269] 0709 13:02:28.273225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.276772 (+  3547us) service_pool.cc:224] Handling call
0709 13:02:41.504302 (+13227530us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:36.724777 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:36.725415 (+   638us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:36.725473 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:02:36.725522 (+    49us) tablet.cc:662] Decoding operations
0709 13:02:36.727750 (+  2228us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:36.727882 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:36.727922 (+    40us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:02:36.761676 (+ 33754us) tablet.cc:701] Row locks acquired
0709 13:02:36.771598 (+  9922us) write_op.cc:260] PREPARE: finished
0709 13:02:36.793804 (+ 22206us) write_op.cc:270] Start()
0709 13:02:36.882399 (+ 88595us) write_op.cc:276] Timestamp: P: 1783602156784652 usec, L: 0
0709 13:02:36.921721 (+ 39322us) op_driver.cc:348] REPLICATION: starting
0709 13:02:37.208309 (+286588us) log.cc:844] Serialized 7679 byte log entry
0709 13:02:38.426827 (+1218518us) op_driver.cc:464] REPLICATION: finished
0709 13:02:38.632156 (+205329us) write_op.cc:301] APPLY: starting
0709 13:02:38.658669 (+ 26513us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:39.700463 (+1041794us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:39.700591 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:40.026849 (+326258us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:40.027191 (+   342us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:02:40.027251 (+    60us) write_op.cc:312] APPLY: finished
0709 13:02:40.027706 (+   455us) log.cc:844] Serialized 172 byte log entry
0709 13:02:40.235825 (+208119us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:40.235996 (+   171us) write_op.cc:454] Released schema lock
0709 13:02:40.236071 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:40.236518 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:40.236558 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21361,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":114326,"apply.run_cpu_time_us":56207,"apply.run_wall_time_us":1644407,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83509,"num_ops":19,"prepare.queue_time_us":286032,"prepare.run_cpu_time_us":33434,"prepare.run_wall_time_us":510623,"raft.queue_time_us":777190,"raft.run_cpu_time_us":8804,"raft.run_wall_time_us":166728,"replication_time_us":1418606,"thread_start_us":1110534,"threads_started":5,"wal-append.queue_time_us":472230,"wal-append.run_cpu_time_us":37100,"wal-append.run_wall_time_us":2731498}]]}
W20260709 13:02:41.705612  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 271446us
I20260709 13:02:41.684934  9542 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:41.713563  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.750568  1634 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:41.711035  1601 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:41.695021  9552 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:41.675482  9499 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:41.753345  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 44448.8us
I20260709 13:02:41.702510  9483 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.753657  2263 raft_consensus.cc:2468] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:41.753849  8737 raft_consensus.cc:2804] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:02:41.754755  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 56329.9us
I20260709 13:02:41.703768  9551 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:41.755904  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.759476  8737 raft_consensus.cc:697] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:41.759757  1630 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 26.
I20260709 13:02:41.760354  8737 consensus_queue.cc:237] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:41.762667  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:41.767767  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:41.777601  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:41.704553  9529 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:41.783995  1700 raft_consensus.cc:1275] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:41.764472  9552 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:41.702632  9287 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.796900  1632 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:41.704216  9269 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.764662  9087 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.705377  9300 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.076s
I20260709 13:02:41.755040  9542 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:41.805496  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.806536  1632 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 22: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:41.775220  9547 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:41.813055  9258 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.813886  9287 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.798946  9364 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.815369  9364 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.817400  9364 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:41.813900  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.798988  9551 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:41.820384  1700 raft_consensus.cc:2410] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 25 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
W20260709 13:02:41.818929  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 322097us
I20260709 13:02:41.803766  9498 raft_consensus.cc:3060] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:41.827296  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.823038  2236 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:41.831027  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.831871  1634 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 23.
I20260709 13:02:41.832159  8941 raft_consensus.cc:2804] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:41.832759  8941 raft_consensus.cc:697] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 24 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:41.836879  8941 consensus_queue.cc:237] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.821722  9287 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.842941  1630 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:02:41.861984  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.864413  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:41.864969  1634 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:41.809175  9635 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.041s
I20260709 13:02:41.865568  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:41.866777  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:41.867494  2268 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:41.845062  9562 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:41.910667  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:41.911113  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:41.911213  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:41.920372  1634 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:41.879951  9563 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.875022  9547 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:41.929077  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.929955  1633 raft_consensus.cc:2393] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:41.935518  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.935851  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.864606  9287 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:41.948149  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:41.939795  9629 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 13:02:41.940551  9634 log.cc:927] Time spent T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:41.940732  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.936185  1703 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:41.954983  1700 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 26.
I20260709 13:02:41.942430  9547 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:41.958196  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:41.958525  1600 leader_election.cc:336] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:41.958838  1702 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:41.946102  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58714 (request call id 1734) took 1033 ms. Trace:
I20260709 13:02:41.959575  2263 rpcz_store.cc:276] 0709 13:02:40.912487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.962309 (+ 49822us) service_pool.cc:224] Handling call
0709 13:02:41.945892 (+983583us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400590954. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:41.946040 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1564381056}
I20260709 13:02:41.947785  1704 raft_consensus.cc:2368] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:41.949981  1629 raft_consensus.cc:1275] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:02:41.914664  9552 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:41.967808  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.968719  1630 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:02:41.954293  8737 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.942807  1634 raft_consensus.cc:1275] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:02:41.954284  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 172345us
W20260709 13:02:41.957005  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 179404us
W20260709 13:02:41.963697  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:41.960703  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:41.963436  1626 raft_consensus.cc:2468] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
W20260709 13:02:41.964394  1598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.978295  1673 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:41.979951  1673 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:41.965034  1600 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:41.981282  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:41.982021  1626 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:02:41.986399  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:41.971575  8737 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:41.989099  1673 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:41.990651  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:41.980717  1600 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:41.960052  9627 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:02:42.009615  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:42.000484  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.007360  9511 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:42.009506  1526 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:42.016026  1526 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:42.016752  1524 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:41.965889  9562 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.023478  1526 leader_election.cc:400] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:42.024300  2234 leader_election.cc:400] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 27. Current term is 28.
I20260709 13:02:42.025837  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:42.026557  1626 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 26.
I20260709 13:02:42.026810  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:42.027405  1634 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:42.009034  9535 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:42.031473  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:42.024865  1526 leader_election.cc:403] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:42.032684  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:41.931394  9563 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.020133  9529 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:42.126685  9638 log.cc:927] Time spent T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260709 13:02:42.127403  9639 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 13:02:42.351847  9540 consensus_meta.cc:287] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.746s	user 0.005s	sys 0.009s
W20260709 13:02:42.150804  9644 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:02:42.028424  9535 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:42.035426  9562 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:42.109606  9619 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.551s	user 0.006s	sys 0.000s
I20260709 13:02:42.158737  8737 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:42.182103  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 159447us
I20260709 13:02:42.089632  9542 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:42.090054  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:42.291777  9556 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:42.010382  9491 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:42.009243  9368 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:42.323949  9269 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.324563  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:42.325470  9287 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.325851  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:42.009217  9483 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 13:02:42.010819  9626 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.019888  9636 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:42.089241  9364 consensus_queue.cc:1048] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:02:42.028365  9300 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:42.013906  9469 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:42.014775  9552 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:42.341451  1634 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:42.398895  9542 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.392508  9490 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:42.430792  9630 log.cc:927] Time spent T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.740s	user 0.003s	sys 0.006s
I20260709 13:02:42.430876  9490 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.432976  9490 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:42.435012  9498 consensus_meta.cc:287] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
I20260709 13:02:42.435456  9498 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:42.351266  1700 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:42.437953  2267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1598) took 1435 ms. Trace:
I20260709 13:02:42.438143  9563 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.438609  9368 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:42.439498  9562 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.438385  2267 rpcz_store.cc:276] 0709 13:02:41.002897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.003061 (+   164us) service_pool.cc:224] Handling call
0709 13:02:41.003495 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.003926 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.003966 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.051702 (+ 47736us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.448227 (+396525us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:41.448283 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.448368 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.034386 (+586018us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:42.437677 (+403291us) raft_consensus.cc:1685] finished
0709 13:02:42.437698 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.437896 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":790,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":5144448,"thread_start_us":320403,"threads_started":1,"wal-append.queue_time_us":562415}
I20260709 13:02:42.351543  9529 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.353823  1524 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:42.357064  1674 leader_election.cc:336] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:42.360563  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 327761us
W20260709 13:02:42.366714  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 377433us
I20260709 13:02:42.344823  8966 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:42.344063  9384 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:42.344271  9236 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:42.344447  9551 raft_consensus.cc:3060] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 22
W20260709 13:02:42.364886  9633 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.438s	user 0.002s	sys 0.006s
I20260709 13:02:42.352361  9540 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.394995  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:42.459494  1708 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 19.
I20260709 13:02:42.368268  9535 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:42.405187  2263 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:02:42.368152  9370 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:42.416810  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:42.401553  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:42.416687  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:42.421279  9287 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.346628  1702 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:42.343222  9635 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:42.400334  9087 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.396468  9499 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:42.426859  9552 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:42.507792  9552 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:42.411072  9640 consensus_queue.cc:1048] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:02:42.429862  9542 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.497172  9515 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 13:02:42.444707  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 87638us
I20260709 13:02:42.451398  9236 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:42.480643  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:42.420166  9300 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:42.450575  9652 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:02:42.463936  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 110133us
I20260709 13:02:42.534240  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:42.425194  9511 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.466675  8941 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:42.470446  9269 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:42.471300  9585 consensus_meta.cc:287] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.882s	user 0.010s	sys 0.006s
I20260709 13:02:42.471477  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:42.471824  9656 consensus_queue.cc:1048] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:42.471235  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:42.542690  1708 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 24.
W20260709 13:02:42.543140  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 71966.2us
I20260709 13:02:42.544231  1673 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:42.472718  9522 consensus_meta.cc:287] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.131s	user 0.007s	sys 0.012s
W20260709 13:02:42.457248  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.506819  9287 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.441252  9636 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:42.451836  8966 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:42.521701  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:42.551627  2263 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 25.
I20260709 13:02:42.523818  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:42.525671  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:42.496330  9384 raft_consensus.cc:697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:42.529742  2267 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:02:42.555897  2267 pending_rounds.cc:85] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 12
I20260709 13:02:42.556255  2267 pending_rounds.cc:107] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:02:42.556407  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:42.557271  2267 raft_consensus.cc:2889] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:42.455423  9649 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:02:42.536940  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:42.533442  9300 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:42.539016  8941 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.529136  9547 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.546861  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:42.536026  9640 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:02:42.547000  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 162425us
I20260709 13:02:42.549341  1709 raft_consensus.cc:2410] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:02:42.462853  9333 consensus_queue.cc:1048] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.070s
I20260709 13:02:42.548538  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:42.555734  1702 raft_consensus.cc:1275] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:02:42.528153  9236 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:42.464710  9490 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:42.553368  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:42.586287  1633 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:42.587275  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:42.553041  2262 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:42.528644  9369 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.528934  9087 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:42.473722  9370 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:42.566358  8737 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.567546  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:42.570250  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:42.569799  1601 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:02:42.621636  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 51892.2us
I20260709 13:02:42.572079  1634 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 26.
I20260709 13:02:42.625025  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:42.546902  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:42.569049  1599 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:42.626995  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 58017.9us
I20260709 13:02:42.621935  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:42.628351  1599 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:42.573212  1600 leader_election.cc:336] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:42.577906  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:42.427245  9626 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.536422  9493 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:42.459293  9643 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.135s
I20260709 13:02:42.458135  9529 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.594822  9490 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.596089  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:42.564817  9406 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:42.555083  8966 raft_consensus.cc:3060] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:42.603390  9657 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:42.585464  9563 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:42.559914  9483 raft_consensus.cc:2804] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:42.580278  9640 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:02:42.608721  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 86201.4us
I20260709 13:02:42.509563  9635 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.622596  1601 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:42.630414  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:42.676201  1627 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:02:42.560432  9632 consensus_queue.cc:1048] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:02:42.630780  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:42.644030  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
W20260709 13:02:42.623816  9405 consensus_meta.cc:287] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.232s	user 0.015s	sys 0.004s
I20260709 13:02:42.669991  1704 raft_consensus.cc:2468] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 26.
W20260709 13:02:42.634548  9524 consensus_meta.cc:287] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 1.214s	user 0.016s	sys 0.003s
I20260709 13:02:42.590776  9542 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.620503  8737 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.679302  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:42.678814  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 144502us
I20260709 13:02:42.679842  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:42.632694  9370 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:42.617121  9651 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:42.712517  1632 raft_consensus.cc:2410] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:02:42.683260  1634 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:42.551846  9511 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.555392  9522 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.555466  9585 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.637993  9262 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:42.685844  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:42.739112  1526 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:42.686501  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63950us
I20260709 13:02:42.700177  2270 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:02:42.700418  9490 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:42.676790  9406 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.633070  9369 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.670284  9657 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:42.702296  9483 raft_consensus.cc:697] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:42.686228  9211 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
W20260709 13:02:42.704612  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 131375us
I20260709 13:02:42.555441  9269 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.710844  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:42.716040  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 159983us
I20260709 13:02:42.759690  9269 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.760648  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:02:42.762746  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.681200  9641 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:42.763185  9632 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.763361  9641 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:42.763782  9632 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.764338  9641 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.764904  9650 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.765646  9641 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:42.765413  9650 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.766004  9632 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:42.767580  9650 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:42.763200  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 214251us
I20260709 13:02:42.767652  9300 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.769093  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:42.769381  1674 leader_election.cc:336] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:42.770434  9491 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:42.677618  9640 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:42.770785  9300 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.771507  9300 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:42.771934  9300 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:42.772686  9529 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:42.739600  2264 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 25.
I20260709 13:02:42.743242  8737 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:42.616904  9384 consensus_queue.cc:237] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.644929  9493 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.687731  9087 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:42.748193  9635 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:42.798907  9635 raft_consensus.cc:3060] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:42.713306  9524 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:42.739320  9262 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.803049  9262 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:42.803601  9370 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.805433  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:42.762365  8966 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.807585  9626 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.808154  9626 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:42.741678  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 168598us
I20260709 13:02:42.808789  9626 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:02:42.810003  1600 leader_election.cc:336] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:42.810467  1600 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:42.810828  9499 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:42.811517  1600 leader_election.cc:336] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:42.811285  9499 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.811913  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:42.812556  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1557) took 1490 ms. Trace:
W20260709 13:02:42.812919  1600 leader_election.cc:336] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:42.769785  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:42.728200  1634 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:42.813344  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:42.814145  9585 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:42.815116  1600 leader_election.cc:336] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:42.816021  9258 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:42.816725  9258 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:42.817381  9258 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:42.820359  9563 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.820901  9563 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:42.821947  1600 leader_election.cc:336] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:42.822878  1600 leader_election.cc:336] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:42.823868  1600 leader_election.cc:336] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:42.824230  1600 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:42.825280  9551 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 21. Current term is 22.
I20260709 13:02:42.826463  9540 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.833014  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2942) took 1006 ms. Trace:
I20260709 13:02:42.833498  1628 rpcz_store.cc:276] 0709 13:02:41.827021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.827139 (+   118us) service_pool.cc:224] Handling call
0709 13:02:41.845280 (+ 18141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.845587 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.845612 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.863654 (+ 18042us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.117564 (+253910us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:42.117628 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.117734 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.832764 (+715030us) raft_consensus.cc:1685] finished
0709 13:02:42.832788 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.832952 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4820,"thread_start_us":201082,"threads_started":1,"wal-append.queue_time_us":917331}
I20260709 13:02:42.843719  9369 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.846678  9406 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:42.847590  9406 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:42.851998  9483 consensus_queue.cc:237] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.812928  1701 rpcz_store.cc:276] 0709 13:02:41.322357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.322542 (+   185us) service_pool.cc:224] Handling call
0709 13:02:41.323009 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.604481 (+281472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.604512 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.670015 (+ 65503us) log.cc:844] Serialized 26 byte log entry
0709 13:02:41.994895 (+324880us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:41.994940 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:41.995005 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.812332 (+817327us) raft_consensus.cc:1685] finished
0709 13:02:42.812352 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.812489 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18112,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":21160,"thread_start_us":543543,"threads_started":2,"wal-append.queue_time_us":1057459}
I20260709 13:02:42.751190  9657 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:42.864140  9087 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.871106  9656 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:42.872571  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:42.873427  1630 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 25.
I20260709 13:02:42.880594  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1600) took 1043 ms. Trace:
I20260709 13:02:42.793699  9636 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.796833  9529 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.885219  9529 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.894956  9370 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:42.855795  9493 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:42.911284  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 141841us
I20260709 13:02:42.912302  9635 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:42.789716  8737 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:42.913196  8737 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.913633  8737 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:02:42.790288  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.915426  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 125119us
W20260709 13:02:42.916239  2235 leader_election.cc:336] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:42.770848  9491 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.917106  9491 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:42.825405  1600 leader_election.cc:336] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:42.724761  9542 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.926443  9542 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.908353  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:42.928714  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 103276us
I20260709 13:02:42.772715  9300 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.724472  9405 raft_consensus.cc:2804] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:02:42.938503  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.939409  9660 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
W20260709 13:02:42.955752  2235 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:42.957576  2235 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:42.957719  8737 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.963186  9087 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:42.968961  1600 leader_election.cc:336] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:42.912382  1674 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:42.983453  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 71063.4us
I20260709 13:02:42.881178  2266 rpcz_store.cc:276] 0709 13:02:41.837201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.839648 (+  2447us) service_pool.cc:224] Handling call
0709 13:02:41.862312 (+ 22664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:41.875189 (+ 12877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:41.875218 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:41.875662 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.326538 (+450876us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:42.326578 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.326641 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:42.880344 (+553703us) raft_consensus.cc:1685] finished
0709 13:02:42.880371 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:42.880526 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12584,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":20874,"thread_start_us":450598,"threads_started":1,"wal-append.queue_time_us":1002941}
I20260709 13:02:42.953363  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:42.958145  2235 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:42.945822  9491 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:42.940374  9287 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:42.761842  9269 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.168s
I20260709 13:02:43.018183  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:43.021163  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:43.022404  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:43.023185  1700 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:43.002705  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 45147.3us
W20260709 13:02:43.024178  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.024731  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:43.025859  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:43.002686  1701 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 26: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:42.949028  9262 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:43.002929  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 372805us
I20260709 13:02:43.035709  1599 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:43.042999  1706 raft_consensus.cc:2393] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 26: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:43.044358  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:43.046165  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.065539  8737 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.071283  1704 raft_consensus.cc:2393] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:42.948485  9552 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:42.837761  9236 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.073733  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:43.082691  1709 raft_consensus.cc:1275] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:02:43.079421  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:43.084108  1706 raft_consensus.cc:2468] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:43.083276  1701 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 26.
I20260709 13:02:43.003890  9405 raft_consensus.cc:697] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:43.009776  9370 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:43.008560  9490 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:43.089039  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:43.047772  9635 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.014858  9499 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.043596  9211 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.076464  9087 raft_consensus.cc:2804] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:02:43.045347  9368 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:43.098361  2268 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:02:43.108562  1700 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
W20260709 13:02:43.100643  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 389667us
I20260709 13:02:43.114303  9368 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.123224  9368 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:43.099779  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 65937.3us
I20260709 13:02:43.125982  9236 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.130796  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:43.131410  9262 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.133005  9542 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.135264  9542 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:02:43.136010  9542 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.136583  9542 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:02:43.136921  9522 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:43.137548  9491 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:43.138509  8941 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:43.140533  8966 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.138554  9624 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:43.154505  9668 log.cc:927] Time spent T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:02:43.156934  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.158181  9529 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.102455  9635 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.159377  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.160497  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:43.161182  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:43.086872  9287 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.156718  9405 consensus_queue.cc:237] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.168789  1633 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:43.170455  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:43.175390  1708 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:43.172375  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:43.103036  9653 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.361s	user 0.005s	sys 0.000s
I20260709 13:02:43.176321  1701 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:43.175904  2234 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:43.176545  9529 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.178853  9370 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:43.183480  8941 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:43.184082  8941 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:43.102133  9087 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:43.217949  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:43.218705  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:43.224331  2267 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:43.219028  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:43.219828  8941 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.220693  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:43.225559  2266 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:43.225163  2263 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:43.226439  1701 raft_consensus.cc:2468] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 25.
I20260709 13:02:43.125998  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:43.229355  1674 leader_election.cc:336] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:43.230517  2236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.025s
W20260709 13:02:43.230866  2236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.000s	sys 0.025s
I20260709 13:02:43.160739  9635 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:43.227694  1601 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:43.244848  1708 raft_consensus.cc:2468] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:43.246892  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:43.247162  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:43.248306  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:43.252300  9551 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.252969  9551 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.253753  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:43.254207  9669 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.231304  9087 raft_consensus.cc:3060] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:02:43.254983  9669 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.256990  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:43.257297  9669 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.257589  2265 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:43.254277  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:43.259831  9542 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.261763  2267 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
W20260709 13:02:43.264860  9535 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.002s
I20260709 13:02:43.213950  9625 consensus_queue.cc:1048] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 13:02:43.213605  9498 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:02:43.269146  1632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42252 (request call id 2940) took 1461 ms. Trace:
I20260709 13:02:43.269575  1632 rpcz_store.cc:276] 0709 13:02:41.807999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.820509 (+ 12510us) service_pool.cc:224] Handling call
0709 13:02:43.268935 (+1448426us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b540034e9d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:43.269081 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019215744}
I20260709 13:02:43.272078  1627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2954) took 1314 ms. Trace:
I20260709 13:02:43.272503  1627 rpcz_store.cc:276] 0709 13:02:41.958057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.959419 (+  1362us) service_pool.cc:224] Handling call
0709 13:02:42.009657 (+ 50238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:42.676668 (+667011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.271856 (+595188us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b540006c2d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:43.272020 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531361664}
I20260709 13:02:43.278502  9551 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.279919  1524 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:43.265367  9535 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.105618  9211 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.179245  9529 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.283612  9211 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.284500  9529 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:43.285086  9529 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:43.286298  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:43.287635  1524 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:43.288399  9551 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:43.290480  9551 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.291121  9551 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:43.289515  9535 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:43.295460  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 67804.5us
I20260709 13:02:43.297021  1601 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:43.297544  8966 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.298218  9499 raft_consensus.cc:2804] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:43.332430  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:43.298296  8966 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.100672  9490 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.180405  9287 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.295460  9529 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:43.363754  9671 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:43.366351  2269 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
W20260709 13:02:43.336017  9470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.018s	sys 0.046s
I20260709 13:02:43.298992  9499 raft_consensus.cc:697] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:43.370971  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:43.353430  9625 raft_consensus.cc:2804] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:43.353236  9524 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:43.374435  9640 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.000s
I20260709 13:02:43.356241  9585 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:43.358170  9626 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:43.380682  9470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.019s	sys 0.046s
W20260709 13:02:43.362146  9657 consensus_meta.cc:287] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
W20260709 13:02:43.419474  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 293427us
I20260709 13:02:43.416143  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:43.427968  1599 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:43.429207  2263 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:43.432524  1524 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:43.384795  9535 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:02:43.385653  9562 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:43.389667  9493 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:43.437456  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.442487  2266 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 21.
I20260709 13:02:43.450802  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:43.451162  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:43.451876  1524 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:43.456456  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:43.391183  9529 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:43.455240  9368 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:02:43.455510  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:43.480243  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:43.480903  2270 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:43.475512  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:43.482836  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.413411  9625 raft_consensus.cc:697] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:43.476146  2268 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 18.
I20260709 13:02:43.443013  9522 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:43.475535  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:43.488149  1524 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:43.451480  9664 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.435757  9369 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.492163  9669 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:43.413535  9640 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.475198  9368 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.561482  9368 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:02:43.477283  1628 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:02:43.567312  1628 raft_consensus.cc:1275] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:43.428037  9498 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:02:43.456619  9624 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:43.570199  9624 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.572522  9624 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.419269  9585 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.574712  9585 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:43.576510  9490 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:43.397763  9524 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.452025  9262 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:43.492712  9674 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:43.577997  9674 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.472749  9542 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:43.484171  9552 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.579514  9515 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:43.580094  9515 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.580576  9674 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.472666  9483 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:02:43.583091  9529 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.498799  9693 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.584326  9693 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.587162  9693 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:43.500892  9563 consensus_meta.cc:287] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.000s
I20260709 13:02:43.588405  9563 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.443847  9657 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.590445  9563 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:43.590553  1707 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 20.
I20260709 13:02:43.591485  9657 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:43.430359  9626 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.594120  9626 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:43.594792  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:43.595827  1674 leader_election.cc:336] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:43.595996  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:43.487753  9663 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:43.594877  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:43.599857  1706 raft_consensus.cc:2368] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22.
I20260709 13:02:43.475250  9635 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:43.596473  1674 leader_election.cc:336] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:43.494213  9641 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:43.608968  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:43.616410  1633 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:43.493180  8966 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:43.616967  1674 leader_election.cc:336] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:43.393095  9671 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:43.634303  1674 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:43.472100  9677 consensus_queue.cc:1048] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.117s
I20260709 13:02:43.509680  9547 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:43.508876  9522 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:43.483909  9493 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:43.660362  9687 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.077s	user 0.004s	sys 0.000s
I20260709 13:02:43.681401  1633 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:43.494963  9499 consensus_queue.cc:237] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.669458  9674 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:43.578761  9524 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:43.660109  9515 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.647898  1632 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 23.
I20260709 13:02:43.680033  9511 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:43.553722  9369 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.706681  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.635501  9087 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.638978  9641 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.723090  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.723724  9641 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.714936  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2956) took 1165 ms. Trace:
I20260709 13:02:43.724359  1626 rpcz_store.cc:276] 0709 13:02:42.549434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.549568 (+   134us) service_pool.cc:224] Handling call
0709 13:02:43.270150 (+720582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.384741 (+114591us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:43.384771 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.384818 (+    47us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:43.384853 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.384937 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.714714 (+329777us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b540034e9d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:43.714860 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114184,"raft.queue_time_us":117521,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":38217,"spinlock_wait_cycles":1655679232}
I20260709 13:02:43.725997  9087 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.527456  9664 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.640231  9663 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.729815  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:43.731194  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:43.740162  2265 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:43.525667  9625 consensus_queue.cc:237] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.732524  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.752537  1626 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 25.
I20260709 13:02:43.753824  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:43.754644  1626 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:43.759189  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:43.759501  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 271270us
I20260709 13:02:43.760469  1628 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 13:02:43.760970  1524 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:43.761747  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:43.741667  9269 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.780958  1673 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:43.707731  9674 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.751569  9563 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:43.775828  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:43.789912  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:43.738822  9287 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.796716  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.772672  9650 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:43.803438  1526 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:43.771813  9522 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:43.807255  9696 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:02:43.808399  9674 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:43.808614  9694 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:02:43.784727  9657 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:02:43.813213  9657 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.813616  9657 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:02:43.818895  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.820358  1526 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:43.783205  9675 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:02:43.847203  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 201077us
I20260709 13:02:43.771793  9535 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:02:43.816403  9563 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:43.815590  9547 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:02:43.831604  1526 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:43.889740  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.819229  9635 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:43.910118  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 78601.3us
I20260709 13:02:43.822463  9650 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:43.892740  9636 raft_consensus.cc:3060] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:43.795888  9269 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.821617  9368 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:43.892438  8966 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:43.919495  1629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2958) took 1367 ms. Trace:
I20260709 13:02:43.894829  9672 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:43.897119  9552 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.918532  9650 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.909945  9640 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.914477  9087 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:02:43.925628  9563 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.927011  9368 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:43.928545  1626 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:43.931313  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:43.927953  1629 rpcz_store.cc:276] 0709 13:02:42.552297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.552426 (+   129us) service_pool.cc:224] Handling call
0709 13:02:42.564717 (+ 12291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:42.565058 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:42.565086 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:42.577645 (+ 12559us) log.cc:844] Serialized 26 byte log entry
0709 13:02:42.965702 (+388057us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b18000bf380. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daec4e07 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b 00007f06ddb6ed23 00007f06ddb6f0d1 00007f06ddf8aa0f
0709 13:02:43.382124 (+416422us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:43.382161 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.382242 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:43.919118 (+536876us) raft_consensus.cc:1685] finished
0709 13:02:43.919144 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.919422 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1040,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":17187,"spinlock_wait_cycles":28485888,"thread_start_us":416226,"threads_started":1,"wal-append.queue_time_us":1223896}
W20260709 13:02:43.923870  9697 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:02:43.944244  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.948087  9671 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.949275  1709 raft_consensus.cc:1275] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:02:44.005033  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.006529  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.007215  1632 raft_consensus.cc:2468] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:44.008139  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.966388  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.009465  1703 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 28.
I20260709 13:02:43.970708  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:43.986538  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:43.996061  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:43.997030  1635 raft_consensus.cc:2393] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:44.045140  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:44.046643  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:44.047518  1632 raft_consensus.cc:2393] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:44.050354  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:44.051069  1626 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:02:44.054831  9692 log.cc:927] Time spent T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:02:44.049782  1632 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:02:44.065438  1632 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:02:43.934386  8966 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:44.068245  8966 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:43.936564  9552 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:44.072181  9552 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:44.072825  9711 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:02:44.001123  9563 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.992581  9087 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.075906  9087 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:02:44.001865  9535 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.077876  9535 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.080588  9671 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:44.081067  1626 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 27.
I20260709 13:02:44.081349  9671 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.082886  9369 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:44.083634  9671 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:44.080694  9535 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:44.092316  9551 consensus_meta.cc:287] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.000s
I20260709 13:02:44.092954  9551 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:43.943367  9493 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:44.100111  9269 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:44.114531  9695 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.315s	user 0.000s	sys 0.003s
I20260709 13:02:44.119002  9490 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:44.119661  9490 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.120919  1524 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:44.122620  9664 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:44.081751  9663 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:44.127823  9563 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:44.133080  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 105951us
I20260709 13:02:44.166280  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.166674  1599 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:44.143549  9490 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:44.155781  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:44.173451  2267 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:02:44.173949  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.174796  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.159775  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.160218  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.160460  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.161518  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.176401  1706 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 24.
I20260709 13:02:44.176595  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.164722  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.178381  1703 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
W20260709 13:02:44.167409  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46526.8us
I20260709 13:02:44.168993  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.180692  2262 raft_consensus.cc:2410] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 13:02:44.170249  8737 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:02:44.170545  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 380076us
I20260709 13:02:44.170710  1599 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:44.172536  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:44.181140  8737 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.181500  8737 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:44.163976  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.185743  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:44.199623  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.200146  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:44.207371  1673 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:44.209522  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.210487  1703 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 28.
I20260709 13:02:44.165921  9675 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.219317  8737 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.212190  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:44.212785  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:44.199268  9665 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:44.200934  9682 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.222649  9700 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:44.171937  8966 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:44.279884  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.305212  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 1.07691e+06us
I20260709 13:02:44.236191  2267 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 27.
I20260709 13:02:44.220022  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:44.188160  9236 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.274087  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 88495.5us
I20260709 13:02:44.220167  9663 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:02:44.230378  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 306672us
I20260709 13:02:44.220021  9672 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:44.247957  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.311921  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:44.313236  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.312959  8737 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:44.325034  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.271077  9700 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.309505  1524 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:44.238129  9643 raft_consensus.cc:2764] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 13:02:44.328447  9236 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.237913  9511 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:44.238101  9675 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:44.356329  9663 raft_consensus.cc:697] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 23 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:44.211822  9563 consensus_queue.cc:1048] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 13:02:44.357527  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.247000  9491 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:44.360893  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:44.366139  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:44.404626  1628 raft_consensus.cc:3060] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:02:44.405441  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:44.367853  9540 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:44.368482  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:44.369109  9529 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:44.371610  9657 consensus_meta.cc:287] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.002s
I20260709 13:02:44.305480  9670 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:02:44.371829  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:44.414233  1630 raft_consensus.cc:2368] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21.
I20260709 13:02:44.413980  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.374534  9636 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:44.376366  9684 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.749s	user 0.002s	sys 0.000s
I20260709 13:02:44.419108  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.384722  9087 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:44.387897  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.419605  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.419802  1626 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
W20260709 13:02:44.397559  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 88093.5us
I20260709 13:02:44.402388  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.407943  1707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48138 (request call id 3537) took 1843 ms. Trace:
I20260709 13:02:44.407958  1634 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:44.409819  2236 leader_election.cc:400] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22.
I20260709 13:02:44.270744  9665 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.398727  9700 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:44.425982  1628 raft_consensus.cc:2468] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 27.
I20260709 13:02:44.404311  9672 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:44.432225  9657 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.433000  9540 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.433102  9672 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.435820  9542 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.436004  9540 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:44.407488  9491 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:44.436334  9542 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.436779  9491 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:44.436944  9087 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:44.438422  9236 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:44.420046  1627 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 24.
I20260709 13:02:44.422446  1707 rpcz_store.cc:276] 0709 13:02:42.564194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.568934 (+  4740us) service_pool.cc:224] Handling call
0709 13:02:44.407789 (+1838855us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b5400233a54. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:44.407890 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227306880}
I20260709 13:02:44.440043  9675 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:44.441413  9663 consensus_queue.cc:237] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:44.425019  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:44.418555  9641 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:44.444622  1634 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:44.456926  8941 consensus_queue.cc:1048] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:02:44.401136  9585 raft_consensus.cc:2804] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:44.460211  1705 raft_consensus.cc:2393] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 20: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:44.408167  9493 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:44.407599  9269 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:44.471716  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:44.468847  1632 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:02:44.475412  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.475397  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:44.462592  9585 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:44.479063  1633 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.019s	sys 0.027s
W20260709 13:02:44.480041  1633 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.019s	sys 0.028s
I20260709 13:02:44.481791  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.462278  9643 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:44.296419  9682 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.497430  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.415526  9511 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.498217  1707 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:44.499676  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.499882  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.526187  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:44.530256  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.530974  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.536386  1709 raft_consensus.cc:2410] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:02:44.531481  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:44.539114  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:44.540047  1709 raft_consensus.cc:2368] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20.
I20260709 13:02:44.465983  8966 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
W20260709 13:02:44.493693  9522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.005s	sys 0.034s
I20260709 13:02:44.442585  9529 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:44.547156  9715 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:44.547254  9657 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:44.548089  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.548777  2269 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:44.548960  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:44.549870  1700 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 27: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:44.498653  9535 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.551947  9535 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.548213  9529 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:44.466355  9087 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:02:44.556550  9542 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:44.559185  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 339044us
I20260709 13:02:44.559867  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:44.562247  9662 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:44.562640  9662 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.562989  9662 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:44.566272  9287 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:44.566725  9287 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:44.567094  9287 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:44.574501  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.574965  9535 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:44.578388  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:44.579180  1708 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:44.580605  1702 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
I20260709 13:02:44.581019  1673 leader_election.cc:400] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21.
I20260709 13:02:44.477056  9540 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:02:44.481760  9585 raft_consensus.cc:3060] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:44.581374  1673 leader_election.cc:403] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:02:44.581832  2234 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:44.478789  9369 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:44.584017  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:44.546561  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.606681  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.621150  1632 raft_consensus.cc:2393] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 27: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:44.621650  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:44.621986  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.622812  1705 raft_consensus.cc:2410] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:02:44.622882  1709 raft_consensus.cc:2393] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 in current term 25: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:44.623601  2263 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 27: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:44.480108  9269 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.610913  1634 pending_rounds.cc:85] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting all ops after (but not including) 14
I20260709 13:02:44.631491  1634 pending_rounds.cc:107] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:02:44.631865  1634 raft_consensus.cc:2889] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:44.612041  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:44.635576  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 54660us
I20260709 13:02:44.636584  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:44.638465  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.595036  2262 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:44.641117  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.613472  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:44.642890  1627 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 27: Already voted for candidate 87144ea1a4a14ab8b942fb426159f031 in this term.
I20260709 13:02:44.613802  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.615363  2265 raft_consensus.cc:1240] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:44.616523  9542 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:44.607125  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.532158  9640 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.608608  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 82468.4us
I20260709 13:02:44.626971  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:44.584306  9211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.009s	sys 0.030s
W20260709 13:02:44.545540  9522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.005s	sys 0.037s
I20260709 13:02:44.647094  1673 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:44.647460  1524 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:44.647866  1629 raft_consensus.cc:1275] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:02:44.680137  1709 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:02:44.542577  9551 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:44.602073  9716 log.cc:927] Time spent T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:02:44.686441  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.685722  1629 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22. Ops: []
I20260709 13:02:44.646641  2270 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
I20260709 13:02:44.692346  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:44.692654  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.693028  2270 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:44.666013  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:44.663007  9211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.009s	sys 0.031s
I20260709 13:02:44.694921  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.674706  1708 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
W20260709 13:02:44.629436  9650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.056s	sys 0.078s
I20260709 13:02:44.652890  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:44.631060  9641 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:44.648581  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.669314  1703 raft_consensus.cc:1275] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
W20260709 13:02:44.703547  9723 log.cc:927] Time spent T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:02:44.689777  9529 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:02:44.704267  9665 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:44.694557  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:44.708642  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.697158  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:44.754058  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 59531.6us
W20260709 13:02:44.711843  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 392918us
I20260709 13:02:44.714612  1700 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:02:44.675459  9490 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:44.719745  2270 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:44.756062  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.756398  1707 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:02:44.721978  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.726209  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:44.728842  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:44.733160  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:44.759023  2266 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:44.736574  1627 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:02:44.634253  9369 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:44.730600  9650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.056s	sys 0.079s
W20260709 13:02:44.752745  2271 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.011s	sys 0.014s
I20260709 13:02:44.706846  9563 raft_consensus.cc:2804] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:02:44.754751  1673 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:02:44.767400  2271 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.011s	sys 0.014s
I20260709 13:02:44.682248  9640 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:44.746892  9674 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.016s	sys 0.024s
I20260709 13:02:44.751485  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.765133  1524 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:44.763377  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:44.722890  9535 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) with higher term. Message: Invalid argument: T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21.
W20260709 13:02:44.808691  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.811079  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46012.4us
I20260709 13:02:44.810299  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:44.741297  9641 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:44.809619  1601 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:44.710165  9491 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.820080  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:44.824921  1709 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:44.764349  9483 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:02:44.772081  9674 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.016s	sys 0.025s
I20260709 13:02:44.860308  9483 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.860908  9483 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:44.761688  9490 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.866322  9490 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:44.826495  9665 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:44.870503  9665 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:44.772032  9499 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:44.811118  2266 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
W20260709 13:02:44.854610  1454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35578 (request call id 326) took 59360 ms (client timeout 15000 ms). Trace:
W20260709 13:02:44.873809  9727 log.cc:927] Time spent T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:02:44.877529  9729 log.cc:927] Time spent T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:02:44.883332  1599 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:44.894945  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:44.881143  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 54662.9us
I20260709 13:02:44.898368  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:44.766351  9529 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 27 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:44.909511  2269 raft_consensus.cc:1275] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:02:44.917990  8737 consensus_queue.cc:1048] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:44.921788  8941 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:44.922327  8941 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.816663  9657 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:44.922683  8941 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:44.812731  9563 raft_consensus.cc:697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 27 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:44.817871  9650 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:44.819065  9641 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:44.923924  1701 raft_consensus.cc:1240] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:44.931525  2236 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:44.942408  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 130132us
I20260709 13:02:44.952979  8941 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.911379  9671 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 13:02:44.947211  9511 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:44.979465  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:44.871838  9665 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:44.982702  8941 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:44.961787  9682 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:44.977672  9661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.035s	sys 0.046s
W20260709 13:02:44.873544  1454 rpcz_store.cc:269] 0709 13:01:45.494257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.515700 (+ 21443us) service_pool.cc:224] Handling call
0709 13:02:44.854516 (+59338816us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:42.117970 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:42.432069 (+314099us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:42.432107 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:02:42.432126 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:42.432473 (+   347us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:42.432524 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:42.432551 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:42.432729 (+   178us) tablet.cc:701] Row locks acquired
0709 13:02:42.432746 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:02:42.432882 (+   136us) write_op.cc:270] Start()
0709 13:02:42.432991 (+   109us) write_op.cc:276] Timestamp: P: 1783602162432833 usec, L: 0
0709 13:02:42.433016 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:02:42.433665 (+   649us) log.cc:844] Serialized 541 byte log entry
0709 13:02:43.153769 (+720104us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06ddb6a86e 00007f06ddb69bb6 00007f06ddb697d8 00007f06ddb73221 00007f06ddb731d9 00007f06ddb73169
0709 13:02:43.582471 (+428702us) op_driver.cc:464] REPLICATION: finished
0709 13:02:44.270137 (+687666us) write_op.cc:301] APPLY: starting
0709 13:02:44.273055 (+  2918us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:44.375334 (+102279us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:44.375359 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:44.376093 (+   734us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:44.376267 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:02:44.376317 (+    50us) write_op.cc:312] APPLY: finished
0709 13:02:44.376485 (+   168us) log.cc:844] Serialized 25 byte log entry
0709 13:02:44.376644 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:44.376722 (+    78us) write_op.cc:454] Released schema lock
0709 13:02:44.376761 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:44.377142 (+   381us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:44.377173 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":36299,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":640391,"apply.run_cpu_time_us":3935,"apply.run_wall_time_us":154003,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":377195,"prepare.run_cpu_time_us":30791,"prepare.run_wall_time_us":527223,"raft.queue_time_us":426593,"raft.run_cpu_time_us":56667,"raft.run_wall_time_us":310371,"replication_time_us":1149316,"spinlock_wait_cycles":4457856,"thread_start_us":906661,"threads_started":4,"wal-append.queue_time_us":570955}]]}
W20260709 13:02:45.000116  1706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.011s	sys 0.027s
W20260709 13:02:45.002542  1706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.011s	sys 0.028s
I20260709 13:02:45.011881  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:45.003930  1709 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
W20260709 13:02:45.000485  9632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.021s	sys 0.038s
I20260709 13:02:44.996780  9643 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:02:44.998806  9661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.035s	sys 0.047s
W20260709 13:02:45.066910  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 55133.6us
I20260709 13:02:44.999667  9671 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:02:45.050802  9563 consensus_queue.cc:237] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:45.069520  9632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.021s	sys 0.038s
I20260709 13:02:45.074970  1524 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:45.093288  1630 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.008s	sys 0.012s
I20260709 13:02:45.026654  9269 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:45.098169  2264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.012s	sys 0.005s
W20260709 13:02:45.116278  1630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.008s	sys 0.012s
W20260709 13:02:45.095718  9722 log.cc:927] Time spent T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:02:45.100649  9719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.009s	sys 0.026s
I20260709 13:02:45.093971  9671 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
W20260709 13:02:45.116335  2264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.013s	sys 0.006s
I20260709 13:02:45.107236  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:45.073559  9682 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:45.114385  9547 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:02:45.136313  9719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.009s	sys 0.026s
W20260709 13:02:45.122512  9364 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.010s	sys 0.009s
I20260709 13:02:45.109721  9632 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.139643  1600 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.008s	sys 0.015s
W20260709 13:02:45.156867  1600 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.008s	sys 0.015s
W20260709 13:02:45.157352  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 580882us
I20260709 13:02:45.119531  9258 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:45.160498  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 228934us
W20260709 13:02:45.158612  1600 leader_election.cc:336] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.131366  9369 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:45.178730  1634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.013s	sys 0.024s
I20260709 13:02:45.175238  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:45.026679  9529 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:45.153606  9493 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.014s	sys 0.022s
W20260709 13:02:45.193784  9493 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.015s	sys 0.028s
I20260709 13:02:45.157644  9547 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 23 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:45.153359  9364 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.010s	sys 0.010s
I20260709 13:02:45.178573  9624 consensus_queue.cc:1048] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
W20260709 13:02:45.195298  1600 leader_election.cc:336] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:45.180253  1626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.010s	sys 0.051s
W20260709 13:02:45.195860  1634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.014s	sys 0.025s
I20260709 13:02:45.200547  9087 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:45.200608  1626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.010s	sys 0.052s
I20260709 13:02:45.201170  9087 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:45.200537  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:45.204141  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 428255us
W20260709 13:02:45.183180  9726 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 13:02:45.211441  1635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.004s	sys 0.049s
I20260709 13:02:45.190627  9699 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:45.220650  1635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.005s	sys 0.049s
I20260709 13:02:45.221107  8737 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:45.222437  9535 consensus_queue.cc:1048] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:45.197278  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:45.202077  1626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2975) took 1015 ms. Trace:
W20260709 13:02:45.224820  1600 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.198385  9682 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.202626  9661 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:45.228858  1600 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:45.215865  9636 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.219169  9491 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:45.267539  9535 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:45.268477  9732 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 13:02:45.269217  9738 log.cc:927] Time spent T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:02:45.280962  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58718 (request call id 1805) took 1124 ms. Trace:
W20260709 13:02:45.282534  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 57732.4us
I20260709 13:02:45.281512  2271 rpcz_store.cc:276] 0709 13:02:44.157016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.157219 (+   203us) service_pool.cc:224] Handling call
0709 13:02:44.199714 (+ 42495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.200086 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:02:44.200114 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.200555 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:02:44.767932 (+567377us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:44.767988 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.768087 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.280696 (+512609us) raft_consensus.cc:1685] finished
0709 13:02:45.280726 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.280891 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1296,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":12529,"thread_start_us":552547,"threads_started":1,"wal-append.queue_time_us":857090}
W20260709 13:02:45.283054  9725 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.222s	user 0.003s	sys 0.000s
W20260709 13:02:45.283366  1600 leader_election.cc:336] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.283833  1600 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:45.284458  9731 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 13:02:45.284809  9499 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:02:45.286149  1600 leader_election.cc:336] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.288033  2236 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:45.282543  9661 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:45.290181  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 3178) took 1098 ms. Trace:
I20260709 13:02:45.290365  8941 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:45.291025  8941 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:45.293308  8941 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:45.290711  1635 rpcz_store.cc:276] 0709 13:02:44.191817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.420429 (+228612us) service_pool.cc:224] Handling call
0709 13:02:44.463437 (+ 43008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.463664 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:02:44.483496 (+ 19832us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.233616 (+750120us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.281324 (+ 47708us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b18001edba0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06dae5cc0a 00007f06e459c219 00007f06daee4a40 00007f06daedf4e4 00007f06daedf455 00007f06ddfc7060 00007f06ddfd9716 00007f06ddfea287 00007f06ddfea208
0709 13:02:45.281639 (+   315us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.281824 (+   185us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:02:45.281875 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.281948 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.290118 (+  8170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23790,"prepare.queue_time_us":105984,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":55347,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":6055,"spinlock_wait_cycles":79626496,"thread_start_us":737665,"threads_started":1}
I20260709 13:02:45.294776  9677 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:45.296577  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:45.298368  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:45.300547  1635 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:02:45.314123  9511 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:45.161656  9632 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:45.219875  9640 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:45.318693  9632 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:45.306802  9737 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:45.310195  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:45.311861  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:45.305922  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:45.231598  9551 raft_consensus.cc:3060] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:45.320761  9719 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:45.321233  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:45.323047  9719 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:45.323541  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:45.324990  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:02:45.326654  9748 log.cc:927] Time spent T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:02:45.330588  9632 consensus_queue.cc:1059] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:45.332643  9632 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:02:45.333583  9632 raft_consensus.cc:2764] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:02:45.334730  9632 raft_consensus.cc:3055] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:45.335114  9632 raft_consensus.cc:740] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:45.335186  9483 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:45.338862  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:45.342967  9733 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:02:45.238248  9682 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:45.237015  9562 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.275432  9636 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:45.262981  1630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2974) took 1077 ms. Trace:
I20260709 13:02:45.360179  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:45.369937  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:45.365705  9287 consensus_meta.cc:287] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.798s	user 0.011s	sys 0.001s
W20260709 13:02:45.366226  9662 consensus_meta.cc:287] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 0.796s	user 0.005s	sys 0.005s
W20260709 13:02:45.366572  9585 consensus_meta.cc:287] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.001s
W20260709 13:02:45.372848  9490 consensus_meta.cc:287] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
W20260709 13:02:45.366734  9674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.015s	sys 0.024s
I20260709 13:02:45.230381  9699 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:45.357998  9269 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.391561  9511 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:45.390921  1630 rpcz_store.cc:276] 0709 13:02:44.185757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.418968 (+233211us) service_pool.cc:224] Handling call
0709 13:02:44.538471 (+119503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.538680 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:02:44.548340 (+  9660us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.116912 (+568572us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.116972 (+    60us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:02:45.117017 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.117087 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.262709 (+145622us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002fb7d0. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfce8ad 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:45.262891 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28597,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":101,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4747,"spinlock_wait_cycles":274045696,"thread_start_us":568204,"threads_started":1,"wal-append.queue_time_us":793955}
I20260709 13:02:45.426894  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:45.419948  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 498379us
W20260709 13:02:45.393702  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 161640us
I20260709 13:02:45.429973  1526 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:45.358865  9535 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:45.227231  1626 rpcz_store.cc:276] 0709 13:02:44.186319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.420421 (+234102us) service_pool.cc:224] Handling call
0709 13:02:44.457200 (+ 36779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.457467 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:44.467464 (+  9997us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.201709 (+734245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.201766 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:45.201810 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.201880 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.201995 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":109373,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":94,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":726676,"threads_started":1}
I20260709 13:02:45.418977   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:02:45.421031  9674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.016s	sys 0.025s
I20260709 13:02:45.437556  1526 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:45.440949  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 184459us
W20260709 13:02:45.442068  1674 leader_election.cc:336] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:45.443295  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:45.444036  1674 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:45.445233  1674 leader_election.cc:336] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:45.453217  1674 leader_election.cc:336] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.447765  1706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48150 (request call id 3110) took 1122 ms. Trace:
I20260709 13:02:45.395778  9562 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:45.495172  1674 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:45.501461  1674 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:45.502942  1674 leader_election.cc:336] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.503433  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:45.511106  1674 leader_election.cc:336] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.511778  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:45.515614  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 80327.5us
I20260709 13:02:45.409317  9287 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:45.517797  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:45.372488  9671 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:45.530843  9751 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:45.531257  9699 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:45.534427  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:45.535586  9562 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:45.536051  9743 log.cc:927] Time spent T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:02:45.455513  1706 rpcz_store.cc:276] 0709 13:02:44.325659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.325816 (+   157us) service_pool.cc:224] Handling call
0709 13:02:44.326195 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.326473 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:44.382536 (+ 56063us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.447346 (+1064810us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.447421 (+    75us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:45.447477 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.447552 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.447693 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":877,"prepare.queue_time_us":56326,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":125068,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":4921,"thread_start_us":1064404,"threads_started":2,"wal-append.queue_time_us":820287}
W20260709 13:02:45.538045  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 108769us
I20260709 13:02:45.425992  9490 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:45.543151  1707 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 23: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:45.546130  1627 raft_consensus.cc:1240] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:45.547370  9287 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:45.552227  9384 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:45.553207  9384 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:02:45.432003  9269 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:45.565095  9087 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:45.567510  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58716 (request call id 1620) took 1036 ms. Trace:
I20260709 13:02:45.567983  2264 rpcz_store.cc:276] 0709 13:02:44.531649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.531919 (+   270us) service_pool.cc:224] Handling call
0709 13:02:44.532291 (+   372us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:44.542892 (+ 10601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.542941 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:44.543672 (+   731us) log.cc:844] Serialized 52 byte log entry
0709 13:02:45.132994 (+589322us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:45.155475 (+ 22481us) log.cc:844] Serialized 14 byte log entry
0709 13:02:45.156039 (+   564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.160727 (+  4688us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.558463 (+397736us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b18002cbf60. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee2557 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:02:45.567169 (+  8706us) raft_consensus.cc:1685] finished
0709 13:02:45.567273 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.567443 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22413,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":2552,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":3024,"spinlock_wait_cycles":10173184,"thread_start_us":558421,"threads_started":1,"wal-append.queue_time_us":845062}
I20260709 13:02:45.576220  9636 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:45.578333  9490 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:45.578639  9535 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:45.581677  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:45.582144  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 68415.7us
I20260709 13:02:45.588213  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:45.589107  1706 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 23: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:45.589103  9682 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:45.407894  9662 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:45.591864  9663 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:45.592448  9663 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:45.593206  9662 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:45.594018  1629 raft_consensus.cc:1240] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:02:45.595544  9663 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:45.388636  9547 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:45.453219  9700 consensus_meta.cc:287] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: Time spent flushing consensus metadata: real 1.026s	user 0.011s	sys 0.002s
I20260709 13:02:45.422228  9585 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:45.528455  9753 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:02:45.528930  9744 log.cc:927] Time spent T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:02:45.529721  1526 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:45.604732  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:45.431746  9657 raft_consensus.cc:697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:45.437987  8966 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:45.639381  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 109714us
I20260709 13:02:45.598011  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:45.629952   431 tablet_replica.cc:333] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:45.634616  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:45.640383  1526 leader_election.cc:400] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20.
I20260709 13:02:45.640745  1526 leader_election.cc:403] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:02:45.641093  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:45.642156  1635 raft_consensus.cc:2468] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:45.643375  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:45.632370  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:45.637789  1700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.015s
W20260709 13:02:45.644687  1700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.000s	sys 0.015s
I20260709 13:02:45.647023  1629 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:45.525944  9640 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:45.652925  1524 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:45.635931  9641 consensus_meta.cc:287] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.000s
I20260709 13:02:45.656720  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:45.423020  9632 consensus_queue.cc:260] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:45.643741  9682 consensus_queue.cc:1059] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
W20260709 13:02:45.667761  1675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.012s	sys 0.005s
W20260709 13:02:45.675887  1675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.012s	sys 0.005s
W20260709 13:02:45.658430  9672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.024s	sys 0.041s
I20260709 13:02:45.654271  9753 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:45.658092  9674 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.719596  9765 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:45.723354  9671 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:45.723585  1633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 3184) took 1034 ms. Trace:
W20260709 13:02:45.711050  9672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.179s	user 0.024s	sys 0.041s
W20260709 13:02:45.726279  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.674547  9641 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:45.727162  9749 log.cc:927] Time spent T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:45.630369  9700 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:45.724184  9483 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:45.635602  9636 consensus_queue.cc:1059] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:02:45.730764  1633 rpcz_store.cc:276] 0709 13:02:44.689468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.739384 (+ 49916us) service_pool.cc:224] Handling call
0709 13:02:44.767109 (+ 27725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.772540 (+  5431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.772570 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.813055 (+ 40485us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.179871 (+366816us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:45.179939 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.180034 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.723382 (+543348us) raft_consensus.cc:1685] finished
0709 13:02:45.723404 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.723527 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5014,"raft.queue_time_us":5480,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":351570,"threads_started":1,"wal-append.queue_time_us":829639}
I20260709 13:02:45.735164  9765 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:45.748461  1704 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 21. Current term is 22. Ops: []
W20260709 13:02:45.751333  9758 log.cc:927] Time spent T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:45.749379  9636 raft_consensus.cc:493] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:45.717278  8966 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:02:45.662002  9524 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.008s	sys 0.008s
W20260709 13:02:45.769731  1709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.011s	sys 0.005s
I20260709 13:02:45.669807  9640 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:45.777508  1631 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:02:45.786058  2271 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 22. Current term is 23. Ops: []
I20260709 13:02:45.752264  9632 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:02:45.793334  1701 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.008s	sys 0.033s
W20260709 13:02:45.804539  1701 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.008s	sys 0.033s
I20260709 13:02:45.805640  1634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2982) took 1202 ms. Trace:
I20260709 13:02:45.806218  1634 rpcz_store.cc:276] 0709 13:02:44.603301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.610263 (+  6962us) service_pool.cc:224] Handling call
0709 13:02:44.610705 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.632559 (+ 21854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.632609 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.633156 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:02:45.200909 (+567753us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:45.200952 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.201027 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.805360 (+604333us) raft_consensus.cc:1685] finished
0709 13:02:45.805392 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.805551 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":567409,"threads_started":1,"wal-append.queue_time_us":1040260}
W20260709 13:02:45.785974  9665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.016s	sys 0.025s
W20260709 13:02:45.811843  9665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.016s	sys 0.025s
I20260709 13:02:45.752797  9753 raft_consensus.cc:2804] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:02:45.796926  1709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.012s	sys 0.005s
W20260709 13:02:45.775838  9524 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.009s	sys 0.008s
W20260709 13:02:45.760975  9364 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.008s	sys 0.007s
I20260709 13:02:45.732095  9087 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:02:45.772482  9682 raft_consensus.cc:3055] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:45.816560  1702 raft_consensus.cc:1275] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:02:45.734256  9674 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:45.832719  1629 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
W20260709 13:02:45.838124  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7270b72e069f42daa3f82eaa77d9e299 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 7e99891af85f4b10aa1cc2da6aa33082 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:45.839236  1443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 124614us
W20260709 13:02:45.841548  9742 log.cc:927] Time spent T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:02:45.771718  9636 raft_consensus.cc:515] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:45.823153  9364 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.009s	sys 0.008s
W20260709 13:02:45.817548  9563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.009s	sys 0.009s
I20260709 13:02:45.819960  9491 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:45.741472  9657 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:45.817404  9753 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.823858  9511 raft_consensus.cc:3055] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:02:45.823923  9551 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:45.830106  9682 raft_consensus.cc:740] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:45.850013  9563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.010s	sys 0.009s
W20260709 13:02:45.870318  1705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.020s	sys 0.059s
I20260709 13:02:45.856806  9511 raft_consensus.cc:740] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:45.882511  1705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.020s	sys 0.059s
I20260709 13:02:45.856113  9753 raft_consensus.cc:3060] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:45.868557  9585 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:45.876622  9236 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.009s	sys 0.016s
I20260709 13:02:45.926455  8941 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:45.941715  8941 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:45.941651  9768 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:02:45.963923  9700 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:45.984423  9780 log.cc:927] Time spent T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:02:45.934610  9682 consensus_queue.cc:260] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:45.992321  9640 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:45.978442  9763 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:02:45.999219  9682 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:46.002511  9674 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:46.024524  9775 log.cc:927] Time spent T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:02:46.027659  9774 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:02:46.034942  9777 log.cc:927] Time spent T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:02:46.037808  9779 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:02:46.043844  9770 log.cc:927] Time spent T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:46.010972  9636 leader_election.cc:290] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:45.962568  9641 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:46.076651  9753 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:46.141391  1600 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 115 similar messages]
W20260709 13:02:46.145991  1628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.000s	sys 0.027s
W20260709 13:02:46.280128  1628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.000s	sys 0.028s
W20260709 13:02:46.170857  1673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.006s	sys 0.005s
W20260709 13:02:46.174933  1674 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:46.194521  1705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1594) took 1069 ms. Trace:
I20260709 13:02:46.195058  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:46.198709  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:46.194614  1701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1593) took 1096 ms. Trace:
I20260709 13:02:46.204257  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:46.209180  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.208969  9258 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.210665  9287 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:46.211017  9364 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.215140  2268 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:02:46.216508  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:45.943195  9236 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.012s	sys 0.016s
W20260709 13:02:46.218815  9490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.006s	sys 0.034s
I20260709 13:02:46.220921  1631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2971) took 2036 ms. Trace:
I20260709 13:02:46.210891  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:46.228650  1708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48150 (request call id 3134) took 1418 ms (client timeout 1883 ms). Trace:
I20260709 13:02:46.229390  8941 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:46.230440  9211 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:46.231688  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:46.237872  1672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.290125  1673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.007s	sys 0.006s
W20260709 13:02:46.245548  9529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.003s	sys 0.024s
I20260709 13:02:46.245328  9269 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:46.295740  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 749493us
W20260709 13:02:46.296849  9529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.003s	sys 0.025s
I20260709 13:02:46.298413   431 raft_consensus.cc:2243] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:02:46.301654  1706 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 25: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:46.303125  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:46.304272  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:46.304996  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:46.305287  1632 raft_consensus.cc:2393] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 25: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:46.306274  1627 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 23: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:46.306757  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:46.308852  9287 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.310647  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:46.281608  1701 rpcz_store.cc:276] 0709 13:02:45.098290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.098437 (+   147us) service_pool.cc:224] Handling call
0709 13:02:45.098756 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.099024 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:02:45.804953 (+705929us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.193561 (+388608us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.193710 (+   149us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:46.193860 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.194017 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.194365 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28597,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":93785,"thread_start_us":1072720,"threads_started":2,"wal-append.queue_time_us":228336}
I20260709 13:02:45.956142  9511 consensus_queue.cc:260] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:46.320529  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 81213.2us
W20260709 13:02:46.313628  9632 consensus_meta.cc:287] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.005s
I20260709 13:02:46.281279  1705 rpcz_store.cc:276] 0709 13:02:45.125382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.125645 (+   263us) service_pool.cc:224] Handling call
0709 13:02:45.126000 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.126302 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:02:45.127987 (+  1685us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.193416 (+1065429us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.193581 (+   165us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:02:46.193750 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.193892 (+   142us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.194230 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":311189,"prepare.queue_time_us":54009,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":399523,"thread_start_us":754747,"threads_started":1,"wal-append.queue_time_us":840932}
I20260709 13:02:46.321717  9511 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:46.323179  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:46.324270  1626 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:46.326320  9753 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:46.326493  1628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 3191) took 1184 ms. Trace:
I20260709 13:02:46.326879  1628 rpcz_store.cc:276] 0709 13:02:45.142646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.328026 (+185380us) service_pool.cc:224] Handling call
0709 13:02:45.328363 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.328587 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.328612 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:45.329116 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.325967 (+996851us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:02:46.326054 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.326188 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.326233 (+    45us) raft_consensus.cc:1685] finished
0709 13:02:46.326244 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.326439 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":951282,"threads_started":1,"wal-append.queue_time_us":548981}
I20260709 13:02:46.329264  9211 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.330480  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:46.332165  9211 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:46.331841  8966 consensus_meta.cc:287] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.531s	user 0.018s	sys 0.010s
I20260709 13:02:46.333668  8966 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for earlier term 19. Current term is 20.
I20260709 13:02:46.335121  9269 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:46.335979  9269 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:46.337706  1704 raft_consensus.cc:3060] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:46.339200  9269 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:46.315533  9258 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:46.343597  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 202370us
I20260709 13:02:46.331902  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:46.289132  1631 rpcz_store.cc:276] 0709 13:02:44.183800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.415154 (+231354us) service_pool.cc:224] Handling call
0709 13:02:44.460636 (+ 45482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.799080 (+1338444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.219963 (+420883us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540006c2d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfcfe01 00007f06ddfce83e 00007f06e2f93419 00007f06dc50abd4 00007f06dc50ab62 00007f06dc50aa91 00007f06dc50aa0c 00007f06dc509cc2 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:46.220617 (+   654us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3026319616}
W20260709 13:02:46.289474  1708 rpcz_store.cc:269] 0709 13:02:44.809621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.810076 (+   455us) service_pool.cc:224] Handling call
0709 13:02:46.227961 (+1417885us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001ab8d4. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf38571 00007f06ddfd32fa 00007f06e2f94b17 00007f06dc50f6d4 00007f06dc50f662 00007f06dc50f591 00007f06dc50f50c 00007f06dc50e7c2 00007f06dc30a48c 00007f06dc3098c6 00007f06dc30926f
0709 13:02:46.228312 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2449059584}
I20260709 13:02:46.355901  8941 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:46.347311  9490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.006s	sys 0.035s
W20260709 13:02:46.362248  1523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.000s	sys 0.028s
W20260709 13:02:46.365962  1523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.000s	sys 0.029s
I20260709 13:02:46.366348  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:46.370569  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:46.370900  9547 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:46.371188  8966 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.371968  8966 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.372942  9364 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.374585  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:46.375778  2264 raft_consensus.cc:2393] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 23: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:46.376066  9364 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:46.376608  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 55256.1us
I20260709 13:02:46.380587  8966 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:46.392168   431 pending_rounds.cc:70] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Trying to abort 1 pending ops.
I20260709 13:02:46.395354  1704 raft_consensus.cc:2468] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:02:46.371934  9547 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.398818   431 pending_rounds.cc:77] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031: Aborting op as it isn't in flight: id { term: 27 index: 16 } timestamp: 7305634470245281792 op_type: NO_OP noop_request { }
W20260709 13:02:46.403151  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 228460us
I20260709 13:02:46.405242  9562 consensus_queue.cc:1048] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:46.408888  9258 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:46.414991  1524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.002s	sys 0.023s
W20260709 13:02:46.401804  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.418936   431 raft_consensus.cc:2889] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 27 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260709 13:02:46.422124  1524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.003s	sys 0.024s
W20260709 13:02:46.423381  1526 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.018s	sys 0.009s
W20260709 13:02:46.427868  1526 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.018s	sys 0.010s
W20260709 13:02:46.432576  1600 leader_election.cc:336] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:46.438385  1626 raft_consensus.cc:2468] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:46.440230   431 raft_consensus.cc:2272] T 3fe250573e1c4fdd9d93dbaaa494b367 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:46.432179  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 778930us
W20260709 13:02:46.435988  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 786098us
I20260709 13:02:46.445808  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:46.451902  9493 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.232s	user 0.007s	sys 0.019s
W20260709 13:02:46.452319  9493 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.244s	user 0.007s	sys 0.019s
I20260709 13:02:46.454960  1635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42252 (request call id 2989) took 1127 ms. Trace:
I20260709 13:02:46.455416  1635 rpcz_store.cc:276] 0709 13:02:45.327541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.646005 (+318464us) service_pool.cc:224] Handling call
0709 13:02:45.646429 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:45.655414 (+  8985us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:45.711489 (+ 56075us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.147117 (+435628us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.148219 (+  1102us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.148420 (+   201us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:46.148475 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.148576 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.454574 (+305998us) raft_consensus.cc:1685] finished
0709 13:02:46.454599 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.454771 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65009,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":106401,"raft.run_cpu_time_us":575,"raft.run_wall_time_us":20582,"thread_start_us":419079,"threads_started":1,"wal-append.queue_time_us":297761}
W20260709 13:02:46.457795  1524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.459038  9788 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:46.459770  9788 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:46.462332  9788 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:46.463297  1601 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:46.463487  9788 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:02:46.467941  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:46.468206  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:46.468721  1705 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 27.
I20260709 13:02:46.468883  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:46.470474  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:46.477090  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 44240.5us
I20260709 13:02:46.477381  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:46.480347  9765 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:46.468681  9258 raft_consensus.cc:2804] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:46.473663  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:46.473843  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:46.487790  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:46.490458  1702 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:02:46.501706  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:46.504487  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:02:46.514000  1626 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:02:46.490985  9258 raft_consensus.cc:697] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:46.520020  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:46.518702  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:46.527103  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 52807.8us
I20260709 13:02:46.516914  9788 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:46.528754  9493 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:46.533149  1526 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:46.550679  9287 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:46.566682  9802 log.cc:927] Time spent T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:02:46.568549  9547 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:46.569420  1700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36040 (request call id 1592) took 1471 ms. Trace:
I20260709 13:02:46.569849  1700 rpcz_store.cc:276] 0709 13:02:45.097830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.097958 (+   128us) service_pool.cc:224] Handling call
0709 13:02:45.106603 (+  8645us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:45.645099 (+538496us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:02:45.738431 (+ 93332us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.189523 (+451092us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.189974 (+   451us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:46.191647 (+  1673us) log.cc:844] Serialized 52 byte log entry
0709 13:02:46.191817 (+   170us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:02:46.192117 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.192384 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.192572 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.406726 (+214154us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b18000ae940. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f
0709 13:02:46.408402 (+  1676us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b48001e0258. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:02:46.527360 (+118958us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b18000ae940. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f
0709 13:02:46.528380 (+  1020us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b48001e0258. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e2ef8aa1 00007f06e2eefb37 00007f06e2eef9ca 00007f06e2fe726f 00007f06e2fe6f37 00007f06e2ffb55c 00007f06e2ffb508 00007f06e2ffb488 00007f06e2ffb443 00007f06e2ffa6ec 00007f06e1f24a96
0709 13:02:46.552122 (+ 23742us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b18000ae940. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1
0709 13:02:46.553623 (+  1501us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b18000ae940. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daee23f3 00007f06daee47c1 00007f06daee4779 00007f06daee4709 00007f06daee46d1 00007f06daee39cd 000000000038f354 000000000038f199 00007f06daec583a
0709 13:02:46.567197 (+ 13574us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b18000ae940. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06e3daade1 00007f06e3db75b1 00007f06daeb02a6 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dad689c4 00007f06dad66acb 00007f06daf21dc9
0709 13:02:46.569063 (+  1866us) raft_consensus.cc:1685] finished
0709 13:02:46.569082 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.569253 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2836,"prepare.queue_time_us":237574,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":82,"raft.queue_time_us":250010,"raft.run_cpu_time_us":7564,"raft.run_wall_time_us":412025,"spinlock_wait_cycles":394551296,"thread_start_us":915515,"threads_started":2,"wal-append.queue_time_us":260974}
W20260709 13:02:46.569840  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 96185us
I20260709 13:02:46.547863  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:46.578544  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:46.579425  2263 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 27.
W20260709 13:02:46.548291  1674 leader_election.cc:336] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:46.586452  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:46.587772  9563 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:02:46.589773  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 66105.8us
W20260709 13:02:46.591001  1674 leader_election.cc:336] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:46.607972  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:46.666728  9563 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:46.595607   431 tablet_replica.cc:333] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:46.598676  9258 consensus_queue.cc:237] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:46.607308  9682 consensus_meta.cc:287] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.553s	user 0.006s	sys 0.015s
I20260709 13:02:46.610534  9632 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:02:46.613744  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 99839us
I20260709 13:02:46.616343  9547 raft_consensus.cc:3060] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:02:46.594174  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 173609us
I20260709 13:02:46.639034  9493 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:46.640429  9211 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.646713  1599 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:46.651854  2234 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:46.657745  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:46.664664  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:46.687189  1526 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:46.689020  1526 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:46.696120  1626 raft_consensus.cc:1240] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 22. Current term is 23. Ops: []
W20260709 13:02:46.699123  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 47386.5us
I20260709 13:02:46.731393  1627 raft_consensus.cc:1275] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:02:46.700778  9788 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:46.677134  9563 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:46.730176  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:46.702481  9511 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:02:46.755617  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 109082us
I20260709 13:02:46.694666  9211 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:46.776289  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 46275.6us
I20260709 13:02:46.778298  9787 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:46.778198  9563 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.780758  9563 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:46.781738  8941 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:46.781884  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:46.782644  1633 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 27.
W20260709 13:02:46.763574  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:46.768620  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.752674  9805 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:46.782385  8941 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.783911  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:46.785257  8941 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:46.767122  9665 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.785993  9665 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:46.788618  9665 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:46.790218  9672 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 13:02:46.791788  9672 raft_consensus.cc:3055] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:46.792244  9672 raft_consensus.cc:740] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:46.794154  9677 raft_consensus.cc:2804] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:46.794339  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:46.796388  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:46.799098   431 raft_consensus.cc:2243] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:46.800783   431 raft_consensus.cc:2272] T 01508a4751a04c12a68c8570eb4d2e7f P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:46.802297  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:46.796483  9632 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:02:46.802702  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 211664us
W20260709 13:02:46.803491  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 45830.8us
I20260709 13:02:46.803561  9369 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:02:46.803829  1674 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:46.804351  1599 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:46.804530  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:46.805294  9662 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:46.805368  1599 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:46.806277  9369 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:46.813980  9493 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.813865  1451 catalog_manager.cc:5697] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 15 to 16, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.816563  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:46.816327  1451 catalog_manager.cc:5697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 16 to 21, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.818167  9632 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.818557  9491 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:46.818656  9632 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.819267  9491 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:46.820472  9491 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.821934  9699 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader pre-election won for term 28
W20260709 13:02:46.822507  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 133603us
I20260709 13:02:46.822942  9699 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.823364  9699 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:02:46.824142  1526 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:46.825373  9789 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 13:02:46.826390  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 69226.7us
I20260709 13:02:46.839001  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:46.794975  9677 raft_consensus.cc:697] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:46.777930  9211 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:46.842501  9491 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:46.793457  9672 consensus_queue.cc:260] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.860602  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca9a7e99a249b3820b6df8c497bfde" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:46.875273  2235 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.526s (SENT)
W20260709 13:02:46.877815  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.850364  9805 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:46.887662  2268 pending_rounds.cc:85] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Aborting all ops after (but not including) 16
I20260709 13:02:46.834056  9753 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:02:46.892580  2266 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:02:46.892395  9677 consensus_queue.cc:237] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.852213  9788 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:02:46.897109  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:46.888281  2268 pending_rounds.cc:107] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:02:46.883977  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:46.852433  9662 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:46.877210  9665 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:02:46.916433  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 81480.2us
I20260709 13:02:46.917901  2268 raft_consensus.cc:2889] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:46.926600  1600 leader_election.cc:336] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:46.922683  1526 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:46.932308  1600 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:46.915196  9563 consensus_queue.cc:1059] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 13:02:46.929947  9632 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:46.951053  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:46.954241  8941 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:46.950969  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:46.952292  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.965095  9671 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.965765  9671 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.968223  9719 consensus_queue.cc:1048] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.081s
I20260709 13:02:46.942709  9682 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.977010  9682 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.960260  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:46.964046  1524 leader_election.cc:304] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:46.934002  9805 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:46.982728  9562 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:46.957250  9662 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:47.007674  8966 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:47.024941  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 60886us
W20260709 13:02:47.034693  1673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.070724  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 195540us
W20260709 13:02:47.078719  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 191733us
I20260709 13:02:47.088752  9788 raft_consensus.cc:2749] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:47.122390  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 163868us
I20260709 13:02:47.087464  9682 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:47.129446  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 48244.5us
I20260709 13:02:47.130851  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:47.134756  1600 leader_election.cc:336] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:47.140453  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.127023   431 tablet_replica.cc:333] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:47.154664  9699 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.155762   431 raft_consensus.cc:2243] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:47.155001  9829 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:02:47.156464   431 raft_consensus.cc:2272] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:47.128612  9511 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.161792  9511 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.164479  9833 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:47.165118  9833 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:47.168958  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 303771us
W20260709 13:02:47.174998  9817 log.cc:927] Time spent T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 13:02:47.179179  9821 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:02:47.179991  9826 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:02:47.181779  9823 log.cc:927] Time spent T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:02:47.184715  9822 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 13:02:47.189529  9815 log.cc:927] Time spent T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 13:02:47.189920  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 98700.9us
W20260709 13:02:47.190820  1600 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:47.192150  1600 leader_election.cc:336] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:47.192528  1600 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.193591  9800 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:47.167846  9511 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:47.200768  9818 log.cc:927] Time spent T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.160s	user 0.001s	sys 0.001s
W20260709 13:02:47.201107  9816 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:02:47.205935  9662 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:47.206514  9805 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:47.206929  9832 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:47.208810  9547 consensus_meta.cc:287] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: Time spent flushing consensus metadata: real 0.524s	user 0.002s	sys 0.011s
W20260709 13:02:47.205629  1600 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:47.207509  9832 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.210536  1600 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.214898  9832 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:47.220055  9805 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:02:47.209288  9547 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:02:47.222146  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.221163  1526 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:47.227936  9672 raft_consensus.cc:3060] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:47.231166  9547 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:47.240547  9789 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:47.241238  9789 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:47.256095  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 57106.5us
W20260709 13:02:47.269534  9820 log.cc:927] Time spent T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:02:47.270975  9832 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.272395  9831 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:02:47.274391  2235 leader_election.cc:336] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.935s (SENT)
I20260709 13:02:47.263410   431 tablet_replica.cc:333] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:47.279239  2235 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.275003  9547 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:47.288203  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 148655us
I20260709 13:02:47.289320  8941 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:02:47.286448  1600 leader_election.cc:336] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:47.298300  1600 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.303342  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.300360  9547 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.292268  9662 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:47.294392  9800 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:47.327262  9800 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:47.330478  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 56130.3us
I20260709 13:02:47.301805  9831 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.335354  9831 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:47.335724  9699 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:47.336881  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 54935.2us
W20260709 13:02:47.337962  9836 log.cc:927] Time spent T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.002s
I20260709 13:02:47.337980  1526 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:47.340305  1526 raft_consensus.cc:2686] T 9ffc7074d09d4b0a8caf498542f3e843 P 87144ea1a4a14ab8b942fb426159f031: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:47.341682  9087 consensus_queue.cc:1059] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:47.342830  9087 raft_consensus.cc:3055] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:02:47.343183  9087 raft_consensus.cc:740] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
W20260709 13:02:47.343843  1525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.344002  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 274943us
I20260709 13:02:47.344857  9087 consensus_queue.cc:260] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.316464  9805 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:47.347450  9087 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:47.351418  9547 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:47.358106  9833 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:47.358829  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.359951  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:47.360180  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 81894.8us
I20260709 13:02:47.360605  1633 raft_consensus.cc:2468] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
W20260709 13:02:47.361088  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:47.361189  9671 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:47.361701  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:47.362319  1708 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 27.
I20260709 13:02:47.362591  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:47.363241  1707 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:47.364290  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:47.364907  1700 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:47.365578  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:47.365973  9547 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:47.318951  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.286115  9832 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:47.366611  9547 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.368251  9832 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:47.325373  9662 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.369293  1627 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:02:47.372575  9756 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:47.373205  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:47.374471  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.373206  9756 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.376056  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:47.376678  2265 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:02:47.377264  9756 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:47.379724  9789 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:47.329742  9800 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:47.382719  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.384392  1524 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:47.401918  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.406106  2265 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 28.
I20260709 13:02:47.406687  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:47.407883  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:47.408988  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:47.411115  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.411892  2264 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 17.
W20260709 13:02:47.415148  2235 leader_election.cc:336] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 1.949s (SENT)
I20260709 13:02:47.415701  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.418073  9831 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:47.421032  1526 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:47.373229  9662 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:47.401160  1674 leader_election.cc:336] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:47.375594  9547 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:47.426535  1674 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.423002  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:47.425056  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:47.433497  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:47.435292  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.452381  8941 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:47.452841  8941 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:47.453245  8941 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:47.456522  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.458060  1526 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:47.458238  9719 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:47.459080  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:47.403754  9832 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:47.460820  9491 consensus_meta.cc:287] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: Time spent flushing consensus metadata: real 0.611s	user 0.010s	sys 0.003s
I20260709 13:02:47.464203  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:47.468868  1524 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:47.468803  9547 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 13:02:47.498241  9839 log.cc:927] Time spent T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:02:47.469324  9787 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:47.498947   431 raft_consensus.cc:2243] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:47.499136  9751 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:02:47.499778   431 raft_consensus.cc:2272] T 2c340bead2014c39bd9825dce2602d61 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:47.500174  9834 raft_consensus.cc:2804] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:47.500754  9834 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:47.501237  9834 raft_consensus.cc:3060] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:47.502156  8941 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.504072  8941 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:47.519152   431 tablet_replica.cc:333] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:47.520949   431 raft_consensus.cc:2243] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:47.523268  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 137809us
W20260709 13:02:47.525770  2235 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 2.124s (SENT)
W20260709 13:02:47.527429  1674 leader_election.cc:336] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:47.527660  2235 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Timed out: RequestConsensusVote RPC to 127.0.107.193:39635 timed out after 2.132s (SENT)
I20260709 13:02:47.527876  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.530509  9788 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.531206  9788 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:47.535846  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:47.536739  1628 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 25.
I20260709 13:02:47.538607  9756 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:02:47.540429  1674 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:47.541083  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.521971   431 raft_consensus.cc:2272] T 5336feea1c174b498bc0252f726f9461 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:47.541924  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:47.533931  9788 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:47.549321  9547 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:02:47.562407  1674 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:47.572487  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:47.557777  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 195993us
I20260709 13:02:47.573594  9269 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:47.558494  9756 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:02:47.574080  9547 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.604038  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:47.604871  1708 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:02:47.600714  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 111390us
W20260709 13:02:47.608044  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:47.601686  1674 leader_election.cc:336] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:47.609061  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.606734  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:47.610368  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:47.591388  9547 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:02:47.611514  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 126327us
W20260709 13:02:47.666074  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 55062.1us
I20260709 13:02:47.668800  2236 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:47.670351  9211 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:47.676342  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:47.680769  1524 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:47.664410  9800 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.681716  9753 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:47.682228  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:47.682859  1709 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:02:47.682926  1705 raft_consensus.cc:1275] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:02:47.663956  9830 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.690624  9830 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:47.686988  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:47.693250  9830 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:47.694787  9671 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:47.664345  9269 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:47.695199  9671 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:47.695595  9671 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:02:47.661266  9821 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:47.684588  9677 raft_consensus.cc:2764] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Leader pre-election decision vote started in defunct term 27: won
I20260709 13:02:47.677816  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:47.681856  9800 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.707968  9800 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:47.708995  1634 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:47.720327  1601 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:47.721266  9700 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:47.721649  9700 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:02:47.722012  9700 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:47.726884  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:47.723299  9834 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:47.732208  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 130472us
W20260709 13:02:47.667140  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:47.737004  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 97720us
I20260709 13:02:47.737425  1708 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 28.
W20260709 13:02:47.733397  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:47.730279  9493 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:47.756382  2264 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: []
I20260709 13:02:47.752745  9493 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.760766  9493 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:47.761197  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:47.761934   431 tablet_replica.cc:333] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:47.762984   431 raft_consensus.cc:2243] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:47.763491  1701 raft_consensus.cc:2410] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for term 24 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:02:47.763839   431 raft_consensus.cc:2272] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:47.766139  1600 leader_election.cc:336] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:47.766638  1600 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.767815  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.771998  9493 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.775435  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.776060  9493 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:47.777104  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.777977  2265 raft_consensus.cc:2368] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 23. Current term is 24.
I20260709 13:02:47.784323  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:47.785602  1674 leader_election.cc:336] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:47.787307  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.787842  9853 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:47.789268  9483 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:47.790362  9719 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:47.791349  9833 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:47.792606  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:47.794607  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:47.791392  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.794735  9562 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:02:47.747802  9665 consensus_queue.cc:1048] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:02:47.795964  9805 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:02:47.799057  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:47.814729  1599 leader_election.cc:400] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 23. Current term is 24.
I20260709 13:02:47.807156   431 tablet_replica.cc:333] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
W20260709 13:02:47.813450  1674 leader_election.cc:336] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:47.815564  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.850423  9830 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.850966   431 raft_consensus.cc:2243] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:47.851161  9830 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.851656   431 raft_consensus.cc:2272] T 7ddb83400fc244a9ba5283309591785d P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:47.853525  9830 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:47.856145  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:47.859555  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 46224.3us
I20260709 13:02:47.807058  9563 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:47.861755  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 94552.5us
I20260709 13:02:47.812115  9562 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
W20260709 13:02:47.866747  1674 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:47.869076  9671 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.870862  2270 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 24. Current term is 25. Ops: []
I20260709 13:02:47.872932  9787 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.865906  9563 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.877092  9563 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:47.874945  9787 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.867565  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:47.863337  9491 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:47.883773  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:47.886371  2236 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:47.887655  9087 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.888155  9087 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:02:47.888583  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 161069us
I20260709 13:02:47.889004  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:47.891357  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.891335  1632 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:02:47.894757  1708 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:02:47.907573  1705 raft_consensus.cc:1275] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:02:47.911164  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:47.937295  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:47.899075  9211 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:47.904570  9483 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:47.950939  1632 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 20.
I20260709 13:02:47.953370  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:47.987636  1705 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:47.956511  8941 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:02:47.959048  9671 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:47.959565  9087 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:47.960322  9562 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 28, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:47.988433  1524 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:47.965123  9855 log.cc:927] Time spent T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:47.911571   431 tablet_replica.cc:333] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:48.002044  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.003394  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:48.004398  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.005398  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.006477  1703 raft_consensus.cc:2410] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 27 because replica has last-logged OpId of term: 26 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 16.
I20260709 13:02:48.007321  9753 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:48.007839  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:48.008656  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:48.007309  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:47.948477  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:48.007359  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:48.010185  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 65321.1us
I20260709 13:02:48.010886  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.011668  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.012068  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.012853  1704 raft_consensus.cc:2468] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 18.
I20260709 13:02:48.013281  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.009804  1703 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 25.
I20260709 13:02:48.009830  1708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:47.983189  9700 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.013803  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.021173  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:48.021997  1700 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:48.012193  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:48.023238  1706 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 27. Current term is 28. Ops: []
I20260709 13:02:47.900709  9830 consensus_queue.cc:1059] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
I20260709 13:02:48.034071  1708 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
W20260709 13:02:48.014295  9842 log.cc:927] Time spent T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:02:48.043641  1702 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:48.043874  1628 raft_consensus.cc:3060] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:48.065503  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:47.984859  9547 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:48.086229  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.055367  9529 consensus_queue.cc:1059] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 13:02:48.091504  9529 raft_consensus.cc:3055] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:02:48.092051  9529 raft_consensus.cc:740] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:48.096685  9834 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:48.100019  1526 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:48.101550  1526 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:48.102213  9087 raft_consensus.cc:3055] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:48.136564  9087 raft_consensus.cc:740] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:48.104799  9788 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:02:48.106298  8941 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:02:48.093254  9529 consensus_queue.cc:260] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.109210  9853 consensus_queue.cc:1048] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:02:48.081910  9672 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.111982   431 raft_consensus.cc:2243] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:48.119386  9787 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:48.120640  1700 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:02:48.126724  1632 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:02:48.128386  1702 raft_consensus.cc:2468] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 25.
I20260709 13:02:48.131112  9547 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:48.131235  1628 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:48.138162  1526 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:48.139124  1524 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:48.133697  2235 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.155948  1526 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:48.154300  2235 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:48.158331  8941 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:02:48.158674  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 110231us
I20260709 13:02:48.158854  9788 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:02:48.161369  1674 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.162406  9087 consensus_queue.cc:260] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.163935  9087 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:48.165684  9845 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.161932  2235 leader_election.cc:336] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.170593  2235 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:48.170431  9845 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.171327  9364 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:48.167630  9547 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:02:48.173379  9845 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:48.173736  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7270b72e069f42daa3f82eaa77d9e299 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 7e99891af85f4b10aa1cc2da6aa33082 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:48.157804  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:48.174206  9547 raft_consensus.cc:2804] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:02:48.175383  9547 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.175745  9547 raft_consensus.cc:3060] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:48.179064  9700 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:48.180397  9529 raft_consensus.cc:3060] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:48.186519  1524 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:48.148644  9834 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:02:48.191772  2234 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:48.186839  1703 raft_consensus.cc:1240] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 24. Current term is 25. Ops: [24.18-24.18]
I20260709 13:02:48.194527  9834 raft_consensus.cc:2706] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Received election callback for term 20 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:02:48.195317  9853 raft_consensus.cc:2804] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:48.195461  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:48.195926  9853 raft_consensus.cc:697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 24 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:48.196628  2267 raft_consensus.cc:2410] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87144ea1a4a14ab8b942fb426159f031 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 13:02:48.196878  9853 consensus_queue.cc:237] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.202060  9269 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:48.151762  9672 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.209383  9672 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:48.158393  9852 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:02:48.214880  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:48.215507  1523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.223572  1705 raft_consensus.cc:2468] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:48.230494  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:48.238732  1628 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
W20260709 13:02:48.239539  1674 leader_election.cc:336] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.240880  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:48.168671  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:48.190376  9547 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:48.244323  9563 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.256809  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:48.262132  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:48.258679  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:48.256470  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 87830.8us
I20260709 13:02:48.263892  1702 raft_consensus.cc:2368] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 23. Current term is 24.
I20260709 13:02:48.267225  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:48.267831  1632 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:48.270993   431 raft_consensus.cc:2272] T af202c0dfac940fb86d9d9d0a9124f44 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:48.292560  1601 leader_election.cc:400] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 23. Current term is 24.
I20260709 13:02:48.292943  1601 leader_election.cc:403] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:02:48.295069  1526 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:48.232273  9852 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.298394  1524 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:48.269869  9719 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:02:48.269778  9751 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:48.292227  9483 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:48.270298  9563 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:48.365929  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 171429us
I20260709 13:02:48.368414  9087 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:02:48.371483  1600 leader_election.cc:336] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.372287  9087 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.344511  9483 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.371951  1600 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:48.334880  9805 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 23. Current term is 24.
W20260709 13:02:48.377985  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 113970us
I20260709 13:02:48.379081  1526 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:48.361879  9832 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:48.380162  9483 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:48.383210  1526 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:48.389138  1600 leader_election.cc:336] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.369700  9787 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:48.400658  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:48.413049  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 305209us
I20260709 13:02:48.384461  9830 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:48.419025  9087 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:48.420051  1526 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:48.384624  9700 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:48.439919  2236 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:48.410792  9788 raft_consensus.cc:2804] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:48.442668  1526 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:48.444410  1600 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.468590  1600 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:48.465013  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:48.471264  1628 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 19: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:48.445250  9787 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:48.475893  2236 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
W20260709 13:02:48.482632  1526 raft_consensus.cc:2686] T 9b989fc00ec242a59fb2167b2255b3a8 P 87144ea1a4a14ab8b942fb426159f031: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:48.437155  9832 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.035s
I20260709 13:02:48.468294  9788 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:02:48.519038  1700 raft_consensus.cc:1240] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Rejecting Update request from peer 87144ea1a4a14ab8b942fb426159f031 for earlier term 18. Current term is 19. Ops: []
W20260709 13:02:48.526888  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 82477.5us
I20260709 13:02:48.530637  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:48.487648  9547 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:48.532670  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:48.533396  1707 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:48.480329  9871 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.483659  9873 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:02:48.544266  9880 log.cc:927] Time spent T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:02:48.544173  9871 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.487567  9211 raft_consensus.cc:2804] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:48.528348  9788 raft_consensus.cc:3060] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:48.552013  1632 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 26.
W20260709 13:02:48.553328  2235 leader_election.cc:336] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:48.559275  2235 leader_election.cc:336] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.559710  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:48.560832  2235 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.563673   431 tablet_replica.cc:333] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:48.564970   431 raft_consensus.cc:2243] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:48.565706   431 raft_consensus.cc:2272] T 660b57178c7f4ffebd30c42df43b303a P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:48.546936  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:48.566370  2263 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 18.
I20260709 13:02:48.568125  9871 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:48.568739  9853 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:02:48.561780  2235 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.575002  9493 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:02:48.575269  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:48.575680  9493 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.570256  9211 raft_consensus.cc:697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 25 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:48.578393  9493 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:48.581007  2235 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.577692  9211 consensus_queue.cc:237] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.534317  9852 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:48.583287  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:48.584939  9872 log.cc:927] Time spent T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:02:48.588848  2235 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.592444  9364 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:48.592957  1707 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 26.
W20260709 13:02:48.593663  2235 leader_election.cc:336] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:48.596100  2235 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.596843   431 tablet_replica.cc:333] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:48.598284   431 raft_consensus.cc:2243] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:48.599046   431 raft_consensus.cc:2272] T f981c1c6e2c5466395ecd385d6b24151 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:48.603453  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:48.590330  9867 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:02:48.609156  1524 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:48.594015  9563 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:48.635528  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:48.615327  9873 raft_consensus.cc:697] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:48.626443  9753 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:02:48.650625  9753 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 26 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:48.655663  9753 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:48.659516  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.669986  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.676872  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:48.679822  1524 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:48.681123  9832 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:48.647212  9483 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.678432   431 tablet_replica.cc:333] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:48.720008  9873 consensus_queue.cc:237] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:48.722764  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 59543.4us
I20260709 13:02:48.723234  1707 raft_consensus.cc:2368] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20.
I20260709 13:02:48.724959  9483 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:48.727326   431 raft_consensus.cc:2243] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:48.736459  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:48.738159  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:48.739745  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:48.740338  2267 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:02:48.754359  1700 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:02:48.758083  2270 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:02:48.762355  1526 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:48.764534  9547 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:02:48.777011  2267 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:48.697865  9788 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.787983   431 raft_consensus.cc:2272] T ff5a03f3312f4e6bac9383280b5b9131 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:48.800365  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 158686us
I20260709 13:02:48.802845  9753 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.803649  9753 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.806133  9860 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:48.806733  9860 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:48.808959  9860 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:48.811648   431 tablet_replica.cc:333] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:48.812723   431 raft_consensus.cc:2243] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:48.808988  9878 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.280s	user 0.003s	sys 0.000s
I20260709 13:02:48.813392   431 raft_consensus.cc:2272] T 02b42bc07b3d4b49afb7d3e929183dd2 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:48.836048  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:48.845516  2236 leader_election.cc:400] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20.
I20260709 13:02:48.846100  2236 leader_election.cc:403] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:48.846782  9493 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513) with higher term. Message: Invalid argument: T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 for earlier term 19. Current term is 20.
I20260709 13:02:48.851270   431 tablet_replica.cc:333] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:48.852418   431 raft_consensus.cc:2243] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:48.853076   431 raft_consensus.cc:2272] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:48.856467  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:48.857052  9699 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:48.862682  1626 raft_consensus.cc:1275] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 13:02:48.866521  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 129412us
W20260709 13:02:48.864954  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:48.870452  1634 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:48.866892  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:48.817715  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.833364  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:02:48.874981  1600 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.832137  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:48.883344  1709 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 23.
I20260709 13:02:48.885087  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:48.884930  1600 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:48.886101  1674 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:48.886649  1600 leader_election.cc:336] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.886924  1674 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:48.884374  2268 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 22.
I20260709 13:02:48.887190  1600 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:48.820255  9753 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:48.906647  1704 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:02:48.908004  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:48.891542  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:48.827838  9788 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:48.927104  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:48.888703  9845 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:48.830439  9853 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.096s
I20260709 13:02:48.911911  9483 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:48.906327  9805 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:02:48.922588  9881 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:48.939131  9529 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.981249  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 76146.5us
I20260709 13:02:48.928531  9787 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.978241  2235 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:48.965723  9788 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:48.990229  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:48.985055  1526 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:48.987545  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:48.988415  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:48.991770  1707 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 23: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:48.998912  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:49.000061  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 106744us
W20260709 13:02:49.000805  1600 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:49.007400  1600 leader_election.cc:336] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:49.005764  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 72975.3us
I20260709 13:02:49.009002  9087 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:49.009569  9087 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.009970  9087 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:49.014539  2234 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:48.979599  9845 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:49.007951  1600 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:49.043381  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 107786us
I20260709 13:02:48.992800  9787 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:49.036550  9852 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:48.991959  9788 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:49.087771  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 98109.8us
I20260709 13:02:48.992079  9896 consensus_queue.cc:1048] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.070s
I20260709 13:02:48.989114  9529 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:49.051359  9860 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:49.064172  9832 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.079589  9845 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:49.078325  9834 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.108623  9087 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:49.039922  9805 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
W20260709 13:02:49.117451  9877 log.cc:927] Time spent T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.585s	user 0.004s	sys 0.000s
I20260709 13:02:49.133380  9087 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:49.133899  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 148840us
W20260709 13:02:49.126875  9884 log.cc:927] Time spent T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:02:49.134958  9753 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.159443  9529 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:49.139884  9832 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:49.169941  9832 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:49.172389  9787 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:49.174681   431 tablet_replica.cc:333] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.175649   431 raft_consensus.cc:2243] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.176192   431 raft_consensus.cc:2272] T a45da2e3894b42dc93ed11eb2c31220c P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.179229   431 tablet_replica.cc:333] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.170504  9753 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:49.181259  9787 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.188956  9787 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:49.191394  9787 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:49.181182  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:49.138994  9834 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:49.204422  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:49.219002  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 83137.7us
I20260709 13:02:49.219333  1704 raft_consensus.cc:1275] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:02:49.221391  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:49.226679  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:49.227591  1702 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:49.226619  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:49.236526  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:49.239820  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:49.241466  1674 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:49.242858  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:49.246090  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:49.254385  9493 consensus_queue.cc:1048] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:02:49.258769  9788 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:49.260613  9834 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:49.266887  9852 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:49.267963  2267 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:02:49.270480  9753 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:49.275193  2267 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:49.241966  1674 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:49.279886  1524 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:49.300601   431 raft_consensus.cc:2243] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:49.301607  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 294088us
W20260709 13:02:49.302371  1600 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:49.302922  1600 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:49.303766  1526 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63045.6us
I20260709 13:02:49.308248  9800 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:49.308668  1600 leader_election.cc:336] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:49.309115  1600 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:49.310199  1600 leader_election.cc:336] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:49.310568  9889 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:49.311981   431 raft_consensus.cc:2272] T 44a80c9a41a3498da7aa33d70b18ace6 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.302301  9900 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:49.316871  1702 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 24.
I20260709 13:02:49.319617  9832 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:49.322496  9881 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:49.324206  1634 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:02:49.328299   431 tablet_replica.cc:333] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
W20260709 13:02:49.329109  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47142.1us
W20260709 13:02:49.332831  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 50913.4us
I20260709 13:02:49.338668  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:49.339542  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:49.344825  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:49.345466  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:49.350901   431 raft_consensus.cc:2243] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.351696   431 raft_consensus.cc:2272] T d45e74819157464ca3f225e90c8b6a9e P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.352670  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 28 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:49.354579  1632 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:02:49.355356  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:49.310578  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:49.354336  1526 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
W20260709 13:02:49.365494  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 55305.8us
W20260709 13:02:49.367693  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.372942  1524 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:49.375830  9624 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:49.383533  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:49.384575  1524 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:49.390060  9910 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:49.378572  9834 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:49.403617  9834 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Becoming Leader. State: Replica: 87144ea1a4a14ab8b942fb426159f031, State: Running, Role: LEADER
I20260709 13:02:49.404532  9834 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:49.406787  9910 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:49.412563   431 tablet_replica.cc:333] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.413874   431 raft_consensus.cc:2243] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.424423  1702 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:02:49.419719  1524 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:49.426337  9910 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 13:02:49.457397  1524 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:49.464123  1524 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:02:49.466950  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7270b72e069f42daa3f82eaa77d9e299 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 7e99891af85f4b10aa1cc2da6aa33082 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.454979  9909 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:02:49.464942  9788 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:02:49.471925  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:49.459292  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:49.459883  9832 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:02:49.459795  1454 catalog_manager.cc:5697] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 15 to 19, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:49.476925  1600 consensus_peers.cc:597] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.482191  9547 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:02:49.484885  1524 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:49.490252   431 raft_consensus.cc:2272] T 7270b72e069f42daa3f82eaa77d9e299 P 87144ea1a4a14ab8b942fb426159f031 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:49.502157  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:49.498020  1524 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:49.508770  9910 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:49.512028   431 tablet_replica.cc:333] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.514477  1454 catalog_manager.cc:5697] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 17 to 21, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.516374  1454 catalog_manager.cc:5697] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 15 to 21, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.517688  1454 catalog_manager.cc:5697] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 24 to 25, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 25 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.519304  1454 catalog_manager.cc:5697] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 18 to 21, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 21 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.512938   431 raft_consensus.cc:2243] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.530855   431 raft_consensus.cc:2272] T 64ca31f55ece4416bc4225ea16dc1728 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.531864  1454 catalog_manager.cc:5697] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 19 to 23, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 23 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.533504  1454 catalog_manager.cc:5697] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 19 to 21, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.534976  1454 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.536491   431 tablet_replica.cc:333] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.542755   431 raft_consensus.cc:2243] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:49.542949  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.546499  1709 raft_consensus.cc:1275] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:49.537492  9834 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:02:49.554539  9493 consensus_queue.cc:1048] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:49.547837  9910 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.567545  9910 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:49.560197   431 pending_rounds.cc:70] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Trying to abort 1 pending ops.
I20260709 13:02:49.561421  1454 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 15 to 18, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.570171   431 pending_rounds.cc:77] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031: Aborting op as it isn't in flight: id { term: 18 index: 10 } timestamp: 7305634429937426432 op_type: NO_OP noop_request { }
I20260709 13:02:49.570554   431 raft_consensus.cc:2889] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:49.570906   431 raft_consensus.cc:2272] T 6ffd1be44d384b0d9dfc0986195efbd1 P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.570667  1454 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 19 to 22, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 22 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.572103  1454 catalog_manager.cc:5697] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 17 to 24, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 24 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.573561  1454 catalog_manager.cc:5697] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.574898  1454 catalog_manager.cc:5697] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 9 to 22, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 22 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.575628  9910 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:49.577450  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:49.578084  1705 raft_consensus.cc:2468] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87144ea1a4a14ab8b942fb426159f031 in term 19.
I20260709 13:02:49.579444  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031; no voters: 
I20260709 13:02:49.576248  1454 catalog_manager.cc:5697] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 17 to 18, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 18 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.581604  1454 catalog_manager.cc:5697] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 18 to 26. New cstate: current_term: 26 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.593966  9832 raft_consensus.cc:2804] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:49.594442  9832 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.594792  9832 raft_consensus.cc:3060] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:49.602862   431 tablet_replica.cc:333] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.603989   431 raft_consensus.cc:2243] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.610078  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:49.607306   431 pending_rounds.cc:70] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: Trying to abort 1 pending ops.
I20260709 13:02:49.583033  1454 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 24 to 28, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 28 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.617288   431 pending_rounds.cc:77] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031: Aborting op as it isn't in flight: id { term: 26 index: 16 } timestamp: 7305634424811900928 op_type: NO_OP noop_request { }
I20260709 13:02:49.627377   431 raft_consensus.cc:2889] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:49.619614  1454 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 20 to 25, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 25 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:49.618271  1451 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35578 (request call id 327) took 40295 ms (client timeout 15000 ms). Trace:
I20260709 13:02:49.629470   431 raft_consensus.cc:2272] T 41e0e763e6004147b0d7ea0abb37c886 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.630568  1454 catalog_manager.cc:5697] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.633219  1454 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.639613   431 tablet_replica.cc:333] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.620262  9832 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:49.648044  1632 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:49.649257  9832 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:49.651705  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:49.651803  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:49.653901  1526 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:49.654946  9881 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:49.657291  1454 catalog_manager.cc:5697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 13 to 24. New cstate: current_term: 24 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.659713  9834 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:02:49.663691   431 raft_consensus.cc:2243] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:49.632099  1451 rpcz_store.cc:269] 0709 13:02:09.323134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.342218 (+ 19084us) service_pool.cc:224] Handling call
0709 13:02:49.618142 (+40275924us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:47.174233 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:47.201857 (+ 27624us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:47.201912 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:02:47.201949 (+    37us) tablet.cc:662] Decoding operations
0709 13:02:47.202517 (+   568us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:47.202610 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:47.202643 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:02:47.203105 (+   462us) tablet.cc:701] Row locks acquired
0709 13:02:47.203159 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:02:47.203341 (+   182us) write_op.cc:270] Start()
0709 13:02:47.203498 (+   157us) write_op.cc:276] Timestamp: P: 1783602167203271 usec, L: 0
0709 13:02:47.203535 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:02:47.204354 (+   819us) log.cc:844] Serialized 929 byte log entry
0709 13:02:47.362709 (+158355us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b4400022b4c. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06dad6adb1 00007f06dae08c85 00007f06dae096a2 00007f06ddb7b1db 00007f06ddb76aaf 00007f06daec50ac 00007f06e3d1fab9 00007f06daee169b 00007f06daedf93f 00007f06daee1c02 00007f06ddb6920b
0709 13:02:47.999314 (+636605us) op_driver.cc:464] REPLICATION: finished
0709 13:02:48.455576 (+456262us) write_op.cc:301] APPLY: starting
0709 13:02:48.473565 (+ 17989us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:48.661338 (+187773us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:48.661382 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:48.714723 (+ 53341us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:48.715031 (+   308us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:02:48.715092 (+    61us) write_op.cc:312] APPLY: finished
0709 13:02:48.715419 (+   327us) log.cc:844] Serialized 33 byte log entry
0709 13:02:48.715640 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:48.715741 (+   101us) write_op.cc:454] Released schema lock
0709 13:02:48.715805 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:48.716251 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:48.716287 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":135908,"reported_tablets":48,"spinlock_wait_cycles":25344,"child_traces":[["op",{"apply.queue_time_us":410040,"apply.run_cpu_time_us":7135,"apply.run_wall_time_us":292816,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12483,"num_ops":2,"prepare.queue_time_us":217454,"prepare.run_cpu_time_us":20610,"prepare.run_wall_time_us":443253,"raft.queue_time_us":222767,"raft.run_cpu_time_us":28116,"raft.run_wall_time_us":309327,"replication_time_us":795598,"spinlock_wait_cycles":102896384,"thread_start_us":882968,"threads_started":4,"wal-append.queue_time_us":405484}]]}
I20260709 13:02:49.667461   431 raft_consensus.cc:2272] T db8014a9a7494e619e862cbd380cb262 P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.673380   431 tablet_replica.cc:333] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.676712   431 raft_consensus.cc:2243] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:02:49.661274  1454 catalog_manager.cc:5697] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.687285  1454 catalog_manager.cc:5697] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 20, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 20 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.689124  1454 catalog_manager.cc:5697] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 17 to 20, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 20 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.690919  1454 catalog_manager.cc:5697] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 17 to 24, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 24 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.695341  1454 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.696730  1454 catalog_manager.cc:5697] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 22 to 24, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 24 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.700248  1454 catalog_manager.cc:5697] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 16 to 18, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 18 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.705961  1454 catalog_manager.cc:5697] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 14 to 18, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.707337   431 raft_consensus.cc:2272] T b8fae2aaea9349b488e73c3574050a18 P 87144ea1a4a14ab8b942fb426159f031 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.707051  1454 catalog_manager.cc:5697] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 16 to 18, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:49.729843  2270 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:02:49.735751  9881 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:02:49.740139  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:49.784037  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:49.807793   431 tablet_replica.cc:333] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.808853   431 raft_consensus.cc:2243] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:02:49.826076  2270 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:02:49.827747  9910 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:49.830242   431 raft_consensus.cc:2272] T c546ee055ea8417b8c1054e545eee77c P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.833257   431 tablet_replica.cc:333] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.866710   431 raft_consensus.cc:2243] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.867385   431 raft_consensus.cc:2272] T 6d65ebb9a940495b98325fe3474babd1 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.870266   431 tablet_replica.cc:333] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.871234  1700 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Refusing update from remote peer 87144ea1a4a14ab8b942fb426159f031: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:02:49.890300   431 raft_consensus.cc:2243] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:49.890918  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:49.891230   431 raft_consensus.cc:2272] T 12ca9a7e99a249b3820b6df8c497bfde P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.892457  9834 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:02:49.925285  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:49.946630  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:49.952560   431 tablet_replica.cc:333] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.953563   431 raft_consensus.cc:2243] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.954150   431 raft_consensus.cc:2272] T 447b9d1298e947858fa3d05e918d4a08 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.956769   431 tablet_replica.cc:333] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:49.978715   431 raft_consensus.cc:2243] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:02:49.991427  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:49.997080  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.002810   431 raft_consensus.cc:2272] T 8e325950f4164ab99442980dc2c53386 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.035666   431 tablet_replica.cc:333] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.037158   431 raft_consensus.cc:2243] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.056619   431 raft_consensus.cc:2272] T 88018a232de842fc8fcd30e124b7c4d7 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.068667   431 tablet_replica.cc:333] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.069684   431 raft_consensus.cc:2243] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:02:50.070971   431 raft_consensus.cc:2272] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 87144ea1a4a14ab8b942fb426159f031 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.073952   431 tablet_replica.cc:333] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.086309   431 raft_consensus.cc:2243] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:50.100819  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.101838   431 raft_consensus.cc:2272] T 0ab2c76ce9ba4519b8beb7decd86314d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:50.113327  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.126576   431 tablet_replica.cc:333] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.139330   431 raft_consensus.cc:2243] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.140057   431 raft_consensus.cc:2272] T d44a8411cf4642829994ec97173d358a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.140946  9910 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.141472  9910 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:50.143886  9910 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:50.145546  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:50.150859  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "87144ea1a4a14ab8b942fb426159f031" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:50.157840  1526 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87144ea1a4a14ab8b942fb426159f031; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:02:50.158758  9834 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:02:50.161154   431 tablet_replica.cc:333] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.163977   431 raft_consensus.cc:2243] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.164633   431 raft_consensus.cc:2272] T 56d2e4b816a44719af0c86481062c407 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.186892   431 tablet_replica.cc:333] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.187870   431 raft_consensus.cc:2243] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.188449   431 raft_consensus.cc:2272] T 5332d0582c2b46f598be9871f6cfdcf7 P 87144ea1a4a14ab8b942fb426159f031 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.213665   431 tablet_replica.cc:333] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
W20260709 13:02:50.220899  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.216210   431 raft_consensus.cc:2243] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.225209   431 raft_consensus.cc:2272] T d0ab32967f744404a0f736900b1d7b9a P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.232158  1454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 238) took 3256 ms. Trace:
I20260709 13:02:50.233145   431 tablet_replica.cc:333] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.237116   431 raft_consensus.cc:2243] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:50.235954  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.254308  1458 catalog_manager.cc:5697] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 19 to 20, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.260135   431 raft_consensus.cc:2272] T 86aa6466101d44fc98160eb3586dc176 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.232688  1454 rpcz_store.cc:276] 0709 13:02:46.974737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.974988 (+   251us) service_pool.cc:224] Handling call
0709 13:02:50.230836 (+3255848us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:49.855179 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:49.855760 (+   581us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:49.855789 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:02:49.855806 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:49.858216 (+  2410us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:49.858305 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:49.858332 (+    27us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:02:49.887642 (+ 29310us) tablet.cc:701] Row locks acquired
0709 13:02:49.887659 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:02:49.887808 (+   149us) write_op.cc:270] Start()
0709 13:02:49.887911 (+   103us) write_op.cc:276] Timestamp: P: 1783602169887759 usec, L: 0
0709 13:02:49.887934 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:49.888667 (+   733us) log.cc:844] Serialized 11387 byte log entry
0709 13:02:50.006818 (+118151us) op_driver.cc:464] REPLICATION: finished
0709 13:02:50.035872 (+ 29054us) write_op.cc:301] APPLY: starting
0709 13:02:50.050712 (+ 14840us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:50.082485 (+ 31773us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:50.082610 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:50.125861 (+ 43251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:50.126371 (+   510us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:02:50.126437 (+    66us) write_op.cc:312] APPLY: finished
0709 13:02:50.126926 (+   489us) log.cc:844] Serialized 252 byte log entry
0709 13:02:50.127110 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:50.127345 (+   235us) write_op.cc:454] Released schema lock
0709 13:02:50.127410 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:50.127781 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:50.127811 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":196005,"reported_tablets":37,"spinlock_wait_cycles":19840,"child_traces":[["op",{"apply.queue_time_us":28797,"apply.run_cpu_time_us":35789,"apply.run_wall_time_us":91893,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125289,"num_ops":29,"prepare.queue_time_us":94377,"prepare.run_cpu_time_us":13012,"prepare.run_wall_time_us":76352,"raft.queue_time_us":15802,"raft.run_cpu_time_us":13852,"raft.run_wall_time_us":24670,"replication_time_us":118703,"spinlock_wait_cycles":4992,"thread_start_us":171609,"threads_started":4,"wal-append.queue_time_us":95556}]]}
I20260709 13:02:50.294531   431 tablet_replica.cc:333] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
W20260709 13:02:50.296521  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.295416  1458 catalog_manager.cc:5697] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 15 to 16, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.299001  1458 catalog_manager.cc:5697] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 18 to 19, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 19 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.302314   431 raft_consensus.cc:2243] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:50.315670  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.324379   431 raft_consensus.cc:2272] T 95ea20fae86647d4bbf85d9c0864f5f1 P 87144ea1a4a14ab8b942fb426159f031 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.327415   431 tablet_replica.cc:333] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.328290   431 raft_consensus.cc:2243] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.332845   431 raft_consensus.cc:2272] T 1ce7dbd8e7cf45808506e02da2925882 P 87144ea1a4a14ab8b942fb426159f031 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:50.343184  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.313921  1458 catalog_manager.cc:5697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
W20260709 13:02:50.355394  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.356904  1458 catalog_manager.cc:5697] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 16 to 19, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
W20260709 13:02:50.358479  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.360466  1458 catalog_manager.cc:5697] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.361754  1458 catalog_manager.cc:5697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 10 to 17, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.364562  1458 catalog_manager.cc:5697] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.368369   431 tablet_replica.cc:333] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.374727   431 raft_consensus.cc:2243] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.385968   431 raft_consensus.cc:2272] T dc48c88f26dc4e35ae381c821f0a805d P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.388763   431 tablet_replica.cc:333] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.389631   431 raft_consensus.cc:2243] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:02:50.378476  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:50.392817  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.366194  1458 catalog_manager.cc:5697] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.402740  1458 catalog_manager.cc:5697] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 16 to 18, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 18 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
W20260709 13:02:50.404564  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.404358  1458 catalog_manager.cc:5697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.416985  1458 catalog_manager.cc:5697] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 19 to 21, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.429955   431 raft_consensus.cc:2272] T d6b0ca7e03c249ebad5c6f720df4efca P 87144ea1a4a14ab8b942fb426159f031 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.461328   431 tablet_replica.cc:333] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.477355   431 raft_consensus.cc:2243] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.480213   431 raft_consensus.cc:2272] T b699c6ee183d45208fccb5d51557fe41 P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.491721   431 tablet_replica.cc:333] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.492694   431 raft_consensus.cc:2243] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.493407   431 raft_consensus.cc:2272] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.525060   431 tablet_replica.cc:333] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.526111   431 raft_consensus.cc:2243] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.545115   431 raft_consensus.cc:2272] T 2b113b168afa40cfaab164f8317e42c1 P 87144ea1a4a14ab8b942fb426159f031 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.548013   431 tablet_replica.cc:333] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.548806   431 raft_consensus.cc:2243] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:02:50.549870   431 raft_consensus.cc:2272] T 423fad3d086c4c18b5d84ecfeeb2957a P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:50.570765  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.604429   431 tablet_replica.cc:333] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.605425   431 raft_consensus.cc:2243] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:02:50.629658   431 raft_consensus.cc:2272] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 87144ea1a4a14ab8b942fb426159f031 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.638772   431 tablet_replica.cc:333] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.639464   431 raft_consensus.cc:2243] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:02:50.640448   431 raft_consensus.cc:2272] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.661255   431 tablet_replica.cc:333] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.678718   431 raft_consensus.cc:2243] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.679482   431 raft_consensus.cc:2272] T eda09757c25a4279a4c93c29eeff416a P 87144ea1a4a14ab8b942fb426159f031 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.682264   431 tablet_replica.cc:333] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031: stopping tablet replica
I20260709 13:02:50.694442   431 raft_consensus.cc:2243] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:02:50.699360   431 raft_consensus.cc:2272] T f52157fbf77948c283b3ba328c6ebcdd P 87144ea1a4a14ab8b942fb426159f031 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:50.709839  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:50.741240  1458 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35578 (request call id 328) took 24991 ms (client timeout 15000 ms). Trace:
W20260709 13:02:50.741708  1458 rpcz_store.cc:269] 0709 13:02:25.750393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.750659 (+   266us) service_pool.cc:224] Handling call
0709 13:02:50.741140 (+24990481us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:50.535130 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:50.535813 (+   683us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:50.535932 (+   119us) write_op.cc:435] Acquired schema lock
0709 13:02:50.535961 (+    29us) tablet.cc:662] Decoding operations
0709 13:02:50.539374 (+  3413us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:50.539466 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:50.539496 (+    30us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:02:50.540616 (+  1120us) tablet.cc:701] Row locks acquired
0709 13:02:50.540640 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:02:50.540807 (+   167us) write_op.cc:270] Start()
0709 13:02:50.540944 (+   137us) write_op.cc:276] Timestamp: P: 1783602170540754 usec, L: 0
0709 13:02:50.540974 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:02:50.541752 (+   778us) log.cc:844] Serialized 4806 byte log entry
0709 13:02:50.606909 (+ 65157us) op_driver.cc:464] REPLICATION: finished
0709 13:02:50.607266 (+   357us) write_op.cc:301] APPLY: starting
0709 13:02:50.607642 (+   376us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:50.615454 (+  7812us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:50.615563 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:50.634063 (+ 18500us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:50.634271 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:02:50.634311 (+    40us) write_op.cc:312] APPLY: finished
0709 13:02:50.634611 (+   300us) log.cc:844] Serialized 113 byte log entry
0709 13:02:50.635341 (+   730us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:50.635482 (+   141us) write_op.cc:454] Released schema lock
0709 13:02:50.635539 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:50.647241 (+ 11702us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:50.647272 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23423,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":95,"apply.run_cpu_time_us":16852,"apply.run_wall_time_us":39925,"cfile_cache_hit":48,"cfile_cache_hit_bytes":50136,"num_ops":12,"prepare.queue_time_us":56492,"prepare.run_cpu_time_us":4698,"prepare.run_wall_time_us":23766,"replication_time_us":65763,"thread_start_us":55769,"threads_started":1}]]}
I20260709 13:02:50.781337  1454 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 20 to 23, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 23 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:50.783231  1454 catalog_manager.cc:5697] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 18 to 23, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 23 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.786526  1454 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 18 to 22, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:50.788805  1454 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 17 to 23, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 23 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.807546  1454 catalog_manager.cc:5697] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 18 to 19, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.809286  1454 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:50.810856  1454 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 23 to 28. New cstate: current_term: 28 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } attrs { replace: true } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:50.813906  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:50.816504  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.822862  1454 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:50.824355  1454 catalog_manager.cc:5697] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 20 to 24, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 24 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.843169  1454 catalog_manager.cc:5697] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:50.845214  1454 catalog_manager.cc:5697] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 22 to 25, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 25 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:50.852589  1452 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35568 (request call id 324) took 61868 ms (client timeout 15000 ms). Trace:
W20260709 13:02:50.859827  1452 rpcz_store.cc:269] 0709 13:01:48.983729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.985043 (+  1314us) service_pool.cc:224] Handling call
0709 13:02:50.852492 (+61867449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":344057,"reported_tablets":47}
W20260709 13:02:50.878996  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.913791  9269 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:50.913831  1455 catalog_manager.cc:5697] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 16 to 18, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.914606  9269 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:50.917016  1455 catalog_manager.cc:5697] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 18 to 23. New cstate: current_term: 23 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.919139  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:50.918637  1455 catalog_manager.cc:5697] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 19 to 20, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.920686  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:50.921561  9269 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:50.921271  1455 catalog_manager.cc:5697] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.922974  1455 catalog_manager.cc:5697] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 25 to 27, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 27 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.926877  1455 catalog_manager.cc:5697] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:50.929245  1674 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:50.929764  1674 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:50.929150  1455 catalog_manager.cc:5697] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 16 to 22, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.930673  9269 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:02:50.931851  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:50.935038  1455 catalog_manager.cc:5697] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 19 to 21, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.936548  1455 catalog_manager.cc:5697] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.941710  1455 catalog_manager.cc:5697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 17 to 20, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.943979  1455 catalog_manager.cc:5697] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.945456  1455 catalog_manager.cc:5697] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.946754  1455 catalog_manager.cc:5697] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.948340  1455 catalog_manager.cc:5697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.949925  1455 catalog_manager.cc:5697] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 21 to 25, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 25 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:50.967396  9860 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:50.968050  9860 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:50.970203  9860 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:50.973242  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:50.986858  2235 leader_election.cc:336] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:50.987323  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:50.988410  9671 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:02:51.018751  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:51.024415  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:51.039985  9867 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.044831  9867 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.042311  9933 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.048519  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:51.048609  9933 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.049283  2267 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 25.
W20260709 13:02:51.050832  1600 leader_election.cc:336] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:51.052270  9867 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:51.052664  9933 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:51.033998  1455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35578 (request call id 329) took 3578 ms. Trace:
I20260709 13:02:51.052769  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:51.044092  1453 catalog_manager.cc:5697] T 2fb004c86c654110bd570a13f623ed9f P 87144ea1a4a14ab8b942fb426159f031 reported cstate change: term changed from 20 to 21, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.056448  1701 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 28.
W20260709 13:02:51.056715  1600 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:51.061146  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.054956  1455 rpcz_store.cc:276] 0709 13:02:47.455534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.455838 (+   304us) service_pool.cc:224] Handling call
0709 13:02:47.679386 (+223548us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b540009b354. stack: 00007f06daeb0343 00007f06daeb0240 00007f06da83f1d4 00007f06e457d304 00007f06e457d299 00007f06ddf39090 00007f06ddfd7f3a 00007f06e3d8e1cc 00007f06e3e8c37e 00007f06e234d2a4 00007f06e234d232 00007f06e234d161 00007f06e234d0dc 00007f06e234c392 00007f06dc30a48c 00007f06dc3098c6
0709 13:02:51.033931 (+3354545us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:50.956234 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:50.956711 (+   477us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:50.956745 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:02:50.956761 (+    16us) tablet.cc:662] Decoding operations
0709 13:02:50.957997 (+  1236us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:50.958072 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:50.958104 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:02:50.959158 (+  1054us) tablet.cc:701] Row locks acquired
0709 13:02:50.959174 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:02:50.959312 (+   138us) write_op.cc:270] Start()
0709 13:02:50.959421 (+   109us) write_op.cc:276] Timestamp: P: 1783602170959269 usec, L: 0
0709 13:02:50.959439 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:02:50.960044 (+   605us) log.cc:844] Serialized 5970 byte log entry
0709 13:02:50.962802 (+  2758us) op_driver.cc:464] REPLICATION: finished
0709 13:02:50.963209 (+   407us) write_op.cc:301] APPLY: starting
0709 13:02:50.963286 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:50.982163 (+ 18877us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:50.982249 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:50.995927 (+ 13678us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:50.996208 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:02:50.996265 (+    57us) write_op.cc:312] APPLY: finished
0709 13:02:50.996614 (+   349us) log.cc:844] Serialized 139 byte log entry
0709 13:02:50.997401 (+   787us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:50.997567 (+   166us) write_op.cc:454] Released schema lock
0709 13:02:50.997623 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:51.019404 (+ 21781us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:51.019433 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":48,"spinlock_wait_cycles":150248704,"child_traces":[["op",{"apply.queue_time_us":160,"apply.run_cpu_time_us":18473,"apply.run_wall_time_us":56164,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62670,"num_ops":15,"prepare.queue_time_us":102,"prepare.run_cpu_time_us":4122,"prepare.run_wall_time_us":4125,"replication_time_us":3234}]]}
I20260709 13:02:51.076622  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:51.080147  9867 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:02:51.080678  9867 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.081115  9867 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:51.110126  1599 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.110713  9671 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.111276  9671 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.135661  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:51.136406  1701 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 28.
W20260709 13:02:51.137143  2235 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:51.144990  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:51.145756  1628 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 28.
I20260709 13:02:51.138603  9671 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:51.146961  2234 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.155987  9671 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:02:51.171900  9671 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.172437  9671 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:02:51.180203  9937 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:02:51.186983  9867 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.200176  9867 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:51.201614  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:51.202333  2267 raft_consensus.cc:3060] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:51.210646  9671 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.211799  2267 raft_consensus.cc:2468] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 26.
I20260709 13:02:51.222397  1599 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:51.228133  9936 raft_consensus.cc:2804] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:02:51.228708  9936 raft_consensus.cc:697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:51.229573  9936 consensus_queue.cc:237] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.228138  9671 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:51.234812  1600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111) [suppressed 233 similar messages]
W20260709 13:02:51.250583  1453 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35556 (request call id 323) took 22417 ms (client timeout 15000 ms). Trace:
W20260709 13:02:51.251087  1453 rpcz_store.cc:269] 0709 13:02:28.833202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.833432 (+   230us) service_pool.cc:224] Handling call
0709 13:02:51.071404 (+22237972us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:51.071431 (+    27us) write_op.cc:454] Released schema lock
0709 13:02:51.250500 (+179069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:51.063851 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:51.064370 (+   519us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:51.064410 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:02:51.064427 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:51.064786 (+   359us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:51.064839 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:51.064874 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:51.065042 (+   168us) tablet.cc:701] Row locks acquired
0709 13:02:51.065056 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:02:51.065173 (+   117us) write_op.cc:270] Start()
0709 13:02:51.065267 (+    94us) write_op.cc:276] Timestamp: P: 1783602171065137 usec, L: 0
0709 13:02:51.065284 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:02:51.065842 (+   558us) log.cc:844] Serialized 541 byte log entry
0709 13:02:51.067681 (+  1839us) op_driver.cc:464] REPLICATION: finished
0709 13:02:51.068085 (+   404us) write_op.cc:301] APPLY: starting
0709 13:02:51.068153 (+    68us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:51.068968 (+   815us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:51.069054 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:51.069758 (+   704us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:51.069915 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:02:51.069960 (+    45us) write_op.cc:312] APPLY: finished
0709 13:02:51.070172 (+   212us) log.cc:844] Serialized 25 byte log entry
0709 13:02:51.070326 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:51.070407 (+    81us) write_op.cc:454] Released schema lock
0709 13:02:51.070447 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":146,"reported_tablets":47,"spinlock_wait_cycles":326400,"child_traces":[["op",{"apply.queue_time_us":214,"apply.run_cpu_time_us":2619,"apply.run_wall_time_us":2619,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4178,"num_ops":1,"prepare.queue_time_us":2353,"prepare.run_cpu_time_us":2235,"prepare.run_wall_time_us":2237,"replication_time_us":2298}]]}
I20260709 13:02:51.253803  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:51.254580  1634 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:02:51.258383  1444 connection.cc:466] server connection from 127.0.0.1:35556 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35556 (request call id 323) could send its response
W20260709 13:02:51.272046  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:51.272140  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 29 candidate_status { last_received { term: 28 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:02:51.272917  1600 leader_election.cc:336] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.272919  1701 raft_consensus.cc:3060] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:02:51.274839  1634 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 29.
W20260709 13:02:51.296989  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:51.300210  1701 raft_consensus.cc:2468] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 29.
I20260709 13:02:51.302166  2236 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:51.322243  9936 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.323117  9936 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:51.324055  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7270b72e069f42daa3f82eaa77d9e299 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 7e99891af85f4b10aa1cc2da6aa33082 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:51.325377  9936 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:51.325809  1457 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35556 (request call id 320) took 88578 ms (client timeout 15000 ms). Trace:
W20260709 13:02:51.329147  1457 rpcz_store.cc:269] 0709 13:01:22.747243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.748502 (+  1259us) service_pool.cc:224] Handling call
0709 13:02:51.325609 (+88577107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190496,"reported_tablets":47}
W20260709 13:02:51.330145  1444 connection.cc:466] server connection from 127.0.0.1:35556 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35556 (request call id 320) could send its response
W20260709 13:02:51.330487  1600 leader_election.cc:336] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.332756  9939 raft_consensus.cc:2804] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:02:51.333312  9939 raft_consensus.cc:697] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 29 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:51.333631  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:51.338038  9939 consensus_queue.cc:237] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 28.15, Last appended by leader: 15, Current term: 29, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.338672  1599 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.339546  9867 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:51.370987  9860 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:51.370419  2235 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.378238  1455 catalog_manager.cc:5697] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 20 to 23, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 23 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:51.375548  9860 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.387431  9860 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:51.392896  2235 leader_election.cc:336] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.351472  9944 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.404335  9944 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.410300  9944 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:51.414753  2235 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:02:51.435946  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:51.438650  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 62155.9us
I20260709 13:02:51.452838  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:51.453500  1634 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:51.455605  1455 catalog_manager.cc:5697] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:51.464059  1455 catalog_manager.cc:5697] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 21 to 26. New cstate: current_term: 26 leader_uuid: "87144ea1a4a14ab8b942fb426159f031" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } }
I20260709 13:02:51.470573  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:02:51.473455  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:51.477962  1634 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:51.488933  1456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35568 (request call id 326) took 13205 ms (client timeout 15000 ms). Trace:
I20260709 13:02:51.496263  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.502528  1457 catalog_manager.cc:5697] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 28 to 29, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 29 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.507846  9946 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:51.508394  9946 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.508816  9946 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:51.510012  9867 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.510627  9867 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.515352  9937 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.515990  9937 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:51.516736  1456 rpcz_store.cc:269] 0709 13:02:38.377378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.465372 (+ 87994us) service_pool.cc:224] Handling call
0709 13:02:51.488741 (+13023369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29142,"reported_tablets":47}
I20260709 13:02:51.525507  9937 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:51.526510  9867 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:51.531615  1600 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:02:51.539492  1600 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.566151  9946 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.567590  1705 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:02:51.569588  9937 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:02:51.573909  2235 leader_election.cc:336] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.578361  9946 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:51.596097  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 88381.7us
I20260709 13:02:51.596854  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.597770  9946 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:02:51.601926  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:51.602592  1628 raft_consensus.cc:3060] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:51.609158  9756 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.609757  9756 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:51.612310  9756 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:51.616001  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:51.624183  1628 raft_consensus.cc:2468] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 25.
I20260709 13:02:51.627461  2234 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.628866  9947 raft_consensus.cc:2804] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:51.629763  9947 raft_consensus.cc:697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 25 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:51.631642  9947 consensus_queue.cc:237] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:51.596021  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 86295.2us
I20260709 13:02:51.641207  9946 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
W20260709 13:02:51.639287  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 43523.2us
W20260709 13:02:51.642058  9949 log.cc:927] Time spent T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:51.641793  9946 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.645750  9946 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:51.648842  9938 raft_consensus.cc:2955] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 LEADER]: Committing config change with OpId 28.17: config changed from index 9 to 17, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:51.651582  2235 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.660337  1701 raft_consensus.cc:2955] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Committing config change with OpId 28.17: config changed from index 9 to 17, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:51.685369  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3fe250573e1c4fdd9d93dbaaa494b367 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:51.695906  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:51.696597  2267 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:02:51.697942  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:51.698544  2267 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:02:51.691111  1455 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 9 to 17, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New cstate: current_term: 28 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:51.701659  2267 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:02:51.717446  1457 catalog_manager.cc:5697] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 24 to 25, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 25 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.738665  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:51.739488  1628 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
W20260709 13:02:51.740978  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:51.741115  2234 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:51.748330  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:51.749550  9947 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:51.750954  9947 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.751513  9947 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:51.750136  9944 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.758450  9944 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.750160  2267 raft_consensus.cc:1275] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:02:51.760155  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.761488  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.762928  9935 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:51.763363  9935 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.763548  9936 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:51.763907  9935 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:51.764029  9936 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.764531  9936 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:51.766649  2235 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.768590  9937 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:02:51.763330  1674 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.772217  9939 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.774072  9939 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.776368  9939 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:51.779531  9935 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.782008  9935 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:51.782312  9944 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:51.773155  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.791448  9269 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.781327  9936 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.792392  9269 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:51.797887  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:51.798797  2235 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.805248  9269 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:51.805984  9269 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:02:51.810105  1444 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 62602.3us
I20260709 13:02:51.813463  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:51.822405  9947 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.827013  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:51.827890  1628 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 22: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:02:51.832667  9936 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:02:51.843052  1600 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.846160  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:51.850940  1444 catalog_manager.cc:4755] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3fe250573e1c4fdd9d93dbaaa494b367: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.846408  9947 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:51.846902  1701 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 24.
I20260709 13:02:51.864296  1457 catalog_manager.cc:5697] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 25 to 26, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 26 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.876075  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:02:51.844108  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 72538.4us
W20260709 13:02:51.875147  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:51.879175  1600 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.879273  9944 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:02:51.875065  2235 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.880003  2235 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.880936  9939 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:02:51.882018  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:51.882513  1634 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 13:02:51.884487  9939 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:51.889236  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:51.889911  2267 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 24.
I20260709 13:02:51.905754  9935 consensus_queue.cc:1048] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:02:51.912384  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:51.913064  2270 raft_consensus.cc:3060] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:51.913717  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:51.915967  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:51.916742  2269 raft_consensus.cc:2393] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 22: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:02:51.921383  9269 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:51.921849  9269 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.922430  9269 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:51.930876  9269 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:51.937520  1674 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.940438  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.941816  9935 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:02:51.944942  9935 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.940153  2270 raft_consensus.cc:2468] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:02:51.945564  9935 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:51.949225  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.950690  9269 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:51.953758  1705 raft_consensus.cc:1275] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 29 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 28 index: 15. Preceding OpId from leader: term: 29 index: 16. (index mismatch)
I20260709 13:02:51.952028  2267 raft_consensus.cc:2955] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Committing config change with OpId 28.17: config changed from index 9 to 17, VOTER 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:51.958820  9935 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:51.959005  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:02:51.962636  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:51.967052  1600 leader_election.cc:336] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:51.967511  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.968199  9935 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:02:51.969151  9939 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:51.969661  9939 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:51.970134  9939 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:51.983909  1599 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:51.985194  9935 raft_consensus.cc:2804] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:51.986783  9935 raft_consensus.cc:697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:51.988515  9939 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:51.988411  9935 consensus_queue.cc:237] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:51.996315  1674 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:52.000895  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:52.001722  2269 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 25: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:02:52.003757  2235 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:52.005654  9939 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:52.006726  9947 consensus_queue.cc:1048] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:52.008710  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:52.012313  9756 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:02:52.012885  9269 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:52.013597  9269 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:52.016335  9269 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:52.018328  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:52.022557  1628 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 24.
I20260709 13:02:52.024019  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:52.024241  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:52.024847  1701 raft_consensus.cc:2393] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 25: Already voted for candidate 4f1725fe36e349ac85405627f9c93d95 in this term.
I20260709 13:02:52.025655  9756 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:02:52.026077  9756 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:52.026553  9756 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:52.041465  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:52.042699  9944 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:02:52.062153  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.068490  1674 leader_election.cc:336] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:52.069224  9756 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:52.069280  9953 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:52.071164  9953 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:52.071652  9756 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:52.074496  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:02:52.075110  1701 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 26.
W20260709 13:02:52.076454  1674 leader_election.cc:336] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:52.076624  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:52.077692  9953 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:52.078238  9953 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:02:52.078573  9953 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:52.078946  9953 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:02:52.081576  1455 catalog_manager.cc:5697] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 22 to 23, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 23 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.089032  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:52.091802  1628 raft_consensus.cc:3060] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:02:52.091922  1634 raft_consensus.cc:1275] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:02:52.089226  9954 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:52.093230  9954 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:52.095257  9944 consensus_queue.cc:1048] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:02:52.104728  1628 raft_consensus.cc:2468] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 25.
W20260709 13:02:52.097982  1600 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:52.109840  1673 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:52.111341  9756 raft_consensus.cc:2804] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:02:52.111847  9756 raft_consensus.cc:697] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 25 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:52.112733  9756 consensus_queue.cc:237] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:52.113885  9954 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:52.115077  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:02:52.115675  2269 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 23.
I20260709 13:02:52.117147  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:02:52.117946  9954 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:02:52.118327  9954 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 87144ea1a4a14ab8b942fb426159f031)
I20260709 13:02:52.118681  9954 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:52.128015  1674 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:52.131203  9954 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:52.132886  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:52.133571  9954 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:52.135535  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:52.136142  2269 raft_consensus.cc:3060] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:02:52.140740  1674 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:52.147198  2269 raft_consensus.cc:2468] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 24.
I20260709 13:02:52.151000  1673 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:52.152338  9954 raft_consensus.cc:2804] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:02:52.152985  9954 raft_consensus.cc:697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:52.154471  9954 consensus_queue.cc:237] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:52.161799  9953 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:52.172849  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:02:52.173480  1705 raft_consensus.cc:3060] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:02:52.179303  1600 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:52.183009  1705 raft_consensus.cc:2468] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 27.
I20260709 13:02:52.184266  1601 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:52.185153  9935 raft_consensus.cc:2804] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:02:52.185664  9935 raft_consensus.cc:697] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:02:52.186515  9935 consensus_queue.cc:237] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:02:52.187243  1455 catalog_manager.cc:5697] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 24 to 25, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 25 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.191054  9953 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 27 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:52.199717   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1581)
I20260709 13:02:52.224220  1457 catalog_manager.cc:5697] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 26 to 27, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 27 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.233088  1456 catalog_manager.cc:5697] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 23 to 24, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 24 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:52.282123  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.300580  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.305670  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:52.395478  2269 raft_consensus.cc:1275] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:02:52.401742  9867 consensus_queue.cc:1048] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:02:52.434580  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:52.450493  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:52.507625  1632 raft_consensus.cc:1275] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:02:52.509101  9954 consensus_queue.cc:1048] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:02:52.516841  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:52.526310  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:52.533324  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:52.619257  1705 raft_consensus.cc:1275] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:02:52.621544  9936 consensus_queue.cc:1048] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:02:52.650605  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.653551  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:52.660528  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.682173  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.708969  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.710759  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.737457  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:52.748629  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:52.774468  2267 raft_consensus.cc:1275] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
W20260709 13:02:52.776202  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:52.777561  9269 consensus_queue.cc:1048] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
W20260709 13:02:52.782838  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.785059  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.842203  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.902329  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:52.949733  1632 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:02:52.991966  1705 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:52.994998  9936 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:53.001991  1599 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95ea20fae86647d4bbf85d9c0864f5f1. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:53.019510  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:53.039716  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:53.049753  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:53.064270  9935 raft_consensus.cc:2955] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:02:53.071620  1701 raft_consensus.cc:2955] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
W20260709 13:02:53.107038  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:53.163513  1456 catalog_manager.cc:5697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 12, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 20 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
W20260709 13:02:53.170244  1444 catalog_manager.cc:4755] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3fe250573e1c4fdd9d93dbaaa494b367: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:02:53.200191   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1581)
I20260709 13:02:53.214212  1630 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:02:53.279992  1705 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:02:53.281803  1599 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 660b57178c7f4ffebd30c42df43b303a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:53.282508  9935 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:02:53.284053  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:53.298589  9935 raft_consensus.cc:2955] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:02:53.300380  1705 raft_consensus.cc:2955] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:02:53.318542  1457 catalog_manager.cc:5697] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index -1 to 12, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 18 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:53.377485  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:53.401384  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:53.404134  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:53.410075  1705 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
W20260709 13:02:53.421923  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7270b72e069f42daa3f82eaa77d9e299 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 7e99891af85f4b10aa1cc2da6aa33082 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:53.432257  1673 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ffd1be44d384b0d9dfc0986195efbd1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:53.439746  1630 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:02:53.446054  9965 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:02:53.450196  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:53.458400  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:53.475752  9493 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.476336  9493 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:53.479650  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:02:53.480312  1628 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:02:53.481869  2234 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:02:53.482748  9860 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:02:53.483130  9860 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.483513  9860 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:53.492383  9493 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:53.497380  2235 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:53.499025  9954 raft_consensus.cc:2955] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:02:53.506137  1630 raft_consensus.cc:2955] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:02:53.541395  1705 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:02:53.537392  9860 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:53.554708  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:02:53.555461  1628 raft_consensus.cc:3060] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:02:53.568236  9860 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:53.578080  1457 catalog_manager.cc:5697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 12, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 20 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.604771  9990 ts_tablet_manager.cc:933] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:02:53.610743  2235 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:02:53.613499  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:53.620185  1628 raft_consensus.cc:2468] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:02:53.622385  2234 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:53.623677  9493 raft_consensus.cc:2804] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:02:53.624172  9493 raft_consensus.cc:697] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:02:53.624956  9493 consensus_queue.cc:237] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:53.638525  1634 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:02:53.640357  9269 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:02:53.666227  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:53.673449  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:53.714252  9997 ts_tablet_manager.cc:933] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:02:53.713204  1456 catalog_manager.cc:5697] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 21 to 23, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 23 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:53.722787  1673 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311): Couldn't send request to peer 6923294c847b48ebb577e0935d316aa3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5336feea1c174b498bc0252f726f9461. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:53.729390  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:53.738886  9997 tablet_copy_client.cc:323] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 13:02:53.740610  9990 tablet_copy_client.cc:323] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39441
I20260709 13:02:53.740931  1645 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 660b57178c7f4ffebd30c42df43b303a from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 13:02:53.741720  1645 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 660b57178c7f4ffebd30c42df43b303a from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-660b57178c7f4ffebd30c42df43b303a
I20260709 13:02:53.745250  1644 tablet_copy_service.cc:140] P 7e99891af85f4b10aa1cc2da6aa33082: Received BeginTabletCopySession request for tablet 95ea20fae86647d4bbf85d9c0864f5f1 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:59260)
I20260709 13:02:53.745940  1644 tablet_copy_service.cc:161] P 7e99891af85f4b10aa1cc2da6aa33082: Beginning new tablet copy session on tablet 95ea20fae86647d4bbf85d9c0864f5f1 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:59260: session id = 6923294c847b48ebb577e0935d316aa3-95ea20fae86647d4bbf85d9c0864f5f1
I20260709 13:02:53.753683  1644 tablet_copy_source_session.cc:215] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:53.757351  9990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ea20fae86647d4bbf85d9c0864f5f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.763780  9992 raft_consensus.cc:2955] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:02:53.777763  1645 tablet_copy_source_session.cc:215] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:53.782441  9990 tablet_copy_client.cc:806] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
W20260709 13:02:53.782509  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:53.783150  9990 tablet_copy_client.cc:670] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:53.787750  9997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660b57178c7f4ffebd30c42df43b303a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.791177  1628 raft_consensus.cc:2955] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } } }
I20260709 13:02:53.806541  9990 tablet_copy_client.cc:538] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:02:53.815954  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:53.817898  9990 tablet_bootstrap.cc:492] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
W20260709 13:02:53.837049  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:53.836469  1456 catalog_manager.cc:5697] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index -1 to 14, NON_VOTER 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) added. New cstate: current_term: 21 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.849251  9997 tablet_copy_client.cc:806] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:53.856407  9997 tablet_copy_client.cc:670] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:53.863420  9997 tablet_copy_client.cc:538] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:53.879562  9997 tablet_bootstrap.cc:492] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 13:02:53.954658 10002 ts_tablet_manager.cc:933] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:02:53.972226 10002 tablet_copy_client.cc:323] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 13:02:53.974367  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet 6ffd1be44d384b0d9dfc0986195efbd1 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 13:02:53.974963  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet 6ffd1be44d384b0d9dfc0986195efbd1 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-6ffd1be44d384b0d9dfc0986195efbd1
I20260709 13:02:53.985983  9996 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.986617  9996 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:53.988695  9996 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:53.990461  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:02:53.991964  1674 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:53.991143  2267 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 25.
I20260709 13:02:53.995813  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:53.998942  9990 tablet_bootstrap.cc:492] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:53.999725  9996 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:02:53.999984  9990 tablet_bootstrap.cc:492] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 13:02:54.000207  9996 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.000633  9996 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:02:54.000808  9990 ts_tablet_manager.cc:1403] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.183s	user 0.038s	sys 0.009s
I20260709 13:02:54.010762  1719 tablet_copy_source_session.cc:215] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:54.016829  9996 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:54.022257  9996 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 election: Requested vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:02:54.023180  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:02:54.028679  2269 raft_consensus.cc:3060] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:02:54.027681  1674 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:02:54.036947  2269 raft_consensus.cc:2468] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 26.
I20260709 13:02:54.038415  1673 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 87144ea1a4a14ab8b942fb426159f031
I20260709 13:02:54.039211  9996 raft_consensus.cc:2804] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:02:54.040172  9996 raft_consensus.cc:697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 26 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:02:54.041311  9996 consensus_queue.cc:237] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:54.044376 10002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ffd1be44d384b0d9dfc0986195efbd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:54.049546  9997 tablet_bootstrap.cc:492] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.050746  9997 tablet_bootstrap.cc:492] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 13:02:54.051601  9997 ts_tablet_manager.cc:1403] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.172s	user 0.045s	sys 0.007s
W20260709 13:02:54.063370  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:54.068007  9990 raft_consensus.cc:359] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:02:54.087524  9990 raft_consensus.cc:740] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 13:02:54.089582  1456 catalog_manager.cc:5697] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 24 to 26, leader changed from 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 26 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:54.088476  9990 consensus_queue.cc:260] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:02:54.114487 10002 tablet_copy_client.cc:806] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:54.115229 10002 tablet_copy_client.cc:670] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:54.120740  9990 ts_tablet_manager.cc:1434] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.120s	user 0.010s	sys 0.000s
I20260709 13:02:54.092020  9997 raft_consensus.cc:359] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:02:54.139842  9997 raft_consensus.cc:740] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 13:02:54.140828  9997 consensus_queue.cc:260] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:02:54.149107  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-95ea20fae86647d4bbf85d9c0864f5f1 received from {username='slave'} at 127.0.0.1:59260
I20260709 13:02:54.149713  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-95ea20fae86647d4bbf85d9c0864f5f1 on tablet 95ea20fae86647d4bbf85d9c0864f5f1 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:54.152839  2269 raft_consensus.cc:1217] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
W20260709 13:02:54.155375  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:54.157775  9997 ts_tablet_manager.cc:1434] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.001s
I20260709 13:02:54.160125  1645 tablet_copy_service.cc:342] P 7e99891af85f4b10aa1cc2da6aa33082: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-660b57178c7f4ffebd30c42df43b303a received from {username='slave'} at 127.0.0.1:59260
I20260709 13:02:54.160547  1645 tablet_copy_service.cc:434] P 7e99891af85f4b10aa1cc2da6aa33082: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-660b57178c7f4ffebd30c42df43b303a on tablet 660b57178c7f4ffebd30c42df43b303a with peer 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:54.177670  1630 raft_consensus.cc:1275] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:02:54.181432 10002 tablet_copy_client.cc:538] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:54.188182  9994 consensus_queue.cc:1048] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:02:54.200671   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1581)
I20260709 13:02:54.214269  9997 ts_tablet_manager.cc:933] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3: Initiating tablet copy from peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:02:54.227550  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46327.6us
I20260709 13:02:54.249718 10002 tablet_bootstrap.cc:492] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
W20260709 13:02:54.247479  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.255548  9997 tablet_copy_client.cc:323] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45513
I20260709 13:02:54.282321  1719 tablet_copy_service.cc:140] P 4f1725fe36e349ac85405627f9c93d95: Received BeginTabletCopySession request for tablet 5336feea1c174b498bc0252f726f9461 from peer 6923294c847b48ebb577e0935d316aa3 ({username='slave'} at 127.0.0.1:36040)
I20260709 13:02:54.282879  1719 tablet_copy_service.cc:161] P 4f1725fe36e349ac85405627f9c93d95: Beginning new tablet copy session on tablet 5336feea1c174b498bc0252f726f9461 from peer 6923294c847b48ebb577e0935d316aa3 at {username='slave'} at 127.0.0.1:36040: session id = 6923294c847b48ebb577e0935d316aa3-5336feea1c174b498bc0252f726f9461
W20260709 13:02:54.298468  1444 catalog_manager.cc:4755] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3fe250573e1c4fdd9d93dbaaa494b367: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:02:54.304216  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:54.310052  1719 tablet_copy_source_session.cc:215] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:02:54.312361  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:54.345868  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:54.383271  9997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5336feea1c174b498bc0252f726f9461. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:54.451411  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:54.452030  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:54.456216  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:54.474978  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.502816  9997 tablet_copy_client.cc:806] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:54.503536  9997 tablet_copy_client.cc:670] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:54.521565  9997 tablet_copy_client.cc:538] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:54.539151  9997 tablet_bootstrap.cc:492] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3: Bootstrap starting.
I20260709 13:02:54.543262  2269 raft_consensus.cc:1217] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.11->[20.12-20.12]   Dedup: 20.12->[]
I20260709 13:02:54.580014  2267 raft_consensus.cc:1275] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:02:54.586156  9992 consensus_queue.cc:1048] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:54.601547 10002 tablet_bootstrap.cc:492] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=2 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.612562  9867 raft_consensus.cc:1064] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 13:02:54.642480  9867 consensus_queue.cc:237] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:54.654964 10002 tablet_bootstrap.cc:492] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 13:02:54.658699 10002 ts_tablet_manager.cc:1403] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.409s	user 0.043s	sys 0.011s
I20260709 13:02:54.685631  1701 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:54.688310  9935 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:54.692505  9997 tablet_bootstrap.cc:492] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.700845  9997 tablet_bootstrap.cc:492] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3: Bootstrap complete.
I20260709 13:02:54.702551  9997 ts_tablet_manager.cc:1403] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3: Time spent bootstrapping tablet: real 0.164s	user 0.050s	sys 0.002s
I20260709 13:02:54.702659  2269 raft_consensus.cc:1275] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:54.704914 10002 raft_consensus.cc:359] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:02:54.707062 10005 consensus_queue.cc:1048] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:54.710285  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:54.740008  9997 raft_consensus.cc:359] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:02:54.741132  9997 raft_consensus.cc:740] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
W20260709 13:02:54.741674  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:54.742057  9997 consensus_queue.cc:260] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:02:54.709405 10002 raft_consensus.cc:740] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Initialized, Role: LEARNER
I20260709 13:02:54.773888 10002 consensus_queue.cc:260] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: true } }
I20260709 13:02:54.782902  9997 ts_tablet_manager.cc:1434] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.004s
I20260709 13:02:54.797812  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-5336feea1c174b498bc0252f726f9461 received from {username='slave'} at 127.0.0.1:36040
I20260709 13:02:54.799418  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-5336feea1c174b498bc0252f726f9461 on tablet 5336feea1c174b498bc0252f726f9461 with peer 6923294c847b48ebb577e0935d316aa3
W20260709 13:02:54.808557  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:54.809352  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:54.832377  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:54.835894  2270 raft_consensus.cc:1217] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.11->[20.12-20.12]   Dedup: 20.12->[]
I20260709 13:02:54.847651 10002 ts_tablet_manager.cc:1434] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3: Time spent starting tablet: real 0.187s	user 0.007s	sys 0.000s
I20260709 13:02:54.861059  9867 raft_consensus.cc:2955] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:54.866526  1719 tablet_copy_service.cc:342] P 4f1725fe36e349ac85405627f9c93d95: Request end of tablet copy session 6923294c847b48ebb577e0935d316aa3-6ffd1be44d384b0d9dfc0986195efbd1 received from {username='slave'} at 127.0.0.1:36040
I20260709 13:02:54.867007  1719 tablet_copy_service.cc:434] P 4f1725fe36e349ac85405627f9c93d95: ending tablet copy session 6923294c847b48ebb577e0935d316aa3-6ffd1be44d384b0d9dfc0986195efbd1 on tablet 6ffd1be44d384b0d9dfc0986195efbd1 with peer 6923294c847b48ebb577e0935d316aa3
I20260709 13:02:54.868642  2267 raft_consensus.cc:2955] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:54.893347  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:54.897177  1701 raft_consensus.cc:2955] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:54.920831  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:54.952623  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:54.927117  1457 catalog_manager.cc:5697] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 reported cstate change: config changed from index 12 to 13, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:55.002281  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:55.099166  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:55.129568  9978 raft_consensus.cc:1064] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 13:02:55.132638  9978 consensus_queue.cc:237] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 10, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:55.150761  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:55.151403  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:55.180202  1701 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:55.183140  9935 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:02:55.192307  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:55.201190   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:55.207401  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:55.212981  2267 raft_consensus.cc:1275] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEARNER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:55.215029  9935 consensus_queue.cc:1048] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:02:55.248251  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:55.250001  2267 raft_consensus.cc:1217] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.13->[21.14-21.14]   Dedup: 21.14->[]
W20260709 13:02:55.279423  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:55.290326 10024 log.cc:927] Time spent T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:02:55.294221  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:55.303578  9992 raft_consensus.cc:1064] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 13:02:55.313443  9992 consensus_queue.cc:237] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 10, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:02:55.295377  9978 raft_consensus.cc:2955] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:55.350145  2270 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:55.351616  1635 raft_consensus.cc:1275] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:55.352094  9992 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:55.364810  9965 consensus_queue.cc:1048] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:55.387633  1455 catalog_manager.cc:5697] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 12 to 13, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.388269  2269 raft_consensus.cc:2955] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:55.392561  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:55.440703  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:55.451623  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:55.474501  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:55.486601  1700 raft_consensus.cc:2955] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:55.551271  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:55.585166  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:55.595952  2269 raft_consensus.cc:2955] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:55.593784 10028 raft_consensus.cc:2955] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:55.602378  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 61802.6us
I20260709 13:02:55.645267  1628 raft_consensus.cc:2955] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:55.656527  1456 catalog_manager.cc:5697] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: config changed from index 12 to 13, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:55.665380  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:55.693806  9965 raft_consensus.cc:1064] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: attempting to promote NON_VOTER 6923294c847b48ebb577e0935d316aa3 to VOTER
I20260709 13:02:55.696849  9965 consensus_queue.cc:237] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:02:55.711898  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:55.732805  2269 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 LEARNER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:55.737111 10028 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:02:55.747268  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:55.751462  1628 raft_consensus.cc:1275] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:02:55.753413 10028 consensus_queue.cc:1048] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:02:55.766817  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:55.806654  9965 raft_consensus.cc:2955] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:55.812768  1630 raft_consensus.cc:2955] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:55.867620  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:55.875378  1455 catalog_manager.cc:5697] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 14 to 15, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:02:55.895475  2267 raft_consensus.cc:2955] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:55.975517  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:56.011123  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:56.201690   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:56.243362  1600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111) [suppressed 465 similar messages]
W20260709 13:02:56.246737  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:56.295846  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:56.368060  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:56.380681  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 82994.5us
W20260709 13:02:56.395607  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 90956.8us
W20260709 13:02:56.396636  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 119970us
W20260709 13:02:56.479166  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:56.502096  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:56.503233  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:56.556854  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 273243us
W20260709 13:02:56.665100  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:56.725616  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:56.753058  1444 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 107833us
W20260709 13:02:56.770447  1444 catalog_manager.cc:4755] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3fe250573e1c4fdd9d93dbaaa494b367: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:02:56.836189  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:56.866639  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:56.889739  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:56.968142  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:57.024559  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:57.122867  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:57.199761  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:57.202539   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:57.226568  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:57.232590  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:57.335273  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:57.346841  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:57.372241  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:57.473591  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:57.554498  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7270b72e069f42daa3f82eaa77d9e299 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 7e99891af85f4b10aa1cc2da6aa33082 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:02:57.613335  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:57.646209  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:57.646931  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:57.658442  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:57.815160  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:57.828954  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:57.834692  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:57.923415  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:57.943908  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:57.971762  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.033794  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.195483  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:58.203040   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:58.210693  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 76051.8us
W20260709 13:02:58.211479  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.216830  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.233819  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 69546.9us
W20260709 13:02:58.290330  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 73503.6us
W20260709 13:02:58.298207  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.276420  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.334393  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 90164.9us
W20260709 13:02:58.329669  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.369478  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 71271.7us
W20260709 13:02:58.406522  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.454473  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.459808  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.508030  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.512364  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.547389  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.548045  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.741406  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.762732  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.808343  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.810734  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.813944  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:58.891883  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:59.027700  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:59.141450  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:59.203662   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1581)
W20260709 13:02:59.283527  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:59.979215  1447 maintenance_manager.cc:419] P 72b78a86b5e34075b0982caa9c5426ab: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033392
W20260709 13:03:00.198994  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:00.204219   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1581)
I20260709 13:03:00.338231 10080 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:00.339226 10080 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:00.352748 10080 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:00.406975 10088 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.407733 10088 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.411906 10088 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:00.423265 10073 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:00.424098 10073 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.435545 10073 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:00.470952 10091 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.471606 10091 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.472869 10084 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.474792 10092 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.475383 10092 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.477002 10083 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.473485 10084 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.483682 10091 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:00.501291  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 105645us
I20260709 13:03:00.508183 10091 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.477566 10083 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:00.530277 10091 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.538920  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.545964 10080 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:00.546891 10080 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.554996 10091 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.565208 10092 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.568024 10080 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.571494 10083 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:00.572829 10084 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.573590  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.575951 10091 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.576429 10084 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.576512 10091 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.577203 10084 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.578984 10091 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.579551 10091 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.575001 10099 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.580102 10091 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.580246 10099 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.581499  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.582288 10091 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.583133 10099 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.583535  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.584700 10084 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.585479  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.582921 10091 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.588457  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.593422  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.594271  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.602882 10083 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.604020 10083 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.606474 10083 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.603437 10092 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.603071 10091 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.607234 10092 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:00.609157 10091 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.609958 10092 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:00.611653  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.611907  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.616600  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.618391  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.619916  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.622288  1446 maintenance_manager.cc:643] P 72b78a86b5e34075b0982caa9c5426ab: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.642s	user 0.052s	sys 0.030s Metrics: {"bytes_written":7616,"delete_count":0,"lbm_write_time_us":1504,"lbm_writes_lt_1ms":7,"reinsert_count":0,"thread_start_us":135560,"threads_started":1,"update_count":297,"wal-append.queue_time_us":181307}
I20260709 13:03:00.625126  1447 maintenance_manager.cc:419] P 72b78a86b5e34075b0982caa9c5426ab: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.373155
I20260709 13:03:00.627282  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.627748  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.630271  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.633204 10091 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.633893 10091 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.635183  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.643560 10091 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.644433  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.645833 10087 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:00.646248 10078 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:00.650980 10078 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:00.648442 10087 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:00.654767  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.656286 10087 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:00.657485  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.658620 10078 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:00.663946 10097 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.645548 10104 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.664083  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:00.664710 10099 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.664565 10097 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:00.665228 10099 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.666765 10097 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:00.667264 10097 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.668000  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.667804 10097 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.668344 10086 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:00.669059 10086 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.669596 10086 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:00.669993  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:00.675150  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.675335 10091 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.668046 10084 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.678601 10091 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:00.678925 10084 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:00.680850 10091 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:00.681113 10084 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:03:00.671936  2235 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:00.682684  2235 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:00.685786 10074 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:00.685942 10098 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:00.685513  2235 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:00.685775 10102 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.687378 10092 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.687527 10083 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:03:00.687702  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:00.688021 10092 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.688189 10083 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:00.690888 10092 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.691408 10092 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.691499 10083 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:00.692088 10083 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.691949 10092 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.692675 10083 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.687428 10102 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.695647  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:00.696403 10102 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.675150 10086 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:03:00.667320 10099 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.669972 10097 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.697829  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:03:00.707551  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:00.708264  1600 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:00.708787  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:00.708621  1600 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:00.710201 10078 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:00.699445 10092 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.702308 10099 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:00.711194 10092 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:03:00.709806  1673 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:00.711392 10099 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.712751  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:00.712823  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:00.713634 10105 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:00.714326 10105 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:00.714610  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:00.716112  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.716424  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.716112  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.717600  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.718590  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.719194 10099 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:00.702257  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:00.720017  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.674314 10104 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.710268 10086 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:00.721614  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:00.723439 10104 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.707252 10083 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.728878  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.729741  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.730252  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:03:00.728223  1600 leader_election.cc:336] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:00.731813  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.733300  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.734880  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:03:00.735154  1600 leader_election.cc:336] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:00.735816  1600 leader_election.cc:336] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:00.736397  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.737735  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.733428  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:00.740302 10109 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.740949 10104 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:00.741003 10109 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.741878  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.743480 10109 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.744352  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.746307  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.747362  1601 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:00.748229 10078 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:00.756146  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.757807  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.763007  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:00.770453  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:00.771400 10109 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:00.772763  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:00.778455 10109 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:00.780925  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:00.787722 10109 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:03:00.792630  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:00.790246  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:00.795832 10109 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:00.796095 10080 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:00.796494 10109 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:00.797263  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:00.797987 10080 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:03:00.797034 10109 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:00.800268 10109 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:00.802278  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:00.844031  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:00.845995  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:00.846810 10109 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:00.848002  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:00.848733 10109 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:00.852550  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:03:00.880843  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:00.886960  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:00.887732  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:00.890941  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:00.901181  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:00.920871  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 65588.9us
W20260709 13:03:00.943065  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:00.945523  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:00.961550  1444 catalog_manager.cc:4755] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3fe250573e1c4fdd9d93dbaaa494b367: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:01.000893  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:01.013378  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.017500  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:01.025987  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.026963 10074 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:01.043148  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.054481  1674 leader_election.cc:336] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.054996  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:03:01.056325  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:01.062212 10083 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:01.071409  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.071846  1674 leader_election.cc:336] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.072230  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:03:01.073992  1674 leader_election.cc:336] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.074852  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.078292 10109 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:01.076133 10099 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:01.082253  1674 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:01.083195  1674 leader_election.cc:336] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.083709  1674 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.085019 10099 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:01.085057  1674 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:01.087298  1674 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.087785  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.088627 10099 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:03:01.091065  1674 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.091568  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.093509 10083 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:03:01.093741  1674 leader_election.cc:336] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:01.095109  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.095641  1674 leader_election.cc:336] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.096108  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.096915 10083 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:01.098138  1674 leader_election.cc:336] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.098628  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.099414 10083 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:03:01.100569  1674 leader_election.cc:336] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.101063  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.101814 10083 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:01.102829  1674 leader_election.cc:336] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.103322  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.104188 10083 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:01.126864  1674 leader_election.cc:336] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.127554  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.128772 10083 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:01.131245  1674 leader_election.cc:336] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.138247  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.139180 10099 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:01.140376  1674 leader_election.cc:336] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.140904  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.141693 10099 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:01.146486  1674 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:01.148005  1674 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.148449  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.149236 10099 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:01.193575  1674 leader_election.cc:336] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:01.194164  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:01.195704 10099 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:01.204819   431 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:01.211823  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:01.223753  1446 maintenance_manager.cc:643] P 72b78a86b5e34075b0982caa9c5426ab: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.598s	user 0.093s	sys 0.018s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":29433,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":78548,"lbm_read_time_us":6382,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":25,"lbm_write_time_us":2618,"lbm_writes_lt_1ms":12,"peak_mem_usage":315936,"reinsert_count":0,"thread_start_us":52510,"threads_started":2,"update_count":317}
I20260709 13:03:01.226284  1447 maintenance_manager.cc:419] P 72b78a86b5e34075b0982caa9c5426ab: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:03:01.227151  1446 maintenance_manager.cc:643] P 72b78a86b5e34075b0982caa9c5426ab: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:03:01.271335  2235 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111) [suppressed 395 similar messages]
W20260709 13:03:01.292098  2292 debug-util.cc:398] Leaking SignalData structure 0x7b080021af00 after lost signal to thread 434
W20260709 13:03:01.293251  2292 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5480 after lost signal to thread 1492
W20260709 13:03:01.294725  2292 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5ae0 after lost signal to thread 1659
W20260709 13:03:01.295943  2292 debug-util.cc:398] Leaking SignalData structure 0x7b08002d51e0 after lost signal to thread 1733
W20260709 13:03:01.297113  2292 debug-util.cc:398] Leaking SignalData structure 0x7b08000c56a0 after lost signal to thread 2295
W20260709 13:03:01.382987  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.432096  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.440754  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.451376  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.451987  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.496491  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.570403  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.601949  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.696030  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.696962  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.732293  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.744305  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:01.829144  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.963851  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:01.977082  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:02.028168  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:02.033573  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:02.058164  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:02.103528  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:02.205364   431 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:02.228184  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:02.404083  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:02.418496  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:02.528563  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 59588us
W20260709 13:03:02.540771  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:02.567698  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 98105.4us
W20260709 13:03:02.701756  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:02.742093  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:02.873720  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:02.898212  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:02.911773  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:03.102860  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:03.135680  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.176929  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.181026  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:03.197862  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.206090   431 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:03.217903  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.371465  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.416463  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.491194  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.499002  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.528946  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.558568  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.569825  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:03.577476  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:03.676170  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.738574  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.782836  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.794966  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:03.814297  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:03.831017  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.853175  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.858390  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:03.927984  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.071007  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.131138  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.134429  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.161003  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.207511   431 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:04.248248  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.279335  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:04.330503  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.401997  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.426873  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.440099  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:04.489265  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.546087  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.568037  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.635172  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:04.748479  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.764454  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:04.840476  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:05.097811  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:05.209168   431 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:05.228323  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:05.229116  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:05.250754  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:05.414757  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:05.442822  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:05.528059  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:05.573774  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:05.654395  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:05.656375  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:05.737576  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:05.764881  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:05.765196  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7270b72e069f42daa3f82eaa77d9e299 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 7e99891af85f4b10aa1cc2da6aa33082 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:03:05.833052  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:05.837518  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:05.883502  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:05.982453  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:06.004786  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.102993  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.125504  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.157639  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:06.207656  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:06.209725   431 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:06.223340  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.244990  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.246470  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:06.317943  1600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111) [suppressed 463 similar messages]
W20260709 13:03:06.404824  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.412742  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.466130  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:06.506649  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.527670  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.567166  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:06.736153  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.749645  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.783124  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.789040  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.824451  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.827701  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.867650  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:06.871440  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:06.901168  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:06.908838  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:07.001794  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:07.130355  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:07.164242  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:07.166724  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:07.210408   431 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:07.273257  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:07.274225  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:07.516049  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:07.592845  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:07.673470  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:07.718873  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:07.969937  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:08.081060  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:08.090142  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:08.096426  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:08.109246  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:08.210907   431 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:08.258467  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:08.267138  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:08.278431  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:08.340809  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:08.423578  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:08.503113  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:09.211472   431 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:09.278415  1444 catalog_manager.cc:4755] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3fe250573e1c4fdd9d93dbaaa494b367: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.429085 10141 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:09.430130 10141 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:09.433765 10141 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:09.438787 10148 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:03:09.440304  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 59873.7us
I20260709 13:03:09.441171 10148 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:09.466934 10148 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:09.478689 10153 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:09.479439 10153 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:09.512764 10153 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:09.522866  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:09.554060 10145 raft_consensus.cc:493] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:09.554767 10150 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:09.554745 10145 raft_consensus.cc:515] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:09.555519 10150 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:09.557665 10145 leader_election.cc:290] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:09.558018 10150 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:09.566495  1705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:09.548156 10156 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:09.577713  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:09.577939 10150 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:09.578583 10150 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:09.580952 10156 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:09.582381 10150 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:09.581431  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:09.594293 10156 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:09.595749  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:03:09.602483  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:09.603031  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:09.606168  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:03:09.603804  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:09.610716  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:09.614300  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44a8411cf4642829994ec97173d358a" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:09.619486 10157 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:09.620075 10157 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:09.623114 10157 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:09.632954 10164 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:09.633721 10164 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:09.635118  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:03:09.642102  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 94727.7us
I20260709 13:03:09.651015 10145 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:09.651806 10145 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:09.653002 10164 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:09.655318  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:09.656813 10145 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:09.659765  1599 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:03:09.660604  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:09.661533 10153 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:09.663103  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:09.663373  1599 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:03:09.665601 10153 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:09.667865  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:09.669032  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:09.669747  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:09.670365  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:09.670467  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 48506.9us
W20260709 13:03:09.682754  1600 leader_election.cc:336] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.683357  1600 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:09.684228 10145 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:03:09.685537  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:09.686103  1600 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.686314 10163 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:09.686946 10163 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:09.671226  2235 leader_election.cc:336] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.688163  2235 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:09.689086 10163 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:09.689229  2235 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.689927 10165 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:09.689262 10162 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:09.690620 10165 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:09.691094 10163 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:09.691902 10163 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:09.693166 10165 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:09.690606  1600 leader_election.cc:336] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.693962 10163 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:09.694003  1600 leader_election.cc:304] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:09.694875 10145 raft_consensus.cc:2749] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:09.701326  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:09.709122  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:09.712009  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:09.714329  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:09.716068  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:09.716288  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:09.717696  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:09.725090  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:09.726747  1599 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:03:09.728147 10145 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:09.728744  1674 leader_election.cc:336] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.729317  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:09.732514  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:09.733403 10160 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:09.733909 10157 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:09.737404  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:09.738268  1674 leader_election.cc:336] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.738735  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:09.739552 10160 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:09.740850  1674 leader_election.cc:336] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.741361  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:09.742231 10160 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:09.747334  1674 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.747896  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:09.748708 10160 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:03:09.749781  1674 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.750262  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:09.750993 10160 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:09.752127  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:09.764660  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:09.773669 10138 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:09.834842  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:09.842420  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:09.886197  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:09.888190  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:09.890779  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:09.935413 10145 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:09.936046 10145 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:09.939222  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:09.944424  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:09.954480 10154 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:09.956736 10150 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:09.957938 10150 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:09.955142 10154 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:09.966868  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:09.968267 10154 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:09.969275  1599 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:03:09.969955 10154 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:09.969996  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:03:09.975464  1600 leader_election.cc:336] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.972415 10150 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:09.973109 10145 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:09.974433  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:09.974647  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:03:09.979713  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:09.980172  2236 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:03:09.980237  1600 leader_election.cc:336] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:09.981366 10150 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:09.984516  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:09.985347 10145 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:03:09.986680  2235 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:09.991711  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:10.043432  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:10.044201  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:10.047797  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:10.049852  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:10.104270  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:10.121887  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:10.132560  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:10.157765 10168 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:10.158489 10168 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:10.164776  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:03:10.167141  1600 leader_election.cc:336] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:10.167582  1600 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:10.169164 10145 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:10.167675 10168 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:10.212146   431 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:10.265755  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:10.354832  2292 debug-util.cc:398] Leaking SignalData structure 0x7b0800358e40 after lost signal to thread 434
W20260709 13:03:10.356045  2292 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3da0 after lost signal to thread 1492
W20260709 13:03:10.357399  2292 debug-util.cc:398] Leaking SignalData structure 0x7b0800340880 after lost signal to thread 1659
W20260709 13:03:10.358628  2292 debug-util.cc:398] Leaking SignalData structure 0x7b08003ea920 after lost signal to thread 1733
W20260709 13:03:10.398787  2292 debug-util.cc:398] Leaking SignalData structure 0x7b08003cbce0 after lost signal to thread 2295
W20260709 13:03:10.508312  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:10.519656  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:10.656344  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:10.749540  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:10.838140  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 86474.8us
W20260709 13:03:10.930155  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:10.952612  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:11.011845  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 59287.5us
W20260709 13:03:11.207049  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:11.211973  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 54154us
W20260709 13:03:11.212729   431 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:11.320779  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:11.321300  1600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111) [suppressed 391 similar messages]
W20260709 13:03:11.383889  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:11.479944  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:11.514931  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:11.496459  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:11.619139  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:11.620819  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:11.623257  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:11.649873  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 47097.3us
W20260709 13:03:11.782519  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:11.784009  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:11.850854  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 66869.4us
W20260709 13:03:11.871840  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:11.850368  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:11.873446  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:11.904990  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:11.972544  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.010542  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:12.076630  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.178568  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.188192  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:12.213186   431 thread.cc:527] Waited for 21000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:12.250675  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.285905  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.373383  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.454946  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:12.467540  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.507658  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.567989  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 60342.3us
W20260709 13:03:12.618673  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.619400  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.631999  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:12.632565  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.638854  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:12.642983  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.642370  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:12.646971  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.657970  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.752477  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.769065  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:12.791290  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.825054  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:12.870792  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:13.141068  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:13.143527  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 57492.5us
W20260709 13:03:13.213712   431 thread.cc:527] Waited for 22000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:13.214318  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:13.299726  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:13.307755  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:13.580260  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:13.606693  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:13.641075  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:13.744263  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:13.745106  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:13.804395  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:13.895850  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:13.968345  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.010016  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.045356  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.088131  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:14.094561  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.137519  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.211578  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:14.214282   431 thread.cc:527] Waited for 23000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:14.309556  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:14.318701  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:14.356418  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.371917  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.436054  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.442616  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.451426  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.551854  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.593696  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:14.682968  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.775259  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.866611  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.936743  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:14.937289  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.949863  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:14.951328  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:14.966858  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:15.003113  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:15.069341  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:15.126092  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:15.140901  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:15.144079  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:15.213467  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:15.214917   431 thread.cc:527] Waited for 24000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:15.218376  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:15.350973  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 69702.5us
W20260709 13:03:15.423386  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:15.438915  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:15.465131  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:15.484997  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:15.490980  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:16.215428   431 thread.cc:527] Waited for 25000ms trying to join with diag-logger (tid 1581)
I20260709 13:03:16.545149 10177 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:16.546087 10177 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.548786 10177 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:16.631652 10177 raft_consensus.cc:493] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.632524 10177 raft_consensus.cc:515] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:16.635483 10177 leader_election.cc:290] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:16.692421 10177 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.693354 10177 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.696206 10177 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:16.724957 10180 raft_consensus.cc:493] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:16.726058 10179 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.728443 10179 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:16.731137 10179 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:16.727440 10180 raft_consensus.cc:515] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.735028 10180 leader_election.cc:290] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:16.751344 10180 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:16.752002 10180 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.754105 10180 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:16.754451 10185 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:16.754653 10180 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:16.756270 10180 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.756382 10185 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.759215 10180 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:16.759370 10179 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.760385 10185 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:16.759981 10179 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.764452 10179 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:16.784819 10181 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.785645 10181 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.787861 10181 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:16.820930 10187 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.821218 10182 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.821704 10185 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.822785 10188 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:16.823122 10182 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.825158 10188 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.823731 10185 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.827117 10182 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:16.827167 10188 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:16.823022 10187 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.828601 10185 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:16.829768 10187 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:16.887615 10181 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:16.885370 10191 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:16.889698 10181 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.891127 10191 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.893916 10179 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.894907 10179 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:16.895164 10181 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:16.899317 10180 raft_consensus.cc:493] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:16.897758 10191 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:16.903959  1600 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111) [suppressed 395 similar messages]
I20260709 13:03:16.900574 10180 raft_consensus.cc:515] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.897735 10179 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:16.908595 10181 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:16.910943 10181 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.927098 10182 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.927027 10185 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:16.938884 10177 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.940033 10177 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.928005 10188 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:16.934126 10184 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.929679 10182 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.984901 10185 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.988466 10185 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:16.990465 10202 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.991665 10202 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.995829 10193 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:16.997016 10193 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.001159 10188 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:16.960160 10179 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.001688 10194 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:17.010582 10184 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.007118 10181 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:17.015127 10182 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.015955 10179 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.020057 10180 leader_election.cc:290] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.024595 10188 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.021435 10194 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.015025 10177 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.033788 10179 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.035064 10184 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.036445 10182 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.037478 10182 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.041735 10182 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:17.025585  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 121760us
I20260709 13:03:17.053336 10194 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.055930 10193 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.058420 10202 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.061569 10182 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.073132 10205 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.089498 10182 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.062189 10188 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:17.091872 10188 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.089610 10205 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.092654 10184 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.093528 10184 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.094799 10205 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.094940 10197 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:17.061092 10185 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.059135 10181 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.058382 10180 raft_consensus.cc:493] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.103282 10203 raft_consensus.cc:493] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.104458 10203 raft_consensus.cc:515] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.106359 10181 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.108994 10181 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:17.100623 10185 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.110677 10179 raft_consensus.cc:493] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:17.111224 10197 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.111593 10179 raft_consensus.cc:515] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:17.101028 10202 raft_consensus.cc:493] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.113200 10185 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.113559 10202 raft_consensus.cc:515] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.113778 10197 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.118319 10204 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.119422 10184 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.119204 10204 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.120503 10210 raft_consensus.cc:493] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.121320 10210 raft_consensus.cc:515] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.122447 10192 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.121903 10204 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.123266 10198 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.115299 10209 raft_consensus.cc:493] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:17.126711 10201 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.142098 10192 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.142457 10201 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:17.145104 10201 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:17.128746 10189 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.145453 10198 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.155851 10204 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.158708 10204 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:17.160147 10198 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.129556 10195 raft_consensus.cc:493] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.160971 10204 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:17.155627  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.131428 10191 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.162533 10191 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.156212 10209 raft_consensus.cc:515] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:17.165576 10191 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.133781 10188 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.145124 10192 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.161304 10195 raft_consensus.cc:515] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.166733 10189 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.168387 10195 leader_election.cc:290] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.131872 10180 raft_consensus.cc:515] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.170195  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.171295  1626 raft_consensus.cc:2468] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:03:17.173043  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee92ce4d1fe4cbdbec21419ac95fa2f" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.176697 10189 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.180871  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.182796  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.130600 10208 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.184471  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.200776  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c546ee055ea8417b8c1054e545eee77c" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.203667  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.208510 10180 leader_election.cc:290] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.209823 10182 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:17.216172   431 thread.cc:527] Waited for 26000ms trying to join with diag-logger (tid 1581)
I20260709 13:03:17.217490 10203 leader_election.cc:290] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.226058  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.227011  2268 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:03:17.228204 10210 leader_election.cc:290] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.230703 10208 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:17.233889 10208 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:03:17.236284 10202 leader_election.cc:290] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.237294 10209 leader_election.cc:290] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.238291  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.244755  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.245620  1633 raft_consensus.cc:2468] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:03:17.247275  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.248132  1627 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:03:17.249184  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.249856  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.250860  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.250989  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.236133 10179 leader_election.cc:290] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.261906 10212 raft_consensus.cc:493] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:03:17.262753  1600 leader_election.cc:336] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.262709 10212 raft_consensus.cc:515] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:17.265673 10212 leader_election.cc:290] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.251499  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.252067  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:03:17.252745  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.253484  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "461e1b446c454dbfa1bd2a8ae75ae2c4" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.253921  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.255635  1634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.256350 10180 raft_consensus.cc:493] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.267753 10180 raft_consensus.cc:515] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.270130 10207 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:03:17.270699 10207 raft_consensus.cc:493] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:17.271106 10207 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:17.256976  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f981c1c6e2c5466395ecd385d6b24151" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.275821 10208 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.270177 10180 leader_election.cc:290] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.276844 10209 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.276631 10208 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.277667 10209 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.279431 10208 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.280925 10180 raft_consensus.cc:493] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:17.281584 10180 raft_consensus.cc:515] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:17.283090  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.280056 10209 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.283679  1631 raft_consensus.cc:2468] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:03:17.283949 10180 leader_election.cc:290] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.284863  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.280270  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.287712  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.281517  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:03:17.263504  1600 leader_election.cc:336] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.300379  1627 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:03:17.301609  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.303016 10208 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.303915  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.304661  2267 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 17.
I20260709 13:03:17.303704 10208 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.307173  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.308282  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db8014a9a7494e619e862cbd380cb262" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.308442 10208 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.316622  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.317057  2234 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:03:17.316622  1627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.318043 10182 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:17.318542 10182 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:17.319001 10182 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:17.322425  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.325491  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.326251  2270 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 22.
I20260709 13:03:17.326403  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.326592  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6b0ca7e03c249ebad5c6f720df4efca" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:03:17.328509  1600 leader_election.cc:336] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:17.329197  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:17.329792  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:17.330425  1600 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:17.331012  1600 leader_election.cc:336] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.333458 10203 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.334206 10203 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.336637 10203 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.336683 10192 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.337286 10204 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.337396 10203 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.337600 10192 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.338171 10205 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.338050 10204 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.338900 10205 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:17.339969 10192 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.340162 10204 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.340538 10192 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.340672 10204 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.341034 10205 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:17.341188 10192 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.341378 10204 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.342150 10203 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.336630 10189 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.343254 10189 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:17.343860 10204 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.344249 10203 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.344807 10213 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.345404 10189 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:17.347461 10192 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.350204 10207 raft_consensus.cc:515] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.352754 10207 leader_election.cc:290] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.354398  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56d2e4b816a44719af0c86481062c407" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.356611  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:03:17.357227  1628 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:17.345453 10213 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:17.360378  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.362444 10213 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:17.361726  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.368495  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.370273 10182 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.372961  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.373482 10182 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.373024  1632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.374610  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.375375  1630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d65ebb9a940495b98325fe3474babd1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.373747  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:03:17.378643  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.384187  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.391259  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb004c86c654110bd570a13f623ed9f" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:03:17.397584  1600 leader_election.cc:336] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:17.401178  1600 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.402274 10213 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.402483 10189 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.402971 10213 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:17.403256 10189 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.405164 10213 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:17.405496 10189 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:17.407653  1600 leader_election.cc:336] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.415709 10189 raft_consensus.cc:493] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.416857  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.417738  2268 raft_consensus.cc:2393] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 19: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:03:17.418154  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.418201 10189 raft_consensus.cc:515] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.420957 10189 leader_election.cc:290] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.421909  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:03:17.415189  1600 leader_election.cc:336] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.415263  1628 raft_consensus.cc:2468] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 19.
I20260709 13:03:17.424027  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.424925  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e325950f4164ab99442980dc2c53386" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.425596  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.426355  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b113b168afa40cfaab164f8317e42c1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.426960  1599 leader_election.cc:304] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.427367  1635 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:17.429257 10194 raft_consensus.cc:2749] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:17.418421  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.431886  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af202c0dfac940fb86d9d9d0a9124f44" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:03:17.422998  1600 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.431962  1599 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.435212  2234 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:03:17.434144 10209 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:17.440049  1599 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:03:17.441450 10180 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:17.441874 10180 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:17.442281 10207 raft_consensus.cc:2804] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:17.442530 10213 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.442982 10207 raft_consensus.cc:697] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:03:17.443269 10192 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.443349 10213 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.443948 10192 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.442801 10208 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.446427  1599 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.447218 10192 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.447937 10192 raft_consensus.cc:493] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.442277 10180 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:17.448448 10207 consensus_queue.cc:237] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.446357 10215 raft_consensus.cc:493] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.447147 10208 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:17.454497 10215 raft_consensus.cc:515] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.456466 10208 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:17.457314 10215 leader_election.cc:290] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.445884 10213 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.459769  1599 leader_election.cc:304] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:03:17.459798  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 50904.4us
W20260709 13:03:17.461002  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 54144us
I20260709 13:03:17.461444  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.462419 10215 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:17.463685 10209 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:17.468779  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.470300 10209 raft_consensus.cc:2749] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:17.470281  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ce7dbd8e7cf45808506e02da2925882" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.471052  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.471099  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.448552 10192 raft_consensus.cc:515] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.484251 10192 leader_election.cc:290] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.478844  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88018a232de842fc8fcd30e124b7c4d7" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.487286  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.471714 10213 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:17.489500  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.490063  1709 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 23.
I20260709 13:03:17.490996  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a45da2e3894b42dc93ed11eb2c31220c" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:03:17.494285  1600 leader_election.cc:336] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.489081  1599 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.496932  1599 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.497910 10179 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:17.498667 10179 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:03:17.503562  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.504205  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.505481  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.505635  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.507553  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.507130  1700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.508535  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a80c9a41a3498da7aa33d70b18ace6" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.509238  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.509864  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.510628  1707 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:03:17.511894  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.513417  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.514494  1599 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.514685  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.515604 10194 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:17.518604  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.520298  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.521803  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.507066  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.522351  1703 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 28.
I20260709 13:03:17.523689  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.524336  1703 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
W20260709 13:03:17.524484  1600 leader_election.cc:336] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:17.526135  1600 leader_election.cc:336] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.526588  1600 leader_election.cc:304] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.526800  1599 leader_election.cc:304] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.527304  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:03:17.527601  1600 leader_election.cc:336] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.527930 10194 raft_consensus.cc:2749] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:03:17.528376  1600 leader_election.cc:336] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.528716 10194 raft_consensus.cc:2749] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:17.528906  1600 leader_election.cc:336] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.529382  1600 leader_election.cc:304] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.530376  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.531015  1703 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 25.
I20260709 13:03:17.532640  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.533385  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.533495  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:03:17.534201  1703 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:03:17.535022  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.535771  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:03:17.536312  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.536657  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.537030  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5336feea1c174b498bc0252f726f9461" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:03:17.538692  1600 leader_election.cc:336] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.541877 10212 raft_consensus.cc:2749] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:17.538087 10180 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.544680  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.546526  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.547943 10213 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:17.554062  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.554610  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:03:17.555677  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.557624  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab2c76ce9ba4519b8beb7decd86314d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.557950  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.558651  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcdd2749ff424225974f40bab0aaff25" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.559461 10180 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.572584  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8fae2aaea9349b488e73c3574050a18" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 30 candidate_status { last_received { term: 29 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.584067  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ca31f55ece4416bc4225ea16dc1728" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.585342  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.585494  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddb83400fc244a9ba5283309591785d" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.586159  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52157fbf77948c283b3ba328c6ebcdd" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.587669  1706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:03:17.592489  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 54680.1us
I20260709 13:03:17.594182  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b42bc07b3d4b49afb7d3e929183dd2" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:17.595460 10208 consensus_queue.cc:1059] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:17.596704 10211 raft_consensus.cc:3055] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:17.597083 10211 raft_consensus.cc:740] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:03:17.597972 10211 consensus_queue.cc:260] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.599368 10211 raft_consensus.cc:3060] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:17.608714  2267 raft_consensus.cc:1240] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:03:17.618378  1635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc48c88f26dc4e35ae381c821f0a805d" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.620072  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e0e763e6004147b0d7ea0abb37c886" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.619410  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.623343  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.622412  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.628160  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.628566  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:17.629959  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.631534 10184 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:03:17.631613  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:03:17.632540 10184 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:17.633216  1601 leader_election.cc:304] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.633623  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86aa6466101d44fc98160eb3586dc176" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.634405 10180 raft_consensus.cc:2749] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:17.634337  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a03f3312f4e6bac9383280b5b9131" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:03:17.628180  1674 leader_election.cc:336] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.635187  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffc7074d09d4b0a8caf498542f3e843" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.635609  1601 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:03:17.639199 10180 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:03:17.639611 10180 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:17.640072 10180 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:17.642437  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:17.652990  1601 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:03:17.654104 10184 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:17.637570  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 74993.6us
I20260709 13:03:17.667377 10180 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.693324  1673 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.694442  1673 leader_election.cc:304] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.696120 10189 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:17.702821  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.703745 10215 raft_consensus.cc:2749] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:03:17.671316  1456 catalog_manager.cc:5697] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 18 to 19, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.674506  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:03:17.681536  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:17.704077  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.704349 10192 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:17.709769 10192 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:17.713020  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.670491  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.714248 10192 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:03:17.714470 10184 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:17.716025  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.716259 10207 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:17.717790  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 47484.6us
I20260709 13:03:17.722203  1601 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:03:17.726224 10192 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:17.727142  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.738220 10192 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:17.729399  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.750603 10184 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:17.752943 10180 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:17.753870 10207 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:03:17.754503 10207 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.754988 10207 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:03:17.755653  2292 debug-util.cc:398] Leaking SignalData structure 0x7b0800262320 after lost signal to thread 434
W20260709 13:03:17.757028  2292 debug-util.cc:398] Leaking SignalData structure 0x7b08002c73a0 after lost signal to thread 1492
W20260709 13:03:17.758479  2292 debug-util.cc:398] Leaking SignalData structure 0x7b080009ea20 after lost signal to thread 1659
W20260709 13:03:17.759774  2292 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0120 after lost signal to thread 1733
W20260709 13:03:17.761229  2292 debug-util.cc:398] Leaking SignalData structure 0x7b0800112c40 after lost signal to thread 2295
W20260709 13:03:17.767143  1674 leader_election.cc:336] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.767755  1674 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.769752  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.772889  1601 leader_election.cc:304] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:03:17.773917 10197 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:03:17.774451 10197 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:17.774897 10197 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:03:17.786360  1674 leader_election.cc:336] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.787382 10192 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:17.790979 10184 raft_consensus.cc:2749] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:17.786917  1674 leader_election.cc:304] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.798663 10192 raft_consensus.cc:2749] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:17.799448  1674 leader_election.cc:336] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:17.800302  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:17.800709  1674 leader_election.cc:336] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.801069  1674 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.801783 10192 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:17.804069  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:03:17.827397  2235 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.831571  1628 raft_consensus.cc:1240] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Rejecting Update request from peer 6923294c847b48ebb577e0935d316aa3 for earlier term 23. Current term is 24. Ops: []
I20260709 13:03:17.833829 10188 consensus_queue.cc:1059] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:03:17.835120 10181 raft_consensus.cc:3055] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:03:17.835516 10181 raft_consensus.cc:740] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:03:17.836462 10181 consensus_queue.cc:260] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.837738 10181 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:03:17.843017  1626 raft_consensus.cc:1240] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 22. Current term is 23. Ops: []
W20260709 13:03:17.846158  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 44101.8us
W20260709 13:03:17.847007  1674 leader_election.cc:336] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.847627  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.863687 10215 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:17.864388 10192 consensus_queue.cc:1059] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:03:17.864842  1674 leader_election.cc:336] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.865392  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.866191 10213 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:17.866379  1674 leader_election.cc:336] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.866830  1628 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:03:17.866925  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.865921 10192 raft_consensus.cc:3055] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:03:17.867600 10192 raft_consensus.cc:740] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:03:17.867894 10207 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.868605 10192 consensus_queue.cc:260] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:17.870225 10192 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:03:17.872198 10182 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:03:17.874305 10215 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:17.874617  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 70581.3us
I20260709 13:03:17.877075  1673 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.878017 10215 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:17.882539  1601 leader_election.cc:304] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.884339  1601 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:03:17.884788 10179 raft_consensus.cc:2749] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:17.885592 10179 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:17.886353  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:03:17.888649 10182 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:03:17.889508  2235 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:03:17.890817  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 63430.1us
W20260709 13:03:17.891297  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:17.852106 10197 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:17.891516  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:17.907145  2235 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.907615  2235 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.895748  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:03:17.896042 10182 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:17.902160  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:17.905081 10207 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.894825 10197 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:17.898775  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:17.913290 10192 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:17.914698  1673 leader_election.cc:304] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.915717 10192 raft_consensus.cc:2749] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:17.918815  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
W20260709 13:03:17.867930  1674 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.919680  1674 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.921593 10215 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:17.885725  1601 leader_election.cc:304] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.920500 10192 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:17.923241 10180 raft_consensus.cc:2749] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:17.924378  1674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 56458.6us
I20260709 13:03:17.925401  1601 leader_election.cc:304] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:03:17.926749  1674 leader_election.cc:336] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.927313  1674 leader_election.cc:304] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.928440 10192 raft_consensus.cc:2749] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:17.929662  1674 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:17.930787  1674 leader_election.cc:336] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:17.931901  1674 leader_election.cc:336] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.932509  1674 leader_election.cc:304] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.933481 10192 raft_consensus.cc:2749] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:03:17.934949  1674 leader_election.cc:336] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.935462  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.936357 10192 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:03:17.937567  1674 leader_election.cc:336] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.938143  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.939002 10192 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:17.940577  1674 leader_election.cc:336] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.942725  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:03:17.944623  1674 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.945081  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.945498  1601 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
W20260709 13:03:17.949947  2235 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.950744  2235 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.954932 10192 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:17.942539 10182 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:17.959473  1674 leader_election.cc:336] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.959991  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.963500  2263 raft_consensus.cc:1240] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 25. Current term is 26. Ops: []
W20260709 13:03:17.971727  1674 leader_election.cc:336] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.972407  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.973063  1601 leader_election.cc:304] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:03:17.973415  1674 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.976897 10199 raft_consensus.cc:2749] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:17.978361  2269 raft_consensus.cc:1240] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Rejecting Update request from peer 4f1725fe36e349ac85405627f9c93d95 for earlier term 20. Current term is 21. Ops: []
I20260709 13:03:17.974681  1674 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.983950  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:03:17.961056 10180 raft_consensus.cc:2749] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:17.971714 10215 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:17.964145 10192 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:17.987659  1674 leader_election.cc:336] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.989096  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.973899 10205 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:17.991379  1674 leader_election.cc:336] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:17.992223  1674 leader_election.cc:304] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:17.975337 10212 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:03:18.001408 10202 consensus_queue.cc:1059] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:18.004078 10189 raft_consensus.cc:2749] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:17.992790  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:03:17.992105 10182 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:18.012212 10215 consensus_queue.cc:1059] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:17.990999 10203 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:03:18.013478 10215 raft_consensus.cc:3055] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:03:18.013954 10215 raft_consensus.cc:740] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:03:17.992045 10204 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:18.016196 10212 raft_consensus.cc:3055] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:03:18.016723  2264 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 24.
I20260709 13:03:18.016805 10212 raft_consensus.cc:740] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:03:18.025350 10212 consensus_queue.cc:260] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:18.014890 10215 consensus_queue.cc:260] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:18.027571 10215 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:18.047506 10212 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:03:18.050410  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 63554.1us
W20260709 13:03:18.057301  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 68410.5us
I20260709 13:03:18.058323  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:03:18.064726  1599 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:03:18.067330  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 117383us
W20260709 13:03:18.067925  2235 leader_election.cc:336] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:18.068333  2235 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:18.069371 10181 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:18.070389 10232 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:03:18.071239 10232 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:03:18.074364 10232 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:18.078105  2235 leader_election.cc:336] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:18.083048  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:18.083751  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
W20260709 13:03:18.095757  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:03:18.098902  2235 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:18.101504  1707 raft_consensus.cc:1275] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:03:18.126329  2235 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 56776.8us
W20260709 13:03:18.129457  2235 leader_election.cc:336] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:18.129925  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:18.139497 10234 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:18.146574  1456 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 23 to 24, leader changed from 6923294c847b48ebb577e0935d316aa3 (127.0.107.196) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 24 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.148856 10181 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:18.149204  2235 leader_election.cc:336] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:18.149695  2235 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:03:18.150717  2235 leader_election.cc:336] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:18.151160  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:18.151546  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:18.152026 10181 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:18.152679  2235 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:18.152822 10181 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:03:18.153201  2235 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:18.154192 10181 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:18.151166 10182 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:18.146486  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:18.155690  2235 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:18.156124  2235 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:18.163743 10227 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:18.165469  2235 leader_election.cc:336] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:18.165987  2235 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:18.175065 10227 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:18.176164  2235 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:18.180136  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:18.184082 10188 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:03:18.185374 10226 consensus_queue.cc:1048] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:03:18.180058  2235 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:18.193523 10207 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:18.193814  2235 leader_election.cc:336] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:18.194443  2235 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:18.195240 10207 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:18.211591  2264 raft_consensus.cc:1240] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 29 FOLLOWER]: Rejecting Update request from peer 7e99891af85f4b10aa1cc2da6aa33082 for earlier term 28. Current term is 29. Ops: []
W20260709 13:03:18.217741   431 thread.cc:527] Waited for 27000ms trying to join with diag-logger (tid 1581)
I20260709 13:03:18.222750 10202 consensus_queue.cc:1059] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:18.223884 10231 raft_consensus.cc:3055] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:03:18.224279 10231 raft_consensus.cc:740] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:03:18.225171 10231 consensus_queue.cc:260] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:18.231614 10231 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:03:18.303249  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:18.328914  2269 consensus_queue.cc:237] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:18.362389  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:18.362979  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:18.363953  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:18.364403  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:18.370678  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:18.388391  1626 raft_consensus.cc:1275] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:03:18.392971  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:18.405575 10227 consensus_queue.cc:1048] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:18.539274  1704 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:03:18.550170  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:18.555297  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:18.557678  1704 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:18.568293 10207 raft_consensus.cc:2955] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 6 to 14, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:03:18.575241  1633 raft_consensus.cc:2955] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 6 to 14, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
I20260709 13:03:18.592108 10231 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:03:18.612452  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:18.628270  1443 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 86aa6466101d44fc98160eb3586dc176 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 13:03:18.627724  1456 catalog_manager.cc:5697] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: config changed from index 6 to 14, VOTER 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) evicted. New cstate: current_term: 20 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:03:18.665172  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:18.672762  2269 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:03:18.682140 10231 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 13:03:18.767262  1692 tablet_service.cc:1558] Processing DeleteTablet for tablet 86aa6466101d44fc98160eb3586dc176 with delete_type TABLET_DATA_TOMBSTONED (TS 4f1725fe36e349ac85405627f9c93d95 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:40598
W20260709 13:03:18.789757  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:18.794297 10251 tablet_replica.cc:333] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
W20260709 13:03:18.799618  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:18.843786  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:18.889410  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:18.909056 10251 raft_consensus.cc:2243] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:18.910006 10251 raft_consensus.cc:2272] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:18.918416 10251 ts_tablet_manager.cc:1916] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:03:18.947865  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:18.951527  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:19.002461  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:19.009856 10251 ts_tablet_manager.cc:1929] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.13
I20260709 13:03:19.020064 10251 log.cc:1199] T 86aa6466101d44fc98160eb3586dc176 P 4f1725fe36e349ac85405627f9c93d95: Deleting WAL directory at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0/minicluster-data/ts-2-root/wals/86aa6466101d44fc98160eb3586dc176
W20260709 13:03:19.016683  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:19.011763 10227 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:19.026556 10227 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:19.028198  1445 catalog_manager.cc:5028] TS 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): tablet 86aa6466101d44fc98160eb3586dc176 (table test-workload [id=c888126390e24065b80c176a28a9339c]) successfully deleted
I20260709 13:03:19.036839 10227 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:19.040045  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:19.040766  1704 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:03:19.042192  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:19.042333  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:03:19.042980  1633 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 23: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:03:19.043375 10227 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:03:19.049026 10227 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:19.049414 10227 raft_consensus.cc:3060] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:03:19.052448  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:19.071216  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:19.091966  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:19.135654  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:19.138166 10227 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:19.141188  1633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:03:19.141904  1633 raft_consensus.cc:2393] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6923294c847b48ebb577e0935d316aa3 in current term 23: Already voted for candidate 7e99891af85f4b10aa1cc2da6aa33082 in this term.
I20260709 13:03:19.141795  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:03:19.166982 10227 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:19.167650  1704 raft_consensus.cc:2468] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 23.
I20260709 13:03:19.170091  2236 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:19.171284 10227 raft_consensus.cc:2804] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:03:19.172051  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:19.173432 10227 raft_consensus.cc:697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:03:19.176965 10227 consensus_queue.cc:237] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:19.209823 10231 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.210374 10231 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:19.211025  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:19.213560 10231 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:19.214347  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:19.215045  1704 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 25.
I20260709 13:03:19.216342  1601 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:03:19.218098 10212 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:03:19.218238   431 thread.cc:527] Waited for 28000ms trying to join with diag-logger (tid 1581)
I20260709 13:03:19.218505 10212 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.218919 10212 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:19.220490  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:19.221083  2267 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 26.
I20260709 13:03:19.233894  1456 catalog_manager.cc:5697] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 22 to 23, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 23 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.239768 10212 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:19.242547  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:03:19.243178  1704 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:03:19.248237 10231 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:19.248867 10231 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:19.251164 10231 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:19.253046  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:19.253896  2267 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 21: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:03:19.258149  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:19.261003  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:19.261790  1707 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:03:19.263078  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 6923294c847b48ebb577e0935d316aa3
I20260709 13:03:19.264184 10231 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:03:19.264595 10231 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:19.264988 10231 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:03:19.279788  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:03:19.280436  2267 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:03:19.281873 10212 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 27 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:19.284410 10252 log.cc:927] Time spent T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:03:19.288707  2267 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 27.
I20260709 13:03:19.288726  1704 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 27.
I20260709 13:03:19.290771  1599 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:03:19.292315  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:19.292320 10202 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:03:19.294204 10202 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:03:19.295077 10202 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:19.338816  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:03:19.309120 10231 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:19.346518  1709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:03:19.354188  1709 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 21.
I20260709 13:03:19.355638  1601 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
W20260709 13:03:19.354605  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:19.371611 10256 log.cc:927] Time spent T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:03:19.372795 10202 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:03:19.373370 10202 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:03:19.381181 10231 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:19.383006 10202 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:19.399370  1456 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:19.418846  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 63296.5us
I20260709 13:03:19.428339  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:03:19.429169  2267 raft_consensus.cc:2393] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e99891af85f4b10aa1cc2da6aa33082 in current term 21: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
W20260709 13:03:19.450495  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:19.451180  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:19.488890  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:19.483220  1456 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 20 to 21, leader changed from 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195) to 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194). New cstate: current_term: 21 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.542856 10212 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.543426 10212 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:19.547125  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:19.545718 10212 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:19.555374  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:19.585031 10189 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:19.585681 10189 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:19.587910 10189 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:19.589313  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:19.590164  1631 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 29.
I20260709 13:03:19.593521  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:03:19.594501 10189 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:03:19.594960 10189 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:19.595379 10189 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:03:19.596297  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 61739.5us
I20260709 13:03:19.612759  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:19.613778  2267 raft_consensus.cc:2393] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 in current term 29: Already voted for candidate 6923294c847b48ebb577e0935d316aa3 in this term.
I20260709 13:03:19.617801  1633 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:03:19.627942  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:19.628616  2267 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 29.
W20260709 13:03:19.640043  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:19.659194 10264 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:03:19.674894 10189 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:19.677275 10189 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 29 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:19.678534  1599 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95
I20260709 13:03:19.679394 10212 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:03:19.679813 10212 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.680234 10212 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:03:19.689395 10212 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:19.692051  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:03:19.692625  1702 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:03:19.700042 10212 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 30 election: Requested vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:19.700106  1702 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 30.
I20260709 13:03:19.711966  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:03:19.712678  2264 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:03:19.711970  1601 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082; no voters: 
I20260709 13:03:19.713582 10212 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:03:19.714084 10212 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 30 LEADER]: Becoming Leader. State: Replica: 7e99891af85f4b10aa1cc2da6aa33082, State: Running, Role: LEADER
I20260709 13:03:19.714962 10212 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:19.718747  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:19.725970  2264 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e99891af85f4b10aa1cc2da6aa33082 in term 30.
W20260709 13:03:19.740013  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:19.759147  1631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082"
I20260709 13:03:19.789894  1704 raft_consensus.cc:1275] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:03:19.795542  1456 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 reported cstate change: term changed from 28 to 30. New cstate: current_term: 30 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.821619  1704 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:03:19.825002 10202 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:19.833387  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:03:19.834115  2264 raft_consensus.cc:2368] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 29. Current term is 30.
I20260709 13:03:19.836879  1673 leader_election.cc:400] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 29 election: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 29. Current term is 30.
I20260709 13:03:19.837186  1673 leader_election.cc:403] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 29 election: Cancelling election due to peer responding with higher term
I20260709 13:03:19.838011 10189 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 30 FOLLOWER]: Leader election lost for term 29. Reason: Vote denied by peer 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311) with higher term. Message: Invalid argument: T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f1725fe36e349ac85405627f9c93d95 for earlier term 29. Current term is 30.
I20260709 13:03:19.866540  2269 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:03:19.876559 10263 consensus_queue.cc:1048] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:03:19.880693  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:19.884600 10258 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:03:19.893460  2265 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:03:19.912603  1704 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:03:19.920318 10261 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:03:19.921209 10260 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:03:19.921700  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:19.930195 10263 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.931252 10263 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:19.933596 10263 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:19.935371  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:20.011631  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:03:20.051582  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 91978.5us
W20260709 13:03:20.101966  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:20.128584  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 94048us
I20260709 13:03:20.146684  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:20.148113 10264 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:20.150786  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 99272.8us
W20260709 13:03:20.182086  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:20.218793   431 thread.cc:527] Waited for 29000ms trying to join with diag-logger (tid 1581)
I20260709 13:03:20.253144  1704 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 30 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
W20260709 13:03:20.276612  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:20.283245  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:20.329985 10283 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:03:20.407074  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:03:20.408437  2269 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 30 FOLLOWER]: Refusing update from remote peer 7e99891af85f4b10aa1cc2da6aa33082: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 13:03:20.412612 10202 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:03:20.524653  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:20.619694  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:20.747584  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:20.748075  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:20.748953  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:20.751385  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:20.795372  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:20.795964  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:20.801923  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:20.988561  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.004885  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:21.090849  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.125557  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.224337   431 thread.cc:527] Waited for 30000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:21.243635  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.293422  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.375697  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.406534  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.765669  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.766345  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.766961  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.767355  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.767884  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:21.768306  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.768704  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.779960  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 261562us
W20260709 13:03:21.833575  2234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 43663us
W20260709 13:03:21.835886  1601 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45513, user_credentials={real_user=slave}} blocked reactor thread for 103422us
W20260709 13:03:21.841668  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:21.876207  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:21.880442  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:21.888518  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.890833  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.891453  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:21.891939  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.895473  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:21.901501  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:21.914934  1674 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111) [suppressed 469 similar messages]
W20260709 13:03:21.935458  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:22.075048  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:22.174348  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:22.182098  1443 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7270b72e069f42daa3f82eaa77d9e299 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 7e99891af85f4b10aa1cc2da6aa33082 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 17 leader_uuid: "7e99891af85f4b10aa1cc2da6aa33082" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } } }
W20260709 13:03:22.224877   431 thread.cc:527] Waited for 31000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:22.275887  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:22.339924  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:22.385502  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:22.429432  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08000cd460 after lost signal to thread 434
W20260709 13:03:22.430593  1730 debug-util.cc:398] Leaking SignalData structure 0x7b080012c9e0 after lost signal to thread 1492
W20260709 13:03:22.431914  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd3a0 after lost signal to thread 1659
W20260709 13:03:22.433040  1730 debug-util.cc:398] Leaking SignalData structure 0x7b080036af60 after lost signal to thread 1733
W20260709 13:03:22.441550  1730 debug-util.cc:398] Leaking SignalData structure 0x7b08003ee1c0 after lost signal to thread 2295
W20260709 13:03:22.494452  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:22.644459  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:22.799074  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:22.844120  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:22.844960  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:23.054934  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.105988  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.225407   431 thread.cc:527] Waited for 32000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:23.346589  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:23.353547  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.409745  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:23.496479  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.500836  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.541751  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.555496  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:23.597038  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:23.720198  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.743352  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.746140  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:23.782811  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.818842  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.824505  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.744182  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.834219  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 90049.1us
W20260709 13:03:23.838707  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:23.858705  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:23.873548  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:23.883574  1599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 94807.2us
W20260709 13:03:24.167479  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:24.177157  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:24.178164  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:24.192183  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:24.193212  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:24.213930  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:24.227240   431 thread.cc:527] Waited for 33000ms trying to join with diag-logger (tid 1581)
W20260709 13:03:24.256764  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:24.272222  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:24.313915  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:24.331353  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:24.371016  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:24.418915  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:24.437579  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:24.464799  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:24.581405  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:24.593854  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:24.656374  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08001d7a80 after lost signal to thread 434
W20260709 13:03:24.657589  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5b40 after lost signal to thread 1492
W20260709 13:03:24.659053  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3fa0 after lost signal to thread 1659
W20260709 13:03:24.660285  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08000bff00 after lost signal to thread 1733
W20260709 13:03:24.661564  1656 debug-util.cc:398] Leaking SignalData structure 0x7b08002211c0 after lost signal to thread 2295
W20260709 13:03:24.674249  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:24.674948  1600 consensus_peers.cc:597] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:24.698916  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:24.772632  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:25.730089  1444 catalog_manager.cc:4755] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3fe250573e1c4fdd9d93dbaaa494b367: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:26.077481  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:03:26.091955 10321 raft_consensus.cc:493] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:26.093722 10321 raft_consensus.cc:515] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.096287 10321 leader_election.cc:290] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:26.133383 10328 raft_consensus.cc:493] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:26.137279 10328 raft_consensus.cc:515] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:26.140693 10328 leader_election.cc:290] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:26.142282  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39441, user_credentials={real_user=slave}} blocked reactor thread for 46531.9us
I20260709 13:03:26.144186  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:26.149878 10321 raft_consensus.cc:493] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:26.150614 10321 raft_consensus.cc:515] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.152966 10321 leader_election.cc:290] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:26.153621 10313 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:26.163309 10313 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.165777 10313 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:26.169983  2236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.005s	sys 0.009s
W20260709 13:03:26.172387  2236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.005s	sys 0.009s
I20260709 13:03:26.174336 10311 raft_consensus.cc:493] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:26.174930 10321 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:26.174949 10311 raft_consensus.cc:515] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.175881 10321 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.177497 10311 leader_election.cc:290] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:26.178583 10321 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:26.154135 10334 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:26.159381 10323 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:26.179642 10323 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.184568  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:26.185695 10323 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:26.186838 10328 raft_consensus.cc:493] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:26.187443 10328 raft_consensus.cc:515] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:26.190204 10328 leader_election.cc:290] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:26.193715  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:26.196015  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:03:26.196725  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:03:26.197232 10325 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:03:26.198073  1600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39635, user_credentials={real_user=slave}} blocked reactor thread for 73150.8us
I20260709 13:03:26.197875 10325 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.179579 10334 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.206172  1626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:26.211174 10325 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:26.212114 10323 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:26.213750  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4afefd9972704c7ba44201033b7d2e6b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.216101  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45e74819157464ca3f225e90c8b6a9e" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.217420  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f195a66bf8449c96e58c306dec48a5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.219411  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ab32967f744404a0f736900b1d7b9a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:26.219276 10326 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:26.221323 10321 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:26.221451  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.221555 10326 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:26.212812 10334 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:26.219338 10323 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.224203 10326 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:26.221889 10321 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:26.225854  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b989fc00ec242a59fb2167b2255b3a8" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:26.226197 10321 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:26.225323 10323 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:26.227968  1628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c340bead2014c39bd9825dce2602d61" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:26.250187 10311 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:26.249919 10321 raft_consensus.cc:493] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:26.251634 10321 raft_consensus.cc:515] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.252717  1673 leader_election.cc:304] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:26.253461 10326 raft_consensus.cc:2749] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:26.250766 10311 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.256093 10311 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:26.256188  1673 leader_election.cc:304] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:26.253736 10321 leader_election.cc:290] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:26.257673 10311 raft_consensus.cc:2749] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:26.261034  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:26.261777 10321 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:03:26.269232  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
W20260709 13:03:26.269766  2235 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:26.269611  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44f91d5f5a1f4564ab4ec7b1b5b0aa0b" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.273042 10326 raft_consensus.cc:493] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:26.273782 10326 raft_consensus.cc:515] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.273870  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.276114 10326 leader_election.cc:290] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:26.281821  2235 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:26.283324  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:03:26.283622  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:26.286230  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845a9ac484f44da5a4a18f3ffa7030e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
W20260709 13:03:26.286791  2235 leader_election.cc:336] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:26.287650  2235 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.288349 10334 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:26.289264  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:26.289781  2235 leader_election.cc:336] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:26.290620  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01508a4751a04c12a68c8570eb4d2e7f" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:26.290190  2235 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.291841  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:26.292364 10334 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:26.293227 10326 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:26.294453  1673 leader_election.cc:304] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:26.296033  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5332d0582c2b46f598be9871f6cfdcf7" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:26.301556 10335 raft_consensus.cc:493] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:26.302237 10335 raft_consensus.cc:515] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.304586 10335 leader_election.cc:290] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:26.301578 10326 raft_consensus.cc:2749] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:26.308243  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "447b9d1298e947858fa3d05e918d4a08" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.310279 10326 raft_consensus.cc:493] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:26.310874 10326 raft_consensus.cc:515] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:26.312724  1600 consensus_peers.cc:597] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:26.312989 10326 leader_election.cc:290] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:26.313421  1600 leader_election.cc:336] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:26.313614 10326 raft_consensus.cc:493] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
W20260709 13:03:26.313969  1600 leader_election.cc:336] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:26.314381 10326 raft_consensus.cc:515] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.316498 10326 leader_election.cc:290] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:26.321106  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:26.321206  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b699c6ee183d45208fccb5d51557fe41" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.324656  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "323bbbd0be5249329755d7e00ed71324" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.330333  1601 leader_election.cc:304] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.331427 10318 raft_consensus.cc:2749] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:26.334403  1601 leader_election.cc:304] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.335429 10318 raft_consensus.cc:2749] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:03:26.328178  1673 leader_election.cc:304] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:26.339949 10326 raft_consensus.cc:2749] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:26.345908 10326 raft_consensus.cc:493] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:26.346484 10326 raft_consensus.cc:515] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.348706 10326 leader_election.cc:290] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:26.349401 10326 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:26.349874 10326 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.351802 10326 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:26.354581  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eda09757c25a4279a4c93c29eeff416a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.355723  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.355943  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:26.358518  1673 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:26.362951 10338 raft_consensus.cc:493] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:26.363250 10326 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:26.363590 10338 raft_consensus.cc:515] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.365845 10338 leader_election.cc:290] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:26.371620  1629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7e99891af85f4b10aa1cc2da6aa33082" is_pre_election: true
I20260709 13:03:26.371924  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8129c29801c142749490f0df95b71485" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.373426  1673 leader_election.cc:304] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:26.374853 10326 raft_consensus.cc:2749] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:26.376570  1703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6e602f7f3e34ef89e4eee8ddf3a9eb5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:26.377372  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:26.379613  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ffd1be44d384b0d9dfc0986195efbd1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:26.382416  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423fad3d086c4c18b5d84ecfeeb2957a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:26.402259  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.403381 10334 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:26.405259  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:26.406304 10334 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:26.411345  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.412421 10334 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:26.413972  1674 leader_election.cc:336] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:26.414779  1674 leader_election.cc:304] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.415494 10326 raft_consensus.cc:2749] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:26.416534  1674 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:26.417331  1674 leader_election.cc:336] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:26.417694  1674 leader_election.cc:304] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.418378 10326 raft_consensus.cc:2749] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:26.419386  1674 leader_election.cc:336] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:26.419770  1674 leader_election.cc:304] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.420423 10326 raft_consensus.cc:2749] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:26.422837  1674 leader_election.cc:336] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:26.423468  1674 leader_election.cc:304] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.424139 10326 raft_consensus.cc:2749] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:26.425194  1674 leader_election.cc:336] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:26.425580  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.426241 10326 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:26.427210  1674 leader_election.cc:336] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:26.427601  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.428234 10326 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:26.432366  1674 leader_election.cc:336] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:26.432773  1674 leader_election.cc:304] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:26.433450 10326 raft_consensus.cc:2749] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:26.505327  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:26.563169 10329 raft_consensus.cc:493] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 6923294c847b48ebb577e0935d316aa3)
I20260709 13:03:26.563841 10329 raft_consensus.cc:515] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:26.566956  1704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:26.602626 10329 leader_election.cc:290] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:26.605818  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207df21ae856459f9637b16a0feb2796" candidate_uuid: "7e99891af85f4b10aa1cc2da6aa33082" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:26.613435  1599 leader_election.cc:304] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e99891af85f4b10aa1cc2da6aa33082; no voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3
I20260709 13:03:26.617671 10330 raft_consensus.cc:2749] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:26.629177  1489 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0ec0 after lost signal to thread 434
W20260709 13:03:26.630364  1489 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4380 after lost signal to thread 1492
W20260709 13:03:26.631769  1489 debug-util.cc:398] Leaking SignalData structure 0x7b080039e940 after lost signal to thread 1659
W20260709 13:03:26.632962  1489 debug-util.cc:398] Leaking SignalData structure 0x7b0800310c20 after lost signal to thread 1733
W20260709 13:03:26.634438  1489 debug-util.cc:398] Leaking SignalData structure 0x7b08003534c0 after lost signal to thread 2295
W20260709 13:03:26.637135  1600 consensus_peers.cc:597] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:26.686067  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:26.700341   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:26.827533  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 89117.8us
W20260709 13:03:26.836530  1600 consensus_peers.cc:597] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:26.837237  1600 consensus_peers.cc:597] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:26.900316  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:26.919308  1674 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111) [suppressed 376 similar messages]
W20260709 13:03:26.946270  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:26.946952  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.046599  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.083518  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:27.090351  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.093757  1600 consensus_peers.cc:597] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:27.106156  1600 consensus_peers.cc:597] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.109380  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.236266  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.254370  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.267932  1600 consensus_peers.cc:597] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.314149  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.318390  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:27.322433  1600 consensus_peers.cc:597] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.339911  1600 consensus_peers.cc:597] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:27.378852  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.399904  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:27.415915  1600 consensus_peers.cc:597] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:27.437829  1600 consensus_peers.cc:597] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.476897  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:27.512085  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.555277  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:03:27.658051   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:27.676648  1600 consensus_peers.cc:597] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.689360  2234 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.700703  2234 consensus_peers.cc:597] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.704569  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.725296  2234 consensus_peers.cc:597] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.748720  1673 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.753530  1673 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.763612  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.766269  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.766474  1673 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.778475  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:27.780700  1673 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.783049  2234 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.788959  2234 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.790845  1673 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.802454  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:27.819528  1673 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.827797  2234 consensus_peers.cc:597] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.833551   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:03:27.867901  2234 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.871184  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:03:27.834995   431 tablet_replica.cc:333] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:27.878306   431 raft_consensus.cc:2243] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.889863   431 raft_consensus.cc:2272] T 9b989fc00ec242a59fb2167b2255b3a8 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.896272   431 tablet_replica.cc:333] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:27.903312   431 raft_consensus.cc:2243] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.904533   431 raft_consensus.cc:2272] T 2c340bead2014c39bd9825dce2602d61 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.908332   431 tablet_replica.cc:333] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:27.909289   431 raft_consensus.cc:2243] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.910750   431 raft_consensus.cc:2272] T 3fe250573e1c4fdd9d93dbaaa494b367 P 7e99891af85f4b10aa1cc2da6aa33082 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.913643   431 tablet_replica.cc:333] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:27.914657   431 raft_consensus.cc:2243] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.915544   431 raft_consensus.cc:2272] T 01508a4751a04c12a68c8570eb4d2e7f P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.918531   431 tablet_replica.cc:333] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:27.919443   431 raft_consensus.cc:2243] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.920670   431 raft_consensus.cc:2272] T 5336feea1c174b498bc0252f726f9461 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:27.922163  1673 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.923717   431 tablet_replica.cc:333] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:27.924734   431 raft_consensus.cc:2243] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.925419   431 raft_consensus.cc:2272] T 323bbbd0be5249329755d7e00ed71324 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:27.925621  1673 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.928431   431 tablet_replica.cc:333] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:27.929461   431 raft_consensus.cc:2243] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.930305   431 raft_consensus.cc:2272] T 0ab2c76ce9ba4519b8beb7decd86314d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.933547   431 tablet_replica.cc:333] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:27.934597   431 raft_consensus.cc:2243] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:27.937247   431 raft_consensus.cc:2272] T 660b57178c7f4ffebd30c42df43b303a P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.940268   431 tablet_replica.cc:333] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:27.941227   431 raft_consensus.cc:2243] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.941968   431 raft_consensus.cc:2272] T 7ddb83400fc244a9ba5283309591785d P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:27.949345  2234 consensus_peers.cc:597] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.954970  2234 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.957780   431 tablet_replica.cc:333] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:27.958983   431 raft_consensus.cc:2243] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.959831   431 raft_consensus.cc:2272] T af202c0dfac940fb86d9d9d0a9124f44 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:27.959915  1673 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:27.968662  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:27.978189   431 tablet_replica.cc:333] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:27.979312   431 raft_consensus.cc:2243] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:03:27.990433  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:28.008028  2234 consensus_peers.cc:597] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:28.008899  2234 consensus_peers.cc:597] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:28.009965  2234 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.010859   431 raft_consensus.cc:2272] T f981c1c6e2c5466395ecd385d6b24151 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.014160   431 tablet_replica.cc:333] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.015115   431 raft_consensus.cc:2243] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.016881   431 raft_consensus.cc:2272] T 44fa411feaaf4e2d91d23edd17e19ae0 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.038625   431 tablet_replica.cc:333] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.039660   431 raft_consensus.cc:2243] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.041210   431 raft_consensus.cc:2272] T 2f6a8ad007074cfe96f8430d622f5f80 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.045037   431 tablet_replica.cc:333] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.046505   431 raft_consensus.cc:2243] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.047216   431 raft_consensus.cc:2272] T db8014a9a7494e619e862cbd380cb262 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.051008   431 tablet_replica.cc:333] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.052954   431 raft_consensus.cc:2243] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.054684   431 raft_consensus.cc:2272] T 7270b72e069f42daa3f82eaa77d9e299 P 7e99891af85f4b10aa1cc2da6aa33082 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.057957   431 tablet_replica.cc:333] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.059203   431 raft_consensus.cc:2243] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.059917   431 raft_consensus.cc:2272] T 64ca31f55ece4416bc4225ea16dc1728 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.068538   431 tablet_replica.cc:333] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.069535   431 raft_consensus.cc:2243] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.070425   431 raft_consensus.cc:2272] T 02b42bc07b3d4b49afb7d3e929183dd2 P 7e99891af85f4b10aa1cc2da6aa33082 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.080770   431 tablet_replica.cc:333] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.081815   431 raft_consensus.cc:2243] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.082995   431 raft_consensus.cc:2272] T a5f195a66bf8449c96e58c306dec48a5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.086429   431 tablet_replica.cc:333] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.087361   431 raft_consensus.cc:2243] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.088400   431 raft_consensus.cc:2272] T b8fae2aaea9349b488e73c3574050a18 P 7e99891af85f4b10aa1cc2da6aa33082 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:28.102491  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:28.106040  1600 consensus_peers.cc:597] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:03:28.104869   431 tablet_replica.cc:333] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.112221   431 raft_consensus.cc:2243] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:28.126577  2234 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:28.141911  2234 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:28.142712  2234 consensus_peers.cc:597] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.143610   431 raft_consensus.cc:2272] T fcdd2749ff424225974f40bab0aaff25 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.146660   431 tablet_replica.cc:333] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.147579   431 raft_consensus.cc:2243] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.148936   431 raft_consensus.cc:2272] T c546ee055ea8417b8c1054e545eee77c P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.152120   431 tablet_replica.cc:333] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.170554   431 raft_consensus.cc:2243] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:03:28.171334  2234 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:28.174855  1673 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.182762   431 raft_consensus.cc:2272] T 6d65ebb9a940495b98325fe3474babd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:28.184505  1600 consensus_peers.cc:597] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:03:28.228999   431 tablet_replica.cc:333] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.229976   431 raft_consensus.cc:2243] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.231099   431 raft_consensus.cc:2272] T 6ffd1be44d384b0d9dfc0986195efbd1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.245208   431 tablet_replica.cc:333] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.246099   431 raft_consensus.cc:2243] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.247272   431 raft_consensus.cc:2272] T 41e0e763e6004147b0d7ea0abb37c886 P 7e99891af85f4b10aa1cc2da6aa33082 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.250118   431 tablet_replica.cc:333] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
W20260709 13:03:28.251310  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:03:28.261624   431 raft_consensus.cc:2243] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.262600   431 raft_consensus.cc:2272] T d6b0ca7e03c249ebad5c6f720df4efca P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.265679   431 tablet_replica.cc:333] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.271632   431 raft_consensus.cc:2243] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.273021   431 raft_consensus.cc:2272] T dc48c88f26dc4e35ae381c821f0a805d P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.276013   431 tablet_replica.cc:333] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.287257   431 raft_consensus.cc:2243] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.288072   431 raft_consensus.cc:2272] T 12ca9a7e99a249b3820b6df8c497bfde P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.290774   431 tablet_replica.cc:333] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.291584   431 raft_consensus.cc:2243] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.292768   431 raft_consensus.cc:2272] T 793edbca26c648ccab7933d6e1c299e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.298111   431 tablet_replica.cc:333] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
W20260709 13:03:28.301218  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:03:28.301929   431 raft_consensus.cc:2243] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.319113   431 raft_consensus.cc:2272] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.322050   431 tablet_replica.cc:333] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.322961   431 raft_consensus.cc:2243] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.323712   431 raft_consensus.cc:2272] T 2b113b168afa40cfaab164f8317e42c1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.326900   431 tablet_replica.cc:333] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.327821   431 raft_consensus.cc:2243] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.337615   431 raft_consensus.cc:2272] T 86aa6466101d44fc98160eb3586dc176 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.340977   431 tablet_replica.cc:333] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.341928   431 raft_consensus.cc:2243] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.347296   431 raft_consensus.cc:2272] T 845a9ac484f44da5a4a18f3ffa7030e5 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.350666   431 tablet_replica.cc:333] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.354698   431 raft_consensus.cc:2243] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.356825   431 raft_consensus.cc:2272] T 95ea20fae86647d4bbf85d9c0864f5f1 P 7e99891af85f4b10aa1cc2da6aa33082 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.363577   431 tablet_replica.cc:333] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.371469   431 raft_consensus.cc:2243] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.378073   431 raft_consensus.cc:2272] T 1ce7dbd8e7cf45808506e02da2925882 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.382140   431 tablet_replica.cc:333] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
W20260709 13:03:28.383198  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:03:28.383296   431 raft_consensus.cc:2243] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.387223   431 raft_consensus.cc:2272] T 8129c29801c142749490f0df95b71485 P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.391073   431 tablet_replica.cc:333] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.394975   431 raft_consensus.cc:2243] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.407339   431 raft_consensus.cc:2272] T d0ab32967f744404a0f736900b1d7b9a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.410869   431 tablet_replica.cc:333] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.411733   431 raft_consensus.cc:2243] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.412632   431 raft_consensus.cc:2272] T 8e325950f4164ab99442980dc2c53386 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.415566   431 tablet_replica.cc:333] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.416399   431 raft_consensus.cc:2243] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.422389   431 raft_consensus.cc:2272] T 05f358a33737477ba11488ec75b16050 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.431192   431 tablet_replica.cc:333] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.435839   431 raft_consensus.cc:2243] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.451303   431 raft_consensus.cc:2272] T 207df21ae856459f9637b16a0feb2796 P 7e99891af85f4b10aa1cc2da6aa33082 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.454360   431 tablet_replica.cc:333] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.466722   431 raft_consensus.cc:2243] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.468184   431 raft_consensus.cc:2272] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.471266   431 tablet_replica.cc:333] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.472105   431 raft_consensus.cc:2243] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.473023   431 raft_consensus.cc:2272] T 4afefd9972704c7ba44201033b7d2e6b P 7e99891af85f4b10aa1cc2da6aa33082 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.476270   431 tablet_replica.cc:333] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.477159   431 raft_consensus.cc:2243] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.478561   431 raft_consensus.cc:2272] T dbfb4dc01d084c658bb8ff2ae985e80a P 7e99891af85f4b10aa1cc2da6aa33082 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.490049   431 tablet_replica.cc:333] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.491171   431 raft_consensus.cc:2243] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.492067   431 raft_consensus.cc:2272] T 5332d0582c2b46f598be9871f6cfdcf7 P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.495227   431 tablet_replica.cc:333] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.502647   431 raft_consensus.cc:2243] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.504030   431 raft_consensus.cc:2272] T 2fb004c86c654110bd570a13f623ed9f P 7e99891af85f4b10aa1cc2da6aa33082 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.507280   431 tablet_replica.cc:333] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.508119   431 raft_consensus.cc:2243] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.517922   431 raft_consensus.cc:2272] T f52157fbf77948c283b3ba328c6ebcdd P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.520927   431 tablet_replica.cc:333] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.528208   431 raft_consensus.cc:2243] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:28.529783   431 raft_consensus.cc:2272] T 56d2e4b816a44719af0c86481062c407 P 7e99891af85f4b10aa1cc2da6aa33082 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:28.532965   431 tablet_replica.cc:333] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082: stopping tablet replica
I20260709 13:03:28.538595   431 raft_consensus.cc:2243] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:28.539721   431 raft_consensus.cc:2272] T d44a8411cf4642829994ec97173d358a P 7e99891af85f4b10aa1cc2da6aa33082 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:28.881203  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:03:28.897434 10335 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:28.898268 10335 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:28.904920  1673 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:28.905414  1674 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:28.905838  1674 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:28.925679 10335 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:28.926283 10335 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:28.928045  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:28.999744 10335 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.000358 10335 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:29.007943  1673 leader_election.cc:336] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.012836 10335 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:29.014585  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:29.016183 10323 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.018384 10335 raft_consensus.cc:493] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.019591 10335 raft_consensus.cc:515] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:29.017772 10323 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.017030  1673 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:29.028111 10345 raft_consensus.cc:2749] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:03:29.038551 10323 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:29.041134  2234 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.045449 10335 leader_election.cc:290] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:29.049154 10345 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.054589 10345 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.057502 10345 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:29.062709 10323 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.063485 10323 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.065780  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:29.076900 10342 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.077581 10342 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.083634 10342 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:03:29.102514  2234 leader_election.cc:336] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.104975  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
W20260709 13:03:29.109184  2234 leader_election.cc:336] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.112411  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:29.109794 10323 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:29.115595 10342 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.116775 10342 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.119831 10342 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:29.116027  2235 leader_election.cc:336] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:29.124856  2234 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.124991  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
W20260709 13:03:29.129256  1673 leader_election.cc:336] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:29.132817  1673 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.137707 10342 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:29.138670  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:29.142095  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:29.143615 10347 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:03:29.143774  1673 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:29.143664 10342 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:29.149956 10335 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:29.151731  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:29.152427  1701 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:03:29.158627 10335 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.159262 10335 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.163036 10335 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:29.174556  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:29.175191  2268 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 21.
I20260709 13:03:29.177621 10335 raft_consensus.cc:493] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:03:29.180059  2235 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.187541  2235 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.191001 10323 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:29.186976  1674 leader_election.cc:336] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.191757  1674 leader_election.cc:304] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.192595 10345 raft_consensus.cc:2749] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:29.190115  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:03:29.178282 10335 raft_consensus.cc:515] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:29.196087 10335 leader_election.cc:290] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:29.200522 10345 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:29.201380 10345 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.201759 10345 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:29.211781 10345 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.223847 10345 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:29.193747  1674 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.230732 10343 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.231295 10343 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.233378 10343 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:29.235939 10323 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.236610 10323 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.240556 10323 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:29.226356  1673 leader_election.cc:336] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.245889 10343 raft_consensus.cc:493] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.246449 10343 raft_consensus.cc:515] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:29.248735 10343 leader_election.cc:290] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:03:29.251286  2234 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.264775  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f6a8ad007074cfe96f8430d622f5f80" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
W20260709 13:03:29.265177  1674 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:03:29.265538  2268 raft_consensus.cc:3060] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:03:29.268093  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:29.268754  2269 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 30.
I20260709 13:03:29.273312  2268 raft_consensus.cc:2468] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 22.
W20260709 13:03:29.292783  1673 leader_election.cc:336] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:29.296602  2235 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.297147  2235 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.298141  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7270b72e069f42daa3f82eaa77d9e299" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:29.298873  1701 raft_consensus.cc:2468] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 17.
I20260709 13:03:29.306402 10323 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:29.317369  1674 leader_election.cc:336] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.317896  1674 leader_election.cc:304] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.311149  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:03:29.337427 10343 raft_consensus.cc:2749] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:29.338654  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:03:29.348343 10343 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:03:29.348950 10343 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 30 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.349419 10343 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 30 FOLLOWER]: Advancing to term 31
W20260709 13:03:29.363329  1673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38311, user_credentials={real_user=slave}} blocked reactor thread for 52246.5us
W20260709 13:03:29.365643  1674 leader_election.cc:336] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.365525  1673 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:03:29.369270 10345 raft_consensus.cc:2804] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:03:29.369786 10345 raft_consensus.cc:697] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
W20260709 13:03:29.370802  1674 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:03:29.370707 10345 consensus_queue.cc:237] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:29.378729  1673 leader_election.cc:336] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:29.380196  1673 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:29.383162  1673 leader_election.cc:336] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.384419  1673 leader_election.cc:304] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.381434 10343 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:29.385711  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:03:29.387084 10335 raft_consensus.cc:2749] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:29.389492 10343 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 31 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:29.395814  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fe250573e1c4fdd9d93dbaaa494b367" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:03:29.396499  2268 raft_consensus.cc:3060] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:03:29.404050  2268 raft_consensus.cc:2468] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 31.
I20260709 13:03:29.411609  1673 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:03:29.412400 10354 raft_consensus.cc:2804] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 31 FOLLOWER]: Leader election won for term 31
W20260709 13:03:29.412534  1673 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.412999 10354 raft_consensus.cc:697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 31 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:03:29.413981 10354 consensus_queue.cc:237] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 30.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.415747 10345 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.416319 10345 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.418932 10345 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:29.420585  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:29.424921  1457 catalog_manager.cc:5697] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 21 to 22, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:29.430357  1673 leader_election.cc:336] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.439924  1673 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:29.441572 10354 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:29.455587  1674 leader_election.cc:336] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.457288 10354 raft_consensus.cc:493] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.457836 10354 raft_consensus.cc:515] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:29.460844 10354 leader_election.cc:290] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:03:29.466419  1673 leader_election.cc:336] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:29.480047  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:29.495051  1674 leader_election.cc:336] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.495657  1674 leader_election.cc:304] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.496400 10354 raft_consensus.cc:2749] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:03:29.499104 10354 raft_consensus.cc:493] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.499631 10354 raft_consensus.cc:515] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
W20260709 13:03:29.500823  1674 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:03:29.501991 10354 leader_election.cc:290] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:29.507500 10342 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.508144 10342 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:29.518222  2234 leader_election.cc:336] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.519447 10342 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:29.520493  1673 leader_election.cc:336] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.529990  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:29.530653  1701 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 27.
I20260709 13:03:29.536298  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:29.538311 10323 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:03:29.538869 10323 raft_consensus.cc:493] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.539320 10323 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:03:29.542882 10335 raft_consensus.cc:493] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.543680 10335 raft_consensus.cc:515] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:29.546144 10335 leader_election.cc:290] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635)
I20260709 13:03:29.546298 10347 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.546898 10347 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.549005 10347 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:29.563079  1457 catalog_manager.cc:5697] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 30 to 31, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 31 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:29.564152  2235 leader_election.cc:336] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:29.569130  1674 leader_election.cc:336] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.569639  1674 leader_election.cc:304] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.570899 10335 raft_consensus.cc:2749] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:29.572927 10323 raft_consensus.cc:515] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.573714 10335 raft_consensus.cc:493] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.574309 10335 raft_consensus.cc:515] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:29.574817 10323 leader_election.cc:290] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 28 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:29.569965  2234 leader_election.cc:336] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.576002  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.576314 10335 leader_election.cc:290] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
I20260709 13:03:29.577384 10347 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:29.580101  1673 leader_election.cc:336] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.583457 10342 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.584017 10342 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:29.586158  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 13:03:29.586946 10342 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:29.588491  1673 leader_election.cc:336] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:29.591497  2234 leader_election.cc:336] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:29.595088  2234 leader_election.cc:336] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.597555  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44fa411feaaf4e2d91d23edd17e19ae0" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:03:29.598169  1701 raft_consensus.cc:3060] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:03:29.601601  1674 leader_election.cc:336] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.602123  1707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:29.603757  1674 leader_election.cc:304] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.604869 10335 raft_consensus.cc:2749] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:29.609109  2236 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:29.610437 10362 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:03:29.613298  1674 leader_election.cc:336] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.613785  1674 leader_election.cc:304] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.614517 10335 raft_consensus.cc:2749] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:29.612893  1701 raft_consensus.cc:2468] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 28.
W20260709 13:03:29.615474  1674 consensus_peers.cc:597] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:03:29.617013  2236 leader_election.cc:304] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:29.617756 10362 raft_consensus.cc:2804] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:03:29.618012 10335 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.618352 10362 raft_consensus.cc:697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 28 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:03:29.618641 10335 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.619267 10362 consensus_queue.cc:237] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.622726  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:29.624889 10335 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
W20260709 13:03:29.625564  1673 leader_election.cc:336] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.626343  1673 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 6923294c847b48ebb577e0935d316aa3, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:29.627451 10335 raft_consensus.cc:2749] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:29.639075  1457 catalog_manager.cc:5697] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 27 to 28, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 28 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.660332 10362 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.660867 10362 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.663316 10362 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:29.666325  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:29.667038  1701 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 21.
I20260709 13:03:29.668159  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:03:29.668912 10362 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:03:29.669260 10362 raft_consensus.cc:493] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.669584 10362 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:29.673161  2234 leader_election.cc:336] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.680630 10362 raft_consensus.cc:515] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.681030 10342 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.681716 10342 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.684671 10342 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:29.685487  1674 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:03:29.686905  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ea20fae86647d4bbf85d9c0864f5f1" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:29.687484  1701 raft_consensus.cc:2468] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 20.
I20260709 13:03:29.690693 10362 leader_election.cc:290] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
I20260709 13:03:29.691983  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793edbca26c648ccab7933d6e1c299e5" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95"
I20260709 13:03:29.692625  1701 raft_consensus.cc:3060] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:03:29.692147  2235 leader_election.cc:336] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:29.697994  2234 leader_election.cc:336] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.698478  2234 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.699177 10362 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:29.699548  1701 raft_consensus.cc:2468] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 22.
I20260709 13:03:29.701476  2236 leader_election.cc:304] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:03:29.702310 10362 raft_consensus.cc:2804] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:03:29.702407  2234 leader_election.cc:336] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.702855 10362 raft_consensus.cc:697] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 22 LEADER]: Becoming Leader. State: Replica: 6923294c847b48ebb577e0935d316aa3, State: Running, Role: LEADER
I20260709 13:03:29.703805 10362 consensus_queue.cc:237] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.717667 10354 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.718333 10354 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.720383 10354 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:29.722070  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:29.722791  2269 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 24.
I20260709 13:03:29.725206 10362 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.725816 10362 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.726172  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:03:29.728945 10362 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:29.731743  1673 leader_election.cc:336] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.731504  1457 catalog_manager.cc:5697] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 reported cstate change: term changed from 21 to 22, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 6923294c847b48ebb577e0935d316aa3 (127.0.107.196). New cstate: current_term: 22 leader_uuid: "6923294c847b48ebb577e0935d316aa3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.731818  1701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:29.727424 10354 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:03:29.737934 10354 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
W20260709 13:03:29.738263  2234 leader_election.cc:336] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.738500 10354 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:03:29.738878  2234 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:29.740171 10323 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:29.748255 10354 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.750638 10354 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:29.752408  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05f358a33737477ba11488ec75b16050" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:03:29.753072  2269 raft_consensus.cc:3060] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:03:29.756721  1673 leader_election.cc:336] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.760834  2269 raft_consensus.cc:2468] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 25.
I20260709 13:03:29.761996  1673 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:29.762861 10354 raft_consensus.cc:2804] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:03:29.763414 10354 raft_consensus.cc:697] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 25 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:03:29.764328 10354 consensus_queue.cc:237] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.783190  1457 catalog_manager.cc:5697] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 24 to 25, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 25 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:29.804430  1673 consensus_peers.cc:597] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:29.843700 10362 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.844625 10362 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.850384 10362 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:03:29.853695  2234 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:29.856453  2235 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.856863  2235 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.857467 10362 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:03:29.862896 10354 raft_consensus.cc:493] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.863462 10354 raft_consensus.cc:515] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } }
I20260709 13:03:29.865272 10354 leader_election.cc:290] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:03:29.869372  1674 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:29.871927  1673 leader_election.cc:336] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.872370  1673 leader_election.cc:304] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.873131 10354 raft_consensus.cc:2749] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:03:29.875424  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:29.879196  2235 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:03:29.885830  2235 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:03:29.901974 10362 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.902773 10362 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.905475 10362 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:03:29.909057  2234 leader_election.cc:336] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:29.910863  2235 leader_election.cc:336] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:29.911284  2235 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:29.912297 10362 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:29.922821  2269 raft_consensus.cc:1275] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 31 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 30 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 13:03:29.924685 10354 consensus_queue.cc:1048] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:03:29.932555 10335 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.933431 10335 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.936545 10335 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:29.946319  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3" is_pre_election: true
I20260709 13:03:29.946951  2268 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 19.
I20260709 13:03:29.953802  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 
I20260709 13:03:29.957266 10335 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:29.957959 10335 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:29.958499 10335 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:29.960345  1673 leader_election.cc:336] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:29.975252 10335 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:29.979409 10335 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Requested vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 6923294c847b48ebb577e0935d316aa3 (127.0.107.196:38311)
I20260709 13:03:29.984741  2269 raft_consensus.cc:1275] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:03:29.986178  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbfb4dc01d084c658bb8ff2ae985e80a" candidate_uuid: "4f1725fe36e349ac85405627f9c93d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6923294c847b48ebb577e0935d316aa3"
I20260709 13:03:29.986802  2269 raft_consensus.cc:3060] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:03:30.003427  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 13:03:30.004312  1674 consensus_peers.cc:597] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:03:30.004829  2269 raft_consensus.cc:2468] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f1725fe36e349ac85405627f9c93d95 in term 20.
I20260709 13:03:29.990329 10335 consensus_queue.cc:1048] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.015s
W20260709 13:03:30.005733  1673 leader_election.cc:336] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:30.008023  1673 consensus_peers.cc:597] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:30.013091  2234 consensus_peers.cc:597] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:30.027565  1673 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:30.029989 10369 raft_consensus.cc:2804] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:30.030654 10369 raft_consensus.cc:697] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Becoming Leader. State: Replica: 4f1725fe36e349ac85405627f9c93d95, State: Running, Role: LEADER
I20260709 13:03:30.031631 10369 consensus_queue.cc:237] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
W20260709 13:03:30.051913  2234 consensus_peers.cc:597] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.065047  2235 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:03:30.071992  2235 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:03:30.076781  1673 consensus_peers.cc:597] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.100922  1673 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:30.103641  1707 raft_consensus.cc:1275] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
W20260709 13:03:30.110981  2234 consensus_peers.cc:597] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:30.105721  1457 catalog_manager.cc:5697] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 reported cstate change: term changed from 19 to 20, leader changed from 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194) to 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195). New cstate: current_term: 20 leader_uuid: "4f1725fe36e349ac85405627f9c93d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:30.118083  2235 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:03:30.119117  2234 consensus_peers.cc:597] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:30.119867 10342 consensus_queue.cc:1048] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:03:30.124389  1674 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:03:30.169780  2235 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:03:30.172441  2234 consensus_peers.cc:597] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:30.175294  1673 consensus_peers.cc:597] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:30.186949  1673 consensus_peers.cc:597] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.198760  2234 consensus_peers.cc:597] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.229645  2234 consensus_peers.cc:597] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:30.306242  2235 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:03:30.307263  1673 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:30.311335  2269 raft_consensus.cc:1275] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:03:30.311439  1702 raft_consensus.cc:1275] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Refusing update from remote peer 6923294c847b48ebb577e0935d316aa3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:03:30.312749 10323 consensus_queue.cc:1048] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:03:30.312770 10335 consensus_queue.cc:1048] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:03:30.349833  2234 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.359501  2234 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.376870  2234 consensus_peers.cc:597] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.404927  1673 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.424497  2234 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.429311  1674 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:03:30.431726  1674 consensus_peers.cc:597] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:03:30.440397  1673 consensus_peers.cc:597] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.438485  2235 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:03:30.436820  1674 consensus_peers.cc:597] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:03:30.447458  1673 consensus_peers.cc:597] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:30.466922  2234 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.480854  1673 consensus_peers.cc:597] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.482239  2234 consensus_peers.cc:597] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.548700  2235 consensus_peers.cc:597] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:30.551174  2234 consensus_peers.cc:597] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.553773  2234 consensus_peers.cc:597] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.561307  2234 consensus_peers.cc:597] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.563074  1674 consensus_peers.cc:597] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:30.585810  1673 consensus_peers.cc:597] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.594450  1674 consensus_peers.cc:597] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:03:30.633126   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:30.649091  2269 raft_consensus.cc:1275] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Refusing update from remote peer 4f1725fe36e349ac85405627f9c93d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:03:30.650854 10354 consensus_queue.cc:1048] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:03:30.691210  2235 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:03:30.728324  1673 consensus_peers.cc:597] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.735108  2234 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:30.744374 10342 raft_consensus.cc:493] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:30.745095 10342 raft_consensus.cc:515] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:30.749507  1702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b57178c7f4ffebd30c42df43b303a" candidate_uuid: "6923294c847b48ebb577e0935d316aa3" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4f1725fe36e349ac85405627f9c93d95" is_pre_election: true
I20260709 13:03:30.750332  1702 raft_consensus.cc:2468] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6923294c847b48ebb577e0935d316aa3 in term 18.
I20260709 13:03:30.752092 10342 leader_election.cc:290] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:30.770358  2234 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:30.772852  2235 leader_election.cc:336] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:30.773406  2235 leader_election.cc:304] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4f1725fe36e349ac85405627f9c93d95, 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:30.774124   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:30.774173 10342 raft_consensus.cc:2749] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:30.794812  2236 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:30.805526  2235 consensus_peers.cc:597] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 13:03:30.813149  2236 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:30.850391   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:30.851614   431 tablet_replica.cc:333] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.852792   431 raft_consensus.cc:2243] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 31 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.855450   431 raft_consensus.cc:2272] T 3fe250573e1c4fdd9d93dbaaa494b367 P 4f1725fe36e349ac85405627f9c93d95 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.860343   431 tablet_replica.cc:333] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.861207   431 raft_consensus.cc:2243] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.861790   431 raft_consensus.cc:2272] T 2c340bead2014c39bd9825dce2602d61 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.864763   431 tablet_replica.cc:333] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.865687   431 raft_consensus.cc:2243] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.866823   431 raft_consensus.cc:2272] T 01508a4751a04c12a68c8570eb4d2e7f P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.869552   431 tablet_replica.cc:333] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.870443   431 raft_consensus.cc:2243] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.872071   431 raft_consensus.cc:2272] T 5336feea1c174b498bc0252f726f9461 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.874867   431 tablet_replica.cc:333] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.875771   431 raft_consensus.cc:2243] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.876603   431 raft_consensus.cc:2272] T 9ffc7074d09d4b0a8caf498542f3e843 P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.879549   431 tablet_replica.cc:333] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.880379   431 raft_consensus.cc:2243] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.881172   431 raft_consensus.cc:2272] T 9b989fc00ec242a59fb2167b2255b3a8 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.884325   431 tablet_replica.cc:333] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.885174   431 raft_consensus.cc:2243] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.886376   431 raft_consensus.cc:2272] T 7ddb83400fc244a9ba5283309591785d P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.889277   431 tablet_replica.cc:333] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.890144   431 raft_consensus.cc:2243] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.891185   431 raft_consensus.cc:2272] T 660b57178c7f4ffebd30c42df43b303a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.893854   431 tablet_replica.cc:333] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.894758   431 raft_consensus.cc:2243] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.895561   431 raft_consensus.cc:2272] T f981c1c6e2c5466395ecd385d6b24151 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.898281   431 tablet_replica.cc:333] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.899070   431 raft_consensus.cc:2243] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.899880   431 raft_consensus.cc:2272] T a45da2e3894b42dc93ed11eb2c31220c P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.902798   431 tablet_replica.cc:333] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.903785   431 raft_consensus.cc:2243] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.905099   431 raft_consensus.cc:2272] T 44a80c9a41a3498da7aa33d70b18ace6 P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:30.905139  2236 consensus_peers.cc:597] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:30.908151   431 tablet_replica.cc:333] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.909175   431 raft_consensus.cc:2243] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.910073   431 raft_consensus.cc:2272] T 44fa411feaaf4e2d91d23edd17e19ae0 P 4f1725fe36e349ac85405627f9c93d95 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.913241   431 tablet_replica.cc:333] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.914139   431 raft_consensus.cc:2243] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.915244   431 raft_consensus.cc:2272] T 2f6a8ad007074cfe96f8430d622f5f80 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.918422   431 tablet_replica.cc:333] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.919315   431 raft_consensus.cc:2243] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.920377   431 raft_consensus.cc:2272] T d45e74819157464ca3f225e90c8b6a9e P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.923238   431 tablet_replica.cc:333] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.924049   431 raft_consensus.cc:2243] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.924901   431 raft_consensus.cc:2272] T ff5a03f3312f4e6bac9383280b5b9131 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.928061   431 tablet_replica.cc:333] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.928983   431 raft_consensus.cc:2243] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.930092   431 raft_consensus.cc:2272] T 02b42bc07b3d4b49afb7d3e929183dd2 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.932837   431 tablet_replica.cc:333] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.933709   431 raft_consensus.cc:2243] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.934746   431 raft_consensus.cc:2272] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.937525   431 tablet_replica.cc:333] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.938381   431 raft_consensus.cc:2243] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.939131   431 raft_consensus.cc:2272] T 7270b72e069f42daa3f82eaa77d9e299 P 4f1725fe36e349ac85405627f9c93d95 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:30.938410  2236 consensus_peers.cc:597] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:30.942075   431 tablet_replica.cc:333] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.942891   431 raft_consensus.cc:2243] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.944036   431 raft_consensus.cc:2272] T 64ca31f55ece4416bc4225ea16dc1728 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.946729   431 tablet_replica.cc:333] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.947512   431 raft_consensus.cc:2243] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.948218   431 raft_consensus.cc:2272] T a5f195a66bf8449c96e58c306dec48a5 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:30.949590  2236 consensus_peers.cc:597] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:30.950912   431 tablet_replica.cc:333] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.952272   431 raft_consensus.cc:2243] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.953516   431 raft_consensus.cc:2272] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.956164   431 tablet_replica.cc:333] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.956951   431 raft_consensus.cc:2243] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.958247   431 raft_consensus.cc:2272] T b8fae2aaea9349b488e73c3574050a18 P 4f1725fe36e349ac85405627f9c93d95 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.960807   431 tablet_replica.cc:333] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.961566   431 raft_consensus.cc:2243] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.962185   431 raft_consensus.cc:2272] T fcdd2749ff424225974f40bab0aaff25 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.964697   431 tablet_replica.cc:333] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.965497   431 raft_consensus.cc:2243] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.966118   431 raft_consensus.cc:2272] T 6d65ebb9a940495b98325fe3474babd1 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.968863   431 tablet_replica.cc:333] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.969641   431 raft_consensus.cc:2243] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.970242   431 raft_consensus.cc:2272] T dc48c88f26dc4e35ae381c821f0a805d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.973115   431 tablet_replica.cc:333] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
W20260709 13:03:30.973203  2234 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Couldn't send request to peer 7e99891af85f4b10aa1cc2da6aa33082. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:30.973536  1674 consensus_peers.cc:597] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:03:30.973948   431 raft_consensus.cc:2243] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.974654   431 raft_consensus.cc:2272] T 793edbca26c648ccab7933d6e1c299e5 P 4f1725fe36e349ac85405627f9c93d95 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.977698   431 tablet_replica.cc:333] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.978505   431 raft_consensus.cc:2243] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.980116   431 raft_consensus.cc:2272] T 6ffd1be44d384b0d9dfc0986195efbd1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:30.980412  2236 consensus_peers.cc:597] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:30.982535   431 tablet_replica.cc:333] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.983327   431 raft_consensus.cc:2243] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.983954   431 raft_consensus.cc:2272] T 41e0e763e6004147b0d7ea0abb37c886 P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.986502   431 tablet_replica.cc:333] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.987246   431 raft_consensus.cc:2243] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.988350   431 raft_consensus.cc:2272] T 5332d0582c2b46f598be9871f6cfdcf7 P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.991021   431 tablet_replica.cc:333] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.991714   431 raft_consensus.cc:2243] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:30.992724   431 raft_consensus.cc:2272] T dbfb4dc01d084c658bb8ff2ae985e80a P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.995517   431 tablet_replica.cc:333] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:30.996295   431 raft_consensus.cc:2243] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.996850   431 raft_consensus.cc:2272] T 323bbbd0be5249329755d7e00ed71324 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.999342   431 tablet_replica.cc:333] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.000039   431 raft_consensus.cc:2243] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.001287   431 raft_consensus.cc:2272] T 0ab2c76ce9ba4519b8beb7decd86314d P 4f1725fe36e349ac85405627f9c93d95 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.003747   431 tablet_replica.cc:333] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.004443   431 raft_consensus.cc:2243] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.005056   431 raft_consensus.cc:2272] T 88018a232de842fc8fcd30e124b7c4d7 P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.007836   431 tablet_replica.cc:333] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
W20260709 13:03:31.007922  2236 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.009150   431 raft_consensus.cc:2243] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.009997   431 raft_consensus.cc:2272] T 56d2e4b816a44719af0c86481062c407 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.012526   431 tablet_replica.cc:333] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.013139   431 raft_consensus.cc:2243] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.013742   431 raft_consensus.cc:2272] T 845a9ac484f44da5a4a18f3ffa7030e5 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:31.014308  2236 consensus_peers.cc:597] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.016358   431 tablet_replica.cc:333] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.016960   431 raft_consensus.cc:2243] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.018227   431 raft_consensus.cc:2272] T 423fad3d086c4c18b5d84ecfeeb2957a P 4f1725fe36e349ac85405627f9c93d95 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.020517   431 tablet_replica.cc:333] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
W20260709 13:03:31.020471  2236 consensus_peers.cc:597] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.021448   431 raft_consensus.cc:2243] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:31.022315  2236 consensus_peers.cc:597] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.022363   431 raft_consensus.cc:2272] T 2fb004c86c654110bd570a13f623ed9f P 4f1725fe36e349ac85405627f9c93d95 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:31.023176  2236 consensus_peers.cc:597] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.024886   431 tablet_replica.cc:333] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.025647   431 raft_consensus.cc:2243] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.026347   431 raft_consensus.cc:2272] T eda09757c25a4279a4c93c29eeff416a P 4f1725fe36e349ac85405627f9c93d95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.029102   431 tablet_replica.cc:333] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.029937   431 raft_consensus.cc:2243] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.031409   431 raft_consensus.cc:2272] T f52157fbf77948c283b3ba328c6ebcdd P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.034322   431 tablet_replica.cc:333] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.035049   431 raft_consensus.cc:2243] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.035995   431 raft_consensus.cc:2272] T 447b9d1298e947858fa3d05e918d4a08 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.038954   431 tablet_replica.cc:333] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.039541   431 raft_consensus.cc:2243] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.040143   431 raft_consensus.cc:2272] T 207df21ae856459f9637b16a0feb2796 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.042258   431 tablet_replica.cc:333] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.042769   431 raft_consensus.cc:2243] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.043846   431 raft_consensus.cc:2272] T 05f358a33737477ba11488ec75b16050 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.046574   431 tablet_replica.cc:333] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.047154   431 raft_consensus.cc:2243] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.048007   431 raft_consensus.cc:2272] T 4afefd9972704c7ba44201033b7d2e6b P 4f1725fe36e349ac85405627f9c93d95 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.050477   431 tablet_replica.cc:333] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.051170   431 raft_consensus.cc:2243] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.051815   431 raft_consensus.cc:2272] T 8129c29801c142749490f0df95b71485 P 4f1725fe36e349ac85405627f9c93d95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.053881   431 tablet_replica.cc:333] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.054391   431 raft_consensus.cc:2243] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.055013   431 raft_consensus.cc:2272] T 95ea20fae86647d4bbf85d9c0864f5f1 P 4f1725fe36e349ac85405627f9c93d95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.057070   431 tablet_replica.cc:333] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.057548   431 raft_consensus.cc:2243] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.058598   431 raft_consensus.cc:2272] T 1ce7dbd8e7cf45808506e02da2925882 P 4f1725fe36e349ac85405627f9c93d95 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.060803   431 tablet_replica.cc:333] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95: stopping tablet replica
I20260709 13:03:31.061403   431 raft_consensus.cc:2243] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.062160   431 raft_consensus.cc:2272] T b699c6ee183d45208fccb5d51557fe41 P 4f1725fe36e349ac85405627f9c93d95 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:31.062088  2236 consensus_peers.cc:597] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.077337 10376 raft_consensus.cc:493] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:31.078169 10376 raft_consensus.cc:515] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:31.081238 10376 leader_election.cc:290] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:31.090451  2235 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:31.092850  2236 consensus_peers.cc:597] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:31.094269  2236 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:31.094734  2236 leader_election.cc:304] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:31.095500 10342 raft_consensus.cc:2749] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:31.096889  2234 leader_election.cc:336] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:31.103809  2236 consensus_peers.cc:597] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:31.114413  2236 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.163445 10342 raft_consensus.cc:493] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:31.164522 10342 raft_consensus.cc:515] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:31.165987 10342 leader_election.cc:290] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:03:31.170401  2234 leader_election.cc:336] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:31.171259  2235 leader_election.cc:336] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:31.171630  2235 leader_election.cc:304] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:31.172188 10342 raft_consensus.cc:2749] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:03:31.179112  2235 consensus_peers.cc:597] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 13:03:31.196179  2236 consensus_peers.cc:597] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:31.222189  2236 consensus_peers.cc:597] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:31.246209  2236 consensus_peers.cc:597] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:31.337085  2236 consensus_peers.cc:597] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 -> Peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Couldn't send request to peer 4f1725fe36e349ac85405627f9c93d95. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.463882 10376 raft_consensus.cc:493] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:31.464429 10376 raft_consensus.cc:515] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:31.466548 10376 leader_election.cc:290] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:03:31.471939  2235 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:31.472702  2234 leader_election.cc:336] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:31.473109  2234 leader_election.cc:304] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:31.473735 10376 raft_consensus.cc:2749] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:03:31.506711  2235 consensus_peers.cc:597] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
I20260709 13:03:31.589339 10376 raft_consensus.cc:493] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:31.589900 10376 raft_consensus.cc:515] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:31.592854 10376 leader_election.cc:290] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:03:31.597360  2235 leader_election.cc:336] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:31.597967  2234 leader_election.cc:336] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:31.598419  2234 leader_election.cc:304] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:31.599097 10376 raft_consensus.cc:2749] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:31.794137 10379 raft_consensus.cc:493] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:31.794669 10379 raft_consensus.cc:515] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:31.796756 10379 leader_election.cc:290] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441)
W20260709 13:03:31.798426  2235 consensus_peers.cc:597] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 81: this message will repeat every 5th retry.
W20260709 13:03:31.801223  2235 leader_election.cc:336] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:31.802747  2234 leader_election.cc:336] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:31.803120  2234 leader_election.cc:304] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:31.803718 10379 raft_consensus.cc:2749] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:31.856138  2235 consensus_peers.cc:597] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:03:31.881160 10379 raft_consensus.cc:493] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7e99891af85f4b10aa1cc2da6aa33082)
I20260709 13:03:31.881763 10379 raft_consensus.cc:515] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:31.886437 10379 leader_election.cc:290] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:31.890182  2234 leader_election.cc:336] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:31.892436 10379 raft_consensus.cc:493] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
W20260709 13:03:31.893615  2236 leader_election.cc:336] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111)
I20260709 13:03:31.894157  2236 leader_election.cc:304] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:31.894910 10342 raft_consensus.cc:2749] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:31.895339  2235 leader_election.cc:336] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:31.893077 10379 raft_consensus.cc:515] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:31.899576 10379 leader_election.cc:290] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:31.902953  2234 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:31.907075  2236 leader_election.cc:336] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111)
I20260709 13:03:31.907552  2236 leader_election.cc:304] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:31.908696 10379 raft_consensus.cc:2749] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 13:03:31.919456  2234 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111) [suppressed 660 similar messages]
I20260709 13:03:32.014937 10379 raft_consensus.cc:493] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:32.015450 10379 raft_consensus.cc:515] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:32.017335 10379 leader_election.cc:290] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:32.022681  2234 leader_election.cc:336] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:32.024989  2236 leader_election.cc:336] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111)
I20260709 13:03:32.025403  2236 leader_election.cc:304] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:32.026106 10342 raft_consensus.cc:2749] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:32.048306  2235 consensus_peers.cc:597] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 13:03:32.056960 10342 raft_consensus.cc:493] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:32.057515 10342 raft_consensus.cc:515] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:32.059634 10342 leader_election.cc:290] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:32.066428  2235 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:32.068156  2236 leader_election.cc:336] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111)
I20260709 13:03:32.068611  2236 leader_election.cc:304] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:32.072705 10342 raft_consensus.cc:2749] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:03:32.171172 10342 raft_consensus.cc:493] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:32.171722 10342 raft_consensus.cc:515] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:32.173846 10342 leader_election.cc:290] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:32.179358  2234 leader_election.cc:336] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:32.180549  2236 leader_election.cc:336] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111)
I20260709 13:03:32.180999  2236 leader_election.cc:304] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:32.181720 10342 raft_consensus.cc:2749] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:03:32.190374 10342 raft_consensus.cc:493] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:32.191886 10342 raft_consensus.cc:515] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:32.195380 10342 leader_election.cc:290] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:32.200618  2235 leader_election.cc:336] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:32.201427  2236 leader_election.cc:336] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111)
I20260709 13:03:32.201884  2236 leader_election.cc:304] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:32.203491 10342 raft_consensus.cc:2749] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:03:32.204573  2234 leader_election.cc:336] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:32.209296 10342 raft_consensus.cc:493] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:32.209807 10342 raft_consensus.cc:515] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:32.214120 10342 leader_election.cc:290] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:32.216166  2236 leader_election.cc:336] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111)
W20260709 13:03:32.219285  2235 leader_election.cc:336] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:32.219698  2235 leader_election.cc:304] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:32.221800 10342 raft_consensus.cc:2749] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:03:32.248569   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:32.255160 10379 raft_consensus.cc:493] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:32.255779 10379 raft_consensus.cc:515] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } attrs { replace: true } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:32.258251 10379 leader_election.cc:290] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:32.262393  2235 leader_election.cc:336] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:32.263367  2234 leader_election.cc:336] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:32.263871  2234 leader_election.cc:304] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 7e99891af85f4b10aa1cc2da6aa33082, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:32.264616 10379 raft_consensus.cc:2749] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:32.265823  2236 leader_election.cc:336] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111)
I20260709 13:03:32.298388 10379 raft_consensus.cc:493] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:32.299007 10379 raft_consensus.cc:515] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:32.300967 10379 leader_election.cc:290] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:32.305745  2235 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:32.306263  2236 leader_election.cc:336] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111)
I20260709 13:03:32.306732  2236 leader_election.cc:304] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 87144ea1a4a14ab8b942fb426159f031
I20260709 13:03:32.307994 10342 raft_consensus.cc:2749] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:03:32.323653 10379 raft_consensus.cc:493] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:32.324237 10379 raft_consensus.cc:515] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:32.328899 10379 leader_election.cc:290] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:32.336568  2236 leader_election.cc:336] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111)
W20260709 13:03:32.339479  2234 leader_election.cc:336] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:32.339932  2234 leader_election.cc:304] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:32.341109 10379 raft_consensus.cc:2749] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:03:32.362210   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
W20260709 13:03:32.371120  2235 consensus_peers.cc:597] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:03:32.385519 10342 raft_consensus.cc:493] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4f1725fe36e349ac85405627f9c93d95)
I20260709 13:03:32.386158 10342 raft_consensus.cc:515] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "87144ea1a4a14ab8b942fb426159f031" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39635 } } peers { permanent_uuid: "7e99891af85f4b10aa1cc2da6aa33082" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39441 } } peers { permanent_uuid: "4f1725fe36e349ac85405627f9c93d95" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45513 } attrs { replace: true } } peers { permanent_uuid: "6923294c847b48ebb577e0935d316aa3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38311 } attrs { promote: false } }
I20260709 13:03:32.403789 10342 leader_election.cc:290] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635), 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441), 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513)
W20260709 13:03:32.417431  2236 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4f1725fe36e349ac85405627f9c93d95 (127.0.107.195:45513): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45513: connect: Connection refused (error 111)
W20260709 13:03:32.418962  2234 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
I20260709 13:03:32.419391  2234 leader_election.cc:304] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6923294c847b48ebb577e0935d316aa3; no voters: 4f1725fe36e349ac85405627f9c93d95, 7e99891af85f4b10aa1cc2da6aa33082
I20260709 13:03:32.420095 10379 raft_consensus.cc:2749] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:03:32.422156  2235 leader_election.cc:336] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
W20260709 13:03:32.429502  2235 consensus_peers.cc:597] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 -> Peer 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): Couldn't send request to peer 87144ea1a4a14ab8b942fb426159f031. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 13:03:32.430667   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:32.431615   431 tablet_replica.cc:333] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.432590   431 raft_consensus.cc:2243] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.433257   431 raft_consensus.cc:2272] T 6ffd1be44d384b0d9dfc0986195efbd1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.436299   431 tablet_replica.cc:333] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.437196   431 raft_consensus.cc:2243] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.437811   431 raft_consensus.cc:2272] T 660b57178c7f4ffebd30c42df43b303a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.441076   431 tablet_replica.cc:333] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.441970   431 raft_consensus.cc:2243] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.442706   431 raft_consensus.cc:2272] T 95ea20fae86647d4bbf85d9c0864f5f1 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.445699   431 tablet_replica.cc:333] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.446547   431 raft_consensus.cc:2243] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.447710   431 raft_consensus.cc:2272] T 86aa6466101d44fc98160eb3586dc176 P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.450564   431 tablet_replica.cc:333] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.451418   431 raft_consensus.cc:2243] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.452395   431 raft_consensus.cc:2272] T eda09757c25a4279a4c93c29eeff416a P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.454975   431 tablet_replica.cc:333] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.455787   431 raft_consensus.cc:2243] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.456909   431 raft_consensus.cc:2272] T ff5a03f3312f4e6bac9383280b5b9131 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.459625   431 tablet_replica.cc:333] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.460371   431 raft_consensus.cc:2243] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.461346   431 raft_consensus.cc:2272] T d45e74819157464ca3f225e90c8b6a9e P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.464006   431 tablet_replica.cc:333] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.464780   431 raft_consensus.cc:2243] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.465358   431 raft_consensus.cc:2272] T dbfb4dc01d084c658bb8ff2ae985e80a P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.468056   431 tablet_replica.cc:333] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.468912   431 raft_consensus.cc:2243] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.469964   431 raft_consensus.cc:2272] T 12ca9a7e99a249b3820b6df8c497bfde P 6923294c847b48ebb577e0935d316aa3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.472829   431 tablet_replica.cc:333] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.473651   431 raft_consensus.cc:2243] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.474263   431 raft_consensus.cc:2272] T 423fad3d086c4c18b5d84ecfeeb2957a P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.476773   431 tablet_replica.cc:333] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.477780   431 raft_consensus.cc:2243] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.478878   431 raft_consensus.cc:2272] T 9ffc7074d09d4b0a8caf498542f3e843 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.481737   431 tablet_replica.cc:333] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.482596   431 raft_consensus.cc:2243] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.483726   431 raft_consensus.cc:2272] T 2b113b168afa40cfaab164f8317e42c1 P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.486492   431 tablet_replica.cc:333] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.487322   431 raft_consensus.cc:2243] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.488312   431 raft_consensus.cc:2272] T 323bbbd0be5249329755d7e00ed71324 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.491031   431 tablet_replica.cc:333] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.491752   431 raft_consensus.cc:2243] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.492712   431 raft_consensus.cc:2272] T fcdd2749ff424225974f40bab0aaff25 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.495362   431 tablet_replica.cc:333] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.496078   431 raft_consensus.cc:2243] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.496584   431 raft_consensus.cc:2272] T 2ee92ce4d1fe4cbdbec21419ac95fa2f P 6923294c847b48ebb577e0935d316aa3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.499348   431 tablet_replica.cc:333] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.500084   431 raft_consensus.cc:2243] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.501082   431 raft_consensus.cc:2272] T 845a9ac484f44da5a4a18f3ffa7030e5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.503741   431 tablet_replica.cc:333] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.504478   431 raft_consensus.cc:2243] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.505007   431 raft_consensus.cc:2272] T e6e602f7f3e34ef89e4eee8ddf3a9eb5 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.507655   431 tablet_replica.cc:333] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.508396   431 raft_consensus.cc:2243] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.508901   431 raft_consensus.cc:2272] T 3fe250573e1c4fdd9d93dbaaa494b367 P 6923294c847b48ebb577e0935d316aa3 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.511475   431 tablet_replica.cc:333] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.512193   431 raft_consensus.cc:2243] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.513181   431 raft_consensus.cc:2272] T 793edbca26c648ccab7933d6e1c299e5 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.515709   431 tablet_replica.cc:333] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.516464   431 raft_consensus.cc:2243] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.516970   431 raft_consensus.cc:2272] T 461e1b446c454dbfa1bd2a8ae75ae2c4 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.519553   431 tablet_replica.cc:333] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.520277   431 raft_consensus.cc:2243] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.521242   431 raft_consensus.cc:2272] T 207df21ae856459f9637b16a0feb2796 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.523617   431 tablet_replica.cc:333] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.524330   431 raft_consensus.cc:2243] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.525552   431 raft_consensus.cc:2272] T 447b9d1298e947858fa3d05e918d4a08 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.528249   431 tablet_replica.cc:333] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.528962   431 raft_consensus.cc:2243] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.529498   431 raft_consensus.cc:2272] T 05f358a33737477ba11488ec75b16050 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.531987   431 tablet_replica.cc:333] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.532666   431 raft_consensus.cc:2243] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.533314   431 raft_consensus.cc:2272] T 2f6a8ad007074cfe96f8430d622f5f80 P 6923294c847b48ebb577e0935d316aa3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.535861   431 tablet_replica.cc:333] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.536566   431 raft_consensus.cc:2243] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.537599   431 raft_consensus.cc:2272] T 44fa411feaaf4e2d91d23edd17e19ae0 P 6923294c847b48ebb577e0935d316aa3 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.540165   431 tablet_replica.cc:333] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.540858   431 raft_consensus.cc:2243] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.541532   431 raft_consensus.cc:2272] T 44a80c9a41a3498da7aa33d70b18ace6 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.544144   431 tablet_replica.cc:333] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.544828   431 raft_consensus.cc:2243] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.545917   431 raft_consensus.cc:2272] T 8e325950f4164ab99442980dc2c53386 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.548656   431 tablet_replica.cc:333] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.549372   431 raft_consensus.cc:2243] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.550383   431 raft_consensus.cc:2272] T 4afefd9972704c7ba44201033b7d2e6b P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.552904   431 tablet_replica.cc:333] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.553702   431 raft_consensus.cc:2243] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.554775   431 raft_consensus.cc:2272] T af202c0dfac940fb86d9d9d0a9124f44 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.557626   431 tablet_replica.cc:333] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.558434   431 raft_consensus.cc:2243] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.559459   431 raft_consensus.cc:2272] T a5f195a66bf8449c96e58c306dec48a5 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.562256   431 tablet_replica.cc:333] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.563045   431 raft_consensus.cc:2243] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.563656   431 raft_consensus.cc:2272] T d0ab32967f744404a0f736900b1d7b9a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.566316   431 tablet_replica.cc:333] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.566999   431 raft_consensus.cc:2243] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.568044   431 raft_consensus.cc:2272] T b699c6ee183d45208fccb5d51557fe41 P 6923294c847b48ebb577e0935d316aa3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.570627   431 tablet_replica.cc:333] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.571321   431 raft_consensus.cc:2243] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.572484   431 raft_consensus.cc:2272] T db8014a9a7494e619e862cbd380cb262 P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.575017   431 tablet_replica.cc:333] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.575707   431 raft_consensus.cc:2243] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.576231   431 raft_consensus.cc:2272] T 0ab2c76ce9ba4519b8beb7decd86314d P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.578899   431 tablet_replica.cc:333] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.579605   431 raft_consensus.cc:2243] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.580598   431 raft_consensus.cc:2272] T d44a8411cf4642829994ec97173d358a P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.583194   431 tablet_replica.cc:333] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.583890   431 raft_consensus.cc:2243] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.584898   431 raft_consensus.cc:2272] T 88018a232de842fc8fcd30e124b7c4d7 P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.587536   431 tablet_replica.cc:333] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.588227   431 raft_consensus.cc:2243] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.589299   431 raft_consensus.cc:2272] T a45da2e3894b42dc93ed11eb2c31220c P 6923294c847b48ebb577e0935d316aa3 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.591987   431 tablet_replica.cc:333] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.592720   431 raft_consensus.cc:2243] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.593775   431 raft_consensus.cc:2272] T d6b0ca7e03c249ebad5c6f720df4efca P 6923294c847b48ebb577e0935d316aa3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.596529   431 tablet_replica.cc:333] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.597221   431 raft_consensus.cc:2243] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.598315   431 raft_consensus.cc:2272] T 8129c29801c142749490f0df95b71485 P 6923294c847b48ebb577e0935d316aa3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.600775   431 tablet_replica.cc:333] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.601460   431 raft_consensus.cc:2243] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.602290   431 raft_consensus.cc:2272] T 7270b72e069f42daa3f82eaa77d9e299 P 6923294c847b48ebb577e0935d316aa3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.604921   431 tablet_replica.cc:333] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.605592   431 raft_consensus.cc:2243] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.607189   431 raft_consensus.cc:2272] T b8fae2aaea9349b488e73c3574050a18 P 6923294c847b48ebb577e0935d316aa3 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.610009   431 tablet_replica.cc:333] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.610765   431 raft_consensus.cc:2243] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.611413   431 raft_consensus.cc:2272] T c546ee055ea8417b8c1054e545eee77c P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.614070   431 tablet_replica.cc:333] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.614790   431 raft_consensus.cc:2243] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.615406   431 raft_consensus.cc:2272] T 5336feea1c174b498bc0252f726f9461 P 6923294c847b48ebb577e0935d316aa3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.618230   431 tablet_replica.cc:333] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3: stopping tablet replica
I20260709 13:03:32.618858   431 raft_consensus.cc:2243] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.619930   431 raft_consensus.cc:2272] T 44f91d5f5a1f4564ab4ec7b1b5b0aa0b P 6923294c847b48ebb577e0935d316aa3 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.011507   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:03:33.089772   431 master.cc:562] Master@127.0.107.254:36797 shutting down...
W20260709 13:03:33.129345  1506 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:03:33.129746  1506 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:33.129979  1506 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:54.991662  1443 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111) [suppressed 81 similar messages]
W20260709 13:03:54.995299  1443 catalog_manager.cc:4755] TS 7e99891af85f4b10aa1cc2da6aa33082 (127.0.107.194:39441): ChangeConfig:REMOVE_PEER RPC failed for tablet 7270b72e069f42daa3f82eaa77d9e299: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39441: connect: Connection refused (error 111)
W20260709 13:03:58.509694  1444 catalog_manager.cc:4755] TS 87144ea1a4a14ab8b942fb426159f031 (127.0.107.193:39635): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3fe250573e1c4fdd9d93dbaaa494b367: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39635: connect: Connection refused (error 111)
I20260709 13:03:59.682725   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.683800   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.684193   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 72b78a86b5e34075b0982caa9c5426ab: stopping tablet replica
I20260709 13:03:59.894845   431 master.cc:584] Master@127.0.107.254:36797 shutdown complete.
I20260709 13:03:59.949232   431 test_util.cc:182] -----------------------------------------------
I20260709 13:03:59.949496   431 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601903731679-431-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (311504 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:03:59.953286   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:33053
I20260709 13:03:59.954509   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:59.960328 10390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:59.961412 10391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:59.962266 10393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:59.963501   431 server_base.cc:1061] running on GCE node
I20260709 13:03:59.967118   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:59.967355   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:59.967509   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602239967492 us; error 0 us; skew 500 ppm
I20260709 13:03:59.968025   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:59.970461   431 webserver.cc:533] Webserver started at http://127.0.107.254:40013/ using document root <none> and password file <none>
I20260709 13:03:59.970947   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:59.971148   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:59.971412   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:59.972642   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/master-0-root/instance:
uuid: "1cb84adc31994c80bd5c448e72a26605"
format_stamp: "Formatted at 2026-07-09 13:03:59 on dist-test-slave-nr1f"
I20260709 13:03:59.977128   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:03:59.980696 10398 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:59.981449   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:59.981809   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/master-0-root
uuid: "1cb84adc31994c80bd5c448e72a26605"
format_stamp: "Formatted at 2026-07-09 13:03:59 on dist-test-slave-nr1f"
I20260709 13:03:59.982139   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:59.993541   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:59.994879   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:00.036593   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:33053
I20260709 13:04:00.036685 10449 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:33053 every 8 connection(s)
I20260709 13:04:00.040782 10450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.052506 10450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605: Bootstrap starting.
I20260709 13:04:00.057425 10450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:00.061987 10450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605: No bootstrap required, opened a new log
I20260709 13:04:00.064280 10450 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cb84adc31994c80bd5c448e72a26605" member_type: VOTER }
I20260709 13:04:00.064754 10450 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:00.064980 10450 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cb84adc31994c80bd5c448e72a26605, State: Initialized, Role: FOLLOWER
I20260709 13:04:00.065555 10450 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cb84adc31994c80bd5c448e72a26605" member_type: VOTER }
I20260709 13:04:00.066063 10450 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:00.066346 10450 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:00.066630 10450 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:00.071321 10450 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cb84adc31994c80bd5c448e72a26605" member_type: VOTER }
I20260709 13:04:00.071882 10450 leader_election.cc:304] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1cb84adc31994c80bd5c448e72a26605; no voters: 
I20260709 13:04:00.073022 10450 leader_election.cc:290] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:00.073392 10453 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:00.074855 10453 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [term 1 LEADER]: Becoming Leader. State: Replica: 1cb84adc31994c80bd5c448e72a26605, State: Running, Role: LEADER
I20260709 13:04:00.075634 10453 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cb84adc31994c80bd5c448e72a26605" member_type: VOTER }
I20260709 13:04:00.075945 10450 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:00.082880 10455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1cb84adc31994c80bd5c448e72a26605. Latest consensus state: current_term: 1 leader_uuid: "1cb84adc31994c80bd5c448e72a26605" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cb84adc31994c80bd5c448e72a26605" member_type: VOTER } }
I20260709 13:04:00.082937 10454 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1cb84adc31994c80bd5c448e72a26605" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cb84adc31994c80bd5c448e72a26605" member_type: VOTER } }
I20260709 13:04:00.084070 10454 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:00.084003 10455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:00.086283 10463 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:00.094045 10463 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:00.095095   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:00.103353 10463 catalog_manager.cc:1383] Generated new cluster ID: a082230133df43c0ba24f3b3aea0c4aa
I20260709 13:04:00.103662 10463 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:00.128010 10463 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:00.129330 10463 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:00.141207 10463 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605: Generated new TSK 0
I20260709 13:04:00.141855 10463 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:00.161665   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:00.168277 10471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:00.169746 10472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:00.171973 10474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:00.172984   431 server_base.cc:1061] running on GCE node
I20260709 13:04:00.175673   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:00.175871   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:00.175992   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602240175981 us; error 0 us; skew 500 ppm
I20260709 13:04:00.176491   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:00.179010   431 webserver.cc:533] Webserver started at http://127.0.107.193:41663/ using document root <none> and password file <none>
I20260709 13:04:00.179467   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:00.179621   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:00.179827   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:00.181025   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-0-root/instance:
uuid: "cbba8b78b34443bcb2be4b73f86fac96"
format_stamp: "Formatted at 2026-07-09 13:04:00 on dist-test-slave-nr1f"
I20260709 13:04:00.185571   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:04:00.189131 10479 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.189888   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:04:00.190268   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-0-root
uuid: "cbba8b78b34443bcb2be4b73f86fac96"
format_stamp: "Formatted at 2026-07-09 13:04:00 on dist-test-slave-nr1f"
I20260709 13:04:00.190582   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:00.228163   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:00.229393   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:00.230973   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:00.233428   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:00.233670   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.233906   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:00.234108   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:04:00.276285   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:45489
I20260709 13:04:00.276371 10541 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:45489 every 8 connection(s)
I20260709 13:04:00.281972   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:00.289482 10546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:00.292694 10547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:00.294662 10549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:00.295908   431 server_base.cc:1061] running on GCE node
I20260709 13:04:00.298643   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:00.298852   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:00.299050   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602240299020 us; error 0 us; skew 500 ppm
I20260709 13:04:00.299619   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:00.301698 10542 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33053
I20260709 13:04:00.302090 10542 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:00.302538   431 webserver.cc:533] Webserver started at http://127.0.107.194:43505/ using document root <none> and password file <none>
I20260709 13:04:00.302987 10542 heartbeater.cc:507] Master 127.0.107.254:33053 requested a full tablet report, sending...
I20260709 13:04:00.303081   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:00.303494   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:00.303766   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:00.305276   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-1-root/instance:
uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
format_stamp: "Formatted at 2026-07-09 13:04:00 on dist-test-slave-nr1f"
I20260709 13:04:00.305472 10415 ts_manager.cc:194] Registered new tserver with Master: cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:00.308135 10415 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40218
I20260709 13:04:00.311381   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 13:04:00.315183 10554 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.316056   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:04:00.316382   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-1-root
uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
format_stamp: "Formatted at 2026-07-09 13:04:00 on dist-test-slave-nr1f"
I20260709 13:04:00.316701   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:00.328907   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:00.330238   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:00.331787   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:00.334120   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:00.334336   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.334576   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:00.334755   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.376125   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:46841
I20260709 13:04:00.376250 10616 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:46841 every 8 connection(s)
I20260709 13:04:00.381350   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:00.389513 10620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:00.391345 10621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:00.394132 10623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:00.394534   431 server_base.cc:1061] running on GCE node
I20260709 13:04:00.395833   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:00.395874 10617 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33053
W20260709 13:04:00.396170   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:00.396416   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602240396400 us; error 0 us; skew 500 ppm
I20260709 13:04:00.396421 10617 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:00.397099   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:00.397405 10617 heartbeater.cc:507] Master 127.0.107.254:33053 requested a full tablet report, sending...
I20260709 13:04:00.399693 10415 ts_manager.cc:194] Registered new tserver with Master: 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:00.399950   431 webserver.cc:533] Webserver started at http://127.0.107.195:43463/ using document root <none> and password file <none>
I20260709 13:04:00.400626   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:00.400862   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:00.401167   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:00.401597 10415 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40220
I20260709 13:04:00.402925   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-2-root/instance:
uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
format_stamp: "Formatted at 2026-07-09 13:04:00 on dist-test-slave-nr1f"
I20260709 13:04:00.407512   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:04:00.411072 10628 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.411836   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:00.412133   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-2-root
uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
format_stamp: "Formatted at 2026-07-09 13:04:00 on dist-test-slave-nr1f"
I20260709 13:04:00.412392   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:00.428295   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:00.429545   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:00.431097   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:00.433359   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:00.433537   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.433830   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:00.433969   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.475873   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:46191
I20260709 13:04:00.475968 10690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:46191 every 8 connection(s)
I20260709 13:04:00.480916   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:00.489733 10694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:00.490862 10695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:00.493899 10697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:00.494557 10691 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33053
I20260709 13:04:00.494652   431 server_base.cc:1061] running on GCE node
I20260709 13:04:00.495163 10691 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:00.495800   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:00.495982 10691 heartbeater.cc:507] Master 127.0.107.254:33053 requested a full tablet report, sending...
W20260709 13:04:00.496125   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:00.496531   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602240496509 us; error 0 us; skew 500 ppm
I20260709 13:04:00.497200   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:00.498437 10415 ts_manager.cc:194] Registered new tserver with Master: 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:00.500200   431 webserver.cc:533] Webserver started at http://127.0.107.196:36221/ using document root <none> and password file <none>
I20260709 13:04:00.500404 10415 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40232
I20260709 13:04:00.500932   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:00.501206   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:00.501529   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:00.502856   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-3-root/instance:
uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
format_stamp: "Formatted at 2026-07-09 13:04:00 on dist-test-slave-nr1f"
I20260709 13:04:00.507146   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:00.510600 10702 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.511404   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:00.511830   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-3-root
uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
format_stamp: "Formatted at 2026-07-09 13:04:00 on dist-test-slave-nr1f"
I20260709 13:04:00.512136   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:00.524564   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:00.525810   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:00.527329   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:00.529639   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:00.529886   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.530138   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:00.530314   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.573544   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:42289
I20260709 13:04:00.573704 10764 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:42289 every 8 connection(s)
I20260709 13:04:00.590207 10765 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33053
I20260709 13:04:00.590692 10765 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:00.591553 10765 heartbeater.cc:507] Master 127.0.107.254:33053 requested a full tablet report, sending...
I20260709 13:04:00.593890 10415 ts_manager.cc:194] Registered new tserver with Master: bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:00.594705   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017739009s
I20260709 13:04:00.595996 10415 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33974
I20260709 13:04:00.623008 10415 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33980:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:04:00.880476 10507 tablet_service.cc:1511] Processing CreateTablet for tablet cea5737b68ca4d8ab303923d787668e9 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:00.882426 10507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea5737b68ca4d8ab303923d787668e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.897341 10506 tablet_service.cc:1511] Processing CreateTablet for tablet 43dc87c50f6e4a299ba01b42bb08af51 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:00.899003 10506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43dc87c50f6e4a299ba01b42bb08af51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.905716 10656 tablet_service.cc:1511] Processing CreateTablet for tablet cea5737b68ca4d8ab303923d787668e9 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:00.907351 10656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea5737b68ca4d8ab303923d787668e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.911878 10653 tablet_service.cc:1511] Processing CreateTablet for tablet b091d4dadcee40108323abee07cb66e4 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:00.913070 10504 tablet_service.cc:1511] Processing CreateTablet for tablet b091d4dadcee40108323abee07cb66e4 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:00.913502 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b091d4dadcee40108323abee07cb66e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.914582 10504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b091d4dadcee40108323abee07cb66e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.914237 10654 tablet_service.cc:1511] Processing CreateTablet for tablet 0627ec961e5d45079cc5672bdcab5121 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:00.915393 10501 tablet_service.cc:1511] Processing CreateTablet for tablet ddadabec8df04c90812c121230deefd6 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:00.916764 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddadabec8df04c90812c121230deefd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.916677 10655 tablet_service.cc:1511] Processing CreateTablet for tablet 43dc87c50f6e4a299ba01b42bb08af51 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:00.919348 10502 tablet_service.cc:1511] Processing CreateTablet for tablet 3acf8caca63d426eb5b16065fee6b938 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:00.920794 10502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3acf8caca63d426eb5b16065fee6b938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.923319 10503 tablet_service.cc:1511] Processing CreateTablet for tablet 994595b7f94b4aac870d2234e0693b6b (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:00.911878 10652 tablet_service.cc:1511] Processing CreateTablet for tablet 3acf8caca63d426eb5b16065fee6b938 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:00.926281 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994595b7f94b4aac870d2234e0693b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.927213 10652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3acf8caca63d426eb5b16065fee6b938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.932499 10651 tablet_service.cc:1511] Processing CreateTablet for tablet ff7453e3b1834c1b90a795fcb9778191 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:00.911878 10505 tablet_service.cc:1511] Processing CreateTablet for tablet 6824db2b4d464925b19c786450677fb2 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:00.935209 10505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6824db2b4d464925b19c786450677fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.942301 10651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7453e3b1834c1b90a795fcb9778191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.943783 10654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0627ec961e5d45079cc5672bdcab5121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.945289 10650 tablet_service.cc:1511] Processing CreateTablet for tablet ddadabec8df04c90812c121230deefd6 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:00.950918 10650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddadabec8df04c90812c121230deefd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.953979 10730 tablet_service.cc:1511] Processing CreateTablet for tablet cea5737b68ca4d8ab303923d787668e9 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:00.954674 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 6824db2b4d464925b19c786450677fb2 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:00.955627 10730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea5737b68ca4d8ab303923d787668e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.956578 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6824db2b4d464925b19c786450677fb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.954674 10500 tablet_service.cc:1511] Processing CreateTablet for tablet c0040a4a12604d64862fe91f215f2174 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:00.959599 10500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0040a4a12604d64862fe91f215f2174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.961572 10655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43dc87c50f6e4a299ba01b42bb08af51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.963367 10649 tablet_service.cc:1511] Processing CreateTablet for tablet 53b87229f79a4fbca5482dfc3a4438b5 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:00.964887 10649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b87229f79a4fbca5482dfc3a4438b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.968532 10499 tablet_service.cc:1511] Processing CreateTablet for tablet 53b87229f79a4fbca5482dfc3a4438b5 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:00.971314 10648 tablet_service.cc:1511] Processing CreateTablet for tablet b19c6fe03f9244a78476037b279a7bea (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:00.972808 10648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19c6fe03f9244a78476037b279a7bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.974210 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b87229f79a4fbca5482dfc3a4438b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.976538 10647 tablet_service.cc:1511] Processing CreateTablet for tablet 83877eedc15a406e8656b628afec0bd5 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:00.978227 10647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83877eedc15a406e8656b628afec0bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:00.980018 10498 tablet_service.cc:1511] Processing CreateTablet for tablet 83877eedc15a406e8656b628afec0bd5 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:00.981645 10498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83877eedc15a406e8656b628afec0bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.013779 10785 tablet_bootstrap.cc:492] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:01.015836 10728 tablet_service.cc:1511] Processing CreateTablet for tablet 0627ec961e5d45079cc5672bdcab5121 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:01.017885 10728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0627ec961e5d45079cc5672bdcab5121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.037271 10727 tablet_service.cc:1511] Processing CreateTablet for tablet 994595b7f94b4aac870d2234e0693b6b (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:01.039373 10727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994595b7f94b4aac870d2234e0693b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.053107 10726 tablet_service.cc:1511] Processing CreateTablet for tablet 3acf8caca63d426eb5b16065fee6b938 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:01.054628 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3acf8caca63d426eb5b16065fee6b938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.059314 10785 tablet_bootstrap.cc:654] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.067400 10725 tablet_service.cc:1511] Processing CreateTablet for tablet ff7453e3b1834c1b90a795fcb9778191 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:01.068951 10725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7453e3b1834c1b90a795fcb9778191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.072052 10582 tablet_service.cc:1511] Processing CreateTablet for tablet 43dc87c50f6e4a299ba01b42bb08af51 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:01.073534 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43dc87c50f6e4a299ba01b42bb08af51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.080583 10724 tablet_service.cc:1511] Processing CreateTablet for tablet c0040a4a12604d64862fe91f215f2174 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:01.082193 10724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0040a4a12604d64862fe91f215f2174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.084430 10581 tablet_service.cc:1511] Processing CreateTablet for tablet 6824db2b4d464925b19c786450677fb2 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:01.085986 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6824db2b4d464925b19c786450677fb2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:01.087877 10462 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:01.092921 10786 tablet_bootstrap.cc:492] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:01.097127 10505 tablet_service.cc:1511] Processing CreateTablet for tablet 7b78ad4d54fb4014a07b4cbee983af70 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:01.098538 10505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b78ad4d54fb4014a07b4cbee983af70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.099866 10786 tablet_bootstrap.cc:654] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.112866 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 53b87229f79a4fbca5482dfc3a4438b5 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:01.114364 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b87229f79a4fbca5482dfc3a4438b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.115351 10723 tablet_service.cc:1511] Processing CreateTablet for tablet b19c6fe03f9244a78476037b279a7bea (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:01.116015 10653 tablet_service.cc:1511] Processing CreateTablet for tablet d68c56443fa044b5865e4dd944d2e929 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:01.116781 10723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19c6fe03f9244a78476037b279a7bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.121894 10580 tablet_service.cc:1511] Processing CreateTablet for tablet 0627ec961e5d45079cc5672bdcab5121 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:01.123351 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0627ec961e5d45079cc5672bdcab5121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.126111 10579 tablet_service.cc:1511] Processing CreateTablet for tablet b091d4dadcee40108323abee07cb66e4 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:01.127513 10579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b091d4dadcee40108323abee07cb66e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.131320 10578 tablet_service.cc:1511] Processing CreateTablet for tablet 994595b7f94b4aac870d2234e0693b6b (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:01.132766 10578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 994595b7f94b4aac870d2234e0693b6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.132655 10503 tablet_service.cc:1511] Processing CreateTablet for tablet d68c56443fa044b5865e4dd944d2e929 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:01.134863 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d68c56443fa044b5865e4dd944d2e929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.135324 10577 tablet_service.cc:1511] Processing CreateTablet for tablet ff7453e3b1834c1b90a795fcb9778191 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:01.136778 10577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7453e3b1834c1b90a795fcb9778191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.139273 10576 tablet_service.cc:1511] Processing CreateTablet for tablet ddadabec8df04c90812c121230deefd6 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:01.140714 10576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddadabec8df04c90812c121230deefd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.117816 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d68c56443fa044b5865e4dd944d2e929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.156450 10722 tablet_service.cc:1511] Processing CreateTablet for tablet d68c56443fa044b5865e4dd944d2e929 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:01.152112 10650 tablet_service.cc:1511] Processing CreateTablet for tablet e802f2e4188a44849dff275987bb46ec (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:01.159255 10650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e802f2e4188a44849dff275987bb46ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.160398 10575 tablet_service.cc:1511] Processing CreateTablet for tablet c0040a4a12604d64862fe91f215f2174 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:01.161991 10575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0040a4a12604d64862fe91f215f2174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.165069 10573 tablet_service.cc:1511] Processing CreateTablet for tablet 83877eedc15a406e8656b628afec0bd5 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:01.183239 10573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83877eedc15a406e8656b628afec0bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.185483 10785 tablet_bootstrap.cc:492] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:01.163383 10574 tablet_service.cc:1511] Processing CreateTablet for tablet b19c6fe03f9244a78476037b279a7bea (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:01.188993 10574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b19c6fe03f9244a78476037b279a7bea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.172058 10722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d68c56443fa044b5865e4dd944d2e929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.194376 10785 ts_tablet_manager.cc:1403] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.181s	user 0.030s	sys 0.050s
I20260709 13:04:01.197691 10785 raft_consensus.cc:359] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.198573 10785 raft_consensus.cc:385] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.198899 10785 raft_consensus.cc:740] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.208012 10785 consensus_queue.cc:260] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.209041 10574 tablet_service.cc:1511] Processing CreateTablet for tablet 7b78ad4d54fb4014a07b4cbee983af70 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:01.213346 10574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b78ad4d54fb4014a07b4cbee983af70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.239548 10786 tablet_bootstrap.cc:492] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:01.240186 10786 ts_tablet_manager.cc:1403] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.148s	user 0.008s	sys 0.007s
I20260709 13:04:01.226256 10580 tablet_service.cc:1511] Processing CreateTablet for tablet e802f2e4188a44849dff275987bb46ec (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:01.243637 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e802f2e4188a44849dff275987bb46ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.261322 10789 tablet_bootstrap.cc:492] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:01.273988 10730 tablet_service.cc:1511] Processing CreateTablet for tablet e802f2e4188a44849dff275987bb46ec (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:01.284524 10786 raft_consensus.cc:359] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:01.291996 10786 raft_consensus.cc:385] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.294929 10786 raft_consensus.cc:740] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.288221 10582 tablet_service.cc:1511] Processing CreateTablet for tablet 67c4c3a7a6b84e2fa267292d100e1f4a (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:01.291632 10499 tablet_service.cc:1511] Processing CreateTablet for tablet 5811d78dc99d4c6ab232228c36f59fa4 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:01.296746 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c4c3a7a6b84e2fa267292d100e1f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.297253 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5811d78dc99d4c6ab232228c36f59fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.298810 10721 tablet_service.cc:1511] Processing CreateTablet for tablet f0539b460f174e8b80e242e8ae3c3801 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:01.286353 10730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e802f2e4188a44849dff275987bb46ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.301295 10721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0539b460f174e8b80e242e8ae3c3801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.301960 10724 tablet_service.cc:1511] Processing CreateTablet for tablet 7b78ad4d54fb4014a07b4cbee983af70 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:01.303545 10724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b78ad4d54fb4014a07b4cbee983af70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.307890 10651 tablet_service.cc:1511] Processing CreateTablet for tablet f0539b460f174e8b80e242e8ae3c3801 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:01.309520 10651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0539b460f174e8b80e242e8ae3c3801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.311440 10542 heartbeater.cc:499] Master 127.0.107.254:33053 was elected leader, sending a full tablet report...
I20260709 13:04:01.315544 10785 ts_tablet_manager.cc:1434] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.121s	user 0.026s	sys 0.018s
I20260709 13:04:01.294070 10725 tablet_service.cc:1511] Processing CreateTablet for tablet 5811d78dc99d4c6ab232228c36f59fa4 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:01.324066 10789 tablet_bootstrap.cc:654] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.330446 10791 tablet_bootstrap.cc:492] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:01.330518 10581 tablet_service.cc:1511] Processing CreateTablet for tablet 5811d78dc99d4c6ab232228c36f59fa4 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:01.331483 10498 tablet_service.cc:1511] Processing CreateTablet for tablet f0539b460f174e8b80e242e8ae3c3801 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:01.339411 10498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0539b460f174e8b80e242e8ae3c3801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.344216 10505 tablet_service.cc:1511] Processing CreateTablet for tablet 67c4c3a7a6b84e2fa267292d100e1f4a (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:01.345700 10505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c4c3a7a6b84e2fa267292d100e1f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.357558 10650 tablet_service.cc:1511] Processing CreateTablet for tablet fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:01.360255 10725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5811d78dc99d4c6ab232228c36f59fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.360639 10650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd5b2ba1e5c4fd09fb5e1e6b14da9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.362320 10728 tablet_service.cc:1511] Processing CreateTablet for tablet fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:01.363794 10728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd5b2ba1e5c4fd09fb5e1e6b14da9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.363855 10655 tablet_service.cc:1511] Processing CreateTablet for tablet 67c4c3a7a6b84e2fa267292d100e1f4a (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:01.365487 10655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67c4c3a7a6b84e2fa267292d100e1f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.373895 10501 tablet_service.cc:1511] Processing CreateTablet for tablet 97e31d4d9ec6473caabd94052248c686 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:01.375705 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e31d4d9ec6473caabd94052248c686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.377414 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5811d78dc99d4c6ab232228c36f59fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.395475 10723 tablet_service.cc:1511] Processing CreateTablet for tablet ee9f9f43d189428086d7fc6781e9ac76 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:01.396303 10653 tablet_service.cc:1511] Processing CreateTablet for tablet 97e31d4d9ec6473caabd94052248c686 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:01.397188 10723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9f9f43d189428086d7fc6781e9ac76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.397717 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e31d4d9ec6473caabd94052248c686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.382691 10791 tablet_bootstrap.cc:654] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.398590 10785 tablet_bootstrap.cc:492] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:01.376515 10786 consensus_queue.cc:260] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:01.407833 10617 heartbeater.cc:499] Master 127.0.107.254:33053 was elected leader, sending a full tablet report...
I20260709 13:04:01.412091 10503 tablet_service.cc:1511] Processing CreateTablet for tablet ee9f9f43d189428086d7fc6781e9ac76 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:01.412324 10573 tablet_service.cc:1511] Processing CreateTablet for tablet fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:01.416612 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9f9f43d189428086d7fc6781e9ac76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.412566 10648 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5e544a9bf947f29b531ce9027580d3 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:01.418274 10726 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5e544a9bf947f29b531ce9027580d3 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:01.419781 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5e544a9bf947f29b531ce9027580d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.422431 10648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5e544a9bf947f29b531ce9027580d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.439060 10580 tablet_service.cc:1511] Processing CreateTablet for tablet 97e31d4d9ec6473caabd94052248c686 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:01.439038 10785 tablet_bootstrap.cc:654] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.451872 10574 tablet_service.cc:1511] Processing CreateTablet for tablet ee9f9f43d189428086d7fc6781e9ac76 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:01.463841 10499 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5e544a9bf947f29b531ce9027580d3 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:01.465467 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5e544a9bf947f29b531ce9027580d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.467535 10573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd5b2ba1e5c4fd09fb5e1e6b14da9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.470949 10789 tablet_bootstrap.cc:492] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:01.471520 10789 ts_tablet_manager.cc:1403] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.211s	user 0.019s	sys 0.011s
I20260709 13:04:01.474776 10789 raft_consensus.cc:359] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.475528 10789 raft_consensus.cc:385] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.475835 10789 raft_consensus.cc:740] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.476643 10789 consensus_queue.cc:260] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.478179 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e31d4d9ec6473caabd94052248c686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.485715 10765 heartbeater.cc:499] Master 127.0.107.254:33053 was elected leader, sending a full tablet report...
I20260709 13:04:01.497792 10574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9f9f43d189428086d7fc6781e9ac76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.499624 10790 raft_consensus.cc:493] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.500173 10790 raft_consensus.cc:515] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.503095 10691 heartbeater.cc:499] Master 127.0.107.254:33053 was elected leader, sending a full tablet report...
I20260709 13:04:01.503367 10790 leader_election.cc:290] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:01.506575 10791 tablet_bootstrap.cc:492] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:01.507157 10791 ts_tablet_manager.cc:1403] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.177s	user 0.007s	sys 0.009s
W20260709 13:04:01.535996 10543 tablet.cc:2406] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:01.540935 10791 raft_consensus.cc:359] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:01.545047 10402 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 56861.3us
I20260709 13:04:01.555562 10786 ts_tablet_manager.cc:1434] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.315s	user 0.013s	sys 0.016s
I20260709 13:04:01.556557 10786 tablet_bootstrap.cc:492] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:01.556810 10785 tablet_bootstrap.cc:492] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:01.557379 10785 ts_tablet_manager.cc:1403] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.211s	user 0.011s	sys 0.011s
I20260709 13:04:01.541971 10791 raft_consensus.cc:385] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.558210 10791 raft_consensus.cc:740] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.558985 10791 consensus_queue.cc:260] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:01.563359 10785 raft_consensus.cc:359] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.564303 10785 raft_consensus.cc:385] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.564661 10785 raft_consensus.cc:740] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.565670 10785 consensus_queue.cc:260] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.568230 10785 ts_tablet_manager.cc:1434] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:04:01.575006 10789 ts_tablet_manager.cc:1434] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.103s	user 0.024s	sys 0.008s
I20260709 13:04:01.576297 10789 tablet_bootstrap.cc:492] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:01.579939 10498 tablet_service.cc:1511] Processing CreateTablet for tablet 2513a3510ad1457d9962458d169aab59 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:01.581496 10498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2513a3510ad1457d9962458d169aab59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.585832 10785 tablet_bootstrap.cc:492] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:01.595242 10789 tablet_bootstrap.cc:654] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.559286 10582 tablet_service.cc:1511] Processing CreateTablet for tablet d73b5dbe2dea4e249d33a2bac3dee4e2 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:01.589399 10725 tablet_service.cc:1511] Processing CreateTablet for tablet d73b5dbe2dea4e249d33a2bac3dee4e2 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:01.601792 10725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d73b5dbe2dea4e249d33a2bac3dee4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.602605 10786 tablet_bootstrap.cc:654] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.606779 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d73b5dbe2dea4e249d33a2bac3dee4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.606930 10791 ts_tablet_manager.cc:1434] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.099s	user 0.010s	sys 0.003s
I20260709 13:04:01.608213 10791 tablet_bootstrap.cc:492] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:01.609395 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dc87c50f6e4a299ba01b42bb08af51" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
W20260709 13:04:01.611281 10482 leader_election.cc:343] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.613551 10785 tablet_bootstrap.cc:654] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.615159 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dc87c50f6e4a299ba01b42bb08af51" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:01.621613 10592 raft_consensus.cc:2468] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:01.622835 10786 tablet_bootstrap.cc:492] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:01.623445 10786 ts_tablet_manager.cc:1403] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.003s
I20260709 13:04:01.623301 10483 leader_election.cc:304] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:01.624300 10790 raft_consensus.cc:2804] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:01.624656 10790 raft_consensus.cc:493] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.623296 10655 tablet_service.cc:1511] Processing CreateTablet for tablet 2513a3510ad1457d9962458d169aab59 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:01.625247 10790 raft_consensus.cc:3060] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.626255 10653 tablet_service.cc:1511] Processing CreateTablet for tablet d73b5dbe2dea4e249d33a2bac3dee4e2 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:01.626917 10574 tablet_service.cc:1511] Processing CreateTablet for tablet 2513a3510ad1457d9962458d169aab59 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:01.627588 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d73b5dbe2dea4e249d33a2bac3dee4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.628168 10574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2513a3510ad1457d9962458d169aab59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.628531 10786 raft_consensus.cc:359] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:01.629256 10786 raft_consensus.cc:385] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.629544 10786 raft_consensus.cc:740] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.631893 10655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2513a3510ad1457d9962458d169aab59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.634514 10791 tablet_bootstrap.cc:654] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.642853 10786 consensus_queue.cc:260] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:01.643944 10789 tablet_bootstrap.cc:492] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:01.644498 10789 ts_tablet_manager.cc:1403] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.001s
I20260709 13:04:01.645718 10786 ts_tablet_manager.cc:1434] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 13:04:01.646788 10786 tablet_bootstrap.cc:492] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:01.649361 10790 raft_consensus.cc:515] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.657582 10789 raft_consensus.cc:359] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:01.658489 10723 tablet_service.cc:1511] Processing CreateTablet for tablet 1d6dbf486214445a8d6a624d253a2a24 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:01.659111 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dc87c50f6e4a299ba01b42bb08af51" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:01.659693 10592 raft_consensus.cc:3060] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.659893 10723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6dbf486214445a8d6a624d253a2a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.653513 10786 tablet_bootstrap.cc:654] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.667361 10592 raft_consensus.cc:2468] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:01.668687 10483 leader_election.cc:304] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:01.675284 10790 leader_election.cc:290] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:01.675907 10790 raft_consensus.cc:2804] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:01.676380 10790 raft_consensus.cc:697] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:01.677174 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dc87c50f6e4a299ba01b42bb08af51" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
W20260709 13:04:01.678946 10482 leader_election.cc:343] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.679437 10785 tablet_bootstrap.cc:492] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:01.679975 10785 ts_tablet_manager.cc:1403] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.004s
I20260709 13:04:01.677210 10790 consensus_queue.cc:237] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.688313 10499 tablet_service.cc:1511] Processing CreateTablet for tablet 1d6dbf486214445a8d6a624d253a2a24 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:01.689689 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6dbf486214445a8d6a624d253a2a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.658516 10789 raft_consensus.cc:385] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.694362 10789 raft_consensus.cc:740] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.695295 10789 consensus_queue.cc:260] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:01.693401 10785 raft_consensus.cc:359] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:01.707697 10789 ts_tablet_manager.cc:1434] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.001s
I20260709 13:04:01.708909 10789 tablet_bootstrap.cc:492] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:01.706278 10785 raft_consensus.cc:385] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.710420 10785 raft_consensus.cc:740] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.711216 10785 consensus_queue.cc:260] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:01.713585 10785 ts_tablet_manager.cc:1434] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.033s	user 0.000s	sys 0.007s
I20260709 13:04:01.719844 10785 tablet_bootstrap.cc:492] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:01.720016 10580 tablet_service.cc:1511] Processing CreateTablet for tablet 1d6dbf486214445a8d6a624d253a2a24 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:01.721374 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d6dbf486214445a8d6a624d253a2a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.723745 10413 catalog_manager.cc:5697] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.731796 10728 tablet_service.cc:1511] Processing CreateTablet for tablet 67449a01ef99467887627b70924e3efc (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:01.728348 10648 tablet_service.cc:1511] Processing CreateTablet for tablet 67449a01ef99467887627b70924e3efc (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:01.733181 10728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67449a01ef99467887627b70924e3efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.733294 10648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67449a01ef99467887627b70924e3efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.735126 10791 tablet_bootstrap.cc:492] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:01.735656 10791 ts_tablet_manager.cc:1403] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.003s
I20260709 13:04:01.739739 10791 raft_consensus.cc:359] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.739993 10503 tablet_service.cc:1511] Processing CreateTablet for tablet 67449a01ef99467887627b70924e3efc (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:01.740483 10791 raft_consensus.cc:385] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.740886 10791 raft_consensus.cc:740] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.741375 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67449a01ef99467887627b70924e3efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.742671 10786 tablet_bootstrap.cc:492] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:01.743196 10786 ts_tablet_manager.cc:1403] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.097s	user 0.008s	sys 0.007s
I20260709 13:04:01.746727 10789 tablet_bootstrap.cc:654] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.741690 10791 consensus_queue.cc:260] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.750717 10786 raft_consensus.cc:359] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:01.751538 10786 raft_consensus.cc:385] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.751914 10786 raft_consensus.cc:740] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.753150 10582 tablet_service.cc:1511] Processing CreateTablet for tablet e9a34b42baf84d3781f0a69c5722c1bb (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:01.754719 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a34b42baf84d3781f0a69c5722c1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.756510 10791 ts_tablet_manager.cc:1434] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:04:01.757907 10786 consensus_queue.cc:260] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:01.758669 10794 raft_consensus.cc:493] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.760861 10785 tablet_bootstrap.cc:654] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.762171 10794 raft_consensus.cc:515] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:01.769913 10789 tablet_bootstrap.cc:492] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:01.769522 10653 tablet_service.cc:1511] Processing CreateTablet for tablet e9a34b42baf84d3781f0a69c5722c1bb (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:01.771322 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a34b42baf84d3781f0a69c5722c1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.773535 10791 tablet_bootstrap.cc:492] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:01.772324 10794 leader_election.cc:290] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:01.778532 10723 tablet_service.cc:1511] Processing CreateTablet for tablet e9a34b42baf84d3781f0a69c5722c1bb (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:01.779090 10655 tablet_service.cc:1511] Processing CreateTablet for tablet a4d54a6a210240e8994f2e4a34596f81 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:01.779955 10723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9a34b42baf84d3781f0a69c5722c1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.783890 10574 tablet_service.cc:1511] Processing CreateTablet for tablet a4d54a6a210240e8994f2e4a34596f81 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:01.785347 10574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d54a6a210240e8994f2e4a34596f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.785574 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 3d5066d6e3bb46aeb08e655bfe8ad7f2 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:01.786938 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5066d6e3bb46aeb08e655bfe8ad7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.786783 10725 tablet_service.cc:1511] Processing CreateTablet for tablet e48aefb05bb248e78e9e5cfd8aa2739c (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:01.788239 10725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48aefb05bb248e78e9e5cfd8aa2739c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.775341 10789 ts_tablet_manager.cc:1403] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.004s
I20260709 13:04:01.785424 10651 tablet_service.cc:1511] Processing CreateTablet for tablet 3d5066d6e3bb46aeb08e655bfe8ad7f2 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:01.791558 10580 tablet_service.cc:1511] Processing CreateTablet for tablet e48aefb05bb248e78e9e5cfd8aa2739c (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:01.792893 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48aefb05bb248e78e9e5cfd8aa2739c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.795519 10498 tablet_service.cc:1511] Processing CreateTablet for tablet a4d54a6a210240e8994f2e4a34596f81 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:01.797045 10498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d54a6a210240e8994f2e4a34596f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.791819 10789 raft_consensus.cc:359] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:01.798178 10789 raft_consensus.cc:385] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:01.798521 10789 raft_consensus.cc:740] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.799293 10789 consensus_queue.cc:260] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:01.801900 10789 ts_tablet_manager.cc:1434] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:01.803028 10789 tablet_bootstrap.cc:492] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:01.805477 10581 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdad68bdd98451886fae7cb5cb4d10a (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:01.806926 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdad68bdd98451886fae7cb5cb4d10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.818498 10789 tablet_bootstrap.cc:654] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.822504 10655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4d54a6a210240e8994f2e4a34596f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.833637 10651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5066d6e3bb46aeb08e655bfe8ad7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.843089 10650 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdad68bdd98451886fae7cb5cb4d10a (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:01.841748 10791 tablet_bootstrap.cc:654] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:01.857613 10650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdad68bdd98451886fae7cb5cb4d10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.858352 10728 tablet_service.cc:1511] Processing CreateTablet for tablet 3bdad68bdd98451886fae7cb5cb4d10a (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:01.859751 10728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bdad68bdd98451886fae7cb5cb4d10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.864290 10790 raft_consensus.cc:493] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.864876 10790 raft_consensus.cc:515] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.865530 10499 tablet_service.cc:1511] Processing CreateTablet for tablet e48aefb05bb248e78e9e5cfd8aa2739c (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:01.866204 10505 tablet_service.cc:1511] Processing CreateTablet for tablet e20701090c4f4bd5ba6c754ccbcd41e1 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:01.867223 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48aefb05bb248e78e9e5cfd8aa2739c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.865631 10501 tablet_service.cc:1511] Processing CreateTablet for tablet 3d5066d6e3bb46aeb08e655bfe8ad7f2 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:01.869668 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d5066d6e3bb46aeb08e655bfe8ad7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.871207 10794 raft_consensus.cc:493] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.871856 10794 raft_consensus.cc:515] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:01.875216 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091d4dadcee40108323abee07cb66e4" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:01.875499 10794 leader_election.cc:290] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
W20260709 13:04:01.876791 10483 leader_election.cc:343] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.877864 10790 leader_election.cc:290] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:01.879091 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091d4dadcee40108323abee07cb66e4" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:01.879802 10666 raft_consensus.cc:2468] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:01.881170 10482 leader_election.cc:304] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb
I20260709 13:04:01.882087 10790 raft_consensus.cc:2804] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:01.882476 10790 raft_consensus.cc:493] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.882805 10790 raft_consensus.cc:3060] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.888455 10796 raft_consensus.cc:493] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.889075 10796 raft_consensus.cc:515] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:01.893051 10796 leader_election.cc:290] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:01.912451 10505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20701090c4f4bd5ba6c754ccbcd41e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.929370 10574 tablet_service.cc:1511] Processing CreateTablet for tablet e20701090c4f4bd5ba6c754ccbcd41e1 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:01.930855 10574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20701090c4f4bd5ba6c754ccbcd41e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.931052 10786 ts_tablet_manager.cc:1434] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.188s	user 0.024s	sys 0.009s
I20260709 13:04:01.932228 10786 tablet_bootstrap.cc:492] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:01.935588 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6824db2b4d464925b19c786450677fb2" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:01.940193 10648 tablet_service.cc:1511] Processing CreateTablet for tablet e20701090c4f4bd5ba6c754ccbcd41e1 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:01.941180 10790 raft_consensus.cc:515] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:01.954422 10789 tablet_bootstrap.cc:492] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:01.960338 10789 ts_tablet_manager.cc:1403] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.158s	user 0.027s	sys 0.026s
I20260709 13:04:01.969499 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0040a4a12604d64862fe91f215f2174" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:01.970744 10648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20701090c4f4bd5ba6c754ccbcd41e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:01.971362 10706 leader_election.cc:343] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:01.972491 10706 leader_election.cc:343] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:01.975909 10503 tablet_service.cc:1511] Processing CreateTablet for tablet ca79b841e581468e84cf2701211496e9 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:01.977321 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca79b841e581468e84cf2701211496e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.978829 10725 tablet_service.cc:1511] Processing CreateTablet for tablet ca79b841e581468e84cf2701211496e9 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:01.978996 10573 tablet_service.cc:1511] Processing CreateTablet for tablet ca79b841e581468e84cf2701211496e9 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:01.979691 10723 tablet_service.cc:1511] Processing CreateTablet for tablet fc85e60ff26b4709aec0629bef9390f6 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:01.980234 10725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca79b841e581468e84cf2701211496e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.980376 10573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca79b841e581468e84cf2701211496e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.980971 10723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc85e60ff26b4709aec0629bef9390f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:01.982445 10790 leader_election.cc:290] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:01.983355 10653 tablet_service.cc:1511] Processing CreateTablet for tablet fc85e60ff26b4709aec0629bef9390f6 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:01.983600 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091d4dadcee40108323abee07cb66e4" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:01.984313 10666 raft_consensus.cc:3060] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:01.984222 10500 tablet_service.cc:1511] Processing CreateTablet for tablet fc85e60ff26b4709aec0629bef9390f6 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:01.986016 10500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc85e60ff26b4709aec0629bef9390f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.004747 10786 tablet_bootstrap.cc:654] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.008781 10789 raft_consensus.cc:359] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.028518 10785 tablet_bootstrap.cc:492] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:02.029192 10785 ts_tablet_manager.cc:1403] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.310s	user 0.024s	sys 0.016s
I20260709 13:04:02.032580 10785 raft_consensus.cc:359] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.013505 10789 raft_consensus.cc:385] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.033340 10785 raft_consensus.cc:385] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.029089 10800 raft_consensus.cc:493] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.033574 10789 raft_consensus.cc:740] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.033491 10580 tablet_service.cc:1511] Processing CreateTablet for tablet be358e09d0714fa2bd4ca5cd34df4a29 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:02.033917 10800 raft_consensus.cc:515] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.035249 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be358e09d0714fa2bd4ca5cd34df4a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.034924 10789 consensus_queue.cc:260] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.036780 10800 leader_election.cc:290] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:02.037482 10789 ts_tablet_manager.cc:1434] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:04:02.038757 10785 raft_consensus.cc:740] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.049398 10785 consensus_queue.cc:260] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.059221 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19c6fe03f9244a78476037b279a7bea" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:02.060921 10785 ts_tablet_manager.cc:1434] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.031s	user 0.000s	sys 0.008s
W20260709 13:04:02.061224 10557 leader_election.cc:343] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.066149 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc85e60ff26b4709aec0629bef9390f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.072088 10789 tablet_bootstrap.cc:492] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:02.074235 10785 tablet_bootstrap.cc:492] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:02.089090 10666 raft_consensus.cc:2468] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:02.093122 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091d4dadcee40108323abee07cb66e4" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:02.111984 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6824db2b4d464925b19c786450677fb2" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:02.120723 10655 tablet_service.cc:1511] Processing CreateTablet for tablet be358e09d0714fa2bd4ca5cd34df4a29 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:02.121721 10482 leader_election.cc:304] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:02.123102 10790 raft_consensus.cc:2804] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.123809 10790 raft_consensus.cc:697] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:02.124338 10655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be358e09d0714fa2bd4ca5cd34df4a29. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:02.130561 10483 leader_election.cc:343] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.136922 10728 tablet_service.cc:1511] Processing CreateTablet for tablet be358e09d0714fa2bd4ca5cd34df4a29 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:02.138818 10501 tablet_service.cc:1511] Processing CreateTablet for tablet 59be6ff2ab0e47f8b55843170279fc38 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:02.124933 10790 consensus_queue.cc:237] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:02.139700 10728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be358e09d0714fa2bd4ca5cd34df4a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.140141 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59be6ff2ab0e47f8b55843170279fc38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.149022 10796 raft_consensus.cc:493] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.146097 10785 tablet_bootstrap.cc:654] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:02.150512 10462 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:02.152179 10650 tablet_service.cc:1511] Processing CreateTablet for tablet 59be6ff2ab0e47f8b55843170279fc38 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:02.153914 10650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59be6ff2ab0e47f8b55843170279fc38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.156611 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0040a4a12604d64862fe91f215f2174" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:02.120865 10582 tablet_service.cc:1511] Processing CreateTablet for tablet 59be6ff2ab0e47f8b55843170279fc38 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:02.159376 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59be6ff2ab0e47f8b55843170279fc38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.149662 10796 raft_consensus.cc:515] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:02.163836 10806 raft_consensus.cc:493] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.164431 10806 raft_consensus.cc:515] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.165287 10796 leader_election.cc:290] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:02.167011 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0627ec961e5d45079cc5672bdcab5121" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
W20260709 13:04:02.168557 10557 leader_election.cc:343] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.169725 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
W20260709 13:04:02.170176 10704 leader_election.cc:343] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.170401 10666 raft_consensus.cc:2468] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:02.170676 10704 leader_election.cc:304] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:02.171813 10813 raft_consensus.cc:2749] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.172922 10482 leader_election.cc:304] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:02.173964 10806 leader_election.cc:290] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:02.194403 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 700134865ef74506af01723a1857195d (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:02.195933 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 700134865ef74506af01723a1857195d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.196171 10581 tablet_service.cc:1511] Processing CreateTablet for tablet 700134865ef74506af01723a1857195d (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:02.197472 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 700134865ef74506af01723a1857195d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.185072 10806 raft_consensus.cc:2804] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.198407 10806 raft_consensus.cc:493] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.198747 10806 raft_consensus.cc:3060] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.194653 10651 tablet_service.cc:1511] Processing CreateTablet for tablet 5397c6b857924714a103d579232e1f74 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:02.202929 10651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5397c6b857924714a103d579232e1f74. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:02.174185 10704 leader_election.cc:343] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.206300 10704 leader_election.cc:304] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:02.207230 10813 raft_consensus.cc:2749] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.217103 10730 tablet_service.cc:1511] Processing CreateTablet for tablet 5397c6b857924714a103d579232e1f74 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:02.224552 10730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5397c6b857924714a103d579232e1f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.218619 10813 raft_consensus.cc:493] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.227890 10813 raft_consensus.cc:515] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.222649 10724 tablet_service.cc:1511] Processing CreateTablet for tablet 52dae8a5daed4ae996d7df5a97147747 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:02.230897 10724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52dae8a5daed4ae996d7df5a97147747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.227051 10648 tablet_service.cc:1511] Processing CreateTablet for tablet 52dae8a5daed4ae996d7df5a97147747 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:02.235119 10648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52dae8a5daed4ae996d7df5a97147747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.240985 10789 tablet_bootstrap.cc:654] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.242353 10813 leader_election.cc:290] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:02.246059 10573 tablet_service.cc:1511] Processing CreateTablet for tablet 52dae8a5daed4ae996d7df5a97147747 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:02.247610 10573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52dae8a5daed4ae996d7df5a97147747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.247999 10786 tablet_bootstrap.cc:492] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:02.248533 10786 ts_tablet_manager.cc:1403] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.317s	user 0.021s	sys 0.023s
I20260709 13:04:02.251925 10786 raft_consensus.cc:359] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:02.252688 10786 raft_consensus.cc:385] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.252985 10786 raft_consensus.cc:740] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.254451 10786 consensus_queue.cc:260] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:02.258255 10786 ts_tablet_manager.cc:1434] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.002s
I20260709 13:04:02.264611 10791 tablet_bootstrap.cc:492] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:02.265208 10791 ts_tablet_manager.cc:1403] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.492s	user 0.014s	sys 0.010s
I20260709 13:04:02.268499 10791 raft_consensus.cc:359] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:02.269140 10791 raft_consensus.cc:385] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.269390 10791 raft_consensus.cc:740] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.269870 10785 tablet_bootstrap.cc:492] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
W20260709 13:04:02.261268 10482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:46191, user_credentials={real_user=slave}} blocked reactor thread for 88449.2us
I20260709 13:04:02.275265 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19c6fe03f9244a78476037b279a7bea" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:02.276226 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0627ec961e5d45079cc5672bdcab5121" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:02.277038 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:02.279151 10574 tablet_service.cc:1511] Processing CreateTablet for tablet 5b67ee136262443e819e7ca67628050a (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:02.284549 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:02.286957 10666 raft_consensus.cc:2468] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:02.290812 10738 raft_consensus.cc:2468] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
W20260709 13:04:02.291221 10558 leader_election.cc:343] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.291693 10558 leader_election.cc:304] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:02.292387 10632 leader_election.cc:304] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:02.292943 10796 raft_consensus.cc:2749] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.293830 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
W20260709 13:04:02.294726 10558 leader_election.cc:343] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.294940 10705 leader_election.cc:304] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:02.295284 10558 leader_election.cc:304] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:02.295969 10813 raft_consensus.cc:2804] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.296376 10813 raft_consensus.cc:493] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.296483 10796 raft_consensus.cc:2749] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.296766 10813 raft_consensus.cc:3060] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.285600 10791 consensus_queue.cc:260] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:02.285833 10785 ts_tablet_manager.cc:1403] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.224s	user 0.011s	sys 0.012s
I20260709 13:04:02.305253 10813 raft_consensus.cc:515] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.306252 10800 raft_consensus.cc:493] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.306754 10800 raft_consensus.cc:515] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:02.307746 10501 tablet_service.cc:1511] Processing CreateTablet for tablet 700134865ef74506af01723a1857195d (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:02.308394 10503 tablet_service.cc:1511] Processing CreateTablet for tablet 5397c6b857924714a103d579232e1f74 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:02.309121 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 700134865ef74506af01723a1857195d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.309778 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5397c6b857924714a103d579232e1f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.311076 10505 tablet_service.cc:1511] Processing CreateTablet for tablet 5b67ee136262443e819e7ca67628050a (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:02.315091 10574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b67ee136262443e819e7ca67628050a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.318331 10725 tablet_service.cc:1511] Processing CreateTablet for tablet 2950e99d7eff498ab8a6edfd044d2178 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:02.320442 10725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2950e99d7eff498ab8a6edfd044d2178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.322659 10800 leader_election.cc:290] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:02.323290 10800 raft_consensus.cc:2804] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.323671 10800 raft_consensus.cc:493] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.323997 10800 raft_consensus.cc:3060] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.325651 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:02.327502 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:02.329077 10829 consensus_queue.cc:1048] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:02.329774 10630 leader_election.cc:343] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.336056 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:02.337100 10806 raft_consensus.cc:515] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.338312 10786 tablet_bootstrap.cc:492] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:02.340232 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:02.341796 10813 leader_election.cc:290] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:02.345615 10500 tablet_service.cc:1511] Processing CreateTablet for tablet 2950e99d7eff498ab8a6edfd044d2178 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:02.348007 10582 tablet_service.cc:1511] Processing CreateTablet for tablet 2950e99d7eff498ab8a6edfd044d2178 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:02.305497 10785 raft_consensus.cc:359] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.360836 10505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b67ee136262443e819e7ca67628050a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.363108 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:02.363970 10738 raft_consensus.cc:2393] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbba8b78b34443bcb2be4b73f86fac96 in current term 1: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
I20260709 13:04:02.358618 10785 raft_consensus.cc:385] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.365129 10785 raft_consensus.cc:740] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.362239 10517 raft_consensus.cc:2393] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd6ac4ec789b459bbbfa3d6952103df5 in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:02.366780 10500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2950e99d7eff498ab8a6edfd044d2178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.369385 10806 leader_election.cc:290] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:02.372816 10791 ts_tablet_manager.cc:1434] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.107s	user 0.012s	sys 0.001s
I20260709 13:04:02.374789 10414 catalog_manager.cc:5697] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.369521 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2950e99d7eff498ab8a6edfd044d2178. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:02.386116 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 93875.3us
I20260709 13:04:02.370154 10785 consensus_queue.cc:260] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.389631 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 244fe231b85a49a9a997bfe10e6e31f5 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:02.389236 10800 raft_consensus.cc:515] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.391053 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 244fe231b85a49a9a997bfe10e6e31f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.391870 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:02.393265 10738 raft_consensus.cc:2393] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cbba8b78b34443bcb2be4b73f86fac96 in current term 1: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
I20260709 13:04:02.393776 10791 tablet_bootstrap.cc:492] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:02.396052 10785 ts_tablet_manager.cc:1434] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.000s
I20260709 13:04:02.397224 10785 tablet_bootstrap.cc:492] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:02.404970 10789 tablet_bootstrap.cc:492] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:02.404587 10650 tablet_service.cc:1511] Processing CreateTablet for tablet 5b67ee136262443e819e7ca67628050a (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:02.405514 10789 ts_tablet_manager.cc:1403] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.334s	user 0.021s	sys 0.033s
I20260709 13:04:02.405979 10650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b67ee136262443e819e7ca67628050a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.415827 10498 tablet_service.cc:1511] Processing CreateTablet for tablet 244fe231b85a49a9a997bfe10e6e31f5 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:02.417240 10498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 244fe231b85a49a9a997bfe10e6e31f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.420863 10723 tablet_service.cc:1511] Processing CreateTablet for tablet 830eb73bc1564d2bb6e76e82e123c6e6 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:02.423255 10723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830eb73bc1564d2bb6e76e82e123c6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.427568 10786 tablet_bootstrap.cc:654] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.430398 10651 tablet_service.cc:1511] Processing CreateTablet for tablet 244fe231b85a49a9a997bfe10e6e31f5 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:02.431018 10581 tablet_service.cc:1511] Processing CreateTablet for tablet 830eb73bc1564d2bb6e76e82e123c6e6 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:02.431903 10651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 244fe231b85a49a9a997bfe10e6e31f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.432325 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830eb73bc1564d2bb6e76e82e123c6e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.432466 10789 raft_consensus.cc:359] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:02.433573 10789 raft_consensus.cc:385] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.401515 10791 tablet_bootstrap.cc:654] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.440493 10796 raft_consensus.cc:493] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.446522 10796 raft_consensus.cc:515] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.447310 10785 tablet_bootstrap.cc:654] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.449003 10796 leader_election.cc:290] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:02.449707 10666 raft_consensus.cc:2393] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bd6ac4ec789b459bbbfa3d6952103df5 in current term 1: Already voted for candidate 8b82fdd6486e40d180a9d1c7c320e38b in this term.
I20260709 13:04:02.450922 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6824db2b4d464925b19c786450677fb2" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:02.451576 10738 raft_consensus.cc:2468] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 0.
I20260709 13:04:02.452339 10806 raft_consensus.cc:493] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.452850 10806 raft_consensus.cc:515] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.451593 10705 leader_election.cc:304] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:02.454607 10813 raft_consensus.cc:2749] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.455065 10806 leader_election.cc:290] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:02.433980 10789 raft_consensus.cc:740] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.455591 10558 leader_election.cc:304] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:02.463905 10800 leader_election.cc:290] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:02.463956 10499 tablet_service.cc:1511] Processing CreateTablet for tablet 50643b87db25412f916733ea13f10554 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:02.465811 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50643b87db25412f916733ea13f10554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.467340 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:02.468524 10517 raft_consensus.cc:2393] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:02.469897 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf8caca63d426eb5b16065fee6b938" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:02.477804 10653 tablet_service.cc:1511] Processing CreateTablet for tablet 830eb73bc1564d2bb6e76e82e123c6e6 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:02.479907 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830eb73bc1564d2bb6e76e82e123c6e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:02.480862 10483 leader_election.cc:343] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.481982 10789 consensus_queue.cc:260] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:02.483574 10796 raft_consensus.cc:2804] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.487226 10796 raft_consensus.cc:493] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.487649 10796 raft_consensus.cc:3060] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.500195 10580 tablet_service.cc:1511] Processing CreateTablet for tablet 50643b87db25412f916733ea13f10554 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:02.501714 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50643b87db25412f916733ea13f10554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.510288 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:02.511202 10666 raft_consensus.cc:2393] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cbba8b78b34443bcb2be4b73f86fac96 in current term 1: Already voted for candidate 8b82fdd6486e40d180a9d1c7c320e38b in this term.
I20260709 13:04:02.518905 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf8caca63d426eb5b16065fee6b938" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:02.519798 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
W20260709 13:04:02.520318 10482 consensus_peers.cc:597] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.520658 10738 raft_consensus.cc:2393] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
I20260709 13:04:02.521077 10482 leader_election.cc:304] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:02.522142 10830 raft_consensus.cc:2749] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.523811 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:02.523926 10632 leader_election.cc:304] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:02.524968 10800 raft_consensus.cc:2749] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.536029 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6824db2b4d464925b19c786450677fb2" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:02.536775 10517 raft_consensus.cc:2468] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 0.
W20260709 13:04:02.538172 10482 leader_election.cc:343] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.538669 10482 leader_election.cc:304] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:02.539453 10830 raft_consensus.cc:2749] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:02.540072 10632 leader_election.cc:343] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.541213 10632 leader_election.cc:304] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:02.552601 10724 tablet_service.cc:1511] Processing CreateTablet for tablet 96ec3c36841f4761b2a802c2592154f3 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:02.554044 10724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ec3c36841f4761b2a802c2592154f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.559128 10501 tablet_service.cc:1511] Processing CreateTablet for tablet 96ec3c36841f4761b2a802c2592154f3 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:02.560537 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ec3c36841f4761b2a802c2592154f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.568500 10800 raft_consensus.cc:2749] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.574120 10791 tablet_bootstrap.cc:492] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:02.574702 10791 ts_tablet_manager.cc:1403] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.181s	user 0.017s	sys 0.001s
I20260709 13:04:02.576555 10813 raft_consensus.cc:493] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.577173 10813 raft_consensus.cc:515] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:02.577888 10791 raft_consensus.cc:359] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.578740 10791 raft_consensus.cc:385] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.578473 10574 tablet_service.cc:1511] Processing CreateTablet for tablet 96ec3c36841f4761b2a802c2592154f3 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:02.584151 10786 tablet_bootstrap.cc:492] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:02.584934 10786 ts_tablet_manager.cc:1403] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.266s	user 0.017s	sys 0.005s
I20260709 13:04:02.585336 10574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ec3c36841f4761b2a802c2592154f3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:02.587630 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 47682.9us
I20260709 13:04:02.579070 10791 raft_consensus.cc:740] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.581288 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7453e3b1834c1b90a795fcb9778191" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:02.581848 10813 leader_election.cc:290] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:02.589838 10791 consensus_queue.cc:260] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:02.590523 10706 leader_election.cc:343] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.598088 10796 raft_consensus.cc:515] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.598939 10785 tablet_bootstrap.cc:492] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:02.600981 10796 leader_election.cc:290] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:02.602798 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6824db2b4d464925b19c786450677fb2" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:02.603552 10517 raft_consensus.cc:3060] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.607524 10650 tablet_service.cc:1511] Processing CreateTablet for tablet 50643b87db25412f916733ea13f10554 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:02.609323 10785 ts_tablet_manager.cc:1403] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.212s	user 0.013s	sys 0.021s
I20260709 13:04:02.601446 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6824db2b4d464925b19c786450677fb2" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:02.613247 10738 raft_consensus.cc:3060] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.616997 10648 tablet_service.cc:1511] Processing CreateTablet for tablet c1e8b005258a4a419135d144d4674208 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:02.624881 10800 raft_consensus.cc:493] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.612677 10785 raft_consensus.cc:359] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:02.625065 10789 ts_tablet_manager.cc:1434] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.219s	user 0.017s	sys 0.010s
I20260709 13:04:02.625497 10800 raft_consensus.cc:515] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.627542 10725 tablet_service.cc:1511] Processing CreateTablet for tablet c1e8b005258a4a419135d144d4674208 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:02.628276 10800 leader_election.cc:290] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:02.629070 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:02.632486 10503 tablet_service.cc:1511] Processing CreateTablet for tablet c1e8b005258a4a419135d144d4674208 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:02.634415 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
W20260709 13:04:02.636098 10630 leader_election.cc:343] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.628906 10725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e8b005258a4a419135d144d4674208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.602557 10791 ts_tablet_manager.cc:1434] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:04:02.633949 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e8b005258a4a419135d144d4674208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.640512 10581 tablet_service.cc:1511] Processing CreateTablet for tablet 775092b557874c49bfae75484c568a37 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:02.642105 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775092b557874c49bfae75484c568a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.652577 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 775092b557874c49bfae75484c568a37 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:02.637887 10738 raft_consensus.cc:2468] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:02.640355 10517 raft_consensus.cc:2468] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:02.655019 10558 leader_election.cc:304] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:02.656421 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7453e3b1834c1b90a795fcb9778191" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:02.656692 10843 raft_consensus.cc:2804] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:02.625520 10785 raft_consensus.cc:385] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:02.657663 10705 leader_election.cc:343] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.657958 10785 raft_consensus.cc:740] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.658202 10705 leader_election.cc:304] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:02.658994 10813 raft_consensus.cc:2749] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.658846 10785 consensus_queue.cc:260] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:02.660539 10789 tablet_bootstrap.cc:492] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:02.661737 10796 raft_consensus.cc:493] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.662226 10796 raft_consensus.cc:515] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:02.664402 10796 leader_election.cc:290] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:02.666173 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e802f2e4188a44849dff275987bb46ec" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:02.667505 10558 leader_election.cc:343] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.668512 10648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1e8b005258a4a419135d144d4674208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.661252 10843 raft_consensus.cc:697] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:02.652685 10786 raft_consensus.cc:359] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
W20260709 13:04:02.638836 10632 leader_election.cc:343] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.670585 10632 leader_election.cc:304] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:02.654778 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775092b557874c49bfae75484c568a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.670778 10843 consensus_queue.cc:237] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.660430 10499 tablet_service.cc:1511] Processing CreateTablet for tablet 13eb6fc681c5467a922827af47067ab8 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:02.673408 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13eb6fc681c5467a922827af47067ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.674717 10650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50643b87db25412f916733ea13f10554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.674865 10791 tablet_bootstrap.cc:492] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:02.676258 10800 raft_consensus.cc:2749] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:02.678354 10830 consensus_queue.cc:1048] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:02.683387 10791 tablet_bootstrap.cc:654] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.683184 10580 tablet_service.cc:1511] Processing CreateTablet for tablet 13eb6fc681c5467a922827af47067ab8 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:02.684939 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13eb6fc681c5467a922827af47067ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.691165 10653 tablet_service.cc:1511] Processing CreateTablet for tablet 13eb6fc681c5467a922827af47067ab8 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:02.691634 10724 tablet_service.cc:1511] Processing CreateTablet for tablet ec6efd752eb04cadb27f38108369d56d (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:02.692648 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13eb6fc681c5467a922827af47067ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.687172 10785 ts_tablet_manager.cc:1434] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
I20260709 13:04:02.694420 10785 tablet_bootstrap.cc:492] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:02.693272 10724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6efd752eb04cadb27f38108369d56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.698894 10651 tablet_service.cc:1511] Processing CreateTablet for tablet 775092b557874c49bfae75484c568a37 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:02.700562 10651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 775092b557874c49bfae75484c568a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.705852 10785 tablet_bootstrap.cc:654] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.708848 10789 tablet_bootstrap.cc:654] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.687529 10786 raft_consensus.cc:385] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.729760 10501 tablet_service.cc:1511] Processing CreateTablet for tablet ec6efd752eb04cadb27f38108369d56d (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:02.731344 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6efd752eb04cadb27f38108369d56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.718138 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e802f2e4188a44849dff275987bb46ec" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:02.718421 10786 raft_consensus.cc:740] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.748899 10786 consensus_queue.cc:260] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:02.749797 10650 tablet_service.cc:1511] Processing CreateTablet for tablet b7e3368943d24f409949b4a22082867d (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:02.753667 10581 tablet_service.cc:1511] Processing CreateTablet for tablet ec6efd752eb04cadb27f38108369d56d (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:02.754899 10650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e3368943d24f409949b4a22082867d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.755300 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6efd752eb04cadb27f38108369d56d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:02.758474 10557 leader_election.cc:343] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.758992 10557 leader_election.cc:304] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:02.760035 10796 raft_consensus.cc:2749] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:02.777709 10483 consensus_peers.cc:597] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.781898 10786 ts_tablet_manager.cc:1434] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.197s	user 0.008s	sys 0.003s
I20260709 13:04:02.796658 10503 tablet_service.cc:1511] Processing CreateTablet for tablet b7e3368943d24f409949b4a22082867d (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:02.805248 10415 catalog_manager.cc:5697] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.823241 10786 tablet_bootstrap.cc:492] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:02.826455 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e3368943d24f409949b4a22082867d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.827785 10580 tablet_service.cc:1511] Processing CreateTablet for tablet 247484525e554724a7ec4defcf27b19c (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:02.829361 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247484525e554724a7ec4defcf27b19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.832798 10724 tablet_service.cc:1511] Processing CreateTablet for tablet b7e3368943d24f409949b4a22082867d (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:02.835726 10724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e3368943d24f409949b4a22082867d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.839017 10648 tablet_service.cc:1511] Processing CreateTablet for tablet 247484525e554724a7ec4defcf27b19c (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:02.840507 10648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247484525e554724a7ec4defcf27b19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.842900 10725 tablet_service.cc:1511] Processing CreateTablet for tablet 247484525e554724a7ec4defcf27b19c (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:02.847231 10789 tablet_bootstrap.cc:492] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:02.847447 10725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247484525e554724a7ec4defcf27b19c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.847972 10789 ts_tablet_manager.cc:1403] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.188s	user 0.044s	sys 0.022s
I20260709 13:04:02.853084 10789 raft_consensus.cc:359] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:02.853829 10789 raft_consensus.cc:385] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.854233 10789 raft_consensus.cc:740] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.855017 10789 consensus_queue.cc:260] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:02.865244 10785 tablet_bootstrap.cc:492] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:02.865826 10785 ts_tablet_manager.cc:1403] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.172s	user 0.019s	sys 0.004s
I20260709 13:04:02.868865 10785 raft_consensus.cc:359] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:02.869586 10785 raft_consensus.cc:385] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.870180 10785 raft_consensus.cc:740] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.870275 10499 tablet_service.cc:1511] Processing CreateTablet for tablet 716d74aced19425b839452e8495dfd2a (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:02.869588 10791 tablet_bootstrap.cc:492] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:02.872174 10580 tablet_service.cc:1511] Processing CreateTablet for tablet 716d74aced19425b839452e8495dfd2a (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:02.873039 10786 tablet_bootstrap.cc:654] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.873517 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716d74aced19425b839452e8495dfd2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.873745 10789 ts_tablet_manager.cc:1434] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:04:02.871016 10785 consensus_queue.cc:260] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:02.872040 10791 ts_tablet_manager.cc:1403] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.197s	user 0.015s	sys 0.007s
I20260709 13:04:02.872072 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716d74aced19425b839452e8495dfd2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.877497 10785 ts_tablet_manager.cc:1434] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:02.887616 10785 tablet_bootstrap.cc:492] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:02.887265 10791 raft_consensus.cc:359] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:02.888180 10791 raft_consensus.cc:385] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:02.889583 10843 raft_consensus.cc:493] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.885603 10813 raft_consensus.cc:493] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.874899 10789 tablet_bootstrap.cc:492] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:02.891013 10813 raft_consensus.cc:515] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:02.890139 10843 raft_consensus.cc:515] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:02.903004 10843 leader_election.cc:290] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:02.903601 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83877eedc15a406e8656b628afec0bd5" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:02.903942 10813 leader_election.cc:290] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:02.904688 10650 tablet_service.cc:1511] Processing CreateTablet for tablet 716d74aced19425b839452e8495dfd2a (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 13:04:02.905202 10556 leader_election.cc:343] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.905912 10650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716d74aced19425b839452e8495dfd2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.909349 10498 tablet_service.cc:1511] Processing CreateTablet for tablet 1d84f52b275445629ba8545f2f1f3773 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:02.910638 10498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d84f52b275445629ba8545f2f1f3773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.910434 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83877eedc15a406e8656b628afec0bd5" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:02.888518 10791 raft_consensus.cc:740] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:02.922199 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994595b7f94b4aac870d2234e0693b6b" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:02.922447 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994595b7f94b4aac870d2234e0693b6b" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:02.923048 10517 raft_consensus.cc:2468] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:02.924238 10704 leader_election.cc:304] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:02.925155 10813 raft_consensus.cc:2804] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.925545 10813 raft_consensus.cc:493] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.925917 10813 raft_consensus.cc:3060] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.932983 10813 raft_consensus.cc:515] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:02.937309 10791 consensus_queue.cc:260] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:02.947130 10580 tablet_service.cc:1511] Processing CreateTablet for tablet 1d84f52b275445629ba8545f2f1f3773 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:02.947741 10725 tablet_service.cc:1511] Processing CreateTablet for tablet 1d84f52b275445629ba8545f2f1f3773 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:02.948474 10580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d84f52b275445629ba8545f2f1f3773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.948882 10725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d84f52b275445629ba8545f2f1f3773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.949687 10785 tablet_bootstrap.cc:654] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.952868 10665 raft_consensus.cc:2468] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 0.
I20260709 13:04:02.957976 10806 raft_consensus.cc:493] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.958537 10806 raft_consensus.cc:515] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:02.959142 10557 leader_election.cc:304] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:02.959986 10843 raft_consensus.cc:2804] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.960357 10843 raft_consensus.cc:493] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.960528 10806 leader_election.cc:290] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:02.960762 10843 raft_consensus.cc:3060] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:02.964154 10789 tablet_bootstrap.cc:654] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:02.966389 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0040a4a12604d64862fe91f215f2174" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:02.967088 10738 raft_consensus.cc:2468] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:02.969247 10483 leader_election.cc:304] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:02.970527 10653 tablet_service.cc:1511] Processing CreateTablet for tablet fa8dbc2680fd461c836d48a8f8692e50 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:02.970790 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0040a4a12604d64862fe91f215f2174" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:02.971705 10653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8dbc2680fd461c836d48a8f8692e50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.971920 10651 tablet_service.cc:1511] Processing CreateTablet for tablet 99676c8e7e874fe98cb48b3d570c6275 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:02.973161 10651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99676c8e7e874fe98cb48b3d570c6275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.974040 10499 tablet_service.cc:1511] Processing CreateTablet for tablet 99676c8e7e874fe98cb48b3d570c6275 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:02.974709 10503 tablet_service.cc:1511] Processing CreateTablet for tablet fa8dbc2680fd461c836d48a8f8692e50 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:02.975127 10499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99676c8e7e874fe98cb48b3d570c6275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.974880 10501 tablet_service.cc:1511] Processing CreateTablet for tablet 19fe36fcadfd4768a963dc396271497c (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:02.975787 10503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8dbc2680fd461c836d48a8f8692e50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.976420 10786 tablet_bootstrap.cc:492] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
W20260709 13:04:02.976702 10706 leader_election.cc:343] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:02.976922 10786 ts_tablet_manager.cc:1403] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.154s	user 0.012s	sys 0.017s
I20260709 13:04:02.977495 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19fe36fcadfd4768a963dc396271497c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.978892 10648 tablet_service.cc:1511] Processing CreateTablet for tablet 92ec17bb1b33495d9caa05a15cbd16e4 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:02.986411 10648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ec17bb1b33495d9caa05a15cbd16e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.988391 10729 tablet_service.cc:1511] Processing CreateTablet for tablet 99676c8e7e874fe98cb48b3d570c6275 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:02.980506 10786 raft_consensus.cc:359] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.989758 10729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99676c8e7e874fe98cb48b3d570c6275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.995492 10791 ts_tablet_manager.cc:1434] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.111s	user 0.005s	sys 0.003s
I20260709 13:04:02.977170 10843 raft_consensus.cc:515] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:02.997769 10574 tablet_service.cc:1511] Processing CreateTablet for tablet fa8dbc2680fd461c836d48a8f8692e50 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:02.999115 10574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8dbc2680fd461c836d48a8f8692e50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:02.999185 10813 leader_election.cc:290] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:03.000728 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83877eedc15a406e8656b628afec0bd5" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
W20260709 13:04:03.002233 10556 leader_election.cc:343] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.003149 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994595b7f94b4aac870d2234e0693b6b" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:03.003289 10728 tablet_service.cc:1511] Processing CreateTablet for tablet 19fe36fcadfd4768a963dc396271497c (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:02.989310 10786 raft_consensus.cc:385] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.004555 10786 raft_consensus.cc:740] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.004920 10728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19fe36fcadfd4768a963dc396271497c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.005569 10843 leader_election.cc:290] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:02.983314 10806 raft_consensus.cc:2804] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:02.989343 10581 tablet_service.cc:1511] Processing CreateTablet for tablet 92ec17bb1b33495d9caa05a15cbd16e4 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:03.006726 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83877eedc15a406e8656b628afec0bd5" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:03.007181 10581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ec17bb1b33495d9caa05a15cbd16e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.007349 10665 raft_consensus.cc:3060] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.005602 10786 consensus_queue.cc:260] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:02.991014 10723 tablet_service.cc:1511] Processing CreateTablet for tablet 92ec17bb1b33495d9caa05a15cbd16e4 (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:04:02.982378 10483 leader_election.cc:343] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.006268 10806 raft_consensus.cc:493] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.014261 10723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ec17bb1b33495d9caa05a15cbd16e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.014547 10655 tablet_service.cc:1511] Processing CreateTablet for tablet d7af85d78c0c41aeb882be10181161bf (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 13:04:03.004943 10706 leader_election.cc:343] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.015811 10655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7af85d78c0c41aeb882be10181161bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.016898 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994595b7f94b4aac870d2234e0693b6b" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:03.017515 10517 raft_consensus.cc:3060] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.012866 10806 raft_consensus.cc:3060] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.009984 10786 ts_tablet_manager.cc:1434] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:04:03.031635 10517 raft_consensus.cc:2468] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:03.034984 10582 tablet_service.cc:1511] Processing CreateTablet for tablet 19fe36fcadfd4768a963dc396271497c (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:03.064677 10791 tablet_bootstrap.cc:492] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:03.071866 10665 raft_consensus.cc:2468] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:03.073335 10557 leader_election.cc:304] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:03.073882 10582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19fe36fcadfd4768a963dc396271497c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.074577 10843 raft_consensus.cc:2804] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.065016 10704 leader_election.cc:304] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb
I20260709 13:04:03.075091 10843 raft_consensus.cc:697] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:03.075927 10843 consensus_queue.cc:237] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.084348 10786 tablet_bootstrap.cc:492] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:03.088694 10785 tablet_bootstrap.cc:492] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:03.089322 10785 ts_tablet_manager.cc:1403] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.202s	user 0.014s	sys 0.013s
I20260709 13:04:03.091442 10806 raft_consensus.cc:515] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.092203 10785 raft_consensus.cc:359] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.093015 10785 raft_consensus.cc:385] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.093277 10785 raft_consensus.cc:740] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.093513 10806 leader_election.cc:290] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:03.095103 10725 tablet_service.cc:1511] Processing CreateTablet for tablet d7af85d78c0c41aeb882be10181161bf (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:03.096745 10725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7af85d78c0c41aeb882be10181161bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.094573 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0040a4a12604d64862fe91f215f2174" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:03.098536 10738 raft_consensus.cc:3060] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.100343 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0040a4a12604d64862fe91f215f2174" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
W20260709 13:04:03.101824 10483 leader_election.cc:343] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.093919 10785 consensus_queue.cc:260] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.105041 10813 raft_consensus.cc:2804] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.105551 10813 raft_consensus.cc:697] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:03.106349 10501 tablet_service.cc:1511] Processing CreateTablet for tablet d7af85d78c0c41aeb882be10181161bf (DEFAULT_TABLE table=test-workload [id=ede1332dabf24908b8dd2c071e14ab1f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:03.106492 10813 consensus_queue.cc:237] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.112411 10501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7af85d78c0c41aeb882be10181161bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:03.130968 10785 ts_tablet_manager.cc:1434] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.003s
I20260709 13:04:03.132258 10785 tablet_bootstrap.cc:492] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:03.132908 10786 tablet_bootstrap.cc:654] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.132908 10791 tablet_bootstrap.cc:654] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.094520 10789 tablet_bootstrap.cc:492] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:03.149982 10785 tablet_bootstrap.cc:654] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.155234 10738 raft_consensus.cc:2468] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:03.156754 10483 leader_election.cc:304] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb
I20260709 13:04:03.157981 10806 raft_consensus.cc:2804] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.158530 10789 ts_tablet_manager.cc:1403] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.284s	user 0.015s	sys 0.016s
I20260709 13:04:03.158483 10806 raft_consensus.cc:697] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
W20260709 13:04:03.156749 10462 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:03.160537 10806 consensus_queue.cc:237] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.175796 10791 tablet_bootstrap.cc:492] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:03.176614 10791 ts_tablet_manager.cc:1403] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.124s	user 0.005s	sys 0.009s
I20260709 13:04:03.161757 10789 raft_consensus.cc:359] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.180889 10789 raft_consensus.cc:385] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.181280 10789 raft_consensus.cc:740] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.181010 10414 catalog_manager.cc:5697] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.182134 10789 consensus_queue.cc:260] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.183019 10415 catalog_manager.cc:5697] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.184939 10789 ts_tablet_manager.cc:1434] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:04:03.186370 10789 tablet_bootstrap.cc:492] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
W20260709 13:04:03.170764 10704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 107337us
I20260709 13:04:03.186383 10786 tablet_bootstrap.cc:492] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:03.190119 10786 ts_tablet_manager.cc:1403] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.013s
I20260709 13:04:03.197184 10789 tablet_bootstrap.cc:654] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.193424 10786 raft_consensus.cc:359] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.180949 10791 raft_consensus.cc:359] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.198817 10786 raft_consensus.cc:385] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.199718 10786 raft_consensus.cc:740] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.199223 10791 raft_consensus.cc:385] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.201028 10796 consensus_queue.cc:1048] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.201284 10791 raft_consensus.cc:740] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.207378 10791 consensus_queue.cc:260] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.204217 10786 consensus_queue.cc:260] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.215543 10412 catalog_manager.cc:5697] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.248306 10785 tablet_bootstrap.cc:492] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:03.248911 10785 ts_tablet_manager.cc:1403] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.117s	user 0.022s	sys 0.009s
I20260709 13:04:03.251042 10796 consensus_queue.cc:1048] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.251499 10786 ts_tablet_manager.cc:1434] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:04:03.252137 10785 raft_consensus.cc:359] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.252857 10785 raft_consensus.cc:385] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.254588 10785 raft_consensus.cc:740] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.256703 10789 tablet_bootstrap.cc:492] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:03.257222 10789 ts_tablet_manager.cc:1403] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.071s	user 0.006s	sys 0.011s
I20260709 13:04:03.259707 10785 consensus_queue.cc:260] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.260363 10789 raft_consensus.cc:359] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.261116 10789 raft_consensus.cc:385] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.261412 10789 raft_consensus.cc:740] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.263958 10813 raft_consensus.cc:493] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.264616 10813 raft_consensus.cc:515] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.266330 10785 ts_tablet_manager.cc:1434] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:04:03.266851 10806 raft_consensus.cc:493] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.267313 10813 leader_election.cc:290] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:03.263429 10791 ts_tablet_manager.cc:1434] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.086s	user 0.001s	sys 0.011s
I20260709 13:04:03.267354 10806 raft_consensus.cc:515] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.268179 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf8caca63d426eb5b16065fee6b938" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:03.268407 10789 consensus_queue.cc:260] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.269788 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf8caca63d426eb5b16065fee6b938" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:03.270567 10789 ts_tablet_manager.cc:1434] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:04:03.270656 10806 leader_election.cc:290] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:03.271122 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:03.271565 10789 tablet_bootstrap.cc:492] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:03.271709 10791 tablet_bootstrap.cc:492] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
W20260709 13:04:03.272563 10483 leader_election.cc:343] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.270471 10516 raft_consensus.cc:2468] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:03.270731 10785 tablet_bootstrap.cc:492] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:03.274696 10705 leader_election.cc:343] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.273909 10786 tablet_bootstrap.cc:492] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:03.279276 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:03.279204 10704 leader_election.cc:304] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:03.280185 10665 raft_consensus.cc:2468] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:03.281080 10813 raft_consensus.cc:2804] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.281648 10813 raft_consensus.cc:493] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.281770 10482 leader_election.cc:304] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb
I20260709 13:04:03.282212 10813 raft_consensus.cc:3060] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.283175 10806 raft_consensus.cc:2804] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.284055 10806 raft_consensus.cc:493] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.284480 10806 raft_consensus.cc:3060] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.293242 10791 tablet_bootstrap.cc:654] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.300612 10789 tablet_bootstrap.cc:654] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.303002 10813 raft_consensus.cc:515] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.305337 10806 raft_consensus.cc:515] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.307133 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf8caca63d426eb5b16065fee6b938" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:03.308382 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf8caca63d426eb5b16065fee6b938" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:03.310542 10516 raft_consensus.cc:3060] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.305850 10813 leader_election.cc:290] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
W20260709 13:04:03.311197 10705 leader_election.cc:343] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.309712 10785 tablet_bootstrap.cc:654] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.325676 10786 tablet_bootstrap.cc:654] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.321873 10516 raft_consensus.cc:2468] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:03.334270 10789 tablet_bootstrap.cc:492] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:03.334741 10789 ts_tablet_manager.cc:1403] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.006s
I20260709 13:04:03.339934 10786 tablet_bootstrap.cc:492] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:03.334748 10785 tablet_bootstrap.cc:492] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:03.342326 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
W20260709 13:04:03.343917 10483 leader_election.cc:343] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.335656 10704 leader_election.cc:304] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:03.344861 10813 raft_consensus.cc:2804] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.344779 10789 raft_consensus.cc:359] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.345505 10813 raft_consensus.cc:697] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:03.345645 10789 raft_consensus.cc:385] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.346014 10789 raft_consensus.cc:740] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.346598 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:03.346457 10813 consensus_queue.cc:237] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.347157 10791 tablet_bootstrap.cc:492] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:03.346877 10789 consensus_queue.cc:260] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.347174 10665 raft_consensus.cc:3060] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.347851 10791 ts_tablet_manager.cc:1403] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.017s
I20260709 13:04:03.349359 10789 ts_tablet_manager.cc:1434] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:03.350389 10789 tablet_bootstrap.cc:492] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:03.350813 10791 raft_consensus.cc:359] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.351610 10791 raft_consensus.cc:385] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.352001 10791 raft_consensus.cc:740] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.352697 10785 ts_tablet_manager.cc:1403] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.007s
I20260709 13:04:03.352802 10791 consensus_queue.cc:260] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.345413 10806 leader_election.cc:290] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:03.355652 10791 ts_tablet_manager.cc:1434] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:04:03.356761 10791 tablet_bootstrap.cc:492] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:03.356864 10789 tablet_bootstrap.cc:654] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.364274 10791 tablet_bootstrap.cc:654] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.365808 10412 catalog_manager.cc:5697] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.370836 10789 tablet_bootstrap.cc:492] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:03.370751 10785 raft_consensus.cc:359] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.371403 10789 ts_tablet_manager.cc:1403] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:04:03.371742 10785 raft_consensus.cc:385] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.374378 10785 raft_consensus.cc:740] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.375484 10785 consensus_queue.cc:260] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.377794 10665 raft_consensus.cc:2468] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:03.382222 10789 raft_consensus.cc:359] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.388200 10789 raft_consensus.cc:385] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.388561 10789 raft_consensus.cc:740] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.389283 10789 consensus_queue.cc:260] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.389698 10806 raft_consensus.cc:493] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.390215 10806 raft_consensus.cc:515] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.391515 10789 ts_tablet_manager.cc:1434] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:04:03.392315 10806 leader_election.cc:290] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:03.383527 10785 ts_tablet_manager.cc:1434] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:04:03.386576 10800 raft_consensus.cc:493] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.393576 10800 raft_consensus.cc:515] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.394443 10482 leader_election.cc:304] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb
I20260709 13:04:03.394866 10592 raft_consensus.cc:3060] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.394888 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83877eedc15a406e8656b628afec0bd5" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:03.395726 10800 leader_election.cc:290] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:03.396517 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83877eedc15a406e8656b628afec0bd5" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:03.397298 10666 raft_consensus.cc:2393] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbba8b78b34443bcb2be4b73f86fac96 in current term 1: Already voted for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in this term.
I20260709 13:04:03.397312 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf8caca63d426eb5b16065fee6b938" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:03.397753 10785 tablet_bootstrap.cc:492] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:03.398204 10516 raft_consensus.cc:2393] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
I20260709 13:04:03.385179 10791 tablet_bootstrap.cc:492] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:03.398957 10791 ts_tablet_manager.cc:1403] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.017s
I20260709 13:04:03.387681 10786 ts_tablet_manager.cc:1403] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.008s
I20260709 13:04:03.400236 10483 leader_election.cc:304] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:03.401073 10806 raft_consensus.cc:2804] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.392469 10789 tablet_bootstrap.cc:492] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:03.401892 10829 raft_consensus.cc:3060] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.396865 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acf8caca63d426eb5b16065fee6b938" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:03.402520 10786 raft_consensus.cc:359] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.403180 10786 raft_consensus.cc:385] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.403435 10786 raft_consensus.cc:740] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.404016 10632 leader_election.cc:304] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:03.404850 10800 raft_consensus.cc:3060] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.408248 10789 tablet_bootstrap.cc:654] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.401799 10791 raft_consensus.cc:359] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.411718 10791 raft_consensus.cc:385] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.412312 10791 raft_consensus.cc:740] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.413407 10791 consensus_queue.cc:260] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.412273 10800 raft_consensus.cc:2749] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.409845 10829 raft_consensus.cc:2749] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.424940 10785 tablet_bootstrap.cc:654] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.430624 10806 raft_consensus.cc:697] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:03.430467 10786 consensus_queue.cc:260] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.434585 10789 tablet_bootstrap.cc:492] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:03.435148 10789 ts_tablet_manager.cc:1403] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.004s
I20260709 13:04:03.434612 10806 consensus_queue.cc:237] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.437856 10789 raft_consensus.cc:359] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.438618 10789 raft_consensus.cc:385] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.439159 10789 raft_consensus.cc:740] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.440012 10789 consensus_queue.cc:260] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.441185 10786 ts_tablet_manager.cc:1434] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 13:04:03.442217 10789 ts_tablet_manager.cc:1434] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:03.442893 10791 ts_tablet_manager.cc:1434] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.004s
I20260709 13:04:03.448007 10789 tablet_bootstrap.cc:492] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:03.450836 10791 tablet_bootstrap.cc:492] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:03.454885 10789 tablet_bootstrap.cc:654] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.464385 10786 tablet_bootstrap.cc:492] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:03.466423 10789 tablet_bootstrap.cc:492] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:03.466959 10789 ts_tablet_manager.cc:1403] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:04:03.471161 10786 tablet_bootstrap.cc:654] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.471444 10789 raft_consensus.cc:359] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.472188 10789 raft_consensus.cc:385] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.472515 10789 raft_consensus.cc:740] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.473227 10789 consensus_queue.cc:260] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.475806 10789 ts_tablet_manager.cc:1434] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:04:03.476773 10789 tablet_bootstrap.cc:492] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:03.479048 10791 tablet_bootstrap.cc:654] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.483104 10789 tablet_bootstrap.cc:654] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.486598 10878 raft_consensus.cc:493] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.487114 10878 raft_consensus.cc:515] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.489389 10878 leader_election.cc:290] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:03.490371 10791 tablet_bootstrap.cc:492] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:03.490898 10791 ts_tablet_manager.cc:1403] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.000s
I20260709 13:04:03.490527 10413 catalog_manager.cc:5697] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.491290 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7453e3b1834c1b90a795fcb9778191" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:03.491832 10813 consensus_queue.cc:1048] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.492010 10738 raft_consensus.cc:2468] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:03.493767 10791 raft_consensus.cc:359] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.493970 10632 leader_election.cc:304] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:03.494910 10878 raft_consensus.cc:2804] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.494839 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7453e3b1834c1b90a795fcb9778191" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:03.495422 10878 raft_consensus.cc:493] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.495719 10592 raft_consensus.cc:2468] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:03.495878 10878 raft_consensus.cc:3060] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.500221 10785 tablet_bootstrap.cc:492] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:03.501580 10785 ts_tablet_manager.cc:1403] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.104s	user 0.030s	sys 0.033s
I20260709 13:04:03.504528 10785 raft_consensus.cc:359] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.505280 10785 raft_consensus.cc:385] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.505622 10785 raft_consensus.cc:740] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.506449 10785 consensus_queue.cc:260] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.508088 10789 tablet_bootstrap.cc:492] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:03.508632 10789 ts_tablet_manager.cc:1403] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 13:04:03.508399 10843 consensus_queue.cc:1048] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:03.509325 10785 ts_tablet_manager.cc:1434] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:03.510301 10786 tablet_bootstrap.cc:492] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:03.510422 10785 tablet_bootstrap.cc:492] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:03.510790 10786 ts_tablet_manager.cc:1403] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.005s
I20260709 13:04:03.512564 10843 raft_consensus.cc:493] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.513007 10791 raft_consensus.cc:385] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.513055 10843 raft_consensus.cc:515] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.513505 10791 raft_consensus.cc:740] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.514585 10791 consensus_queue.cc:260] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.515599 10843 leader_election.cc:290] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:03.512259 10789 raft_consensus.cc:359] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.516438 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0040a4a12604d64862fe91f215f2174" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:03.517216 10738 raft_consensus.cc:2393] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a3b379dbfc7437e99aa8bb10ef958cb in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:03.517400 10786 raft_consensus.cc:359] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.518123 10786 raft_consensus.cc:385] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.518352 10806 raft_consensus.cc:493] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.518862 10806 raft_consensus.cc:515] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.517243 10515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0040a4a12604d64862fe91f215f2174" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:03.519685 10813 raft_consensus.cc:493] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.519927 10789 raft_consensus.cc:385] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.520294 10789 raft_consensus.cc:740] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.520233 10813 raft_consensus.cc:515] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.521078 10789 consensus_queue.cc:260] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.521817 10806 leader_election.cc:290] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:03.522410 10813 leader_election.cc:290] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:03.523988 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19c6fe03f9244a78476037b279a7bea" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:03.524363 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19c6fe03f9244a78476037b279a7bea" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:03.525067 10592 raft_consensus.cc:2468] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
W20260709 13:04:03.526331 10705 leader_election.cc:343] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.526620 10791 ts_tablet_manager.cc:1434] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:04:03.526677 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:03.527700 10791 tablet_bootstrap.cc:492] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:03.518376 10786 raft_consensus.cc:740] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.528312 10556 leader_election.cc:304] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:03.528988 10786 consensus_queue.cc:260] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.529273 10706 leader_election.cc:304] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:03.530391 10878 raft_consensus.cc:515] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.531387 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:03.532454 10878 leader_election.cc:290] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:03.530589 10855 raft_consensus.cc:2804] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.533320 10855 raft_consensus.cc:493] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.533752 10855 raft_consensus.cc:3060] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.535952 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7453e3b1834c1b90a795fcb9778191" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:03.536711 10738 raft_consensus.cc:3060] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.537041 10789 ts_tablet_manager.cc:1434] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:04:03.539166 10789 tablet_bootstrap.cc:492] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:03.539458 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7453e3b1834c1b90a795fcb9778191" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:03.540064 10592 raft_consensus.cc:3060] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.540455 10786 ts_tablet_manager.cc:1434] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:04:03.541440 10786 tablet_bootstrap.cc:492] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
W20260709 13:04:03.545323 10483 leader_election.cc:343] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.545606 10796 raft_consensus.cc:3060] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.545364 10843 consensus_queue.cc:1048] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.527662 10665 raft_consensus.cc:2468] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:03.549233 10482 leader_election.cc:304] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:03.550727 10806 raft_consensus.cc:2804] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.551234 10806 raft_consensus.cc:493] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.551690 10806 raft_consensus.cc:3060] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.584473 10786 tablet_bootstrap.cc:654] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.585644 10592 raft_consensus.cc:2468] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:03.586962 10791 tablet_bootstrap.cc:654] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.597064 10796 raft_consensus.cc:2749] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:03.598712 10632 leader_election.cc:304] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:03.599267 10855 raft_consensus.cc:515] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.600171 10878 raft_consensus.cc:2804] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.606824 10738 raft_consensus.cc:2468] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:03.607303 10806 raft_consensus.cc:515] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.619091 10789 tablet_bootstrap.cc:654] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.620541 10878 raft_consensus.cc:697] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:03.623122 10878 consensus_queue.cc:237] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.626618 10666 raft_consensus.cc:3060] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.629122 10785 tablet_bootstrap.cc:654] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.632843 10786 tablet_bootstrap.cc:492] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:03.633545 10786 ts_tablet_manager.cc:1403] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.023s
I20260709 13:04:03.649854 10855 leader_election.cc:290] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:03.652081 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19c6fe03f9244a78476037b279a7bea" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:03.654179 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19c6fe03f9244a78476037b279a7bea" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:03.654824 10592 raft_consensus.cc:3060] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.657063 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
W20260709 13:04:03.657387 10705 leader_election.cc:343] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.658095 10888 raft_consensus.cc:493] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.660954 10591 raft_consensus.cc:3060] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:03.661348 10483 leader_election.cc:343] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.663335 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:03.658594 10888 raft_consensus.cc:515] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.664002 10664 raft_consensus.cc:3060] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.655931 10806 leader_election.cc:290] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:03.679301 10875 raft_consensus.cc:493] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.680006 10875 raft_consensus.cc:515] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.685817 10806 consensus_queue.cc:1048] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.688526 10875 leader_election.cc:290] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:03.691020 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78ad4d54fb4014a07b4cbee983af70" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:03.694538 10590 raft_consensus.cc:2468] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:03.692615 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78ad4d54fb4014a07b4cbee983af70" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:03.697615 10800 raft_consensus.cc:493] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.698151 10800 raft_consensus.cc:515] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.700435 10800 leader_election.cc:290] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:03.697469 10664 raft_consensus.cc:2468] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:03.709842 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0627ec961e5d45079cc5672bdcab5121" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:03.710634 10590 raft_consensus.cc:2468] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:03.711735 10893 raft_consensus.cc:493] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.712797 10632 leader_election.cc:304] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:03.713749 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0627ec961e5d45079cc5672bdcab5121" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:03.714416 10739 raft_consensus.cc:2468] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:03.713403 10893 raft_consensus.cc:515] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.716180 10592 raft_consensus.cc:2468] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:03.716744 10888 leader_election.cc:290] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
W20260709 13:04:03.697546 10483 leader_election.cc:343] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.717109 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78ad4d54fb4014a07b4cbee983af70" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:03.717437 10786 raft_consensus.cc:359] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.725389 10786 raft_consensus.cc:385] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.726260 10786 raft_consensus.cc:740] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.716764 10482 leader_election.cc:304] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:03.727156 10878 raft_consensus.cc:2804] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.730458 10875 raft_consensus.cc:2804] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.731103 10878 raft_consensus.cc:493] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.731550 10875 raft_consensus.cc:697] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:03.731715 10878 raft_consensus.cc:3060] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.732560 10875 consensus_queue.cc:237] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.734237 10786 consensus_queue.cc:260] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.736195 10855 consensus_queue.cc:1048] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:04:03.731268 10558 leader_election.cc:343] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.740258 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994595b7f94b4aac870d2234e0693b6b" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:03.740506 10791 tablet_bootstrap.cc:492] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:03.741123 10791 ts_tablet_manager.cc:1403] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.214s	user 0.013s	sys 0.044s
I20260709 13:04:03.743285 10483 leader_election.cc:304] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:03.743917 10786 ts_tablet_manager.cc:1434] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.000s
I20260709 13:04:03.744161 10806 raft_consensus.cc:2804] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:03.744532 10806 raft_consensus.cc:493] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.744834 10806 raft_consensus.cc:3060] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:03.744932 10786 tablet_bootstrap.cc:492] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:03.719064 10894 raft_consensus.cc:493] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.751020 10894 raft_consensus.cc:515] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.752624 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78ad4d54fb4014a07b4cbee983af70" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:03.757741 10791 raft_consensus.cc:359] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.759182 10791 raft_consensus.cc:385] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.759608 10791 raft_consensus.cc:740] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.761580 10791 consensus_queue.cc:260] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.768065 10791 ts_tablet_manager.cc:1434] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:04:03.769903 10791 tablet_bootstrap.cc:492] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:03.770968 10785 tablet_bootstrap.cc:492] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:03.771546 10785 ts_tablet_manager.cc:1403] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.261s	user 0.014s	sys 0.003s
I20260709 13:04:03.776443 10791 tablet_bootstrap.cc:654] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.776919 10706 leader_election.cc:304] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:03.781477 10813 raft_consensus.cc:2804] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:03.779405 10855 raft_consensus.cc:493] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.780021 10887 consensus_queue.cc:1048] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:03.782017 10813 raft_consensus.cc:697] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:03.782270 10855 raft_consensus.cc:515] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.782989 10813 consensus_queue.cc:237] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.784736 10855 leader_election.cc:290] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:03.790400 10785 raft_consensus.cc:359] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.790982 10785 raft_consensus.cc:385] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.791208 10785 raft_consensus.cc:740] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:03.794010 10785 consensus_queue.cc:260] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.765574 10893 leader_election.cc:290] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:03.798389 10789 tablet_bootstrap.cc:492] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:03.799005 10789 ts_tablet_manager.cc:1403] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.260s	user 0.017s	sys 0.012s
I20260709 13:04:03.804387 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0539b460f174e8b80e242e8ae3c3801" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:03.804708 10789 raft_consensus.cc:359] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.805918 10789 raft_consensus.cc:385] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:03.806084 10894 leader_election.cc:290] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:03.806468 10789 raft_consensus.cc:740] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
W20260709 13:04:03.806636 10705 leader_election.cc:343] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:03.797606 10806 raft_consensus.cc:515] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:03.808949 10806 leader_election.cc:290] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:03.808838 10785 ts_tablet_manager.cc:1434] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:04:03.810923 10785 tablet_bootstrap.cc:492] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:03.810261 10789 consensus_queue.cc:260] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.813277 10878 raft_consensus.cc:515] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:03.813789 10789 ts_tablet_manager.cc:1434] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:04:03.827351 10789 tablet_bootstrap.cc:492] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:03.887310 10785 tablet_bootstrap.cc:654] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.902334 10843 raft_consensus.cc:493] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.902904 10878 leader_election.cc:290] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:03.903128 10843 raft_consensus.cc:515] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:03.905845 10843 leader_election.cc:290] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:03.909523 10789 tablet_bootstrap.cc:654] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.913473 10786 tablet_bootstrap.cc:654] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:03.980134 10907 raft_consensus.cc:493] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.980816 10907 raft_consensus.cc:515] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:03.983373 10907 leader_election.cc:290] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:03.983517 10516 raft_consensus.cc:2393] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a3b379dbfc7437e99aa8bb10ef958cb in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:03.986296 10515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0539b460f174e8b80e242e8ae3c3801" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:03.988997 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0627ec961e5d45079cc5672bdcab5121" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:03.989616 10592 raft_consensus.cc:3060] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.000212 10592 raft_consensus.cc:2468] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:04.001550 10632 leader_election.cc:304] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:04.040798 10878 raft_consensus.cc:2804] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.041389 10878 raft_consensus.cc:697] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:04.042317 10878 consensus_queue.cc:237] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.044508 10907 consensus_queue.cc:1048] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:04.048593 10786 tablet_bootstrap.cc:492] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:04.049121 10786 ts_tablet_manager.cc:1403] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.304s	user 0.009s	sys 0.005s
I20260709 13:04:04.052091 10786 raft_consensus.cc:359] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.052776 10786 raft_consensus.cc:385] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.053028 10786 raft_consensus.cc:740] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.053174 10589 raft_consensus.cc:3060] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.053712 10786 consensus_queue.cc:260] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.056143 10786 ts_tablet_manager.cc:1434] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:04.057143 10786 tablet_bootstrap.cc:492] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:04.061529 10785 tablet_bootstrap.cc:492] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:04.062186 10785 ts_tablet_manager.cc:1403] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.251s	user 0.019s	sys 0.000s
I20260709 13:04:04.063794 10786 tablet_bootstrap.cc:654] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.066120 10785 raft_consensus.cc:359] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.068562 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78ad4d54fb4014a07b4cbee983af70" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:04.069123 10785 raft_consensus.cc:385] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.070223 10785 raft_consensus.cc:740] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.069273 10592 raft_consensus.cc:3060] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.072844 10785 consensus_queue.cc:260] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.075809 10785 ts_tablet_manager.cc:1434] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:04.076560 10785 tablet_bootstrap.cc:492] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:04.083376 10704 leader_election.cc:343] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.083926 10704 leader_election.cc:304] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:04.085297 10813 consensus_queue.cc:1048] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:04.086426 10897 raft_consensus.cc:2749] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.093982 10789 tablet_bootstrap.cc:492] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:04.094678 10789 ts_tablet_manager.cc:1403] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.267s	user 0.017s	sys 0.000s
I20260709 13:04:04.097769 10789 raft_consensus.cc:359] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.098606 10789 raft_consensus.cc:385] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.098918 10789 raft_consensus.cc:740] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.099848 10789 consensus_queue.cc:260] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.104616 10913 consensus_queue.cc:1048] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:04:04.103993 10789 ts_tablet_manager.cc:1434] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:04.106798 10785 tablet_bootstrap.cc:654] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.106645 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d68c56443fa044b5865e4dd944d2e929" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:04.109345 10789 tablet_bootstrap.cc:492] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:04.112066 10592 raft_consensus.cc:2468] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:04.112488 10786 tablet_bootstrap.cc:492] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:04.113040 10786 ts_tablet_manager.cc:1403] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.014s
W20260709 13:04:04.115581 10482 leader_election.cc:343] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.116958 10483 leader_election.cc:304] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:04.113951 10813 raft_consensus.cc:493] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.120959 10813 raft_consensus.cc:515] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.123076 10813 leader_election.cc:290] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:04.113852 10897 raft_consensus.cc:493] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.124014 10897 raft_consensus.cc:515] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.128655 10791 tablet_bootstrap.cc:492] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:04.129240 10791 ts_tablet_manager.cc:1403] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.360s	user 0.017s	sys 0.004s
I20260709 13:04:04.130679 10897 leader_election.cc:290] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:04.131047 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:04.131718 10664 raft_consensus.cc:2468] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:04.133692 10705 leader_election.cc:304] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:04.136574 10897 raft_consensus.cc:2804] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:04.137012 10897 raft_consensus.cc:493] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.137401 10897 raft_consensus.cc:3060] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.138309 10515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d68c56443fa044b5865e4dd944d2e929" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:04.138614 10786 raft_consensus.cc:359] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.139029 10515 raft_consensus.cc:2468] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:04.139375 10786 raft_consensus.cc:385] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.139747 10786 raft_consensus.cc:740] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.140519 10786 consensus_queue.cc:260] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.141654 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:04.142213 10512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:04.143797 10704 leader_election.cc:304] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:04.144140 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c4c3a7a6b84e2fa267292d100e1f4a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:04.145008 10511 raft_consensus.cc:2468] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 0.
I20260709 13:04:04.146870 10789 tablet_bootstrap.cc:654] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.133539 10791 raft_consensus.cc:359] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.142342 10517 raft_consensus.cc:2468] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:04.134008 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0627ec961e5d45079cc5672bdcab5121" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:04.150609 10791 raft_consensus.cc:385] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.155313 10791 raft_consensus.cc:740] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.156256 10791 consensus_queue.cc:260] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.152124 10786 ts_tablet_manager.cc:1434] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.002s
I20260709 13:04:04.140455 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "994595b7f94b4aac870d2234e0693b6b" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:04.118791 10913 raft_consensus.cc:2804] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.159269 10738 raft_consensus.cc:3060] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.172084 10878 consensus_queue.cc:1048] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:04.172640 10462 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:04.174731 10791 ts_tablet_manager.cc:1434] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 13:04:04.175766 10897 raft_consensus.cc:515] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.176402 10913 raft_consensus.cc:697] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:04.164610 10813 raft_consensus.cc:2804] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.182745 10791 tablet_bootstrap.cc:492] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:04.185393 10556 leader_election.cc:304] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:04.193169 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:04.193885 10666 raft_consensus.cc:3060] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.206447 10919 raft_consensus.cc:493] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.204519 10893 raft_consensus.cc:2804] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.207322 10893 raft_consensus.cc:493] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.207878 10893 raft_consensus.cc:3060] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.208683 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:04.209199 10897 leader_election.cc:290] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:04.209345 10514 raft_consensus.cc:3060] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:04.211741 10785 tablet_bootstrap.cc:492] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:04.212255 10785 ts_tablet_manager.cc:1403] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.136s	user 0.020s	sys 0.001s
I20260709 13:04:04.207048 10919 raft_consensus.cc:515] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.177686 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d68c56443fa044b5865e4dd944d2e929" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
W20260709 13:04:04.215595 10705 leader_election.cc:343] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.217368 10875 consensus_queue.cc:1048] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:04.217823 10919 leader_election.cc:290] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:04.217993 10878 consensus_queue.cc:1048] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:04.220089 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:04.220393 10791 tablet_bootstrap.cc:654] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:04.222002 10704 leader_election.cc:343] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.215492 10785 raft_consensus.cc:359] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.223865 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:04.223282 10785 raft_consensus.cc:385] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.224655 10785 raft_consensus.cc:740] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.223966 10894 raft_consensus.cc:493] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.225447 10738 raft_consensus.cc:2468] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:04.225334 10785 consensus_queue.cc:260] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.225525 10894 raft_consensus.cc:515] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.227972 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d68c56443fa044b5865e4dd944d2e929" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:04.229766 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd5b2ba1e5c4fd09fb5e1e6b14da9d6" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:04.230046 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78ad4d54fb4014a07b4cbee983af70" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:04.230616 10739 raft_consensus.cc:3060] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:04.231118 10705 leader_election.cc:343] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.231598 10705 leader_election.cc:304] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:04.184633 10813 raft_consensus.cc:493] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:04.234803 10558 leader_election.cc:343] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.233461 10919 raft_consensus.cc:2749] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.234212 10813 raft_consensus.cc:3060] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.251785 10786 tablet_bootstrap.cc:492] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:04.232980 10894 leader_election.cc:290] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:04.236444 10878 raft_consensus.cc:493] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.270234 10878 raft_consensus.cc:515] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.271552 10666 raft_consensus.cc:2468] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 2.
I20260709 13:04:04.272807 10705 leader_election.cc:304] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:04.273581 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19c6fe03f9244a78476037b279a7bea" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:04.274464 10591 raft_consensus.cc:2393] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
I20260709 13:04:04.274714 10855 raft_consensus.cc:2804] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:04.275372 10855 raft_consensus.cc:697] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:04.276808 10878 leader_election.cc:290] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:04.252031 10739 raft_consensus.cc:2468] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:04.277480 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19c6fe03f9244a78476037b279a7bea" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:04.276419 10893 raft_consensus.cc:515] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.279443 10632 leader_election.cc:304] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:04.214323 10556 leader_election.cc:304] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:04.241549 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd5b2ba1e5c4fd09fb5e1e6b14da9d6" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:04.239871 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c4c3a7a6b84e2fa267292d100e1f4a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:04.240687 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:04.260116 10913 consensus_queue.cc:237] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.260629 10414 catalog_manager.cc:5697] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.256884 10415 catalog_manager.cc:5697] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.242189 10785 ts_tablet_manager.cc:1434] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
W20260709 13:04:04.236541 10483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 58009.1us
I20260709 13:04:04.276417 10855 consensus_queue.cc:237] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:04.283237 10557 leader_election.cc:343] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.290994 10785 tablet_bootstrap.cc:492] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:04.294919 10878 raft_consensus.cc:3060] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.296489 10894 raft_consensus.cc:2749] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.301350 10557 leader_election.cc:304] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
W20260709 13:04:04.299974 10556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 86328.5us
I20260709 13:04:04.315675 10556 leader_election.cc:304] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:04.319303 10557 leader_election.cc:343] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.320515 10888 raft_consensus.cc:2749] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.321587 10888 raft_consensus.cc:2749] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:04.328565 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c4c3a7a6b84e2fa267292d100e1f4a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:04.329514 10517 raft_consensus.cc:3060] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.325929 10557 leader_election.cc:304] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:04.330739 10888 raft_consensus.cc:2749] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.337924 10785 tablet_bootstrap.cc:654] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.300853 10893 leader_election.cc:290] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:04.348102 10514 raft_consensus.cc:2468] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 2.
I20260709 13:04:04.341517 10919 consensus_queue.cc:1048] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:04:04.367856 10878 raft_consensus.cc:2749] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.370847 10789 tablet_bootstrap.cc:492] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:04.378480 10789 ts_tablet_manager.cc:1403] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.272s	user 0.018s	sys 0.032s
I20260709 13:04:04.361344 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c4c3a7a6b84e2fa267292d100e1f4a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:04.372701 10517 raft_consensus.cc:2468] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:04.377287 10813 raft_consensus.cc:515] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.382117 10786 tablet_bootstrap.cc:654] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.390185 10737 raft_consensus.cc:2393] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbba8b78b34443bcb2be4b73f86fac96 in current term 1: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
I20260709 13:04:04.392083 10791 tablet_bootstrap.cc:492] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:04.392767 10791 ts_tablet_manager.cc:1403] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.212s	user 0.009s	sys 0.038s
I20260709 13:04:04.393384 10878 raft_consensus.cc:493] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.393951 10878 raft_consensus.cc:515] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.394335 10789 raft_consensus.cc:359] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.394982 10789 raft_consensus.cc:385] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.395252 10789 raft_consensus.cc:740] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.395979 10878 leader_election.cc:290] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:04.395874 10789 consensus_queue.cc:260] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.396780 10791 raft_consensus.cc:359] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.397687 10791 raft_consensus.cc:385] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.397992 10789 ts_tablet_manager.cc:1434] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:04:04.398061 10791 raft_consensus.cc:740] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.402565 10789 tablet_bootstrap.cc:492] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:04.404883 10791 consensus_queue.cc:260] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.405588 10556 leader_election.cc:304] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:04.400339 10483 leader_election.cc:304] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:04.406550 10888 raft_consensus.cc:2804] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.406847 10913 raft_consensus.cc:3060] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.407047 10888 raft_consensus.cc:697] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:04.407969 10888 consensus_queue.cc:237] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
W20260709 13:04:04.388018 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 56446.6us
W20260709 13:04:04.415531 10557 leader_election.cc:343] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.417856 10791 ts_tablet_manager.cc:1434] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:04:04.418821 10791 tablet_bootstrap.cc:492] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:04.427937 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d68c56443fa044b5865e4dd944d2e929" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:04.428992 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d68c56443fa044b5865e4dd944d2e929" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:04.428911 10908 consensus_queue.cc:1048] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.429653 10662 raft_consensus.cc:3060] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.430374 10919 consensus_queue.cc:1048] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.436204 10813 leader_election.cc:290] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:04.445317 10913 raft_consensus.cc:2749] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.445421 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e802f2e4188a44849dff275987bb46ec" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:04.446276 10591 raft_consensus.cc:2468] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:04.447229 10662 raft_consensus.cc:2468] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
W20260709 13:04:04.454393 10483 consensus_peers.cc:597] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 -> Peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Couldn't send request to peer bd6ac4ec789b459bbbfa3d6952103df5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.462374 10789 tablet_bootstrap.cc:654] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.466856 10893 raft_consensus.cc:493] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.467746 10893 raft_consensus.cc:515] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.466737 10705 leader_election.cc:304] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:04.471117 10813 raft_consensus.cc:2804] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.471419 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e802f2e4188a44849dff275987bb46ec" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:04.471625 10813 raft_consensus.cc:697] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:04.471858 10632 leader_election.cc:304] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:04.472510 10813 consensus_queue.cc:237] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.473007 10935 raft_consensus.cc:2804] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.473572 10935 raft_consensus.cc:493] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.473994 10935 raft_consensus.cc:3060] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.474438 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5811d78dc99d4c6ab232228c36f59fa4" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:04.483165 10558 leader_election.cc:343] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.494379 10791 tablet_bootstrap.cc:654] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.491009 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5811d78dc99d4c6ab232228c36f59fa4" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:04.496516 10514 raft_consensus.cc:2468] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 0.
I20260709 13:04:04.493798 10893 leader_election.cc:290] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:04.497756 10517 raft_consensus.cc:2468] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:04.498440 10556 leader_election.cc:304] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: bd6ac4ec789b459bbbfa3d6952103df5
W20260709 13:04:04.498848 10632 leader_election.cc:343] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.503939 10893 raft_consensus.cc:2804] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.505977 10893 raft_consensus.cc:493] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.506371 10893 raft_consensus.cc:3060] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.513682 10935 raft_consensus.cc:515] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.517458 10785 tablet_bootstrap.cc:492] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:04.524303 10893 raft_consensus.cc:515] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.537222 10785 ts_tablet_manager.cc:1403] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.246s	user 0.016s	sys 0.021s
I20260709 13:04:04.538460 10893 leader_election.cc:290] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:04.539559 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5811d78dc99d4c6ab232228c36f59fa4" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:04.540038 10517 raft_consensus.cc:3060] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.540223 10785 raft_consensus.cc:359] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.540951 10785 raft_consensus.cc:385] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.541199 10785 raft_consensus.cc:740] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.543416 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5811d78dc99d4c6ab232228c36f59fa4" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:04.544126 10785 consensus_queue.cc:260] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
W20260709 13:04:04.545166 10558 leader_election.cc:343] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.546778 10785 ts_tablet_manager.cc:1434] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:04:04.547094 10934 consensus_queue.cc:1048] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:04:04.549289 10785 tablet_bootstrap.cc:492] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:04.552349 10412 catalog_manager.cc:5697] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } }
I20260709 13:04:04.570703 10935 leader_election.cc:290] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:04.574791 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e802f2e4188a44849dff275987bb46ec" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:04.575593 10589 raft_consensus.cc:3060] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.578363 10517 raft_consensus.cc:2468] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:04.579594 10556 leader_election.cc:304] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:04.581266 10888 raft_consensus.cc:2804] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.581768 10888 raft_consensus.cc:697] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:04.582387 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e802f2e4188a44849dff275987bb46ec" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:04.582629 10888 consensus_queue.cc:237] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
W20260709 13:04:04.584317 10632 leader_election.cc:343] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.586390 10786 tablet_bootstrap.cc:492] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:04.586963 10786 ts_tablet_manager.cc:1403] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.335s	user 0.011s	sys 0.009s
I20260709 13:04:04.589993 10786 raft_consensus.cc:359] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.602761 10786 raft_consensus.cc:385] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.603055 10786 raft_consensus.cc:740] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.605139 10589 raft_consensus.cc:2468] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:04.594815 10789 tablet_bootstrap.cc:492] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:04.590656 10791 tablet_bootstrap.cc:492] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:04.607173 10791 ts_tablet_manager.cc:1403] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.189s	user 0.017s	sys 0.023s
I20260709 13:04:04.606830 10789 ts_tablet_manager.cc:1403] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.204s	user 0.016s	sys 0.012s
I20260709 13:04:04.600090 10934 consensus_queue.cc:1048] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:04:04.606796 10786 consensus_queue.cc:260] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.609913 10791 raft_consensus.cc:359] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.611580 10789 raft_consensus.cc:359] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.613940 10791 raft_consensus.cc:385] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.613991 10789 raft_consensus.cc:385] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.614404 10791 raft_consensus.cc:740] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.606812 10632 leader_election.cc:304] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:04.615178 10791 consensus_queue.cc:260] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.615545 10903 raft_consensus.cc:2804] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.617527 10791 ts_tablet_manager.cc:1434] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:04.618618 10791 tablet_bootstrap.cc:492] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:04.614462 10789 raft_consensus.cc:740] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.622608 10786 ts_tablet_manager.cc:1434] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.004s
I20260709 13:04:04.623077 10789 consensus_queue.cc:260] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.624357 10894 raft_consensus.cc:493] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.624691 10786 tablet_bootstrap.cc:492] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:04.624989 10894 raft_consensus.cc:515] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.617449 10903 raft_consensus.cc:697] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:04.627205 10903 consensus_queue.cc:237] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.630599 10894 leader_election.cc:290] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:04.630822 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:04.632300 10558 leader_election.cc:343] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.632927 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
W20260709 13:04:04.634225 10556 leader_election.cc:343] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.634745 10934 raft_consensus.cc:493] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.634663 10556 leader_election.cc:304] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:04.635270 10934 raft_consensus.cc:515] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.637439 10934 leader_election.cc:290] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:04.636725 10414 catalog_manager.cc:5697] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.638356 10894 raft_consensus.cc:2749] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.639125 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd5b2ba1e5c4fd09fb5e1e6b14da9d6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:04.639770 10592 raft_consensus.cc:2468] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:04.641268 10791 tablet_bootstrap.cc:654] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.642699 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd5b2ba1e5c4fd09fb5e1e6b14da9d6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:04.644824 10632 leader_election.cc:343] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.646622 10632 leader_election.cc:304] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:04.647686 10935 raft_consensus.cc:2804] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.649504 10935 raft_consensus.cc:493] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.649845 10935 raft_consensus.cc:3060] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.649847 10789 ts_tablet_manager.cc:1434] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.042s	user 0.002s	sys 0.004s
I20260709 13:04:04.651245 10791 tablet_bootstrap.cc:492] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:04.651567 10789 tablet_bootstrap.cc:492] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:04.651824 10791 ts_tablet_manager.cc:1403] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.000s
I20260709 13:04:04.641212 10786 tablet_bootstrap.cc:654] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.654286 10415 catalog_manager.cc:5697] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.654672 10791 raft_consensus.cc:359] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.655581 10791 raft_consensus.cc:385] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.655944 10791 raft_consensus.cc:740] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.656678 10791 consensus_queue.cc:260] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.657222 10935 raft_consensus.cc:515] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.658861 10785 tablet_bootstrap.cc:654] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.659229 10791 ts_tablet_manager.cc:1434] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:04.659328 10935 leader_election.cc:290] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:04.660346 10791 tablet_bootstrap.cc:492] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:04.664158 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd5b2ba1e5c4fd09fb5e1e6b14da9d6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:04.664839 10589 raft_consensus.cc:3060] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.665601 10789 tablet_bootstrap.cc:654] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.667200 10791 tablet_bootstrap.cc:654] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.668655 10786 tablet_bootstrap.cc:492] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:04.669149 10786 ts_tablet_manager.cc:1403] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.001s
I20260709 13:04:04.671350 10413 catalog_manager.cc:5697] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.672964 10589 raft_consensus.cc:2468] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:04.675025 10632 leader_election.cc:304] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:04.675094 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd5b2ba1e5c4fd09fb5e1e6b14da9d6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:04.676167 10903 raft_consensus.cc:2804] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.676659 10903 raft_consensus.cc:697] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
W20260709 13:04:04.676680 10632 leader_election.cc:343] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.677644 10903 consensus_queue.cc:237] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.671921 10786 raft_consensus.cc:359] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.680445 10786 raft_consensus.cc:385] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.680755 10786 raft_consensus.cc:740] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.689363 10785 tablet_bootstrap.cc:492] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:04.690083 10785 ts_tablet_manager.cc:1403] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.000s
I20260709 13:04:04.692121 10412 catalog_manager.cc:5697] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 2, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.695209 10786 consensus_queue.cc:260] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.698732 10786 ts_tablet_manager.cc:1434] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 13:04:04.693543 10785 raft_consensus.cc:359] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.699033 10412 catalog_manager.cc:5697] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.700201 10785 raft_consensus.cc:385] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.700482 10908 raft_consensus.cc:493] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.701122 10908 raft_consensus.cc:515] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.704572 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e31d4d9ec6473caabd94052248c686" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:04.704998 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e31d4d9ec6473caabd94052248c686" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:04.705638 10589 raft_consensus.cc:2468] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
W20260709 13:04:04.706180 10482 leader_election.cc:343] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.707439 10908 leader_election.cc:290] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:04.708214 10789 tablet_bootstrap.cc:492] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:04.708727 10789 ts_tablet_manager.cc:1403] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.001s
I20260709 13:04:04.710773 10483 leader_election.cc:304] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:04.711453 10789 raft_consensus.cc:359] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.712133 10789 raft_consensus.cc:385] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.712386 10789 raft_consensus.cc:740] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.712606 10908 raft_consensus.cc:2804] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.712985 10908 raft_consensus.cc:493] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.700562 10785 raft_consensus.cc:740] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.713357 10908 raft_consensus.cc:3060] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.714059 10785 consensus_queue.cc:260] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.714175 10411 catalog_manager.cc:5697] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.716127 10785 ts_tablet_manager.cc:1434] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:04:04.716912 10786 tablet_bootstrap.cc:492] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:04.723862 10908 raft_consensus.cc:515] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.728091 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e31d4d9ec6473caabd94052248c686" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
W20260709 13:04:04.729977 10482 leader_election.cc:343] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.730688 10908 leader_election.cc:290] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:04.731473 10791 tablet_bootstrap.cc:492] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:04.731436 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e31d4d9ec6473caabd94052248c686" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:04.732228 10791 ts_tablet_manager.cc:1403] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.015s
I20260709 13:04:04.732308 10589 raft_consensus.cc:3060] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.734184 10786 tablet_bootstrap.cc:654] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.713080 10789 consensus_queue.cc:260] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.737178 10789 ts_tablet_manager.cc:1434] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:04:04.738186 10789 tablet_bootstrap.cc:492] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:04.740263 10589 raft_consensus.cc:2468] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:04.741655 10483 leader_election.cc:304] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:04.745119 10789 tablet_bootstrap.cc:654] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.745530 10908 raft_consensus.cc:2804] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.746651 10908 raft_consensus.cc:697] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:04.746316 10791 raft_consensus.cc:359] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.732219 10785 tablet_bootstrap.cc:492] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:04.747916 10908 consensus_queue.cc:237] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.753422 10785 tablet_bootstrap.cc:654] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.753736 10791 raft_consensus.cc:385] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.755986 10791 raft_consensus.cc:740] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.756856 10791 consensus_queue.cc:260] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.759235 10791 ts_tablet_manager.cc:1434] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:04:04.760479 10791 tablet_bootstrap.cc:492] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:04.760910 10786 tablet_bootstrap.cc:492] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:04.761435 10786 ts_tablet_manager.cc:1403] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.007s
I20260709 13:04:04.764276 10786 raft_consensus.cc:359] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.764971 10786 raft_consensus.cc:385] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.765233 10786 raft_consensus.cc:740] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.766326 10414 catalog_manager.cc:5697] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.768321 10786 consensus_queue.cc:260] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.770607 10786 ts_tablet_manager.cc:1434] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:04:04.771514 10786 tablet_bootstrap.cc:492] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:04.773772 10789 tablet_bootstrap.cc:492] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:04.774296 10789 ts_tablet_manager.cc:1403] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.003s
I20260709 13:04:04.777315 10789 raft_consensus.cc:359] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.781484 10791 tablet_bootstrap.cc:654] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.781401 10414 catalog_manager.cc:5697] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.781965 10411 catalog_manager.cc:5697] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.784477 10789 raft_consensus.cc:385] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.784869 10789 raft_consensus.cc:740] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.785627 10789 consensus_queue.cc:260] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.789278 10785 tablet_bootstrap.cc:492] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:04.789357 10789 ts_tablet_manager.cc:1434] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:04:04.790017 10785 ts_tablet_manager.cc:1403] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.005s
I20260709 13:04:04.790849 10789 tablet_bootstrap.cc:492] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:04.793154 10785 raft_consensus.cc:359] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.781544 10786 tablet_bootstrap.cc:654] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.793895 10785 raft_consensus.cc:385] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.802986 10785 raft_consensus.cc:740] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.803781 10785 consensus_queue.cc:260] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.805279 10789 tablet_bootstrap.cc:654] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.810431 10785 ts_tablet_manager.cc:1434] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:04:04.811512 10785 tablet_bootstrap.cc:492] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:04.813023 10517 raft_consensus.cc:1275] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Refusing update from remote peer bd6ac4ec789b459bbbfa3d6952103df5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:04.814713 10897 consensus_queue.cc:1048] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:04.818122 10737 raft_consensus.cc:3060] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.830593 10785 tablet_bootstrap.cc:654] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.845330 10786 tablet_bootstrap.cc:492] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:04.845835 10786 ts_tablet_manager.cc:1403] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.006s
I20260709 13:04:04.855615 10662 raft_consensus.cc:1275] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer bd6ac4ec789b459bbbfa3d6952103df5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:04.857846 10813 consensus_queue.cc:1048] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:04.858862 10908 consensus_queue.cc:1048] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:04.867576 10786 raft_consensus.cc:359] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.868287 10786 raft_consensus.cc:385] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.868568 10786 raft_consensus.cc:740] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.876690 10786 consensus_queue.cc:260] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.880703 10786 ts_tablet_manager.cc:1434] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.001s
I20260709 13:04:04.881983 10786 tablet_bootstrap.cc:492] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:04.887261 10791 tablet_bootstrap.cc:492] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:04.887789 10791 ts_tablet_manager.cc:1403] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.128s	user 0.011s	sys 0.013s
I20260709 13:04:04.889024 10921 consensus_queue.cc:1048] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:04.890977 10786 tablet_bootstrap.cc:654] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.901003 10789 tablet_bootstrap.cc:492] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:04.902098 10789 ts_tablet_manager.cc:1403] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.112s	user 0.029s	sys 0.022s
I20260709 13:04:04.902014 10791 raft_consensus.cc:359] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.902825 10791 raft_consensus.cc:385] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.903065 10791 raft_consensus.cc:740] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.903640 10791 consensus_queue.cc:260] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.906008 10785 tablet_bootstrap.cc:492] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:04.906550 10785 ts_tablet_manager.cc:1403] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.002s
I20260709 13:04:04.909853 10791 ts_tablet_manager.cc:1434] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:04:04.910880 10791 tablet_bootstrap.cc:492] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:04.912407 10789 raft_consensus.cc:359] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.913071 10789 raft_consensus.cc:385] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.913446 10789 raft_consensus.cc:740] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.913208 10894 consensus_queue.cc:1048] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:04.914981 10903 raft_consensus.cc:493] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.915498 10903 raft_consensus.cc:515] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.917120 10791 tablet_bootstrap.cc:654] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.917699 10903 leader_election.cc:290] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:04.919323 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e31d4d9ec6473caabd94052248c686" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:04.924486 10589 raft_consensus.cc:2393] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
W20260709 13:04:04.921335 10446 debug-util.cc:398] Leaking SignalData structure 0x7b080005fde0 after lost signal to thread 434
I20260709 13:04:04.914359 10789 consensus_queue.cc:260] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:04.920567 10785 raft_consensus.cc:359] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.921236 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e31d4d9ec6473caabd94052248c686" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:04.929486 10913 raft_consensus.cc:493] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.930943 10785 raft_consensus.cc:385] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.931384 10785 raft_consensus.cc:740] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.932265 10785 consensus_queue.cc:260] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.935487 10813 raft_consensus.cc:493] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.934521 10913 raft_consensus.cc:515] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:04.936211 10813 raft_consensus.cc:515] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:04.938135 10913 leader_election.cc:290] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:04.940373 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:04.940658 10446 debug-util.cc:398] Leaking SignalData structure 0x7b080004c940 after lost signal to thread 10449
I20260709 13:04:04.941258 10897 consensus_queue.cc:1048] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:04.942106 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:04.942785 10630 leader_election.cc:304] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:04.942821 10592 raft_consensus.cc:2468] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:04.943975 10903 raft_consensus.cc:3060] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.944793 10483 leader_election.cc:304] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
W20260709 13:04:04.942108 10446 debug-util.cc:398] Leaking SignalData structure 0x7b0800289540 after lost signal to thread 10541
I20260709 13:04:04.948256 10813 leader_election.cc:290] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
W20260709 13:04:04.950209 10483 leader_election.cc:343] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:04.950781 10785 ts_tablet_manager.cc:1434] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:04:04.950479 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e802f2e4188a44849dff275987bb46ec" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:04.951728 10785 tablet_bootstrap.cc:492] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:04.951733 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e802f2e4188a44849dff275987bb46ec" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:04.952836 10592 raft_consensus.cc:2393] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd6ac4ec789b459bbbfa3d6952103df5 in current term 1: Already voted for candidate 8b82fdd6486e40d180a9d1c7c320e38b in this term.
I20260709 13:04:04.956575 10935 raft_consensus.cc:493] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.957122 10935 raft_consensus.cc:515] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.959101 10706 leader_election.cc:304] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:04.961850 10935 leader_election.cc:290] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:04.963091 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0539b460f174e8b80e242e8ae3c3801" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:04.963223 10813 raft_consensus.cc:3060] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.963769 10516 raft_consensus.cc:2468] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:04.964313 10785 tablet_bootstrap.cc:654] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.965161 10630 leader_election.cc:304] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:04.967053 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0539b460f174e8b80e242e8ae3c3801" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:04.954582 10446 debug-util.cc:398] Leaking SignalData structure 0x7b08001c4860 after lost signal to thread 10616
I20260709 13:04:04.967875 10737 raft_consensus.cc:2468] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
W20260709 13:04:04.969056 10446 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8840 after lost signal to thread 10690
I20260709 13:04:04.953986 10913 raft_consensus.cc:2804] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.970180 10935 raft_consensus.cc:2804] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:04.970423 10913 raft_consensus.cc:493] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:04.970557 10446 debug-util.cc:398] Leaking SignalData structure 0x7b080012d160 after lost signal to thread 10764
I20260709 13:04:04.971006 10913 raft_consensus.cc:3060] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.970774 10935 raft_consensus.cc:493] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.971791 10935 raft_consensus.cc:3060] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.980430 10789 ts_tablet_manager.cc:1434] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:04:04.984092 10903 raft_consensus.cc:2749] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:04.985906 10789 tablet_bootstrap.cc:492] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
W20260709 13:04:04.991230 10557 consensus_peers.cc:597] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:04.992695 10935 raft_consensus.cc:515] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:04.996343 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0539b460f174e8b80e242e8ae3c3801" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:04.996987 10737 raft_consensus.cc:3060] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.988499 10786 tablet_bootstrap.cc:492] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:04.997890 10786 ts_tablet_manager.cc:1403] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.116s	user 0.010s	sys 0.015s
I20260709 13:04:04.998651 10789 tablet_bootstrap.cc:654] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.003315 10813 raft_consensus.cc:2749] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.008857 10913 raft_consensus.cc:515] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.009451 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0539b460f174e8b80e242e8ae3c3801" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:05.010113 10514 raft_consensus.cc:3060] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.013609 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:05.014523 10592 raft_consensus.cc:3060] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.023936 10813 raft_consensus.cc:493] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.012591 10913 leader_election.cc:290] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:05.027163 10813 raft_consensus.cc:515] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.018265 10935 leader_election.cc:290] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:05.024712 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:05.038301 10813 leader_election.cc:290] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:05.039600 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd5b2ba1e5c4fd09fb5e1e6b14da9d6" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:05.040444 10589 raft_consensus.cc:2393] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd6ac4ec789b459bbbfa3d6952103df5 in current term 1: Already voted for candidate 8b82fdd6486e40d180a9d1c7c320e38b in this term.
I20260709 13:04:05.043836 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd5b2ba1e5c4fd09fb5e1e6b14da9d6" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:05.045382 10592 raft_consensus.cc:2468] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:05.049054 10791 tablet_bootstrap.cc:492] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:05.049640 10791 ts_tablet_manager.cc:1403] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.001s
I20260709 13:04:05.052780 10791 raft_consensus.cc:359] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.053614 10791 raft_consensus.cc:385] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.018790 10514 raft_consensus.cc:2468] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:05.055068 10705 leader_election.cc:304] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:05.055313 10630 leader_election.cc:304] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:05.056221 10935 raft_consensus.cc:2804] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.056950 10935 raft_consensus.cc:697] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:05.057272 10855 raft_consensus.cc:3060] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.057855 10935 consensus_queue.cc:237] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:05.060634 10483 leader_election.cc:343] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.053916 10791 raft_consensus.cc:740] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.063681 10893 raft_consensus.cc:493] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.064242 10893 raft_consensus.cc:515] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.066398 10893 leader_election.cc:290] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:05.067946 10903 consensus_queue.cc:1048] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:05.068650 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2513a3510ad1457d9962458d169aab59" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
W20260709 13:04:05.070290 10556 leader_election.cc:343] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.072286 10737 raft_consensus.cc:2468] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:05.075397 10897 consensus_queue.cc:1048] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:05.083801 10786 raft_consensus.cc:359] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.084314 10483 leader_election.cc:304] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:05.084697 10786 raft_consensus.cc:385] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.067976 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2513a3510ad1457d9962458d169aab59" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:05.085661 10786 raft_consensus.cc:740] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.086310 10791 consensus_queue.cc:260] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.086758 10786 consensus_queue.cc:260] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.085719 10855 raft_consensus.cc:2749] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.086881 10921 raft_consensus.cc:2804] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.088955 10921 raft_consensus.cc:697] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:05.089143 10786 ts_tablet_manager.cc:1434] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.000s
I20260709 13:04:05.093884 10791 ts_tablet_manager.cc:1434] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 13:04:05.094907 10921 consensus_queue.cc:237] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.105334 10893 consensus_queue.cc:1048] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.107472 10903 consensus_queue.cc:1048] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:05.110935 10557 leader_election.cc:343] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.111631 10557 leader_election.cc:304] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:05.113163 10893 raft_consensus.cc:2749] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.120824 10791 tablet_bootstrap.cc:492] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:05.125275 10786 tablet_bootstrap.cc:492] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:05.136190 10785 tablet_bootstrap.cc:492] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:05.138119 10785 ts_tablet_manager.cc:1403] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.187s	user 0.021s	sys 0.031s
I20260709 13:04:05.138541 10893 raft_consensus.cc:493] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.139894 10893 raft_consensus.cc:515] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.142164 10785 raft_consensus.cc:359] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.143471 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d73b5dbe2dea4e249d33a2bac3dee4e2" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:05.146148 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d73b5dbe2dea4e249d33a2bac3dee4e2" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:05.146488 10557 leader_election.cc:343] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.147235 10785 raft_consensus.cc:385] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.147579 10785 raft_consensus.cc:740] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
W20260709 13:04:05.151492 10558 leader_election.cc:343] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.152635 10558 leader_election.cc:304] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:05.153522 10888 raft_consensus.cc:2749] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.148671 10893 leader_election.cc:290] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:05.155567 10785 consensus_queue.cc:260] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.161082 10785 ts_tablet_manager.cc:1434] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 13:04:05.164105 10789 tablet_bootstrap.cc:492] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:05.164669 10789 ts_tablet_manager.cc:1403] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.183s	user 0.021s	sys 0.024s
I20260709 13:04:05.168032 10789 raft_consensus.cc:359] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.168725 10789 raft_consensus.cc:385] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.168984 10789 raft_consensus.cc:740] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.169751 10789 consensus_queue.cc:260] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.170738 10785 tablet_bootstrap.cc:492] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:05.183612 10789 ts_tablet_manager.cc:1434] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:04:05.184566 10789 tablet_bootstrap.cc:492] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:05.193243 10740 raft_consensus.cc:3060] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.197866 10789 tablet_bootstrap.cc:654] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.201172 10903 consensus_queue.cc:1048] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:05.202842 10888 consensus_queue.cc:1048] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:05.203401 10786 tablet_bootstrap.cc:654] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.212487 10791 tablet_bootstrap.cc:654] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.216248 10411 catalog_manager.cc:5697] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.236611 10903 consensus_queue.cc:1048] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.244514 10888 raft_consensus.cc:493] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.245136 10888 raft_consensus.cc:515] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.252527 10888 leader_election.cc:290] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
W20260709 13:04:05.254370 10977 log.cc:927] Time spent T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b: Append to log took a long time: real 0.090s	user 0.002s	sys 0.002s
I20260709 13:04:05.254163 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6dbf486214445a8d6a624d253a2a24" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:05.255384 10516 raft_consensus.cc:2468] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 0.
I20260709 13:04:05.255597 10785 tablet_bootstrap.cc:654] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.256762 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6dbf486214445a8d6a624d253a2a24" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:05.262279 10556 leader_election.cc:304] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:05.264254 10893 raft_consensus.cc:2804] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.264636 10893 raft_consensus.cc:493] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.264721 10789 tablet_bootstrap.cc:492] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:05.265005 10893 raft_consensus.cc:3060] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.265229 10789 ts_tablet_manager.cc:1403] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.081s	user 0.021s	sys 0.008s
I20260709 13:04:05.268141 10789 raft_consensus.cc:359] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.268980 10789 raft_consensus.cc:385] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.269235 10789 raft_consensus.cc:740] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.269949 10789 consensus_queue.cc:260] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.276383 10786 tablet_bootstrap.cc:492] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:05.276997 10786 ts_tablet_manager.cc:1403] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.153s	user 0.007s	sys 0.021s
I20260709 13:04:05.280493 10789 ts_tablet_manager.cc:1434] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
W20260709 13:04:05.273646 10558 leader_election.cc:343] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:05.286952 10980 log.cc:927] Time spent T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 13:04:05.291096 10893 raft_consensus.cc:515] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.301020 10786 raft_consensus.cc:359] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.301393 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6dbf486214445a8d6a624d253a2a24" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:05.302280 10789 tablet_bootstrap.cc:492] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:05.301821 10786 raft_consensus.cc:385] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.303462 10786 raft_consensus.cc:740] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.303505 10517 raft_consensus.cc:3060] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.310721 10414 catalog_manager.cc:5697] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.315076 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6dbf486214445a8d6a624d253a2a24" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:05.317633 10786 consensus_queue.cc:260] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.322898 10786 ts_tablet_manager.cc:1434] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:04:05.293931 10893 leader_election.cc:290] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:05.325162 10786 tablet_bootstrap.cc:492] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
W20260709 13:04:05.317142 10558 leader_election.cc:343] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.330142 10919 raft_consensus.cc:493] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.330655 10919 raft_consensus.cc:515] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.332788 10919 leader_election.cc:290] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:05.325608 10987 raft_consensus.cc:493] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.334901 10987 raft_consensus.cc:515] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.335351 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:05.336975 10786 tablet_bootstrap.cc:654] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.337136 10987 leader_election.cc:290] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:05.342087 10789 tablet_bootstrap.cc:654] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.346261 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:05.347182 10591 raft_consensus.cc:2393] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd6ac4ec789b459bbbfa3d6952103df5 in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:05.345678 10517 raft_consensus.cc:2468] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:05.357748 10791 tablet_bootstrap.cc:492] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:05.358793 10791 ts_tablet_manager.cc:1403] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.238s	user 0.018s	sys 0.014s
I20260709 13:04:05.360811 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c4c3a7a6b84e2fa267292d100e1f4a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:05.350991 10893 raft_consensus.cc:493] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.359350 10706 leader_election.cc:304] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:05.362706 10893 raft_consensus.cc:515] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.362519 10908 raft_consensus.cc:493] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.367925 10919 raft_consensus.cc:3060] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.367719 10908 raft_consensus.cc:515] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:05.371181 10791 raft_consensus.cc:359] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.371889 10791 raft_consensus.cc:385] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.372154 10791 raft_consensus.cc:740] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.372828 10791 consensus_queue.cc:260] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.373085 10908 leader_election.cc:290] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:05.367659 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d54a6a210240e8994f2e4a34596f81" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
W20260709 13:04:05.376084 10557 leader_election.cc:343] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.365667 10893 leader_election.cc:290] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:05.379848 10990 raft_consensus.cc:493] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.380654 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d54a6a210240e8994f2e4a34596f81" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:05.385627 10791 ts_tablet_manager.cc:1434] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:04:05.388211 10791 tablet_bootstrap.cc:492] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:05.388780 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:05.387434 10556 leader_election.cc:304] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:05.383285 10990 raft_consensus.cc:515] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:05.415995 10785 tablet_bootstrap.cc:492] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:05.416543 10785 ts_tablet_manager.cc:1403] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.246s	user 0.010s	sys 0.005s
I20260709 13:04:05.416724 10786 tablet_bootstrap.cc:492] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:05.417240 10786 ts_tablet_manager.cc:1403] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.017s
I20260709 13:04:05.398285 10921 consensus_queue.cc:1048] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:04:05.404276 10737 raft_consensus.cc:2468] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:05.419840 10786 raft_consensus.cc:359] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.420938 10786 raft_consensus.cc:385] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.410276 10888 raft_consensus.cc:2804] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.421200 10786 raft_consensus.cc:740] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.421620 10888 raft_consensus.cc:697] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:05.421907 10786 consensus_queue.cc:260] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.422513 10888 consensus_queue.cc:237] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.426534 10483 leader_election.cc:304] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
W20260709 13:04:05.426834 10556 leader_election.cc:343] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.427462 10921 raft_consensus.cc:2804] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.427883 10921 raft_consensus.cc:493] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.428237 10921 raft_consensus.cc:3060] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.428613 10990 leader_election.cc:290] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:05.427362 10556 leader_election.cc:304] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:05.434376 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:05.435706 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67c4c3a7a6b84e2fa267292d100e1f4a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:05.436981 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:05.437508 10893 raft_consensus.cc:2749] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.437621 10662 raft_consensus.cc:2468] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:05.439360 10908 consensus_queue.cc:1048] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:05.446063 10786 ts_tablet_manager.cc:1434] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:04:05.456368 10786 tablet_bootstrap.cc:492] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:05.462494 10789 tablet_bootstrap.cc:492] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:05.463052 10789 ts_tablet_manager.cc:1403] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.033s
I20260709 13:04:05.463913 10921 raft_consensus.cc:515] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:05.465137 10516 raft_consensus.cc:2393] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:05.467126 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:05.467540 10789 raft_consensus.cc:359] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.467859 10737 raft_consensus.cc:2468] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:05.468279 10789 raft_consensus.cc:385] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.468629 10789 raft_consensus.cc:740] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.469290 10789 consensus_queue.cc:260] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.465922 10785 raft_consensus.cc:359] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.472471 10785 raft_consensus.cc:385] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.472867 10785 raft_consensus.cc:740] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.474870 10789 ts_tablet_manager.cc:1434] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:05.474723 10785 consensus_queue.cc:260] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.475930 10789 tablet_bootstrap.cc:492] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:05.501422 10919 raft_consensus.cc:2749] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.504088 10888 raft_consensus.cc:493] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.504648 10888 raft_consensus.cc:515] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.498603 10632 leader_election.cc:304] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:05.511202 10990 raft_consensus.cc:2749] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.515357 10662 raft_consensus.cc:3060] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.515225 10921 leader_election.cc:290] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:05.525857 10785 ts_tablet_manager.cc:1434] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.109s	user 0.023s	sys 0.028s
I20260709 13:04:05.528389 10785 tablet_bootstrap.cc:492] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:05.529470 10632 leader_election.cc:304] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:05.530629 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdad68bdd98451886fae7cb5cb4d10a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:05.536665 10888 leader_election.cc:290] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:05.534148 10990 consensus_queue.cc:1048] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:04:05.530820 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:05.541036 10737 raft_consensus.cc:3060] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:05.541275 10557 leader_election.cc:343] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.550071 10986 raft_consensus.cc:2804] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.554639 10986 raft_consensus.cc:493] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.555022 10986 raft_consensus.cc:3060] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.550825 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdad68bdd98451886fae7cb5cb4d10a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:05.565114 10791 tablet_bootstrap.cc:654] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:05.566934 10558 leader_election.cc:343] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.567482 10558 leader_election.cc:304] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:05.568631 10893 raft_consensus.cc:2749] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.571974 10414 catalog_manager.cc:5697] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.574146 10785 tablet_bootstrap.cc:654] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.594229 10893 raft_consensus.cc:493] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.594899 10893 raft_consensus.cc:515] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.598425 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48aefb05bb248e78e9e5cfd8aa2739c" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
W20260709 13:04:05.600191 10556 leader_election.cc:343] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.600910 10893 leader_election.cc:290] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:05.601538 10997 raft_consensus.cc:493] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.602433 10997 raft_consensus.cc:515] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.611719 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2513a3510ad1457d9962458d169aab59" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:05.612414 10592 raft_consensus.cc:2468] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:05.616588 10786 tablet_bootstrap.cc:654] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.618965 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:05.613096 10997 leader_election.cc:290] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:05.620499 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48aefb05bb248e78e9e5cfd8aa2739c" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:05.629597 10462 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:05.630762 10483 leader_election.cc:304] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
W20260709 13:04:05.631543 10558 leader_election.cc:343] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.631644 10997 raft_consensus.cc:2804] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.632265 10997 raft_consensus.cc:493] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.632784 10997 raft_consensus.cc:3060] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.632200 10558 leader_election.cc:304] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:05.640182 10893 raft_consensus.cc:2749] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.642858 10986 raft_consensus.cc:515] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:05.644191 10666 raft_consensus.cc:2393] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cbba8b78b34443bcb2be4b73f86fac96 in current term 1: Already voted for candidate 8b82fdd6486e40d180a9d1c7c320e38b in this term.
I20260709 13:04:05.644634 10990 raft_consensus.cc:493] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.645217 10990 raft_consensus.cc:515] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.645772 10998 consensus_queue.cc:1048] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.647557 10990 leader_election.cc:290] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:05.650357 10785 tablet_bootstrap.cc:492] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:05.650913 10785 ts_tablet_manager.cc:1403] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.023s
I20260709 13:04:05.663034 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2513a3510ad1457d9962458d169aab59" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:05.663793 10666 raft_consensus.cc:2468] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:05.665377 10919 raft_consensus.cc:493] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.665963 10919 raft_consensus.cc:515] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.668848 10919 leader_election.cc:290] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:05.671749 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2513a3510ad1457d9962458d169aab59" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:05.676026 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6dbf486214445a8d6a624d253a2a24" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:05.683105 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6dbf486214445a8d6a624d253a2a24" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:05.683156 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:05.684091 10517 raft_consensus.cc:2393] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd6ac4ec789b459bbbfa3d6952103df5 in current term 1: Already voted for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in this term.
I20260709 13:04:05.684361 10511 raft_consensus.cc:2393] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:05.681288 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2513a3510ad1457d9962458d169aab59" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:05.687752 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:05.688202 10704 leader_election.cc:304] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:05.689656 10919 raft_consensus.cc:3060] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.690322 10921 consensus_queue.cc:1048] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.687820 10589 raft_consensus.cc:2468] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:05.700505 10789 tablet_bootstrap.cc:654] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.704082 10785 raft_consensus.cc:359] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:05.705232 10785 raft_consensus.cc:385] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.705502 10785 raft_consensus.cc:740] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.706238 10785 consensus_queue.cc:260] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:05.712168 10737 raft_consensus.cc:2468] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:05.680107 10986 leader_election.cc:290] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:05.725425 10786 tablet_bootstrap.cc:492] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:05.725957 10786 ts_tablet_manager.cc:1403] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.279s	user 0.015s	sys 0.014s
I20260709 13:04:05.740053 10785 ts_tablet_manager.cc:1434] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.001s
I20260709 13:04:05.741272 10785 tablet_bootstrap.cc:492] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:05.734436 10855 raft_consensus.cc:493] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.742959 10855 raft_consensus.cc:515] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.748294 10791 tablet_bootstrap.cc:492] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:05.749095 10791 ts_tablet_manager.cc:1403] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.361s	user 0.008s	sys 0.018s
I20260709 13:04:05.753268 10990 consensus_queue.cc:1048] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:05.757619 10483 leader_election.cc:304] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:05.759434 10921 raft_consensus.cc:2804] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.760102 10921 raft_consensus.cc:697] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:05.761871 10855 leader_election.cc:290] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:05.761996 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d73b5dbe2dea4e249d33a2bac3dee4e2" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:05.762758 10589 raft_consensus.cc:2468] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:05.764626 10706 leader_election.cc:304] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:05.770884 10919 raft_consensus.cc:2749] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.770613 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d73b5dbe2dea4e249d33a2bac3dee4e2" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:05.731709 10997 raft_consensus.cc:515] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.761260 10921 consensus_queue.cc:237] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:05.788408 10785 tablet_bootstrap.cc:654] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.790458 10516 raft_consensus.cc:2393] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:05.792145 10997 leader_election.cc:290] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:05.792624 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2513a3510ad1457d9962458d169aab59" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:05.793409 10591 raft_consensus.cc:3060] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.779579 10855 raft_consensus.cc:2804] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:05.796103 10855 raft_consensus.cc:493] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.796576 10855 raft_consensus.cc:3060] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.777727 10632 leader_election.cc:304] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:05.799068 10990 raft_consensus.cc:2749] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:05.807264 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2513a3510ad1457d9962458d169aab59" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:05.808153 10662 raft_consensus.cc:3060] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.824931 10786 raft_consensus.cc:359] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:05.833072 10591 raft_consensus.cc:2468] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:05.825809 10786 raft_consensus.cc:385] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.846359 10786 raft_consensus.cc:740] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.847967 10786 consensus_queue.cc:260] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:05.862073 10483 leader_election.cc:304] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:05.862258 10791 raft_consensus.cc:359] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.863059 10791 raft_consensus.cc:385] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.863369 10791 raft_consensus.cc:740] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.863996 10913 raft_consensus.cc:2804] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:05.864108 10791 consensus_queue.cc:260] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.864704 10913 raft_consensus.cc:697] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:05.865602 10913 consensus_queue.cc:237] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:05.866607 10632 leader_election.cc:304] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:05.873056 10791 ts_tablet_manager.cc:1434] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.000s
I20260709 13:04:05.875844 10791 tablet_bootstrap.cc:492] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:05.876667 10786 ts_tablet_manager.cc:1434] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.150s	user 0.008s	sys 0.001s
I20260709 13:04:05.880275 10789 tablet_bootstrap.cc:492] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:05.880867 10789 ts_tablet_manager.cc:1403] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.405s	user 0.042s	sys 0.035s
W20260709 13:04:05.882287 10705 leader_election.cc:343] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.882854 10786 tablet_bootstrap.cc:492] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:05.888542 10789 raft_consensus.cc:359] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.889364 10789 raft_consensus.cc:385] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.889710 10789 raft_consensus.cc:740] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.891779 10789 consensus_queue.cc:260] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.894611 10662 raft_consensus.cc:2468] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:05.895308 10934 raft_consensus.cc:2764] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:04:05.904742 10789 ts_tablet_manager.cc:1434] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:04:05.912741 10893 consensus_queue.cc:1048] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:05.914309 10785 tablet_bootstrap.cc:492] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:05.914875 10785 ts_tablet_manager.cc:1403] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.174s	user 0.006s	sys 0.025s
I20260709 13:04:05.928287 10789 tablet_bootstrap.cc:492] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:05.932453 10786 tablet_bootstrap.cc:654] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.946213 10785 raft_consensus.cc:359] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.946828 10785 raft_consensus.cc:385] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.947036 10785 raft_consensus.cc:740] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.947610 10785 consensus_queue.cc:260] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:05.927745 10411 catalog_manager.cc:5697] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.950683 10855 raft_consensus.cc:515] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:05.953446 10791 tablet_bootstrap.cc:654] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.954600 10785 ts_tablet_manager.cc:1434] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:04:05.962891 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d73b5dbe2dea4e249d33a2bac3dee4e2" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:05.989032 10415 catalog_manager.cc:5697] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.990242 10662 raft_consensus.cc:3060] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.977691 10919 raft_consensus.cc:493] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.998533 10919 raft_consensus.cc:515] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:05.998940 10888 consensus_queue.cc:1048] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.000910 10919 leader_election.cc:290] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:06.003540 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67449a01ef99467887627b70924e3efc" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:05.964119 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d73b5dbe2dea4e249d33a2bac3dee4e2" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:06.005558 10592 raft_consensus.cc:3060] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:05.967087 10997 raft_consensus.cc:493] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:06.006202 10705 leader_election.cc:343] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.006762 10997 raft_consensus.cc:515] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.010214 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67449a01ef99467887627b70924e3efc" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:06.010354 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67449a01ef99467887627b70924e3efc" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:06.011214 10737 raft_consensus.cc:2468] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
W20260709 13:04:06.011829 10482 leader_election.cc:343] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:05.975891 10789 tablet_bootstrap.cc:654] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.012883 10483 leader_election.cc:304] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:06.014647 10998 raft_consensus.cc:2804] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.015014 10998 raft_consensus.cc:493] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.015360 10998 raft_consensus.cc:3060] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.015587 10791 tablet_bootstrap.cc:492] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:06.016109 10791 ts_tablet_manager.cc:1403] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.142s	user 0.011s	sys 0.000s
I20260709 13:04:06.018868 10791 raft_consensus.cc:359] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.019680 10791 raft_consensus.cc:385] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.019953 10791 raft_consensus.cc:740] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.022293 10791 consensus_queue.cc:260] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.024435 10791 ts_tablet_manager.cc:1434] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:06.027227 10998 raft_consensus.cc:515] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:05.962271 10855 leader_election.cc:290] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:06.031473 10921 raft_consensus.cc:493] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.035372 10921 raft_consensus.cc:515] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.037899 10921 leader_election.cc:290] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:05.961762 10785 tablet_bootstrap.cc:492] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:06.034384 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67449a01ef99467887627b70924e3efc" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:06.043016 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48aefb05bb248e78e9e5cfd8aa2739c" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:06.043658 10516 raft_consensus.cc:2393] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd6ac4ec789b459bbbfa3d6952103df5 in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:06.045647 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48aefb05bb248e78e9e5cfd8aa2739c" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:06.046625 10591 raft_consensus.cc:2468] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:06.047390 10592 raft_consensus.cc:2468] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:06.048355 10483 leader_election.cc:304] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
W20260709 13:04:06.049659 10483 leader_election.cc:343] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.050225 10921 raft_consensus.cc:2804] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.051363 10921 raft_consensus.cc:493] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.051460 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67449a01ef99467887627b70924e3efc" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:06.052407 10921 raft_consensus.cc:3060] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.057668 10785 tablet_bootstrap.cc:654] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.058223 10665 raft_consensus.cc:3060] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.063220 10706 leader_election.cc:304] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:06.064488 10704 leader_election.cc:304] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:06.065812 10919 raft_consensus.cc:3060] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.067535 10791 tablet_bootstrap.cc:492] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:06.064517 10855 raft_consensus.cc:2804] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.070868 10855 raft_consensus.cc:697] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:06.071940 10855 consensus_queue.cc:237] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.084951 10662 raft_consensus.cc:2468] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:06.085688 10791 tablet_bootstrap.cc:654] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.086297 10998 leader_election.cc:290] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:06.089378 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67449a01ef99467887627b70924e3efc" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:06.098819 10919 raft_consensus.cc:2749] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.079138 10997 leader_election.cc:290] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:06.076289 10921 raft_consensus.cc:515] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.117044 10415 catalog_manager.cc:5697] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.125499 10786 tablet_bootstrap.cc:492] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:06.126142 10786 ts_tablet_manager.cc:1403] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.249s	user 0.014s	sys 0.024s
I20260709 13:04:06.106339 10665 raft_consensus.cc:2468] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:06.131594 10482 leader_election.cc:304] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:06.132862 10997 raft_consensus.cc:2804] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.133215 10737 raft_consensus.cc:2468] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:06.133651 10997 raft_consensus.cc:697] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:06.129705 10786 raft_consensus.cc:359] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.137872 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48aefb05bb248e78e9e5cfd8aa2739c" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:06.138599 10592 raft_consensus.cc:3060] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.139000 10921 leader_election.cc:290] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:06.134398 10786 raft_consensus.cc:385] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.142472 10786 raft_consensus.cc:740] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.143714 10789 tablet_bootstrap.cc:492] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:06.143379 10786 consensus_queue.cc:260] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.144289 10789 ts_tablet_manager.cc:1403] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.239s	user 0.009s	sys 0.010s
I20260709 13:04:06.147182 10592 raft_consensus.cc:2468] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:06.147081 10789 raft_consensus.cc:359] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.148696 10789 raft_consensus.cc:385] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.149009 10789 raft_consensus.cc:740] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.149849 10789 consensus_queue.cc:260] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.151257 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48aefb05bb248e78e9e5cfd8aa2739c" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:06.151782 10786 ts_tablet_manager.cc:1434] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:04:06.151737 10483 leader_election.cc:304] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:06.152714 10921 raft_consensus.cc:2804] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.152977 10786 tablet_bootstrap.cc:492] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
W20260709 13:04:06.152875 10483 leader_election.cc:343] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.153306 10921 raft_consensus.cc:697] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:06.154305 10921 consensus_queue.cc:237] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.135743 10997 consensus_queue.cc:237] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.156769 10789 ts_tablet_manager.cc:1434] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:06.157639 10791 tablet_bootstrap.cc:492] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:06.160564 10791 ts_tablet_manager.cc:1403] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.014s
I20260709 13:04:06.161418 10785 tablet_bootstrap.cc:492] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:06.162010 10785 ts_tablet_manager.cc:1403] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.207s	user 0.011s	sys 0.002s
I20260709 13:04:06.163991 10791 raft_consensus.cc:359] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.164868 10791 raft_consensus.cc:385] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.165270 10791 raft_consensus.cc:740] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.165405 10785 raft_consensus.cc:359] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.166194 10785 raft_consensus.cc:385] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.166636 10785 raft_consensus.cc:740] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.167121 10791 consensus_queue.cc:260] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.167402 10785 consensus_queue.cc:260] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.170610 10785 ts_tablet_manager.cc:1434] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:06.171576 10785 tablet_bootstrap.cc:492] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:06.157795 10789 tablet_bootstrap.cc:492] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:06.178645 10998 consensus_queue.cc:1048] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.185988 10785 tablet_bootstrap.cc:654] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.198553 10786 tablet_bootstrap.cc:654] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.170629 10791 ts_tablet_manager.cc:1434] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:04:06.206430 10791 tablet_bootstrap.cc:492] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:06.209369 10789 tablet_bootstrap.cc:654] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.220091 10411 catalog_manager.cc:5697] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.224550 10921 consensus_queue.cc:1048] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.228092 10786 tablet_bootstrap.cc:492] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:06.228525 10791 tablet_bootstrap.cc:654] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.228642 10786 ts_tablet_manager.cc:1403] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.002s
I20260709 13:04:06.231680 10786 raft_consensus.cc:359] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.232488 10786 raft_consensus.cc:385] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.232772 10786 raft_consensus.cc:740] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.233403 10786 consensus_queue.cc:260] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.234643 10789 tablet_bootstrap.cc:492] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:06.235322 10789 ts_tablet_manager.cc:1403] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.002s
I20260709 13:04:06.236081 10786 ts_tablet_manager.cc:1434] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:06.237160 10786 tablet_bootstrap.cc:492] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:06.240033 10789 raft_consensus.cc:359] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.240957 10789 raft_consensus.cc:385] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.241302 10789 raft_consensus.cc:740] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.242442 10789 consensus_queue.cc:260] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.248665 10789 ts_tablet_manager.cc:1434] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:04:06.250921 10791 tablet_bootstrap.cc:492] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:06.251535 10791 ts_tablet_manager.cc:1403] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.000s
I20260709 13:04:06.253341 10415 catalog_manager.cc:5697] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.257326 10888 raft_consensus.cc:493] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.243728 10785 tablet_bootstrap.cc:492] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:06.257812 10888 raft_consensus.cc:515] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.260515 10888 leader_election.cc:290] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:06.262286 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79b841e581468e84cf2701211496e9" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:06.258785 10785 ts_tablet_manager.cc:1403] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.000s
W20260709 13:04:06.263729 10558 leader_election.cc:343] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.264647 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79b841e581468e84cf2701211496e9" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
W20260709 13:04:06.267196 10556 leader_election.cc:343] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.267606 10556 leader_election.cc:304] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:06.268870 10888 raft_consensus.cc:493] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.269469 10888 raft_consensus.cc:515] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.270224 10893 raft_consensus.cc:2749] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.272244 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a34b42baf84d3781f0a69c5722c1bb" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:06.272892 10665 raft_consensus.cc:2468] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 0.
I20260709 13:04:06.273097 10791 raft_consensus.cc:359] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.273267 10785 raft_consensus.cc:359] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.273934 10791 raft_consensus.cc:385] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.273988 10785 raft_consensus.cc:385] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.274395 10785 raft_consensus.cc:740] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.274282 10557 leader_election.cc:304] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:06.275055 10786 tablet_bootstrap.cc:654] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.275393 10893 raft_consensus.cc:2804] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.275817 10893 raft_consensus.cc:493] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.276175 10893 raft_consensus.cc:3060] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.277070 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a34b42baf84d3781f0a69c5722c1bb" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:06.276866 10888 leader_election.cc:290] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:06.280813 10789 tablet_bootstrap.cc:492] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:06.277753 10737 raft_consensus.cc:2468] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 0.
I20260709 13:04:06.274346 10791 raft_consensus.cc:740] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.287189 10791 consensus_queue.cc:260] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.275352 10785 consensus_queue.cc:260] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.296275 10789 tablet_bootstrap.cc:654] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.309150 10785 ts_tablet_manager.cc:1434] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:04:06.310374 10785 tablet_bootstrap.cc:492] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:06.317816 10789 tablet_bootstrap.cc:492] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:06.318769 10789 ts_tablet_manager.cc:1403] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.000s
I20260709 13:04:06.293995 10791 ts_tablet_manager.cc:1434] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:04:06.319994 10791 tablet_bootstrap.cc:492] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:06.322999 10789 raft_consensus.cc:359] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.324090 10789 raft_consensus.cc:385] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.324528 10789 raft_consensus.cc:740] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.325677 10789 consensus_queue.cc:260] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.327071 10893 raft_consensus.cc:515] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.334635 10893 leader_election.cc:290] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:06.340394 10791 tablet_bootstrap.cc:654] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.340744 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a34b42baf84d3781f0a69c5722c1bb" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:06.341615 10665 raft_consensus.cc:3060] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.348493 10785 tablet_bootstrap.cc:654] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.352901 10888 raft_consensus.cc:493] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.353152 10997 consensus_queue.cc:1048] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.353375 10786 tablet_bootstrap.cc:492] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:06.353482 10888 raft_consensus.cc:515] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.354292 10786 ts_tablet_manager.cc:1403] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.117s	user 0.041s	sys 0.043s
I20260709 13:04:06.355800 10888 leader_election.cc:290] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:06.357127 10786 raft_consensus.cc:359] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.358438 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20701090c4f4bd5ba6c754ccbcd41e1" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:06.360510 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9a34b42baf84d3781f0a69c5722c1bb" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:06.360780 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20701090c4f4bd5ba6c754ccbcd41e1" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:06.361387 10737 raft_consensus.cc:3060] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:06.362584 10557 leader_election.cc:343] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.357831 10786 raft_consensus.cc:385] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.366391 10786 raft_consensus.cc:740] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.367161 10786 consensus_queue.cc:260] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
W20260709 13:04:06.368001 10556 leader_election.cc:343] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.368515 10556 leader_election.cc:304] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:06.369266 10786 ts_tablet_manager.cc:1434] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:04:06.375058 10888 raft_consensus.cc:2749] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.380715 10737 raft_consensus.cc:2468] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:06.380719 10786 tablet_bootstrap.cc:492] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:06.393174 10558 leader_election.cc:304] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:06.398124 10888 raft_consensus.cc:2804] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.398587 10888 raft_consensus.cc:697] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:06.399396 10888 consensus_queue.cc:237] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.406363 10786 tablet_bootstrap.cc:654] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.422230 10785 tablet_bootstrap.cc:492] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:06.422868 10785 ts_tablet_manager.cc:1403] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.007s
I20260709 13:04:06.429136 10665 raft_consensus.cc:2468] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:06.434347 10789 ts_tablet_manager.cc:1434] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.115s	user 0.009s	sys 0.000s
I20260709 13:04:06.436036 10789 tablet_bootstrap.cc:492] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:06.433115 10855 raft_consensus.cc:493] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.437256 10855 raft_consensus.cc:515] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.441772 10789 tablet_bootstrap.cc:654] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.443786 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48aefb05bb248e78e9e5cfd8aa2739c" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:06.441392 10415 catalog_manager.cc:5697] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.445152 10855 leader_election.cc:290] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:06.448124 11036 consensus_queue.cc:1048] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.452543 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48aefb05bb248e78e9e5cfd8aa2739c" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:06.453341 10592 raft_consensus.cc:2393] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd6ac4ec789b459bbbfa3d6952103df5 in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:06.455466 10706 leader_election.cc:304] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:06.460116 10791 tablet_bootstrap.cc:492] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:06.462213 10855 raft_consensus.cc:3060] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.471400 10791 ts_tablet_manager.cc:1403] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.152s	user 0.040s	sys 0.016s
I20260709 13:04:06.473026 10786 tablet_bootstrap.cc:492] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:06.473605 10786 ts_tablet_manager.cc:1403] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.093s	user 0.008s	sys 0.012s
I20260709 13:04:06.473428 10785 raft_consensus.cc:359] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.474179 10785 raft_consensus.cc:385] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.474313 10855 raft_consensus.cc:2749] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.475503 10785 raft_consensus.cc:740] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.476393 10785 consensus_queue.cc:260] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.478649 10785 ts_tablet_manager.cc:1434] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.003s
I20260709 13:04:06.475342 10791 raft_consensus.cc:359] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.479841 10791 raft_consensus.cc:385] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.480154 10791 raft_consensus.cc:740] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.480950 10791 consensus_queue.cc:260] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.483749 10791 ts_tablet_manager.cc:1434] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:04:06.484171 10789 tablet_bootstrap.cc:492] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:06.484748 10789 ts_tablet_manager.cc:1403] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.000s
I20260709 13:04:06.485054 10791 tablet_bootstrap.cc:492] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:06.487433 10789 raft_consensus.cc:359] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.488108 10789 raft_consensus.cc:385] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.488390 10789 raft_consensus.cc:740] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.489403 10786 raft_consensus.cc:359] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.490137 10786 raft_consensus.cc:385] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.490401 10786 raft_consensus.cc:740] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.491148 10786 consensus_queue.cc:260] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.491911 10791 tablet_bootstrap.cc:654] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.492110 10789 consensus_queue.cc:260] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.498631 10786 ts_tablet_manager.cc:1434] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:04:06.499805 10789 ts_tablet_manager.cc:1434] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:04:06.500736 10789 tablet_bootstrap.cc:492] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:06.503340 10785 tablet_bootstrap.cc:492] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:06.506898 10786 tablet_bootstrap.cc:492] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:06.511607 10785 tablet_bootstrap.cc:654] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.520607 10786 tablet_bootstrap.cc:654] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.523591 10789 tablet_bootstrap.cc:654] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.531888 10791 tablet_bootstrap.cc:492] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:06.532524 10791 ts_tablet_manager.cc:1403] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.021s
I20260709 13:04:06.535513 10791 raft_consensus.cc:359] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.537151 10791 raft_consensus.cc:385] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.537500 10791 raft_consensus.cc:740] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.538296 10791 consensus_queue.cc:260] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.538915 10785 tablet_bootstrap.cc:492] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:06.541318 10791 ts_tablet_manager.cc:1434] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:04:06.542230 10785 ts_tablet_manager.cc:1403] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.002s
I20260709 13:04:06.545415 10785 raft_consensus.cc:359] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.546216 10785 raft_consensus.cc:385] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.546562 10785 raft_consensus.cc:740] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.547364 10785 consensus_queue.cc:260] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.550554 10791 tablet_bootstrap.cc:492] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:06.557008 10789 tablet_bootstrap.cc:492] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:06.557597 10789 ts_tablet_manager.cc:1403] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.019s
I20260709 13:04:06.559847 10791 tablet_bootstrap.cc:654] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.557040 10786 tablet_bootstrap.cc:492] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:06.560706 10786 ts_tablet_manager.cc:1403] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.000s
I20260709 13:04:06.560462 10789 raft_consensus.cc:359] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.561517 10789 raft_consensus.cc:385] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.561859 10789 raft_consensus.cc:740] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.562554 10789 consensus_queue.cc:260] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.571573 10786 raft_consensus.cc:359] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.572611 10786 raft_consensus.cc:385] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.572952 10786 raft_consensus.cc:740] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.574842 10786 consensus_queue.cc:260] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.574074 10785 ts_tablet_manager.cc:1434] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 13:04:06.581967 11036 raft_consensus.cc:493] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.582517 11036 raft_consensus.cc:515] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.584679 11036 leader_election.cc:290] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:06.585813 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d54a6a210240e8994f2e4a34596f81" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:06.586565 10665 raft_consensus.cc:2468] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:06.586720 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d54a6a210240e8994f2e4a34596f81" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:06.587371 10591 raft_consensus.cc:2468] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:06.588076 10482 leader_election.cc:304] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:06.589059 10921 raft_consensus.cc:2804] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.589427 10921 raft_consensus.cc:493] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.589764 10921 raft_consensus.cc:3060] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.594136 10789 ts_tablet_manager.cc:1434] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:04:06.594285 11036 raft_consensus.cc:493] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.594956 11036 raft_consensus.cc:515] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.597039 11036 leader_election.cc:290] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:06.598088 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5066d6e3bb46aeb08e655bfe8ad7f2" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:06.598771 10662 raft_consensus.cc:2468] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:06.600349 10482 leader_election.cc:304] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:06.601131 10913 raft_consensus.cc:2804] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.601509 10913 raft_consensus.cc:493] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.601888 10913 raft_consensus.cc:3060] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.607609 10921 raft_consensus.cc:515] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.609009 10785 tablet_bootstrap.cc:492] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:06.610610 10913 raft_consensus.cc:515] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.619371 10789 tablet_bootstrap.cc:492] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:06.647176 10913 leader_election.cc:290] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:06.647547 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5066d6e3bb46aeb08e655bfe8ad7f2" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:06.648268 10665 raft_consensus.cc:3060] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.621619 10791 tablet_bootstrap.cc:492] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:06.650436 10791 ts_tablet_manager.cc:1403] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.100s	user 0.037s	sys 0.020s
I20260709 13:04:06.653090 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5066d6e3bb46aeb08e655bfe8ad7f2" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:06.623342 11036 consensus_queue.cc:1048] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.654745 10785 tablet_bootstrap.cc:654] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.625563 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5066d6e3bb46aeb08e655bfe8ad7f2" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:06.628638 10855 consensus_queue.cc:1048] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.630247 10998 consensus_queue.cc:1048] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.668102 10789 tablet_bootstrap.cc:654] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.632274 10919 raft_consensus.cc:493] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.674376 10919 raft_consensus.cc:515] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.666678 10785 tablet_bootstrap.cc:492] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:06.676189 10785 ts_tablet_manager.cc:1403] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.006s
I20260709 13:04:06.678856 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5066d6e3bb46aeb08e655bfe8ad7f2" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:06.679736 10516 raft_consensus.cc:2393] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bd6ac4ec789b459bbbfa3d6952103df5 in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:06.686199 10740 raft_consensus.cc:3060] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.686057 10785 raft_consensus.cc:359] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.687166 10785 raft_consensus.cc:385] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.687534 10785 raft_consensus.cc:740] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.688282 10785 consensus_queue.cc:260] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.695062 10785 ts_tablet_manager.cc:1434] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:04:06.696133 10785 tablet_bootstrap.cc:492] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:06.635238 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d54a6a210240e8994f2e4a34596f81" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:06.698427 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5066d6e3bb46aeb08e655bfe8ad7f2" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:06.699324 10789 tablet_bootstrap.cc:492] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:06.697795 10591 raft_consensus.cc:3060] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.699877 10789 ts_tablet_manager.cc:1403] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.010s
I20260709 13:04:06.702978 10789 raft_consensus.cc:359] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.703665 10789 raft_consensus.cc:385] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.703915 10789 raft_consensus.cc:740] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.704568 10789 consensus_queue.cc:260] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.705842 10705 leader_election.cc:304] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:06.708948 10591 raft_consensus.cc:2468] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:06.710673 10483 leader_election.cc:304] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:06.712123 10998 raft_consensus.cc:2804] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.712932 10998 raft_consensus.cc:697] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:06.713649 10789 ts_tablet_manager.cc:1434] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:04:06.713783 10998 consensus_queue.cc:237] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.715104 10789 tablet_bootstrap.cc:492] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:06.720443 11036 consensus_queue.cc:1048] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.719341 10997 consensus_queue.cc:1048] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:06.722476 10789 tablet_bootstrap.cc:654] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.725759 10785 tablet_bootstrap.cc:654] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.731683 10919 leader_election.cc:290] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:06.635718 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d54a6a210240e8994f2e4a34596f81" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:06.642541 10888 raft_consensus.cc:493] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.741611 10888 raft_consensus.cc:515] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.743933 10888 leader_election.cc:290] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:06.644548 10921 leader_election.cc:290] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:06.653746 10791 raft_consensus.cc:359] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.749631 10791 raft_consensus.cc:385] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:06.696632 10462 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:06.749961 10791 raft_consensus.cc:740] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.751950 10791 consensus_queue.cc:260] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.632825 10786 ts_tablet_manager.cc:1434] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260709 13:04:06.754112 10786 tablet_bootstrap.cc:492] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:06.764473 10791 ts_tablet_manager.cc:1434] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.114s	user 0.007s	sys 0.000s
I20260709 13:04:06.767966 10665 raft_consensus.cc:2468] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:06.735450 10919 consensus_queue.cc:1048] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:04:06.772594 10786 tablet_bootstrap.cc:654] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.773491 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be358e09d0714fa2bd4ca5cd34df4a29" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:06.755475 10662 raft_consensus.cc:3060] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.782985 10740 raft_consensus.cc:2468] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:06.801241 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be358e09d0714fa2bd4ca5cd34df4a29" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:06.803073 10855 raft_consensus.cc:2749] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.804844 10855 raft_consensus.cc:493] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:06.814311 10557 leader_election.cc:343] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.819933 10919 raft_consensus.cc:493] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.820446 10919 raft_consensus.cc:515] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.822978 10482 leader_election.cc:304] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:06.823885 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700134865ef74506af01723a1857195d" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:06.824301 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700134865ef74506af01723a1857195d" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:06.824990 10589 raft_consensus.cc:2468] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
W20260709 13:04:06.825762 10704 leader_election.cc:343] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.825892 11036 raft_consensus.cc:2804] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.826510 11036 raft_consensus.cc:697] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:06.827380 11036 consensus_queue.cc:237] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.827822 10706 leader_election.cc:304] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:06.828707 11044 raft_consensus.cc:2804] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.829061 11044 raft_consensus.cc:493] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.829375 11044 raft_consensus.cc:3060] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.833427 10791 tablet_bootstrap.cc:492] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:06.836889 10789 tablet_bootstrap.cc:492] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:06.837594 10789 ts_tablet_manager.cc:1403] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.001s
I20260709 13:04:06.840648 10789 raft_consensus.cc:359] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.841368 10789 raft_consensus.cc:385] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.841639 10789 raft_consensus.cc:740] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.850994 10789 consensus_queue.cc:260] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.805439 10855 raft_consensus.cc:515] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.860241 10411 catalog_manager.cc:5697] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:06.864830 10558 leader_election.cc:343] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.865613 10558 leader_election.cc:304] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:06.866669 10893 raft_consensus.cc:2749] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.868709 10888 raft_consensus.cc:493] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.869194 10888 raft_consensus.cc:515] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.849385 10919 leader_election.cc:290] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:06.876799 10888 leader_election.cc:290] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:06.877297 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dae8a5daed4ae996d7df5a97147747" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:06.877388 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dae8a5daed4ae996d7df5a97147747" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
W20260709 13:04:06.879969 10558 leader_election.cc:343] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:06.880478 10557 leader_election.cc:343] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.880924 10557 leader_election.cc:304] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:06.882543 11044 raft_consensus.cc:515] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:06.882560 11035 raft_consensus.cc:2749] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.884462 10913 raft_consensus.cc:493] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.884958 10913 raft_consensus.cc:515] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.887446 10913 leader_election.cc:290] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:06.891745 10789 ts_tablet_manager.cc:1434] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:04:06.893520 10789 tablet_bootstrap.cc:492] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:06.902738 10785 tablet_bootstrap.cc:492] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:06.903226 10785 ts_tablet_manager.cc:1403] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.207s	user 0.022s	sys 0.015s
I20260709 13:04:06.909077 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700134865ef74506af01723a1857195d" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:06.919086 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20701090c4f4bd5ba6c754ccbcd41e1" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:06.919812 10592 raft_consensus.cc:2468] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
W20260709 13:04:06.920317 10704 leader_election.cc:343] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.903972 11044 leader_election.cc:290] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:06.926735 10855 leader_election.cc:290] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:06.928295 10785 raft_consensus.cc:359] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.929042 10785 raft_consensus.cc:385] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.929312 10785 raft_consensus.cc:740] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.929976 10785 consensus_queue.cc:260] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:06.936187 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700134865ef74506af01723a1857195d" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:06.936865 10591 raft_consensus.cc:3060] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.942016 10785 ts_tablet_manager.cc:1434] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:04:06.943118 10785 tablet_bootstrap.cc:492] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:06.950461 11057 raft_consensus.cc:493] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.950997 11057 raft_consensus.cc:515] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:06.948709 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20701090c4f4bd5ba6c754ccbcd41e1" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:06.952135 10665 raft_consensus.cc:2468] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:06.953317 11057 leader_election.cc:290] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
W20260709 13:04:06.953890 11055 log.cc:927] Time spent T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:04:06.957701 10785 tablet_bootstrap.cc:654] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.949364 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdad68bdd98451886fae7cb5cb4d10a" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:06.962710 10592 raft_consensus.cc:2468] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:06.944393 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdad68bdd98451886fae7cb5cb4d10a" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:06.963932 10664 raft_consensus.cc:2468] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:06.966638 10791 tablet_bootstrap.cc:654] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.975457 10705 leader_election.cc:304] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:06.976276 10786 tablet_bootstrap.cc:492] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:06.976838 10786 ts_tablet_manager.cc:1403] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.223s	user 0.011s	sys 0.005s
I20260709 13:04:06.970626 10483 leader_election.cc:304] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:06.979733 10998 raft_consensus.cc:2804] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.980296 10998 raft_consensus.cc:493] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.979913 10786 raft_consensus.cc:359] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.980712 10998 raft_consensus.cc:3060] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.985348 11053 raft_consensus.cc:2804] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.985787 11053 raft_consensus.cc:493] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.986138 11053 raft_consensus.cc:3060] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.988407 10411 catalog_manager.cc:5697] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.980758 10786 raft_consensus.cc:385] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.991485 10786 raft_consensus.cc:740] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.992514 10786 consensus_queue.cc:260] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:06.999063 10786 ts_tablet_manager.cc:1434] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:04:07.000128 10786 tablet_bootstrap.cc:492] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:06.996775 10888 raft_consensus.cc:493] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.996142 10662 raft_consensus.cc:2468] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:06.996691 11035 consensus_queue.cc:1048] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:04:07.018247 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdad68bdd98451886fae7cb5cb4d10a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:07.008881 10888 raft_consensus.cc:515] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:07.018988 10592 raft_consensus.cc:2468] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:07.019374 10913 raft_consensus.cc:493] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.019905 10913 raft_consensus.cc:515] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:07.020681 10888 leader_election.cc:290] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:07.024101 10913 leader_election.cc:290] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:07.026170 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59be6ff2ab0e47f8b55843170279fc38" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:07.026862 10511 raft_consensus.cc:2468] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 0.
I20260709 13:04:07.026964 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59be6ff2ab0e47f8b55843170279fc38" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:07.040448 10556 leader_election.cc:304] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:07.050016 10789 tablet_bootstrap.cc:654] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:07.059846 10557 leader_election.cc:343] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.057560 10632 leader_election.cc:304] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:07.066758 11057 raft_consensus.cc:2804] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.067166 11057 raft_consensus.cc:493] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.067483 11057 raft_consensus.cc:3060] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.071285 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc85e60ff26b4709aec0629bef9390f6" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:07.071977 10737 raft_consensus.cc:2468] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:07.074275 11053 raft_consensus.cc:515] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
W20260709 13:04:07.085088 10556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 44731.2us
I20260709 13:04:07.085664 10785 tablet_bootstrap.cc:492] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:07.086869 10785 ts_tablet_manager.cc:1403] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.144s	user 0.009s	sys 0.008s
I20260709 13:04:07.087312 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdad68bdd98451886fae7cb5cb4d10a" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:07.088028 11035 raft_consensus.cc:2804] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.088442 11035 raft_consensus.cc:493] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.088759 11035 raft_consensus.cc:3060] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.058736 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdad68bdd98451886fae7cb5cb4d10a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:07.090112 10736 raft_consensus.cc:2393] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
W20260709 13:04:07.087466 11062 log.cc:927] Time spent T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:04:07.091454 10785 raft_consensus.cc:359] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.092172 10785 raft_consensus.cc:385] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.092437 10785 raft_consensus.cc:740] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.089016 10483 leader_election.cc:304] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:07.093199 10785 consensus_queue.cc:260] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.094128 10997 raft_consensus.cc:2804] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.094594 10997 raft_consensus.cc:493] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.094920 10997 raft_consensus.cc:3060] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.096385 11057 raft_consensus.cc:515] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.098412 10666 raft_consensus.cc:2393] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bd6ac4ec789b459bbbfa3d6952103df5 in current term 1: Already voted for candidate 8b82fdd6486e40d180a9d1c7c320e38b in this term.
I20260709 13:04:07.104398 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc85e60ff26b4709aec0629bef9390f6" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:07.106773 11035 raft_consensus.cc:515] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:07.077540 11053 leader_election.cc:290] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:07.128674 10791 tablet_bootstrap.cc:492] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:07.129410 10791 ts_tablet_manager.cc:1403] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.296s	user 0.008s	sys 0.010s
I20260709 13:04:07.109668 10591 raft_consensus.cc:2468] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:07.136108 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdad68bdd98451886fae7cb5cb4d10a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:07.135970 10888 consensus_queue.cc:1048] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.137143 10592 raft_consensus.cc:3060] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.125507 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdad68bdd98451886fae7cb5cb4d10a" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:07.145958 10706 leader_election.cc:304] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:07.150178 10855 raft_consensus.cc:2749] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.150413 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bdad68bdd98451886fae7cb5cb4d10a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:07.151332 10737 raft_consensus.cc:2393] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
I20260709 13:04:07.152827 10706 leader_election.cc:304] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:07.154161 10855 raft_consensus.cc:2804] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.154698 10855 raft_consensus.cc:697] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:07.155576 10855 consensus_queue.cc:237] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.155854 10791 raft_consensus.cc:359] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.156589 10791 raft_consensus.cc:385] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.156908 10791 raft_consensus.cc:740] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.132294 11057 leader_election.cc:290] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:07.157629 10791 consensus_queue.cc:260] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
W20260709 13:04:07.152915 10482 leader_election.cc:343] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.172263 10913 raft_consensus.cc:493] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.173028 10913 raft_consensus.cc:515] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.174391 11035 leader_election.cc:290] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:07.175964 10791 ts_tablet_manager.cc:1434] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:04:07.177023 10791 tablet_bootstrap.cc:492] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:07.179337 10785 ts_tablet_manager.cc:1434] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.092s	user 0.021s	sys 0.035s
I20260709 13:04:07.180372 10785 tablet_bootstrap.cc:492] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:07.182845 10592 raft_consensus.cc:2468] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:07.177484 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59be6ff2ab0e47f8b55843170279fc38" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:07.177397 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79b841e581468e84cf2701211496e9" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:07.204711 10786 tablet_bootstrap.cc:654] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.210865 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59be6ff2ab0e47f8b55843170279fc38" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:07.211941 10511 raft_consensus.cc:3060] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.177896 10893 raft_consensus.cc:493] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.225232 10913 leader_election.cc:290] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:07.205044 10998 raft_consensus.cc:515] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:07.231173 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79b841e581468e84cf2701211496e9" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
W20260709 13:04:07.231446 10557 leader_election.cc:343] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.231966 10591 raft_consensus.cc:2468] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:07.232214 10998 leader_election.cc:290] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:07.233533 10893 raft_consensus.cc:515] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:07.235404 10483 leader_election.cc:304] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:07.235847 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20701090c4f4bd5ba6c754ccbcd41e1" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:07.236497 10591 raft_consensus.cc:3060] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.203116 10997 raft_consensus.cc:515] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:07.240043 10997 leader_election.cc:290] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:07.240536 10997 raft_consensus.cc:2804] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.240928 10997 raft_consensus.cc:493] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.240711 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:07.241298 10997 raft_consensus.cc:3060] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:07.245481 10556 leader_election.cc:343] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:07.247455 10483 leader_election.cc:343] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.254333 10789 tablet_bootstrap.cc:492] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:07.254416 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:07.255004 10789 ts_tablet_manager.cc:1403] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.362s	user 0.014s	sys 0.010s
I20260709 13:04:07.248608 10591 raft_consensus.cc:2468] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:07.249071 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc85e60ff26b4709aec0629bef9390f6" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:07.258617 10736 raft_consensus.cc:3060] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:07.258780 10557 leader_election.cc:343] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.259409 10557 leader_election.cc:304] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:07.264933 11069 raft_consensus.cc:2749] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.235575 10893 leader_election.cc:290] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:07.236451 11070 raft_consensus.cc:493] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.267217 11070 raft_consensus.cc:515] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.270280 11070 leader_election.cc:290] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:07.273479 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:07.275617 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
W20260709 13:04:07.277410 10483 leader_election.cc:343] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.279371 10483 leader_election.cc:304] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:07.257836 10789 raft_consensus.cc:359] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.283711 10785 tablet_bootstrap.cc:654] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.284260 10789 raft_consensus.cc:385] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.284746 10789 raft_consensus.cc:740] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.285447 10789 consensus_queue.cc:260] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.286607 10592 raft_consensus.cc:2468] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:07.290635 10789 ts_tablet_manager.cc:1434] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:04:07.291675 10789 tablet_bootstrap.cc:492] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:07.292886 10791 tablet_bootstrap.cc:654] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.293737 11070 raft_consensus.cc:2804] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.299417 10483 leader_election.cc:304] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:07.300726 11070 raft_consensus.cc:697] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:07.301308 10913 raft_consensus.cc:2804] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.302426 10913 raft_consensus.cc:493] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.302193 11070 consensus_queue.cc:237] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:07.302819 10913 raft_consensus.cc:3060] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.303329 10511 raft_consensus.cc:2468] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:07.306175 10789 tablet_bootstrap.cc:654] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.310827 10556 leader_election.cc:304] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:07.318426 11035 raft_consensus.cc:2804] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.318976 11035 raft_consensus.cc:697] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:07.319901 11035 consensus_queue.cc:237] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:07.301507 10736 raft_consensus.cc:2468] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:07.330186 10997 raft_consensus.cc:515] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.333005 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20701090c4f4bd5ba6c754ccbcd41e1" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:07.336253 10664 raft_consensus.cc:3060] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.337677 10789 tablet_bootstrap.cc:492] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:07.338239 10789 ts_tablet_manager.cc:1403] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.011s
I20260709 13:04:07.340973 10789 raft_consensus.cc:359] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.341651 10789 raft_consensus.cc:385] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.341923 10789 raft_consensus.cc:740] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.342679 10789 consensus_queue.cc:260] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.344712 10789 ts_tablet_manager.cc:1434] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:07.345726 10789 tablet_bootstrap.cc:492] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:07.346413 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc85e60ff26b4709aec0629bef9390f6" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:07.353044 10789 tablet_bootstrap.cc:654] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.359366 10997 leader_election.cc:290] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:07.361690 10791 tablet_bootstrap.cc:492] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:07.361748 10789 tablet_bootstrap.cc:492] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:07.362259 10786 tablet_bootstrap.cc:492] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:07.362471 10791 ts_tablet_manager.cc:1403] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.186s	user 0.030s	sys 0.014s
I20260709 13:04:07.362524 10789 ts_tablet_manager.cc:1403] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.008s
I20260709 13:04:07.362679 10786 ts_tablet_manager.cc:1403] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.363s	user 0.017s	sys 0.010s
I20260709 13:04:07.364827 10913 raft_consensus.cc:515] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.365523 10786 raft_consensus.cc:359] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.365728 10789 raft_consensus.cc:359] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:07.366285 10786 raft_consensus.cc:385] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.366403 10789 raft_consensus.cc:385] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.366608 10786 raft_consensus.cc:740] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.367069 10789 raft_consensus.cc:740] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.366395 10791 raft_consensus.cc:359] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:07.367225 10913 leader_election.cc:290] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:07.367803 10791 raft_consensus.cc:385] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.368410 10791 raft_consensus.cc:740] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.367739 10789 consensus_queue.cc:260] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:07.367699 10786 consensus_queue.cc:260] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.369122 10791 consensus_queue.cc:260] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:07.371490 10786 ts_tablet_manager.cc:1434] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:07.371479 10789 ts_tablet_manager.cc:1434] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:07.372556 10786 tablet_bootstrap.cc:492] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:07.372596 10791 ts_tablet_manager.cc:1434] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:07.372840 10789 tablet_bootstrap.cc:492] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:07.373695 10791 tablet_bootstrap.cc:492] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:07.440847 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79b841e581468e84cf2701211496e9" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:07.470757 11073 raft_consensus.cc:493] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.472249 11073 raft_consensus.cc:515] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.443033 10736 raft_consensus.cc:3060] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.491922 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79b841e581468e84cf2701211496e9" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:07.493057 10592 raft_consensus.cc:3060] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.494763 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:07.495749 10591 raft_consensus.cc:3060] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.496268 11073 leader_election.cc:290] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:07.499922 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:07.509538 10789 tablet_bootstrap.cc:654] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.527321 10632 leader_election.cc:304] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:07.529460 10934 raft_consensus.cc:2804] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.530445 10934 raft_consensus.cc:697] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:07.532474 10934 consensus_queue.cc:237] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.535346 10986 raft_consensus.cc:493] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.536216 10986 raft_consensus.cc:515] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:07.541311 10986 leader_election.cc:290] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:07.545231 10786 tablet_bootstrap.cc:654] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.551941 10855 consensus_queue.cc:1048] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.558954 10411 catalog_manager.cc:5697] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.569763 10664 raft_consensus.cc:2468] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:07.589618 10592 raft_consensus.cc:2468] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:07.597467 11035 raft_consensus.cc:493] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.598181 11035 raft_consensus.cc:515] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:07.608690 11035 leader_election.cc:290] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:07.609537 10785 tablet_bootstrap.cc:492] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:07.610906 10785 ts_tablet_manager.cc:1403] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.431s	user 0.015s	sys 0.002s
I20260709 13:04:07.613967 10791 tablet_bootstrap.cc:654] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.608096 10415 catalog_manager.cc:5697] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.621655 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50643b87db25412f916733ea13f10554" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:07.630769 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50643b87db25412f916733ea13f10554" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:07.631594 10414 catalog_manager.cc:5697] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:07.632848 10557 leader_election.cc:343] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:07.634163 10556 leader_election.cc:343] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:07.634578 10704 consensus_peers.cc:597] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.634652 10556 leader_election.cc:304] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:07.637092 11069 raft_consensus.cc:2749] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.640462 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be358e09d0714fa2bd4ca5cd34df4a29" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:07.641255 10483 leader_election.cc:304] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:07.642096 10740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc85e60ff26b4709aec0629bef9390f6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:07.642575 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be358e09d0714fa2bd4ca5cd34df4a29" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:07.643601 10589 raft_consensus.cc:2468] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:07.647831 10740 raft_consensus.cc:2393] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
W20260709 13:04:07.650164 10482 leader_election.cc:343] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.654753 10997 consensus_queue.cc:1048] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:07.657267 10483 leader_election.cc:343] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.663278 10913 raft_consensus.cc:2804] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.664144 10913 raft_consensus.cc:697] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:07.680699 10913 consensus_queue.cc:237] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:07.702001 10632 leader_election.cc:343] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.707278 10483 leader_election.cc:304] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:07.708292 10785 raft_consensus.cc:359] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:07.709138 10785 raft_consensus.cc:385] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.709427 10785 raft_consensus.cc:740] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.711037 10632 leader_election.cc:304] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:07.717715 11084 consensus_queue.cc:1048] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.721311 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc85e60ff26b4709aec0629bef9390f6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:07.720551 10785 consensus_queue.cc:260] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:07.722600 11085 raft_consensus.cc:2804] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.724190 10986 raft_consensus.cc:2804] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:07.727239 10986 raft_consensus.cc:493] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.727602 10986 raft_consensus.cc:3060] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.728492 10791 tablet_bootstrap.cc:492] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:07.729173 10791 ts_tablet_manager.cc:1403] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.356s	user 0.017s	sys 0.010s
I20260709 13:04:07.730204 10789 tablet_bootstrap.cc:492] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:07.730858 10789 ts_tablet_manager.cc:1403] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.358s	user 0.018s	sys 0.022s
I20260709 13:04:07.732795 10791 raft_consensus.cc:359] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:07.733762 10791 raft_consensus.cc:385] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.734274 10791 raft_consensus.cc:740] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.736008 11085 raft_consensus.cc:697] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:07.740895 11085 consensus_queue.cc:237] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.734045 10789 raft_consensus.cc:359] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.745558 10789 raft_consensus.cc:385] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.745903 10789 raft_consensus.cc:740] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.746682 10789 consensus_queue.cc:260] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.748009 10785 ts_tablet_manager.cc:1434] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.137s	user 0.007s	sys 0.001s
I20260709 13:04:07.764356 10791 consensus_queue.cc:260] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:07.770673 10791 ts_tablet_manager.cc:1434] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.003s
I20260709 13:04:07.771382 10786 tablet_bootstrap.cc:492] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:07.772203 10786 ts_tablet_manager.cc:1403] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.400s	user 0.031s	sys 0.027s
I20260709 13:04:07.772374 10791 tablet_bootstrap.cc:492] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:07.749480 10789 ts_tablet_manager.cc:1434] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:04:07.744899 10591 raft_consensus.cc:2468] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:07.755775 11036 consensus_queue.cc:1048] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.776034 10785 tablet_bootstrap.cc:492] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:07.763149 10630 leader_election.cc:304] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:07.757457 11064 consensus_queue.cc:1048] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.777806 10789 tablet_bootstrap.cc:492] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:07.781911 10934 raft_consensus.cc:3060] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.782131 10786 raft_consensus.cc:359] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.792347 10786 raft_consensus.cc:385] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.792632 10786 raft_consensus.cc:740] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.796442 10483 leader_election.cc:304] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:07.798089 10786 consensus_queue.cc:260] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.803691 10786 ts_tablet_manager.cc:1434] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.002s
I20260709 13:04:07.805274 10786 tablet_bootstrap.cc:492] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
W20260709 13:04:07.805961 10557 consensus_peers.cc:597] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.777100 10921 consensus_queue.cc:1048] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:04:07.814656 10997 raft_consensus.cc:2804] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.815488 10997 raft_consensus.cc:697] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:07.816493 10997 consensus_queue.cc:237] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.818276 10934 raft_consensus.cc:2749] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.809567 10736 raft_consensus.cc:2468] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:07.829727 10986 raft_consensus.cc:515] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.843950 10789 tablet_bootstrap.cc:654] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.857728 10785 tablet_bootstrap.cc:654] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.874823 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be358e09d0714fa2bd4ca5cd34df4a29" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:07.875558 10738 raft_consensus.cc:3060] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.870867 10921 consensus_queue.cc:1048] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:07.881560 10986 leader_election.cc:290] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:07.888605 10786 tablet_bootstrap.cc:654] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.891556 11035 raft_consensus.cc:493] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.896374 11035 raft_consensus.cc:515] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.898779 11035 leader_election.cc:290] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:07.899660 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830eb73bc1564d2bb6e76e82e123c6e6" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:07.900583 10791 tablet_bootstrap.cc:654] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.943001 10738 raft_consensus.cc:2468] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:07.905416 10789 tablet_bootstrap.cc:492] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:07.946530 10789 ts_tablet_manager.cc:1403] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.171s	user 0.022s	sys 0.017s
I20260709 13:04:07.948534 10785 tablet_bootstrap.cc:492] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:07.949047 10785 ts_tablet_manager.cc:1403] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.002s
I20260709 13:04:07.951889 10785 raft_consensus.cc:359] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.952517 10785 raft_consensus.cc:385] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.952792 10785 raft_consensus.cc:740] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.953454 10785 consensus_queue.cc:260] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:07.966977 10785 ts_tablet_manager.cc:1434] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.007s
W20260709 13:04:07.903224 10557 leader_election.cc:343] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.966614 10412 catalog_manager.cc:5697] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.927048 10913 consensus_queue.cc:1048] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.944384 10632 leader_election.cc:304] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:07.909916 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be358e09d0714fa2bd4ca5cd34df4a29" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:07.969008 10785 tablet_bootstrap.cc:492] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:07.901872 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830eb73bc1564d2bb6e76e82e123c6e6" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:07.968804 10986 raft_consensus.cc:2804] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.973246 10986 raft_consensus.cc:697] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:07.959198 10789 raft_consensus.cc:359] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
W20260709 13:04:07.967598 10557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:46191, user_credentials={real_user=slave}} blocked reactor thread for 64417.7us
I20260709 13:04:07.974198 10789 raft_consensus.cc:385] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.983151 10789 raft_consensus.cc:740] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.968915 10589 raft_consensus.cc:3060] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.983448 10934 consensus_queue.cc:1048] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:07.983968 10558 leader_election.cc:343] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:07.984644 10558 leader_election.cc:304] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:07.985504 11035 raft_consensus.cc:2749] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:07.984030 10986 consensus_queue.cc:237] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:07.988634 10785 tablet_bootstrap.cc:654] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.991642 10789 consensus_queue.cc:260] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:08.000996 10789 ts_tablet_manager.cc:1434] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 13:04:08.002348 10789 tablet_bootstrap.cc:492] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:08.006178 10934 raft_consensus.cc:493] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.006860 10934 raft_consensus.cc:515] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.009387 10934 leader_election.cc:290] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:08.010314 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5397c6b857924714a103d579232e1f74" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:08.012712 10632 leader_election.cc:343] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.014585 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5397c6b857924714a103d579232e1f74" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
W20260709 13:04:08.016057 10630 leader_election.cc:343] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.016667 10630 leader_election.cc:304] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:08.017067 10589 raft_consensus.cc:2468] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:08.017827 11073 raft_consensus.cc:2749] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.023597 10786 tablet_bootstrap.cc:492] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:08.024446 10415 catalog_manager.cc:5697] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.028294 10415 catalog_manager.cc:5697] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:08.030228 10415 catalog_manager.cc:5697] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.032181 10791 tablet_bootstrap.cc:492] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:08.032795 10791 ts_tablet_manager.cc:1403] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.261s	user 0.015s	sys 0.001s
I20260709 13:04:08.024260 10786 ts_tablet_manager.cc:1403] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.219s	user 0.019s	sys 0.005s
I20260709 13:04:08.035938 10791 raft_consensus.cc:359] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.037936 10791 raft_consensus.cc:385] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.038334 10791 raft_consensus.cc:740] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.045586 11085 raft_consensus.cc:493] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.046226 11085 raft_consensus.cc:515] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:08.048635 11085 leader_election.cc:290] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:08.049160 10414 catalog_manager.cc:5697] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.050887 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700134865ef74506af01723a1857195d" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:08.058395 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700134865ef74506af01723a1857195d" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:08.060942 10786 raft_consensus.cc:359] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.061713 10786 raft_consensus.cc:385] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.062564 10791 consensus_queue.cc:260] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.065672 10483 leader_election.cc:304] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:08.068301 11084 raft_consensus.cc:2749] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.048732 10789 tablet_bootstrap.cc:654] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.074795 10786 raft_consensus.cc:740] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.084379 10791 ts_tablet_manager.cc:1434] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.001s
W20260709 13:04:08.095054 10462 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:08.097712 10986 consensus_queue.cc:1048] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.077482 10786 consensus_queue.cc:260] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.104740 10786 ts_tablet_manager.cc:1434] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 13:04:08.112986 10786 tablet_bootstrap.cc:492] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:08.130307 10785 tablet_bootstrap.cc:492] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:08.131413 10785 ts_tablet_manager.cc:1403] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.163s	user 0.015s	sys 0.009s
I20260709 13:04:08.136626 10785 raft_consensus.cc:359] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.140241 10785 raft_consensus.cc:385] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.140511 10785 raft_consensus.cc:740] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.139859 10786 tablet_bootstrap.cc:654] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.126327 10791 tablet_bootstrap.cc:492] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:08.146930 10789 tablet_bootstrap.cc:492] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:08.147480 10919 raft_consensus.cc:493] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.147475 10789 ts_tablet_manager.cc:1403] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.145s	user 0.014s	sys 0.000s
I20260709 13:04:08.148015 10919 raft_consensus.cc:515] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.151338 10785 consensus_queue.cc:260] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.152630 10919 leader_election.cc:290] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:08.157100 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5397c6b857924714a103d579232e1f74" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:08.145493 11084 raft_consensus.cc:493] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.158524 11084 raft_consensus.cc:515] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
W20260709 13:04:08.159090 10704 leader_election.cc:343] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.153611 10789 raft_consensus.cc:359] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.160442 10789 raft_consensus.cc:385] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.160486 10785 ts_tablet_manager.cc:1434] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:04:08.160753 11084 leader_election.cc:290] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:08.160930 10789 raft_consensus.cc:740] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.157099 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5397c6b857924714a103d579232e1f74" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:08.162248 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:08.162716 10665 raft_consensus.cc:2468] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:08.164978 10789 consensus_queue.cc:260] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.166785 10705 leader_election.cc:304] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:08.167999 10482 leader_election.cc:343] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.174889 10786 tablet_bootstrap.cc:492] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:08.175355 10786 ts_tablet_manager.cc:1403] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.002s
I20260709 13:04:08.178933 11053 raft_consensus.cc:2804] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.179327 11053 raft_consensus.cc:493] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.179641 11053 raft_consensus.cc:3060] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.179875 10786 raft_consensus.cc:359] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.180606 10786 raft_consensus.cc:385] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.180889 10786 raft_consensus.cc:740] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.181676 10786 consensus_queue.cc:260] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.185025 10665 raft_consensus.cc:3060] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.209216 10791 tablet_bootstrap.cc:654] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.169122 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:08.169785 10785 tablet_bootstrap.cc:492] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:08.171444 11035 raft_consensus.cc:493] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.214913 11035 raft_consensus.cc:515] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.217219 11035 leader_election.cc:290] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:08.218297 10789 ts_tablet_manager.cc:1434] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:04:08.218986 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775092b557874c49bfae75484c568a37" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:08.230288 10789 tablet_bootstrap.cc:492] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:08.221819 10785 tablet_bootstrap.cc:654] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.214964 10589 raft_consensus.cc:2468] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
W20260709 13:04:08.230818 10557 leader_election.cc:343] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.223457 11084 consensus_queue.cc:1048] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.243953 10516 raft_consensus.cc:3060] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.256479 10785 tablet_bootstrap.cc:492] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:08.257139 10785 ts_tablet_manager.cc:1403] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.001s
I20260709 13:04:08.260174 10785 raft_consensus.cc:359] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.260919 10785 raft_consensus.cc:385] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.261202 10785 raft_consensus.cc:740] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.263159 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775092b557874c49bfae75484c568a37" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:08.263926 10483 leader_election.cc:304] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:08.264787 11084 raft_consensus.cc:2804] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.265192 11084 raft_consensus.cc:493] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.265551 11084 raft_consensus.cc:3060] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:08.268591 10558 leader_election.cc:343] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.269338 10558 leader_election.cc:304] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:08.270972 11035 raft_consensus.cc:2749] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.274582 11084 raft_consensus.cc:515] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.284261 11053 raft_consensus.cc:515] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.289347 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5397c6b857924714a103d579232e1f74" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:08.290247 10664 raft_consensus.cc:3060] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.307531 11035 raft_consensus.cc:493] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.308226 11035 raft_consensus.cc:515] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:08.308743 11085 consensus_queue.cc:1048] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.312090 11035 leader_election.cc:290] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:08.314292 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
W20260709 13:04:08.318007 10556 leader_election.cc:343] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.325083 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
W20260709 13:04:08.326870 10482 leader_election.cc:343] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.330881 10921 consensus_queue.cc:1048] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.327656 11084 leader_election.cc:290] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:08.333968 11117 raft_consensus.cc:493] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.334380 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:08.334676 11117 raft_consensus.cc:515] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.335718 10785 consensus_queue.cc:260] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.338271 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dae8a5daed4ae996d7df5a97147747" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:08.338689 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dae8a5daed4ae996d7df5a97147747" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:08.339201 10589 raft_consensus.cc:2468] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:08.341152 10789 tablet_bootstrap.cc:654] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:08.345647 10483 consensus_peers.cc:597] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 -> Peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Couldn't send request to peer bd6ac4ec789b459bbbfa3d6952103df5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:08.340742 10706 leader_election.cc:304] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:08.339349 10664 raft_consensus.cc:2468] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
W20260709 13:04:08.351573 10558 leader_election.cc:343] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.354108 10558 leader_election.cc:304] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:08.356192 11035 raft_consensus.cc:2749] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:08.352967 10705 leader_election.cc:343] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.358752 10919 raft_consensus.cc:2804] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.359308 10919 raft_consensus.cc:493] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.359735 10919 raft_consensus.cc:3060] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.362391 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:08.363068 10589 raft_consensus.cc:3060] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.374519 10785 ts_tablet_manager.cc:1434] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.002s
I20260709 13:04:08.375797 10785 tablet_bootstrap.cc:492] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:08.370504 11084 consensus_queue.cc:1048] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:04:08.340720 11117 leader_election.cc:290] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:08.420946 10786 ts_tablet_manager.cc:1434] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.245s	user 0.062s	sys 0.050s
I20260709 13:04:08.421679 10785 tablet_bootstrap.cc:654] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.419333 11053 leader_election.cc:290] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:08.451336 10786 tablet_bootstrap.cc:492] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:08.451453 10705 leader_election.cc:304] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:08.453454 11118 raft_consensus.cc:2804] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.454003 11118 raft_consensus.cc:697] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:08.454873 11118 consensus_queue.cc:237] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.470383 10791 tablet_bootstrap.cc:492] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:08.471004 10791 ts_tablet_manager.cc:1403] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.351s	user 0.023s	sys 0.028s
I20260709 13:04:08.472245 11085 consensus_queue.cc:1048] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:08.473850 10791 raft_consensus.cc:359] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.474648 10791 raft_consensus.cc:385] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.474943 10791 raft_consensus.cc:740] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.475651 10791 consensus_queue.cc:260] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.477222 10791 ts_tablet_manager.cc:1434] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:08.479362 10791 tablet_bootstrap.cc:492] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:08.485615 10789 tablet_bootstrap.cc:492] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:08.486299 10789 ts_tablet_manager.cc:1403] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.256s	user 0.017s	sys 0.006s
I20260709 13:04:08.489185 10789 raft_consensus.cc:359] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.493680 10789 raft_consensus.cc:385] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.494679 10789 raft_consensus.cc:740] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.491353 10791 tablet_bootstrap.cc:654] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.499538 10786 tablet_bootstrap.cc:654] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.525236 10997 raft_consensus.cc:493] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.525929 10997 raft_consensus.cc:515] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.526432 11069 raft_consensus.cc:493] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.527141 11069 raft_consensus.cc:515] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.528250 10997 leader_election.cc:290] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:08.540427 10789 consensus_queue.cc:260] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.542519 10785 tablet_bootstrap.cc:492] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:08.543241 10785 ts_tablet_manager.cc:1403] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.168s	user 0.022s	sys 0.005s
I20260709 13:04:08.533833 10589 raft_consensus.cc:2468] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:08.511941 10919 raft_consensus.cc:515] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.561654 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5397c6b857924714a103d579232e1f74" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:08.583587 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5397c6b857924714a103d579232e1f74" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:08.582700 10516 raft_consensus.cc:3060] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.584494 10665 raft_consensus.cc:2393] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbba8b78b34443bcb2be4b73f86fac96 in current term 1: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
I20260709 13:04:08.585120 10789 ts_tablet_manager.cc:1434] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.001s
I20260709 13:04:08.586714 10789 tablet_bootstrap.cc:492] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:08.591981 11084 raft_consensus.cc:493] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.597390 10483 leader_election.cc:304] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:08.600644 10785 raft_consensus.cc:359] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.601692 10785 raft_consensus.cc:385] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.602099 10785 raft_consensus.cc:740] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.574476 10934 consensus_queue.cc:1048] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:04:08.608287 10919 leader_election.cc:290] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:08.603199 11085 raft_consensus.cc:2804] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.610932 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:08.599773 11084 raft_consensus.cc:515] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.613539 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dae8a5daed4ae996d7df5a97147747" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:08.614193 10589 raft_consensus.cc:3060] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.614445 11084 leader_election.cc:290] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:08.615198 11069 leader_election.cc:290] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:08.619292 11073 consensus_queue.cc:1048] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:08.622545 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5397c6b857924714a103d579232e1f74" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:08.626943 10516 raft_consensus.cc:2468] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:08.634336 10786 tablet_bootstrap.cc:492] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:08.634842 10786 ts_tablet_manager.cc:1403] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.188s	user 0.016s	sys 0.012s
I20260709 13:04:08.631768 10789 tablet_bootstrap.cc:654] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.634057 10785 consensus_queue.cc:260] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.639675 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244fe231b85a49a9a997bfe10e6e31f5" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:08.642730 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
W20260709 13:04:08.646265 10557 leader_election.cc:343] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.628695 10589 raft_consensus.cc:2468] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:08.666582 10413 catalog_manager.cc:5697] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.651706 11085 raft_consensus.cc:697] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:08.670840 11085 consensus_queue.cc:237] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.672406 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dae8a5daed4ae996d7df5a97147747" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:08.673071 10662 raft_consensus.cc:3060] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.680636 10706 leader_election.cc:304] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:08.682394 10919 raft_consensus.cc:2804] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.682963 10919 raft_consensus.cc:697] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:08.683804 10919 consensus_queue.cc:237] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.690639 10786 raft_consensus.cc:359] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.692541 10786 raft_consensus.cc:385] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.692925 10786 raft_consensus.cc:740] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.703819 10785 ts_tablet_manager.cc:1434] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.160s	user 0.016s	sys 0.000s
W20260709 13:04:08.706493 10483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 43776.7us
I20260709 13:04:08.710325 10786 consensus_queue.cc:260] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:08.696353 10556 leader_election.cc:343] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.714493 10662 raft_consensus.cc:2468] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:08.715026 10556 leader_election.cc:304] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:08.716429 11131 raft_consensus.cc:2749] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.719161 10791 tablet_bootstrap.cc:492] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:08.719560 10786 ts_tablet_manager.cc:1434] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:04:08.719674 10791 ts_tablet_manager.cc:1403] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.242s	user 0.030s	sys 0.009s
I20260709 13:04:08.720762 10786 tablet_bootstrap.cc:492] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:08.722877 10791 raft_consensus.cc:359] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.723537 10791 raft_consensus.cc:385] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.723817 10791 raft_consensus.cc:740] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.724462 10791 consensus_queue.cc:260] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.727919 10785 tablet_bootstrap.cc:492] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:08.732738 10483 leader_election.cc:343] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:08.708441 10482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:46191, user_credentials={real_user=slave}} blocked reactor thread for 95047.5us
I20260709 13:04:08.745591 10482 leader_election.cc:304] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:08.755180 10791 ts_tablet_manager.cc:1434] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:04:08.756873 10791 tablet_bootstrap.cc:492] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:08.762567 10786 tablet_bootstrap.cc:654] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.773006 10785 tablet_bootstrap.cc:654] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.773924 11141 raft_consensus.cc:2749] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.804255 10791 tablet_bootstrap.cc:654] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.810447 10789 tablet_bootstrap.cc:492] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:08.811062 10789 ts_tablet_manager.cc:1403] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.225s	user 0.015s	sys 0.000s
I20260709 13:04:08.819095 11148 raft_consensus.cc:493] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.822382 11148 raft_consensus.cc:515] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.824767 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244fe231b85a49a9a997bfe10e6e31f5" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:08.829094 11073 raft_consensus.cc:493] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.829875 11073 raft_consensus.cc:515] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.831063 10789 raft_consensus.cc:359] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.831782 10789 raft_consensus.cc:385] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.832039 10789 raft_consensus.cc:740] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.832608 10789 consensus_queue.cc:260] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.834842 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:08.838142 11035 raft_consensus.cc:493] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.838413 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:08.838687 11035 raft_consensus.cc:515] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:08.839190 10589 raft_consensus.cc:2393] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:08.841140 11035 leader_election.cc:290] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:08.843251 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247484525e554724a7ec4defcf27b19c" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:08.843856 10789 ts_tablet_manager.cc:1434] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:04:08.845007 10789 tablet_bootstrap.cc:492] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:08.844873 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716d74aced19425b839452e8495dfd2a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:08.845841 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716d74aced19425b839452e8495dfd2a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
W20260709 13:04:08.846434 10557 leader_election.cc:343] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:08.847133 10557 leader_election.cc:343] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.833544 11073 leader_election.cc:290] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:08.867226 10630 leader_election.cc:304] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:08.867337 10556 leader_election.cc:343] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.868258 11073 raft_consensus.cc:3060] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.868263 10556 leader_election.cc:304] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:08.870117 10789 tablet_bootstrap.cc:654] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.870913 11035 raft_consensus.cc:2749] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.877139 11073 raft_consensus.cc:2749] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.881093 10786 tablet_bootstrap.cc:492] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:08.881619 10786 ts_tablet_manager.cc:1403] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.161s	user 0.026s	sys 0.027s
W20260709 13:04:08.882563 10482 leader_election.cc:343] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.884830 10786 raft_consensus.cc:359] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:08.886492 10786 raft_consensus.cc:385] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.886816 10786 raft_consensus.cc:740] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.887140 10482 leader_election.cc:304] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:08.887671 10786 consensus_queue.cc:260] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:08.892373 11148 leader_election.cc:290] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:08.894080 10998 raft_consensus.cc:2749] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.900733 10415 catalog_manager.cc:5697] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.902402 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247484525e554724a7ec4defcf27b19c" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:08.903851 10785 tablet_bootstrap.cc:492] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:08.904371 10785 ts_tablet_manager.cc:1403] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.177s	user 0.025s	sys 0.001s
W20260709 13:04:08.910151 10558 leader_election.cc:343] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.910718 10558 leader_election.cc:304] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:08.911499 10791 tablet_bootstrap.cc:492] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:08.912009 10791 ts_tablet_manager.cc:1403] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.155s	user 0.006s	sys 0.006s
I20260709 13:04:08.913216 11035 raft_consensus.cc:2749] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:08.915086 10791 raft_consensus.cc:359] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.915794 10791 raft_consensus.cc:385] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.916066 10791 raft_consensus.cc:740] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.917527 10785 raft_consensus.cc:359] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.918628 10785 raft_consensus.cc:385] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.918903 10785 raft_consensus.cc:740] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.919593 10785 consensus_queue.cc:260] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:08.921854 10785 ts_tablet_manager.cc:1434] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 13:04:08.922894 10785 tablet_bootstrap.cc:492] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:08.926090 10786 ts_tablet_manager.cc:1434] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.005s
I20260709 13:04:08.927754 10786 tablet_bootstrap.cc:492] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:08.929956 10789 tablet_bootstrap.cc:492] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:08.930498 10789 ts_tablet_manager.cc:1403] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.002s
I20260709 13:04:08.931586 10791 consensus_queue.cc:260] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.932426 11073 raft_consensus.cc:493] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.932253 10919 consensus_queue.cc:1048] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:08.932935 11073 raft_consensus.cc:515] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:08.933341 10789 raft_consensus.cc:359] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:08.934016 10789 raft_consensus.cc:385] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.934306 10789 raft_consensus.cc:740] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.935123 10789 consensus_queue.cc:260] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:08.936578 11073 leader_election.cc:290] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:08.937247 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830eb73bc1564d2bb6e76e82e123c6e6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:08.937918 10589 raft_consensus.cc:2468] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:08.938098 10791 ts_tablet_manager.cc:1434] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
I20260709 13:04:08.939182 10791 tablet_bootstrap.cc:492] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:08.939492 10632 leader_election.cc:304] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:08.941193 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830eb73bc1564d2bb6e76e82e123c6e6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:08.942744 10632 leader_election.cc:343] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.944108 11073 raft_consensus.cc:2804] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.944733 11073 raft_consensus.cc:493] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.945196 11073 raft_consensus.cc:3060] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.950344 10785 tablet_bootstrap.cc:654] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.955875 10786 tablet_bootstrap.cc:654] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.958806 10789 ts_tablet_manager.cc:1434] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 13:04:08.959915 10789 tablet_bootstrap.cc:492] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:08.962770 10791 tablet_bootstrap.cc:654] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.969158 10789 tablet_bootstrap.cc:654] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.970276 11128 consensus_queue.cc:1048] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:08.987399 10413 catalog_manager.cc:5697] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:08.996912 10786 tablet_bootstrap.cc:492] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:08.997493 10786 ts_tablet_manager.cc:1403] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.000s
I20260709 13:04:09.003541 10786 raft_consensus.cc:359] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.004820 11073 raft_consensus.cc:515] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.006045 10791 tablet_bootstrap.cc:492] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:09.006548 10791 ts_tablet_manager.cc:1403] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.012s
I20260709 13:04:09.007771 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830eb73bc1564d2bb6e76e82e123c6e6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:09.008395 10589 raft_consensus.cc:3060] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.009227 10791 raft_consensus.cc:359] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.013983 10789 tablet_bootstrap.cc:492] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:09.004367 10786 raft_consensus.cc:385] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.014564 10789 ts_tablet_manager.cc:1403] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.000s
I20260709 13:04:09.015054 10589 raft_consensus.cc:2468] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:09.016223 10632 leader_election.cc:304] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:09.017007 11149 raft_consensus.cc:2804] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.017457 11149 raft_consensus.cc:697] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:09.014427 10786 raft_consensus.cc:740] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.017650 10789 raft_consensus.cc:359] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.018402 10789 raft_consensus.cc:385] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.018695 10789 raft_consensus.cc:740] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.018522 11149 consensus_queue.cc:237] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.009908 10791 raft_consensus.cc:385] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.020771 10791 raft_consensus.cc:740] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.019248 10786 consensus_queue.cc:260] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.022224 10791 consensus_queue.cc:260] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.026782 10786 ts_tablet_manager.cc:1434] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:04:09.028024 10786 tablet_bootstrap.cc:492] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:09.028672 10789 consensus_queue.cc:260] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.030520 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830eb73bc1564d2bb6e76e82e123c6e6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:09.031265 10738 raft_consensus.cc:3060] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.031738 10785 tablet_bootstrap.cc:492] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:09.032400 10785 ts_tablet_manager.cc:1403] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.110s	user 0.015s	sys 0.006s
I20260709 13:04:09.035387 10785 raft_consensus.cc:359] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.036007 10785 raft_consensus.cc:385] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.036274 10785 raft_consensus.cc:740] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.036557 10786 tablet_bootstrap.cc:654] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.037422 10791 ts_tablet_manager.cc:1434] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:04:09.038800 10791 tablet_bootstrap.cc:492] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:09.039819 10738 raft_consensus.cc:2468] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:09.041762 11073 leader_election.cc:290] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:09.050609 10786 tablet_bootstrap.cc:492] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:09.051201 10786 ts_tablet_manager.cc:1403] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.001s
I20260709 13:04:09.052722 10789 ts_tablet_manager.cc:1434] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.002s
I20260709 13:04:09.053869 10789 tablet_bootstrap.cc:492] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:09.062955 10791 tablet_bootstrap.cc:654] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.062798 10786 raft_consensus.cc:359] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.063743 10786 raft_consensus.cc:385] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.064081 10786 raft_consensus.cc:740] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.064989 10786 consensus_queue.cc:260] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.057917 10785 consensus_queue.cc:260] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.067363 10786 ts_tablet_manager.cc:1434] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:04:09.069741 10786 tablet_bootstrap.cc:492] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:09.071655 10785 ts_tablet_manager.cc:1434] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:04:09.072801 10785 tablet_bootstrap.cc:492] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:09.069373 10412 catalog_manager.cc:5697] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.076313 10789 tablet_bootstrap.cc:654] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.081281 11128 consensus_queue.cc:1048] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.081650 10786 tablet_bootstrap.cc:654] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.082717 10785 tablet_bootstrap.cc:654] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.099692 11142 raft_consensus.cc:493] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.100432 11142 raft_consensus.cc:515] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.103128 11142 leader_election.cc:290] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:09.083603 10791 tablet_bootstrap.cc:492] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:09.087306 10998 consensus_queue.cc:1048] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.112145 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:09.112987 10587 raft_consensus.cc:2468] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:09.114065 10791 ts_tablet_manager.cc:1403] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.001s
I20260709 13:04:09.119366 10483 leader_election.cc:304] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:09.120854 10998 raft_consensus.cc:2804] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.121583 10998 raft_consensus.cc:493] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.121906 10998 raft_consensus.cc:3060] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.123360 10786 tablet_bootstrap.cc:492] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:09.123687 10785 tablet_bootstrap.cc:492] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:09.136097 11142 consensus_queue.cc:1048] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.124318 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:09.138445 10738 raft_consensus.cc:2468] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:09.142364 11118 consensus_queue.cc:1048] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.133275 10791 raft_consensus.cc:359] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.143757 10791 raft_consensus.cc:385] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.136302 10786 ts_tablet_manager.cc:1403] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.006s
I20260709 13:04:09.136510 10785 ts_tablet_manager.cc:1403] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.001s
I20260709 13:04:09.155690 10789 tablet_bootstrap.cc:492] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:09.156292 10789 ts_tablet_manager.cc:1403] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.103s	user 0.005s	sys 0.004s
I20260709 13:04:09.159180 10789 raft_consensus.cc:359] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.159912 10789 raft_consensus.cc:385] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.160180 10789 raft_consensus.cc:740] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.148885 10786 raft_consensus.cc:359] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.160677 10786 raft_consensus.cc:385] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.161005 10786 raft_consensus.cc:740] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.160782 10789 consensus_queue.cc:260] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.161816 10786 consensus_queue.cc:260] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.166896 10786 ts_tablet_manager.cc:1434] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.001s
I20260709 13:04:09.162375 10785 raft_consensus.cc:359] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.168417 10785 raft_consensus.cc:385] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.169633 10785 raft_consensus.cc:740] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.182397 10785 consensus_queue.cc:260] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.172817 10789 ts_tablet_manager.cc:1434] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:04:09.179515 10786 tablet_bootstrap.cc:492] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:09.187543 10789 tablet_bootstrap.cc:492] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:09.187693 10998 raft_consensus.cc:515] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.144063 10791 raft_consensus.cc:740] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.188187 10785 ts_tablet_manager.cc:1434] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:04:09.183032 11142 raft_consensus.cc:493] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.189922 11142 raft_consensus.cc:515] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.190186 10791 consensus_queue.cc:260] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.192155 11142 leader_election.cc:290] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:09.192579 10791 ts_tablet_manager.cc:1434] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:04:09.193956 10786 tablet_bootstrap.cc:654] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.193771 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50643b87db25412f916733ea13f10554" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:09.194516 10666 raft_consensus.cc:2468] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:09.194756 11118 raft_consensus.cc:493] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.195199 10785 tablet_bootstrap.cc:492] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:09.196281 10482 leader_election.cc:304] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:09.197388 11142 raft_consensus.cc:2804] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.197911 11142 raft_consensus.cc:493] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.198264 11142 raft_consensus.cc:3060] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.197420 10998 leader_election.cc:290] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:09.206418 11148 raft_consensus.cc:493] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.207084 11148 raft_consensus.cc:515] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.210713 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6efd752eb04cadb27f38108369d56d" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:09.195333 11118 raft_consensus.cc:515] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:09.212836 10556 leader_election.cc:343] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.213135 10786 tablet_bootstrap.cc:492] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:09.213614 11118 leader_election.cc:290] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:09.214123 10786 ts_tablet_manager.cc:1403] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.003s
I20260709 13:04:09.214478 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244fe231b85a49a9a997bfe10e6e31f5" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:09.215138 10516 raft_consensus.cc:2468] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:09.216442 10704 leader_election.cc:304] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:09.217010 10786 raft_consensus.cc:359] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.217367 11148 leader_election.cc:290] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:09.217716 10786 raft_consensus.cc:385] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.218104 10786 raft_consensus.cc:740] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.219079 10786 consensus_queue.cc:260] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.219892 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6efd752eb04cadb27f38108369d56d" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:09.220578 10738 raft_consensus.cc:2468] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 0.
I20260709 13:04:09.222136 10919 raft_consensus.cc:2804] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.222568 10919 raft_consensus.cc:493] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.222908 10919 raft_consensus.cc:3060] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.224144 10558 leader_election.cc:304] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:09.228659 10789 tablet_bootstrap.cc:654] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.229065 11148 raft_consensus.cc:2804] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.229508 11148 raft_consensus.cc:493] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.230100 11148 raft_consensus.cc:3060] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.230895 10919 raft_consensus.cc:515] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.233716 10786 ts_tablet_manager.cc:1434] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:04:09.234776 10786 tablet_bootstrap.cc:492] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:09.239236 10785 tablet_bootstrap.cc:654] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.249073 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244fe231b85a49a9a997bfe10e6e31f5" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:09.260910 10666 raft_consensus.cc:2468] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:09.249325 11140 raft_consensus.cc:493] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.261981 11140 raft_consensus.cc:515] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.250371 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244fe231b85a49a9a997bfe10e6e31f5" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:09.253677 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50643b87db25412f916733ea13f10554" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:09.264429 10662 raft_consensus.cc:3060] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.264504 10592 raft_consensus.cc:2468] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:09.254768 10919 leader_election.cc:290] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:09.255781 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "244fe231b85a49a9a997bfe10e6e31f5" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:09.265843 10516 raft_consensus.cc:3060] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.258786 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:09.266793 10738 raft_consensus.cc:3060] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.258987 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:09.270296 10589 raft_consensus.cc:3060] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.270464 11140 leader_election.cc:290] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
W20260709 13:04:09.270635 10462 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:09.273669 10786 tablet_bootstrap.cc:654] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.274729 10662 raft_consensus.cc:2468] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:09.275818 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e8b005258a4a419135d144d4674208" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:09.277563 10738 raft_consensus.cc:2468] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
W20260709 13:04:09.285696 10482 leader_election.cc:343] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.280936 10589 raft_consensus.cc:2468] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:09.287874 10705 leader_election.cc:304] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:09.288662 11118 raft_consensus.cc:2804] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.289162 11118 raft_consensus.cc:697] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:09.290360 10789 tablet_bootstrap.cc:492] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:09.290055 11118 consensus_queue.cc:237] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.291479 10789 ts_tablet_manager.cc:1403] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.016s
I20260709 13:04:09.295125 10789 raft_consensus.cc:359] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.296463 10789 raft_consensus.cc:385] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.297144 10789 raft_consensus.cc:740] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.257464 11148 raft_consensus.cc:515] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.298373 10789 consensus_queue.cc:260] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.300973 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6efd752eb04cadb27f38108369d56d" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:09.301599 10737 raft_consensus.cc:3060] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.301003 10786 tablet_bootstrap.cc:492] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:09.303185 10786 ts_tablet_manager.cc:1403] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.000s
I20260709 13:04:09.303414 10789 ts_tablet_manager.cc:1434] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:09.304704 10919 raft_consensus.cc:493] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.305280 10919 raft_consensus.cc:515] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.307557 10919 leader_election.cc:290] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:09.308218 10789 tablet_bootstrap.cc:492] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb: Bootstrap starting.
I20260709 13:04:09.308530 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:09.310711 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:09.312839 10706 leader_election.cc:304] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:09.313910 10919 raft_consensus.cc:2749] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.314803 10789 tablet_bootstrap.cc:654] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.318619 10786 raft_consensus.cc:359] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.319347 10786 raft_consensus.cc:385] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.319612 10786 raft_consensus.cc:740] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.320415 10786 consensus_queue.cc:260] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.327521 10786 ts_tablet_manager.cc:1434] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:04:09.339231 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6efd752eb04cadb27f38108369d56d" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
W20260709 13:04:09.340987 10556 leader_election.cc:343] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.342784 11148 leader_election.cc:290] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:09.343674 10786 tablet_bootstrap.cc:492] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:09.345439 10789 tablet_bootstrap.cc:492] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb: No bootstrap required, opened a new log
I20260709 13:04:09.346086 10789 ts_tablet_manager.cc:1403] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.014s
I20260709 13:04:09.349359 10789 raft_consensus.cc:359] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.350183 10789 raft_consensus.cc:385] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.350531 10789 raft_consensus.cc:740] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.351426 10789 consensus_queue.cc:260] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.355017 11035 raft_consensus.cc:493] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.355473 11035 raft_consensus.cc:515] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.357517 11035 leader_election.cc:290] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:09.359385 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d84f52b275445629ba8545f2f1f3773" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:09.359509 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d84f52b275445629ba8545f2f1f3773" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:09.361037 10556 leader_election.cc:343] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:09.361526 10558 leader_election.cc:343] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.361991 10558 leader_election.cc:304] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:09.362264 10789 ts_tablet_manager.cc:1434] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:04:09.362890 11035 raft_consensus.cc:2749] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.370864 10516 raft_consensus.cc:2468] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:09.376294 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e8b005258a4a419135d144d4674208" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:09.376952 10738 raft_consensus.cc:2468] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:09.376294 11142 raft_consensus.cc:515] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.379191 11035 raft_consensus.cc:493] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.379758 11035 raft_consensus.cc:515] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.381992 11035 leader_election.cc:290] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:09.383638 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ec17bb1b33495d9caa05a15cbd16e4" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:09.382510 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50643b87db25412f916733ea13f10554" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:09.384939 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ec17bb1b33495d9caa05a15cbd16e4" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:09.383152 11142 leader_election.cc:290] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:09.385277 10662 raft_consensus.cc:3060] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:09.386374 10558 leader_election.cc:343] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:09.388518 10557 leader_election.cc:343] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.388670 11142 raft_consensus.cc:493] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.388923 10557 leader_election.cc:304] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:09.390412 10483 leader_election.cc:304] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:09.391038 11035 raft_consensus.cc:2749] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.392076 10921 raft_consensus.cc:2804] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.392756 10483 leader_election.cc:304] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:09.393491 11140 raft_consensus.cc:2804] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.393846 11140 raft_consensus.cc:493] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.394205 11140 raft_consensus.cc:3060] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.394222 10921 raft_consensus.cc:697] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:09.395494 10921 consensus_queue.cc:237] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.397173 10791 tablet_bootstrap.cc:492] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:09.403302 10786 tablet_bootstrap.cc:654] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.407956 10738 raft_consensus.cc:3060] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.412735 10413 catalog_manager.cc:5697] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.418128 10737 raft_consensus.cc:2468] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:09.389235 11142 raft_consensus.cc:515] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.405511 11140 raft_consensus.cc:515] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.423478 10558 leader_election.cc:304] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:09.420406 11131 raft_consensus.cc:493] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.400520 10662 raft_consensus.cc:2468] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:09.447096 10482 leader_election.cc:304] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:09.439229 11131 raft_consensus.cc:515] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.449733 10921 raft_consensus.cc:2804] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.450244 11131 leader_election.cc:290] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:09.450264 10921 raft_consensus.cc:697] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:09.450860 11131 raft_consensus.cc:2804] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.459281 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50643b87db25412f916733ea13f10554" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:09.459945 10589 raft_consensus.cc:3060] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.460733 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8dbc2680fd461c836d48a8f8692e50" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
W20260709 13:04:09.462563 10557 leader_election.cc:343] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.458829 11149 consensus_queue.cc:1048] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:09.459930 11131 raft_consensus.cc:697] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:09.467758 11131 consensus_queue.cc:237] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.473450 10589 raft_consensus.cc:2468] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:09.482278 10919 raft_consensus.cc:493] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.482867 10919 raft_consensus.cc:515] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.485044 10919 leader_election.cc:290] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:09.486114 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775092b557874c49bfae75484c568a37" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:09.486474 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:09.487314 10589 raft_consensus.cc:2468] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
W20260709 13:04:09.487600 10705 leader_election.cc:343] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.488632 10791 tablet_bootstrap.cc:654] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.490049 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775092b557874c49bfae75484c568a37" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:09.451931 10921 consensus_queue.cc:237] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.476498 10411 catalog_manager.cc:5697] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.499478 10592 raft_consensus.cc:2468] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:09.499881 10786 tablet_bootstrap.cc:492] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:09.500571 10786 ts_tablet_manager.cc:1403] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.157s	user 0.016s	sys 0.011s
I20260709 13:04:09.503180 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:09.503468 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e8b005258a4a419135d144d4674208" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
W20260709 13:04:09.504662 10482 leader_election.cc:343] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.508247 10785 tablet_bootstrap.cc:492] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
W20260709 13:04:09.510128 10482 leader_election.cc:343] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.512094 10786 raft_consensus.cc:359] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.512812 10786 raft_consensus.cc:385] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.513060 10786 raft_consensus.cc:740] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.509095 10785 ts_tablet_manager.cc:1403] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.315s	user 0.030s	sys 0.024s
I20260709 13:04:09.508800 10706 leader_election.cc:304] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:09.515740 10919 raft_consensus.cc:2804] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.516101 10919 raft_consensus.cc:493] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.516440 10919 raft_consensus.cc:3060] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.501415 11142 leader_election.cc:290] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:09.513710 10786 consensus_queue.cc:260] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.522982 10785 raft_consensus.cc:359] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.523690 10785 raft_consensus.cc:385] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.523931 10785 raft_consensus.cc:740] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.524688 10934 consensus_queue.cc:1048] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.524700 11140 leader_election.cc:290] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:09.528126 10919 raft_consensus.cc:515] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
W20260709 13:04:09.529348 10483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 75735.4us
I20260709 13:04:09.524513 10785 consensus_queue.cc:260] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.542660 10919 leader_election.cc:290] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:09.548056 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775092b557874c49bfae75484c568a37" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:09.548746 10587 raft_consensus.cc:3060] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.548774 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775092b557874c49bfae75484c568a37" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:09.549062 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e8b005258a4a419135d144d4674208" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:09.549551 10738 raft_consensus.cc:3060] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:09.550297 10705 leader_election.cc:343] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.555401 10587 raft_consensus.cc:2468] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:09.556155 10791 tablet_bootstrap.cc:492] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:09.556651 10791 ts_tablet_manager.cc:1403] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.160s	user 0.018s	sys 0.003s
I20260709 13:04:09.558885 10738 raft_consensus.cc:2468] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:09.559721 10785 ts_tablet_manager.cc:1434] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:04:09.562920 10786 ts_tablet_manager.cc:1434] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.062s	user 0.002s	sys 0.005s
I20260709 13:04:09.564008 10706 leader_election.cc:304] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:09.566184 11128 raft_consensus.cc:2804] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.566874 11128 raft_consensus.cc:697] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:09.568214 11128 consensus_queue.cc:237] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.580672 10483 leader_election.cc:304] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:09.588047 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8dbc2680fd461c836d48a8f8692e50" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:09.590108 11142 raft_consensus.cc:2804] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.587531 10483 leader_election.cc:304] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:09.593322 11189 raft_consensus.cc:2804] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.594051 11189 raft_consensus.cc:697] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:09.594889 11189 consensus_queue.cc:237] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.591120 11142 raft_consensus.cc:493] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.600805 10786 tablet_bootstrap.cc:492] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:09.604355 11142 raft_consensus.cc:3060] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:09.619581 10556 leader_election.cc:343] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.620448 10556 leader_election.cc:304] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:09.621260 11184 raft_consensus.cc:2749] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.625765 10786 tablet_bootstrap.cc:654] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:09.628180 11181 log.cc:927] Time spent T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96: Append to log took a long time: real 0.155s	user 0.004s	sys 0.000s
I20260709 13:04:09.666280 11131 raft_consensus.cc:493] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.666873 11131 raft_consensus.cc:515] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.668816 10411 catalog_manager.cc:5697] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.673600 11128 consensus_queue.cc:1048] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.679569 10786 tablet_bootstrap.cc:492] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:09.680097 10786 ts_tablet_manager.cc:1403] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.032s
I20260709 13:04:09.687469 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fe36fcadfd4768a963dc396271497c" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:09.691488 10785 tablet_bootstrap.cc:492] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:09.691766 10558 leader_election.cc:343] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.697161 11142 raft_consensus.cc:515] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.699613 10791 raft_consensus.cc:359] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.700547 10791 raft_consensus.cc:385] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.700836 10791 raft_consensus.cc:740] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.706555 10919 consensus_queue.cc:1048] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.707371 10413 catalog_manager.cc:5697] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.709319 11131 leader_election.cc:290] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:09.710265 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fe36fcadfd4768a963dc396271497c" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
W20260709 13:04:09.711664 10556 leader_election.cc:343] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.712177 10556 leader_election.cc:304] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:09.715730 11131 raft_consensus.cc:2749] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.701602 10791 consensus_queue.cc:260] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.719522 11149 raft_consensus.cc:493] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.689127 10786 raft_consensus.cc:359] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.720053 10786 raft_consensus.cc:385] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.720647 10786 raft_consensus.cc:740] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.720546 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:09.721263 10592 raft_consensus.cc:3060] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.705763 10411 catalog_manager.cc:5697] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.721446 10786 consensus_queue.cc:260] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.722707 10785 tablet_bootstrap.cc:654] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.723131 10786 ts_tablet_manager.cc:1434] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:04:09.724114 10786 tablet_bootstrap.cc:492] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:09.720005 11149 raft_consensus.cc:515] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.727694 11149 leader_election.cc:290] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:09.729578 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:09.730329 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:09.731026 10664 raft_consensus.cc:3060] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.731616 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:09.732663 10516 raft_consensus.cc:2393] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:09.733623 10630 leader_election.cc:304] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:09.736234 11142 leader_election.cc:290] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:09.750922 10785 tablet_bootstrap.cc:492] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:09.751421 10785 ts_tablet_manager.cc:1403] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.171s	user 0.012s	sys 0.000s
I20260709 13:04:09.751616 10786 tablet_bootstrap.cc:654] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.756711 10785 raft_consensus.cc:359] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.757526 10785 raft_consensus.cc:385] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.757846 10785 raft_consensus.cc:740] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.758679 10785 consensus_queue.cc:260] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.765237 10785 ts_tablet_manager.cc:1434] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:09.766260 10785 tablet_bootstrap.cc:492] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:09.772884 10592 raft_consensus.cc:2468] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:09.774415 10483 leader_election.cc:304] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:09.775313 11189 raft_consensus.cc:2804] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:09.775885 11189 raft_consensus.cc:697] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:09.776165 10413 catalog_manager.cc:5697] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.787449 10785 tablet_bootstrap.cc:654] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.777271 11189 consensus_queue.cc:237] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.808059 10664 raft_consensus.cc:2468] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:09.804652 11128 raft_consensus.cc:493] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.809412 11128 raft_consensus.cc:515] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:09.811368 10791 ts_tablet_manager.cc:1434] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.254s	user 0.009s	sys 0.001s
I20260709 13:04:09.812458 10791 tablet_bootstrap.cc:492] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:09.813618 11149 raft_consensus.cc:2749] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:09.815105 10786 tablet_bootstrap.cc:492] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:09.815651 10786 ts_tablet_manager.cc:1403] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.092s	user 0.018s	sys 0.029s
I20260709 13:04:09.821687 11128 leader_election.cc:290] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:09.823611 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e3368943d24f409949b4a22082867d" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:09.824375 10511 raft_consensus.cc:2468] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:09.829036 10921 consensus_queue.cc:1048] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.830917 10786 raft_consensus.cc:359] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.834748 10786 raft_consensus.cc:385] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.835381 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e3368943d24f409949b4a22082867d" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:09.836180 10786 raft_consensus.cc:740] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.838466 10791 tablet_bootstrap.cc:654] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.837561 10786 consensus_queue.cc:260] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.842571 10786 ts_tablet_manager.cc:1434] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.003s
I20260709 13:04:09.846923 10786 tablet_bootstrap.cc:492] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:09.854573 10786 tablet_bootstrap.cc:654] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.832587 10704 leader_election.cc:304] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:09.845670 10785 tablet_bootstrap.cc:492] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:09.855710 10785 ts_tablet_manager.cc:1403] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.003s
W20260709 13:04:09.856036 10705 leader_election.cc:343] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.856971 10919 raft_consensus.cc:2804] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.857414 10919 raft_consensus.cc:493] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.857761 10919 raft_consensus.cc:3060] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.861016 10785 raft_consensus.cc:359] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.868389 10785 raft_consensus.cc:385] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.868774 10785 raft_consensus.cc:740] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.869171 11118 raft_consensus.cc:493] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.869690 11118 raft_consensus.cc:515] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.871845 11118 leader_election.cc:290] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:09.870020 10785 consensus_queue.cc:260] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:09.867146 10411 catalog_manager.cc:5697] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.873687 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d84f52b275445629ba8545f2f1f3773" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:09.879619 10785 ts_tablet_manager.cc:1434] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:04:09.885648 10511 raft_consensus.cc:3060] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.886902 11118 raft_consensus.cc:493] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.887434 11118 raft_consensus.cc:515] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.887815 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d84f52b275445629ba8545f2f1f3773" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:09.888661 10587 raft_consensus.cc:2468] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:09.889658 11118 leader_election.cc:290] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:09.891296 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247484525e554724a7ec4defcf27b19c" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
W20260709 13:04:09.892719 10705 leader_election.cc:343] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.895768 11131 consensus_queue.cc:1048] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.895910 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247484525e554724a7ec4defcf27b19c" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:09.896262 10785 tablet_bootstrap.cc:492] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:09.896620 10592 raft_consensus.cc:2468] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
W20260709 13:04:09.877672 10704 leader_election.cc:343] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.898168 10706 leader_election.cc:304] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:09.899446 10706 leader_election.cc:304] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:09.900246 11118 raft_consensus.cc:2804] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.900640 11118 raft_consensus.cc:493] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.901427 11118 raft_consensus.cc:3060] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.901906 11117 raft_consensus.cc:2804] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:09.906214 11117 raft_consensus.cc:493] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.906617 11117 raft_consensus.cc:3060] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.927688 11117 raft_consensus.cc:515] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.930047 11117 leader_election.cc:290] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:09.934468 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247484525e554724a7ec4defcf27b19c" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
W20260709 13:04:09.938949 10705 leader_election.cc:343] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.924160 11118 raft_consensus.cc:515] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.940663 10786 tablet_bootstrap.cc:492] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:09.941256 10786 ts_tablet_manager.cc:1403] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.000s
I20260709 13:04:09.940970 11189 consensus_queue.cc:1048] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.944689 11118 leader_election.cc:290] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:09.945508 10511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d84f52b275445629ba8545f2f1f3773" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
W20260709 13:04:09.947252 10704 leader_election.cc:343] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:09.949725 10785 tablet_bootstrap.cc:654] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.952709 11131 consensus_queue.cc:1048] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.950662 10786 raft_consensus.cc:359] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.954156 10786 raft_consensus.cc:385] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.954605 10786 raft_consensus.cc:740] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.955495 10786 consensus_queue.cc:260] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:09.958338 10786 ts_tablet_manager.cc:1434] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:04:09.959744 10786 tablet_bootstrap.cc:492] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:09.959993 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247484525e554724a7ec4defcf27b19c" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:09.961040 10587 raft_consensus.cc:3060] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.971184 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d84f52b275445629ba8545f2f1f3773" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:09.971889 10592 raft_consensus.cc:3060] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:09.974570 10785 tablet_bootstrap.cc:492] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:09.975184 10785 ts_tablet_manager.cc:1403] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.005s
I20260709 13:04:09.980342 10785 raft_consensus.cc:359] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.981094 10785 raft_consensus.cc:385] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:09.981976 10785 raft_consensus.cc:740] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:09.981689 10786 tablet_bootstrap.cc:654] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:09.985417 10785 consensus_queue.cc:260] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.991631 10785 ts_tablet_manager.cc:1434] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:04:09.995568 10786 tablet_bootstrap.cc:492] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:09.996201 10786 ts_tablet_manager.cc:1403] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:04:09.999109 10786 raft_consensus.cc:359] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:09.999953 10786 raft_consensus.cc:385] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.000288 10786 raft_consensus.cc:740] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.001107 10786 consensus_queue.cc:260] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:10.003492 10786 ts_tablet_manager.cc:1434] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:10.004534 10786 tablet_bootstrap.cc:492] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:10.008237 11118 raft_consensus.cc:493] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.008819 11118 raft_consensus.cc:515] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:10.011080 11118 leader_election.cc:290] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:10.014707 10786 tablet_bootstrap.cc:654] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.014590 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fe36fcadfd4768a963dc396271497c" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
W20260709 13:04:10.015043 10705 consensus_peers.cc:597] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:10.019059 10704 leader_election.cc:343] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.039348 10786 tablet_bootstrap.cc:492] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:10.039938 10786 ts_tablet_manager.cc:1403] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.008s
I20260709 13:04:10.042949 10786 raft_consensus.cc:359] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.043730 10786 raft_consensus.cc:385] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.044005 10786 raft_consensus.cc:740] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.044799 10786 consensus_queue.cc:260] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.048169 10786 ts_tablet_manager.cc:1434] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:04:10.049237 10786 tablet_bootstrap.cc:492] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5: Bootstrap starting.
I20260709 13:04:10.058385 10786 tablet_bootstrap.cc:654] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.072654 10786 tablet_bootstrap.cc:492] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5: No bootstrap required, opened a new log
I20260709 13:04:10.073216 10786 ts_tablet_manager.cc:1403] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.002s
I20260709 13:04:10.081045 10786 raft_consensus.cc:359] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.081812 10786 raft_consensus.cc:385] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.082158 10786 raft_consensus.cc:740] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.082845 10786 consensus_queue.cc:260] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.091996 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fe36fcadfd4768a963dc396271497c" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:10.093000 10589 raft_consensus.cc:2468] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:10.095350 10786 ts_tablet_manager.cc:1434] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:04:10.097206 10785 tablet_bootstrap.cc:492] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:10.103538 10785 tablet_bootstrap.cc:654] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.109257 10587 raft_consensus.cc:2468] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
W20260709 13:04:10.114364 10482 consensus_peers.cc:597] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.143836 11186 consensus_queue.cc:1048] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:10.066107 10919 raft_consensus.cc:515] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.174225 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e3368943d24f409949b4a22082867d" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
W20260709 13:04:10.175683 10705 leader_election.cc:343] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.177479 10998 raft_consensus.cc:493] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.178122 10998 raft_consensus.cc:515] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:10.180266 10998 leader_election.cc:290] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:10.183207 10592 raft_consensus.cc:2468] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:10.184003 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716d74aced19425b839452e8495dfd2a" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
W20260709 13:04:10.185475 10482 leader_election.cc:343] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.186472 10791 tablet_bootstrap.cc:492] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:10.187580 10791 ts_tablet_manager.cc:1403] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.375s	user 0.073s	sys 0.152s
I20260709 13:04:10.191562 10791 raft_consensus.cc:359] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.192560 10791 raft_consensus.cc:385] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.192955 10791 raft_consensus.cc:740] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.194018 10791 consensus_queue.cc:260] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.203722 10791 ts_tablet_manager.cc:1434] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:04:10.206120 10791 tablet_bootstrap.cc:492] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:10.211570 11216 raft_consensus.cc:493] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.212342 11216 raft_consensus.cc:515] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
W20260709 13:04:10.224752 10483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 62839.6us
I20260709 13:04:10.132323 10706 leader_election.cc:304] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:10.233026 10919 leader_election.cc:290] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
W20260709 13:04:10.238117 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 106305us
I20260709 13:04:10.238763 11117 raft_consensus.cc:2804] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.240267 10706 leader_election.cc:304] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:10.239352 11117 raft_consensus.cc:493] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.241184 11117 raft_consensus.cc:3060] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.242424 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e3368943d24f409949b4a22082867d" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:10.243206 10516 raft_consensus.cc:3060] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.238855 10998 consensus_queue.cc:1048] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:04:10.254980 10919 raft_consensus.cc:2804] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.255577 10919 raft_consensus.cc:697] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:10.256498 10919 consensus_queue.cc:237] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:10.263767 10516 raft_consensus.cc:2468] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:10.271414 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716d74aced19425b839452e8495dfd2a" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:10.272111 10592 raft_consensus.cc:2468] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:10.289991 10785 tablet_bootstrap.cc:492] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:10.290584 10785 ts_tablet_manager.cc:1403] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.194s	user 0.031s	sys 0.061s
I20260709 13:04:10.292490 11117 raft_consensus.cc:515] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:10.301460 11216 leader_election.cc:290] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:10.300450 10704 leader_election.cc:304] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:10.316911 10791 tablet_bootstrap.cc:654] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.336035 10919 raft_consensus.cc:493] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.336614 10919 raft_consensus.cc:515] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.351262 10785 raft_consensus.cc:359] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:10.352322 10785 raft_consensus.cc:385] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.352677 10785 raft_consensus.cc:740] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.356993 10785 consensus_queue.cc:260] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:10.350726 11225 raft_consensus.cc:2804] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.356254 11117 leader_election.cc:290] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:10.378321 10919 leader_election.cc:290] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:10.365108 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d84f52b275445629ba8545f2f1f3773" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
W20260709 13:04:10.368822 10704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 81429.9us
I20260709 13:04:10.380733 10785 ts_tablet_manager.cc:1434] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.090s	user 0.002s	sys 0.007s
I20260709 13:04:10.381409 10921 consensus_queue.cc:1048] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:10.377156 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 137003us
I20260709 13:04:10.400628 10706 leader_election.cc:304] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:10.404292 10919 raft_consensus.cc:2804] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.404904 10919 raft_consensus.cc:697] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:10.405855 10919 consensus_queue.cc:237] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:10.395987 11225 raft_consensus.cc:697] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:10.430796 10785 tablet_bootstrap.cc:492] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:10.428638 10587 raft_consensus.cc:2393] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbba8b78b34443bcb2be4b73f86fac96 in current term 1: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
W20260709 13:04:10.438467 10462 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:10.449673 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fe36fcadfd4768a963dc396271497c" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:10.450582 10592 raft_consensus.cc:3060] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.453465 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fe36fcadfd4768a963dc396271497c" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
W20260709 13:04:10.457969 10483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 123722us
I20260709 13:04:10.469696 10592 raft_consensus.cc:2468] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:10.451756 10934 raft_consensus.cc:493] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.453994 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7af85d78c0c41aeb882be10181161bf" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:10.479347 10483 leader_election.cc:304] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:10.477917 10934 raft_consensus.cc:515] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.483588 11225 consensus_queue.cc:237] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.519181 10934 leader_election.cc:290] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:10.514242 10998 raft_consensus.cc:2804] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.521836 10998 raft_consensus.cc:493] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.522235 10998 raft_consensus.cc:3060] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.524375 11237 raft_consensus.cc:493] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.524967 11237 raft_consensus.cc:515] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
W20260709 13:04:10.526815 10704 leader_election.cc:343] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.527801 11237 leader_election.cc:290] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:10.501489 11117 raft_consensus.cc:493] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.534385 11117 raft_consensus.cc:515] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.536983 10516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7af85d78c0c41aeb882be10181161bf" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:10.541769 10785 tablet_bootstrap.cc:654] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:10.546932 10705 leader_election.cc:343] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.548653 11117 leader_election.cc:290] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:10.591714 10791 tablet_bootstrap.cc:492] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:10.592267 10791 ts_tablet_manager.cc:1403] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.386s	user 0.039s	sys 0.032s
I20260709 13:04:10.596138 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e8b005258a4a419135d144d4674208" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:10.596940 10737 raft_consensus.cc:2393] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate cbba8b78b34443bcb2be4b73f86fac96 in this term.
I20260709 13:04:10.600258 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d84f52b275445629ba8545f2f1f3773" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:10.602223 10706 leader_election.cc:304] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:10.603623 10919 raft_consensus.cc:2804] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.604089 10919 raft_consensus.cc:697] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:10.612643 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ec17bb1b33495d9caa05a15cbd16e4" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:10.604717 10919 consensus_queue.cc:237] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:10.610988 10998 raft_consensus.cc:515] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:10.626350 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ec17bb1b33495d9caa05a15cbd16e4" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:10.611882 11228 consensus_queue.cc:1048] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:04:10.635679 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99676c8e7e874fe98cb48b3d570c6275" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:10.622385 11128 consensus_queue.cc:1048] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 13:04:10.640133 10705 leader_election.cc:343] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.640924 10791 raft_consensus.cc:359] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.641607 10791 raft_consensus.cc:385] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.632809 10998 leader_election.cc:290] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:10.641875 10791 raft_consensus.cc:740] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.632797 10587 raft_consensus.cc:2468] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 0.
I20260709 13:04:10.650833 10785 tablet_bootstrap.cc:492] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:10.651598 10785 ts_tablet_manager.cc:1403] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.255s	user 0.021s	sys 0.026s
I20260709 13:04:10.652537 10706 leader_election.cc:304] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:10.653298 11117 raft_consensus.cc:2804] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.653650 11117 raft_consensus.cc:493] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.653968 11117 raft_consensus.cc:3060] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.657733 10791 consensus_queue.cc:260] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.659900 10791 ts_tablet_manager.cc:1434] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 13:04:10.661381 10791 tablet_bootstrap.cc:492] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:10.665565 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716d74aced19425b839452e8495dfd2a" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
W20260709 13:04:10.668444 10482 leader_election.cc:343] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.677201 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99676c8e7e874fe98cb48b3d570c6275" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:10.679281 10785 raft_consensus.cc:359] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.679864 10785 raft_consensus.cc:385] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.680088 10785 raft_consensus.cc:740] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.680594 10785 consensus_queue.cc:260] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.678774 10411 catalog_manager.cc:5697] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:10.705199 10483 leader_election.cc:304] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:10.708501 10785 ts_tablet_manager.cc:1434] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:04:10.736817 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716d74aced19425b839452e8495dfd2a" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:10.737633 10585 raft_consensus.cc:3060] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.739640 10517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e8b005258a4a419135d144d4674208" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:10.721460 11234 raft_consensus.cc:3060] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.741536 11216 raft_consensus.cc:493] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.742326 11216 raft_consensus.cc:515] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:10.744416 11216 leader_election.cc:290] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:10.746785 10662 raft_consensus.cc:3060] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.748044 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8dbc2680fd461c836d48a8f8692e50" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
W20260709 13:04:10.751748 10482 leader_election.cc:343] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.754001 10785 tablet_bootstrap.cc:492] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:10.719828 10704 leader_election.cc:343] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.765872 11227 consensus_queue.cc:1048] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:10.773295 10919 consensus_queue.cc:1048] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:10.762291 10704 leader_election.cc:304] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:10.779026 10704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 60385.1us
I20260709 13:04:10.780037 11239 raft_consensus.cc:2749] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.781569 11142 raft_consensus.cc:493] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.782155 11142 raft_consensus.cc:515] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:10.782636 10704 leader_election.cc:343] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.790709 10791 tablet_bootstrap.cc:654] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.800966 10630 leader_election.cc:304] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:10.802001 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8dbc2680fd461c836d48a8f8692e50" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:10.802867 10590 raft_consensus.cc:2468] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:10.805100 10483 leader_election.cc:304] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:10.814237 11216 raft_consensus.cc:2804] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.817440 11216 raft_consensus.cc:493] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.817816 11216 raft_consensus.cc:3060] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.821163 11234 raft_consensus.cc:2749] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:10.835875 10705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:46191, user_credentials={real_user=slave}} blocked reactor thread for 191574us
I20260709 13:04:10.838304 11216 raft_consensus.cc:515] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:10.840608 11216 leader_election.cc:290] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:10.799501 11117 raft_consensus.cc:515] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:10.843393 11117 leader_election.cc:290] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:10.833755 10585 raft_consensus.cc:2468] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:10.859465 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99676c8e7e874fe98cb48b3d570c6275" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:10.870441 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8dbc2680fd461c836d48a8f8692e50" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:10.871049 10589 raft_consensus.cc:3060] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.845971 11142 leader_election.cc:290] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
W20260709 13:04:10.873221 10705 leader_election.cc:343] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.873677 10705 leader_election.cc:304] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:10.875522 10482 leader_election.cc:343] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.875623 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8dbc2680fd461c836d48a8f8692e50" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:10.874233 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99676c8e7e874fe98cb48b3d570c6275" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:10.877942 10736 raft_consensus.cc:2468] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 0.
I20260709 13:04:10.880792 10483 leader_election.cc:304] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
W20260709 13:04:10.885676 10482 leader_election.cc:343] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:10.896618 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ec17bb1b33495d9caa05a15cbd16e4" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:10.900156 10586 raft_consensus.cc:3060] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.901456 10785 tablet_bootstrap.cc:654] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.864204 11149 raft_consensus.cc:2749] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.887444 11118 raft_consensus.cc:2749] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:10.916742 10934 raft_consensus.cc:493] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.917315 10934 raft_consensus.cc:515] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:10.898250 11234 raft_consensus.cc:2804] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:10.918597 11201 log.cc:927] Time spent T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96: Append to log took a long time: real 0.183s	user 0.000s	sys 0.004s
I20260709 13:04:10.919070 11234 raft_consensus.cc:697] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:10.919440 10934 leader_election.cc:290] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:10.919952 11234 consensus_queue.cc:237] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:10.922812 10586 raft_consensus.cc:2468] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:10.925988 10706 leader_election.cc:304] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:10.912518 10483 leader_election.cc:304] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:10.934741 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e3368943d24f409949b4a22082867d" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:10.942301 11226 raft_consensus.cc:2804] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.948303 11226 raft_consensus.cc:697] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:10.953651 11226 consensus_queue.cc:237] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:10.958137 10589 raft_consensus.cc:2468] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:10.965859 10483 leader_election.cc:304] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:10.973134 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ec17bb1b33495d9caa05a15cbd16e4" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:10.957954 11230 raft_consensus.cc:2804] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:10.978605 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e3368943d24f409949b4a22082867d" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:10.979653 10514 raft_consensus.cc:2393] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 1: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
I20260709 13:04:10.971400 11189 raft_consensus.cc:2804] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:10.997886 10705 leader_election.cc:343] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.004937 10630 leader_election.cc:304] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:11.006489 11238 raft_consensus.cc:3060] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.976795 11230 raft_consensus.cc:493] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.007244 11230 raft_consensus.cc:3060] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.015457 11238 raft_consensus.cc:2749] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:11.018504 10705 consensus_peers.cc:597] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.024909 11189 raft_consensus.cc:697] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:11.026157 11189 consensus_queue.cc:237] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:11.042429 11117 consensus_queue.cc:1048] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:11.047142 10704 consensus_peers.cc:597] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.048413 11117 consensus_queue.cc:1048] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:04:11.078158 10791 tablet_bootstrap.cc:492] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:11.078804 10791 ts_tablet_manager.cc:1403] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.418s	user 0.033s	sys 0.052s
I20260709 13:04:11.081673 11230 raft_consensus.cc:515] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:11.086491 11230 leader_election.cc:290] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:11.090461 10791 raft_consensus.cc:359] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:11.091399 10791 raft_consensus.cc:385] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.091717 10791 raft_consensus.cc:740] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.093731 10791 consensus_queue.cc:260] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:11.105448 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99676c8e7e874fe98cb48b3d570c6275" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:11.113046 10791 ts_tablet_manager.cc:1434] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:04:11.114590 10791 tablet_bootstrap.cc:492] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:11.114826 11117 consensus_queue.cc:1048] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.124480 10791 tablet_bootstrap.cc:654] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.137456 10664 raft_consensus.cc:3060] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:11.156306 10483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 161190us
W20260709 13:04:11.134900 10482 leader_election.cc:343] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.117370 11129 consensus_queue.cc:1048] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.220155 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99676c8e7e874fe98cb48b3d570c6275" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:11.263633 11128 consensus_queue.cc:1048] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.248996 10739 raft_consensus.cc:3060] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.288453 10785 tablet_bootstrap.cc:492] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:11.288965 10785 ts_tablet_manager.cc:1403] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.569s	user 0.017s	sys 0.006s
I20260709 13:04:11.333607 10785 raft_consensus.cc:359] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:11.334354 10785 raft_consensus.cc:385] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.334622 10785 raft_consensus.cc:740] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.338698 10739 raft_consensus.cc:2468] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 1.
I20260709 13:04:11.360576 10791 tablet_bootstrap.cc:492] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:11.361137 10791 ts_tablet_manager.cc:1403] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.247s	user 0.019s	sys 0.028s
I20260709 13:04:11.363548 10785 consensus_queue.cc:260] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:11.381601 10791 raft_consensus.cc:359] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:11.382838 10483 leader_election.cc:304] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:11.384397 11230 consensus_queue.cc:1048] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.405545 10791 raft_consensus.cc:385] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.405958 10791 raft_consensus.cc:740] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.406625 11230 raft_consensus.cc:2804] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.406697 10791 consensus_queue.cc:260] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:11.409482 10785 ts_tablet_manager.cc:1434] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.120s	user 0.011s	sys 0.000s
I20260709 13:04:11.409559 10791 ts_tablet_manager.cc:1434] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:04:11.410678 10785 tablet_bootstrap.cc:492] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:11.410725 10791 tablet_bootstrap.cc:492] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:11.412163 11230 raft_consensus.cc:697] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:11.415231 11230 consensus_queue.cc:237] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:11.393461 10411 catalog_manager.cc:5697] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } }
I20260709 13:04:11.417382 10785 tablet_bootstrap.cc:654] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:11.421901 10482 consensus_peers.cc:597] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.427778 10705 consensus_peers.cc:597] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:11.444376 10791 tablet_bootstrap.cc:654] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.447502 10662 raft_consensus.cc:3060] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.479385 10514 raft_consensus.cc:3060] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.480887 11224 consensus_queue.cc:1048] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:11.497316 10482 consensus_peers.cc:597] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:11.552121 10462 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:11.556661 11216 consensus_queue.cc:1048] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.567193 10791 tablet_bootstrap.cc:492] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:11.567749 10791 ts_tablet_manager.cc:1403] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.157s	user 0.012s	sys 0.000s
I20260709 13:04:11.580753 10791 raft_consensus.cc:359] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:11.581485 10791 raft_consensus.cc:385] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.581743 10791 raft_consensus.cc:740] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.586206 10791 consensus_queue.cc:260] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:11.603178 10791 ts_tablet_manager.cc:1434] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:04:11.604252 10791 tablet_bootstrap.cc:492] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:11.609587 10785 tablet_bootstrap.cc:492] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96: No bootstrap required, opened a new log
I20260709 13:04:11.610152 10785 ts_tablet_manager.cc:1403] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.200s	user 0.021s	sys 0.058s
I20260709 13:04:11.612839 10785 raft_consensus.cc:359] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:11.613512 10785 raft_consensus.cc:385] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.613799 10785 raft_consensus.cc:740] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.634619 10785 consensus_queue.cc:260] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:11.626761 10791 tablet_bootstrap.cc:654] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.626506 10415 catalog_manager.cc:5697] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } }
I20260709 13:04:11.639737 10785 ts_tablet_manager.cc:1434] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.004s
I20260709 13:04:11.648022 10413 catalog_manager.cc:5697] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.650758 10413 catalog_manager.cc:5697] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.671831 10791 tablet_bootstrap.cc:492] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:11.672360 10791 ts_tablet_manager.cc:1403] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.017s
I20260709 13:04:11.677882 10791 raft_consensus.cc:359] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:11.678715 10791 raft_consensus.cc:385] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.679105 10791 raft_consensus.cc:740] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.679869 10791 consensus_queue.cc:260] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:11.682219 10412 catalog_manager.cc:5697] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.692883 10412 catalog_manager.cc:5697] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:11.683128 10791 ts_tablet_manager.cc:1434] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:11.699703 10791 tablet_bootstrap.cc:492] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:11.706272 10791 tablet_bootstrap.cc:654] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.739956 10411 catalog_manager.cc:5697] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:11.744570 10791 tablet_bootstrap.cc:492] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:11.745175 10791 ts_tablet_manager.cc:1403] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.004s
I20260709 13:04:11.748203 10791 raft_consensus.cc:359] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:11.748927 10791 raft_consensus.cc:385] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.749207 10791 raft_consensus.cc:740] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.749877 10791 consensus_queue.cc:260] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:11.765192 10791 ts_tablet_manager.cc:1434] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:04:11.766705 10791 tablet_bootstrap.cc:492] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:11.773948 10791 tablet_bootstrap.cc:654] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.826383 10791 tablet_bootstrap.cc:492] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:11.826887 10791 ts_tablet_manager.cc:1403] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.007s
I20260709 13:04:11.838088 10791 raft_consensus.cc:359] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:11.838778 10791 raft_consensus.cc:385] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.839049 10791 raft_consensus.cc:740] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.839669 10791 consensus_queue.cc:260] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:11.855088 10791 ts_tablet_manager.cc:1434] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:04:11.858675 10791 tablet_bootstrap.cc:492] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b: Bootstrap starting.
I20260709 13:04:11.870288 10791 tablet_bootstrap.cc:654] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.874177 10663 raft_consensus.cc:3060] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.884773 10662 raft_consensus.cc:3060] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.892833 11215 consensus_queue.cc:1048] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.910966 11245 raft_consensus.cc:493] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.911491 11245 raft_consensus.cc:515] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:11.915194 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716d74aced19425b839452e8495dfd2a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:11.917088 11216 consensus_queue.cc:1048] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.913698 11245 leader_election.cc:290] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:11.920439 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716d74aced19425b839452e8495dfd2a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:11.923745 10630 leader_election.cc:304] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:11.925935 11238 raft_consensus.cc:2749] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.956785 10791 tablet_bootstrap.cc:492] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b: No bootstrap required, opened a new log
I20260709 13:04:11.957895 10791 ts_tablet_manager.cc:1403] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.004s
I20260709 13:04:11.963943 10791 raft_consensus.cc:359] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:11.964764 10791 raft_consensus.cc:385] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.965052 10791 raft_consensus.cc:740] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.965699 10791 consensus_queue.cc:260] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:11.967819 10791 ts_tablet_manager.cc:1434] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:04:12.007193 10663 raft_consensus.cc:3060] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.015240 11245 raft_consensus.cc:493] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.015908 11245 raft_consensus.cc:515] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:12.021181 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7af85d78c0c41aeb882be10181161bf" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96" is_pre_election: true
I20260709 13:04:12.021310 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7af85d78c0c41aeb882be10181161bf" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:12.022202 10514 raft_consensus.cc:2468] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:12.022364 10736 raft_consensus.cc:2468] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 0.
I20260709 13:04:12.024709 10632 leader_election.cc:304] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:12.026985 11245 leader_election.cc:290] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:12.027797 11292 raft_consensus.cc:2804] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:12.028311 11292 raft_consensus.cc:493] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.028712 11292 raft_consensus.cc:3060] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.037902 11292 raft_consensus.cc:515] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:12.040887 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7af85d78c0c41aeb882be10181161bf" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:12.041203 11292 leader_election.cc:290] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:12.041551 10736 raft_consensus.cc:3060] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.041759 10514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7af85d78c0c41aeb882be10181161bf" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
I20260709 13:04:12.042405 10514 raft_consensus.cc:3060] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.049220 10736 raft_consensus.cc:2468] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:12.049978 10514 raft_consensus.cc:2468] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:12.051240 10632 leader_election.cc:304] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:12.052644 11292 raft_consensus.cc:2804] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:12.053191 11292 raft_consensus.cc:697] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:12.054129 11292 consensus_queue.cc:237] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:12.078954 10663 raft_consensus.cc:3060] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:12.099849 10414 catalog_manager.cc:5697] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.531278 11292 consensus_queue.cc:1048] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.549484 11238 consensus_queue.cc:1048] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:13.364938   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:04:13.417865 10704 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:04:13.440248 10704 consensus_peers.cc:597] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.448035   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:04:13.448376 10704 consensus_peers.cc:597] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.449090   431 tablet_replica.cc:333] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.449863   431 raft_consensus.cc:2243] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.450378   431 raft_consensus.cc:2272] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.453234   431 tablet_replica.cc:333] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.453985   431 raft_consensus.cc:2243] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.454509   431 raft_consensus.cc:2272] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.456182   431 tablet_replica.cc:333] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.456776   431 raft_consensus.cc:2243] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.457506   431 raft_consensus.cc:2272] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.459312   431 tablet_replica.cc:333] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.460150   431 raft_consensus.cc:2243] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.460640   431 raft_consensus.cc:2272] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.462976   431 tablet_replica.cc:333] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.463568   431 raft_consensus.cc:2243] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.463987   431 raft_consensus.cc:2272] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.466050   431 tablet_replica.cc:333] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.466828   431 raft_consensus.cc:2243] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:13.467980 10556 consensus_peers.cc:597] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.468007   431 raft_consensus.cc:2272] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.471237   431 tablet_replica.cc:333] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.472246   431 raft_consensus.cc:2243] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.473394   431 raft_consensus.cc:2272] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.476560   431 tablet_replica.cc:333] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.477510   431 raft_consensus.cc:2243] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.478564   431 raft_consensus.cc:2272] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.481252   431 tablet_replica.cc:333] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.482137   431 raft_consensus.cc:2243] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.482802   431 raft_consensus.cc:2272] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.485466   431 tablet_replica.cc:333] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.486470   431 raft_consensus.cc:2243] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.487562   431 raft_consensus.cc:2272] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.490558   431 tablet_replica.cc:333] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.491434   431 raft_consensus.cc:2243] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.492022   431 raft_consensus.cc:2272] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.494825   431 tablet_replica.cc:333] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.495777   431 raft_consensus.cc:2243] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.496814   431 raft_consensus.cc:2272] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.500097   431 tablet_replica.cc:333] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.501117   431 raft_consensus.cc:2243] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.502297   431 raft_consensus.cc:2272] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:13.505209 10630 consensus_peers.cc:597] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.505532   431 tablet_replica.cc:333] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.506584   431 raft_consensus.cc:2243] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.507719   431 raft_consensus.cc:2272] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.510673   431 tablet_replica.cc:333] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.511580   431 raft_consensus.cc:2243] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.512265   431 raft_consensus.cc:2272] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.515393   431 tablet_replica.cc:333] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.516247   431 raft_consensus.cc:2243] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.517269   431 raft_consensus.cc:2272] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.519773   431 tablet_replica.cc:333] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.520548   431 raft_consensus.cc:2243] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.521621   431 raft_consensus.cc:2272] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.524421   431 tablet_replica.cc:333] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.525221   431 raft_consensus.cc:2243] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.526206   431 raft_consensus.cc:2272] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.528661   431 tablet_replica.cc:333] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.529533   431 raft_consensus.cc:2243] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.530624   431 raft_consensus.cc:2272] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.533711   431 tablet_replica.cc:333] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.534737   431 raft_consensus.cc:2243] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.535877   431 raft_consensus.cc:2272] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.538725   431 tablet_replica.cc:333] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.539634   431 raft_consensus.cc:2243] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.540525   431 raft_consensus.cc:2272] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.543433   431 tablet_replica.cc:333] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.544252   431 raft_consensus.cc:2243] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.544772   431 raft_consensus.cc:2272] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.547274   431 tablet_replica.cc:333] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.548120   431 raft_consensus.cc:2243] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.548676   431 raft_consensus.cc:2272] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.551460   431 tablet_replica.cc:333] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.552263   431 raft_consensus.cc:2243] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.552773   431 raft_consensus.cc:2272] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:13.554469 10704 consensus_peers.cc:597] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.555265   431 tablet_replica.cc:333] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.556259   431 raft_consensus.cc:2243] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.557305   431 raft_consensus.cc:2272] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.560246   431 tablet_replica.cc:333] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.561260   431 raft_consensus.cc:2243] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.561844   431 raft_consensus.cc:2272] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.564893   431 tablet_replica.cc:333] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
W20260709 13:04:13.565784 10556 consensus_peers.cc:597] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.565788   431 raft_consensus.cc:2243] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.570585   431 raft_consensus.cc:2272] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:13.570825 10704 consensus_peers.cc:597] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.573899   431 tablet_replica.cc:333] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.574915   431 raft_consensus.cc:2243] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.575975   431 raft_consensus.cc:2272] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.579007   431 tablet_replica.cc:333] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.579823   431 raft_consensus.cc:2243] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.580367   431 raft_consensus.cc:2272] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.583389   431 tablet_replica.cc:333] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.584175   431 raft_consensus.cc:2243] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.585162   431 raft_consensus.cc:2272] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.587826   431 tablet_replica.cc:333] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.588666   431 raft_consensus.cc:2243] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:13.588958 10704 consensus_peers.cc:597] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.589660   431 raft_consensus.cc:2272] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.592602   431 tablet_replica.cc:333] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.593508   431 raft_consensus.cc:2243] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.594636   431 raft_consensus.cc:2272] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.597749   431 tablet_replica.cc:333] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.598649   431 raft_consensus.cc:2243] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.599747   431 raft_consensus.cc:2272] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.602669   431 tablet_replica.cc:333] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.603461   431 raft_consensus.cc:2243] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.604015   431 raft_consensus.cc:2272] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.606935   431 tablet_replica.cc:333] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.607710   431 raft_consensus.cc:2243] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.608667   431 raft_consensus.cc:2272] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:13.609599 10704 consensus_peers.cc:597] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.611325   431 tablet_replica.cc:333] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.612288   431 raft_consensus.cc:2243] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.613299   431 raft_consensus.cc:2272] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.616339   431 tablet_replica.cc:333] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.617172   431 raft_consensus.cc:2243] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.618006   431 raft_consensus.cc:2272] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.620779   431 tablet_replica.cc:333] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.621600   431 raft_consensus.cc:2243] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.622179   431 raft_consensus.cc:2272] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.625000   431 tablet_replica.cc:333] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.625813   431 raft_consensus.cc:2243] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.626916   431 raft_consensus.cc:2272] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.629902   431 tablet_replica.cc:333] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.630750   431 raft_consensus.cc:2243] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.631299   431 raft_consensus.cc:2272] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.634399   431 tablet_replica.cc:333] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.635154   431 raft_consensus.cc:2243] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.636087   431 raft_consensus.cc:2272] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.638831   431 tablet_replica.cc:333] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.639549   431 raft_consensus.cc:2243] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.640045   431 raft_consensus.cc:2272] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.642840   431 tablet_replica.cc:333] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.643571   431 raft_consensus.cc:2243] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.644127   431 raft_consensus.cc:2272] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.646966   431 tablet_replica.cc:333] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.647691   431 raft_consensus.cc:2243] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:13.648212   431 raft_consensus.cc:2272] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.650743   431 tablet_replica.cc:333] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96: stopping tablet replica
I20260709 13:04:13.651425   431 raft_consensus.cc:2243] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.652431   431 raft_consensus.cc:2272] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:13.665721 10556 consensus_peers.cc:597] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:13.673933 10704 consensus_peers.cc:597] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:13.700140 10630 consensus_peers.cc:597] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:13.721004 10704 consensus_peers.cc:597] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:13.733285 10704 consensus_peers.cc:597] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.756723   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:04:13.793431 10556 consensus_peers.cc:597] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:13.811583 10556 consensus_peers.cc:597] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:13.833209 10704 consensus_peers.cc:597] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.849485   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:13.857709 11308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:13.862671 11309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:13.862673 11311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:13.864102 10556 consensus_peers.cc:597] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.865121   431 server_base.cc:1061] running on GCE node
I20260709 13:04:13.871353   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:13.871779   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:13.872076   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602253872053 us; error 0 us; skew 500 ppm
I20260709 13:04:13.873051   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:04:13.878844 10556 consensus_peers.cc:597] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:13.879875   431 webserver.cc:533] Webserver started at http://127.0.107.193:41663/ using document root <none> and password file <none>
I20260709 13:04:13.880800   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:13.881093   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:04:13.887799   431 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.000s	sys 0.005s
I20260709 13:04:13.901093 11316 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:13.904318   431 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:04:13.904794   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-0-root
uuid: "cbba8b78b34443bcb2be4b73f86fac96"
format_stamp: "Formatted at 2026-07-09 13:04:00 on dist-test-slave-nr1f"
I20260709 13:04:13.905432   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601903731679-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:13.933719   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:13.935591   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:13.937930   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:13.945935 11323 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:04:14.287714   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:04:14.288070   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.343s	user 0.011s	sys 0.000s
I20260709 13:04:14.288420   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:04:14.295660 11323 tablet_bootstrap.cc:492] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:14.336709 11323 tablet_bootstrap.cc:492] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.337679 11323 tablet_bootstrap.cc:492] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:14.338318 11323 ts_tablet_manager.cc:1403] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.012s
I20260709 13:04:14.340692 11323 raft_consensus.cc:359] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.341323 11323 raft_consensus.cc:740] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.342168 11323 consensus_queue.cc:260] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.346678 11323 ts_tablet_manager.cc:1434] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:14.347466 11323 tablet_bootstrap.cc:492] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:14.361893 11323 tablet_bootstrap.cc:492] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.362867 11323 tablet_bootstrap.cc:492] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:14.363476 11323 ts_tablet_manager.cc:1403] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:04:14.365844 11323 raft_consensus.cc:359] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.366499 11323 raft_consensus.cc:740] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.367158 11323 consensus_queue.cc:260] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.368927 11323 ts_tablet_manager.cc:1434] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:14.369679 11323 tablet_bootstrap.cc:492] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:14.381356 11324 raft_consensus.cc:493] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.389268 11324 raft_consensus.cc:515] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.395136 11323 tablet_bootstrap.cc:492] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.395690 11324 leader_election.cc:290] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.396154 11323 tablet_bootstrap.cc:492] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:14.396850 11323 ts_tablet_manager.cc:1403] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.006s
I20260709 13:04:14.399485 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99676c8e7e874fe98cb48b3d570c6275" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:14.400084 11323 raft_consensus.cc:359] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.400765 11323 raft_consensus.cc:740] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.401510 11323 consensus_queue.cc:260] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.403334 11323 ts_tablet_manager.cc:1434] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:14.404067 11323 tablet_bootstrap.cc:492] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:14.422708 10704 leader_election.cc:336] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.423390 10704 leader_election.cc:304] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.427126 11324 raft_consensus.cc:2749] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.451013 11224 raft_consensus.cc:493] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.451994 11224 raft_consensus.cc:515] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.460317 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:14.475199 11224 leader_election.cc:290] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
W20260709 13:04:14.491171 10704 leader_election.cc:336] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.492077 10704 leader_election.cc:304] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.492985 11224 raft_consensus.cc:2749] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.499006 11323 tablet_bootstrap.cc:492] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.500072 11323 tablet_bootstrap.cc:492] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:14.500705 11323 ts_tablet_manager.cc:1403] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.097s	user 0.031s	sys 0.054s
I20260709 13:04:14.516860 11323 raft_consensus.cc:359] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.517547 11323 raft_consensus.cc:740] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.518337 11323 consensus_queue.cc:260] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.520385 11323 ts_tablet_manager.cc:1434] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:04:14.521135 11323 tablet_bootstrap.cc:492] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:14.535923 11323 tablet_bootstrap.cc:492] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.536821 11323 tablet_bootstrap.cc:492] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:14.537441 11323 ts_tablet_manager.cc:1403] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:04:14.539892 11323 raft_consensus.cc:359] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.540536 11323 raft_consensus.cc:740] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.541332 11323 consensus_queue.cc:260] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.543413 11323 ts_tablet_manager.cc:1434] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:04:14.544150 11323 tablet_bootstrap.cc:492] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:14.564553 11323 tablet_bootstrap.cc:492] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.565475 11323 tablet_bootstrap.cc:492] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:14.566118 11323 ts_tablet_manager.cc:1403] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 13:04:14.567708 11324 raft_consensus.cc:493] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.568495 11323 raft_consensus.cc:359] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.569247 11323 raft_consensus.cc:740] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.570159 11323 consensus_queue.cc:260] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.570174 11117 raft_consensus.cc:493] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.572259 11323 ts_tablet_manager.cc:1434] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:14.572219 11117 raft_consensus.cc:515] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.573158 11323 tablet_bootstrap.cc:492] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:14.576253 11118 raft_consensus.cc:493] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.576896 11118 raft_consensus.cc:515] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.568411 11324 raft_consensus.cc:515] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.587599 11117 leader_election.cc:290] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.589159 11325 raft_consensus.cc:493] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.589697 11325 raft_consensus.cc:515] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.591784 11325 leader_election.cc:290] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:14.594379 11324 leader_election.cc:290] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.603893 11324 raft_consensus.cc:493] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.604305 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:14.604445 11324 raft_consensus.cc:515] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.606774 11324 leader_election.cc:290] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:14.608428 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5066d6e3bb46aeb08e655bfe8ad7f2" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:14.613370   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:04:14.613729   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.325s	user 0.285s	sys 0.000s
I20260709 13:04:14.618480 11327 raft_consensus.cc:493] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.620414 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:14.621898 11325 raft_consensus.cc:493] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.622659 11325 raft_consensus.cc:515] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.625211 11325 leader_election.cc:290] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.629801 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc85e60ff26b4709aec0629bef9390f6" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:14.619282 11327 raft_consensus.cc:515] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.622097 11118 leader_election.cc:290] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.642823 11242 raft_consensus.cc:493] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.643388 11242 raft_consensus.cc:515] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.643842 11323 tablet_bootstrap.cc:492] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:14.644294 10630 leader_election.cc:336] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.644796 11323 tablet_bootstrap.cc:492] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:14.644877 10630 leader_election.cc:304] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.645601 11323 ts_tablet_manager.cc:1403] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.003s
I20260709 13:04:14.647389 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20701090c4f4bd5ba6c754ccbcd41e1" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:14.649194 11296 raft_consensus.cc:2749] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.650553 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e8b005258a4a419135d144d4674208" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:14.656081 10630 leader_election.cc:336] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.656720 10630 leader_election.cc:304] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.657150 11184 raft_consensus.cc:493] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.657721 11184 raft_consensus.cc:515] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.658449 11325 raft_consensus.cc:2749] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.659147 11323 raft_consensus.cc:359] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.659729 11184 leader_election.cc:290] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:14.659855 11323 raft_consensus.cc:740] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.660611 11323 consensus_queue.cc:260] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.645525 11242 leader_election.cc:290] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:14.664727 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e31d4d9ec6473caabd94052248c686" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:14.669097 11323 ts_tablet_manager.cc:1434] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 13:04:14.670152 11323 tablet_bootstrap.cc:492] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:14.671343 11242 raft_consensus.cc:493] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.671927 11242 raft_consensus.cc:515] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.674319 11337 raft_consensus.cc:493] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.674916 11337 raft_consensus.cc:515] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.676281 11242 leader_election.cc:290] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.677330 11337 leader_election.cc:290] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
W20260709 13:04:14.663877 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 79775.7us
I20260709 13:04:14.680029 11117 raft_consensus.cc:493] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.680059 11296 raft_consensus.cc:493] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
W20260709 13:04:14.681571 10556 leader_election.cc:336] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.681347 11296 raft_consensus.cc:515] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.680588 11117 raft_consensus.cc:515] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.683692 11117 leader_election.cc:290] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.685372 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e8b005258a4a419135d144d4674208" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:14.686084 10663 raft_consensus.cc:2468] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:14.686134 11327 leader_election.cc:290] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
W20260709 13:04:14.687202 10704 leader_election.cc:336] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.687489 10705 leader_election.cc:304] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:14.690133 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091d4dadcee40108323abee07cb66e4" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:14.688908 10556 leader_election.cc:304] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.687707 10704 leader_election.cc:304] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.693537 11118 raft_consensus.cc:2749] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:14.693706 10704 leader_election.cc:336] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.694236 10704 leader_election.cc:304] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.695034 11118 raft_consensus.cc:2749] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:14.695087 10704 leader_election.cc:336] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.690840 11335 raft_consensus.cc:2804] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:14.688397 10630 leader_election.cc:336] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.695757 11335 raft_consensus.cc:493] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.696234 11335 raft_consensus.cc:3060] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:14.696323 10556 leader_election.cc:336] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.696877 10556 leader_election.cc:304] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.697801 10632 leader_election.cc:304] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.688800 11296 leader_election.cc:290] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:14.698921 11325 raft_consensus.cc:2749] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.702445 11323 tablet_bootstrap.cc:492] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:14.703778 11118 raft_consensus.cc:493] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.704286 11337 raft_consensus.cc:2749] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.704730 11327 raft_consensus.cc:2749] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.714289 11118 raft_consensus.cc:515] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.706224 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0040a4a12604d64862fe91f215f2174" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:14.716087 10587 raft_consensus.cc:2468] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:14.707525 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:14.716517 11118 leader_election.cc:290] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
W20260709 13:04:14.716657 10556 leader_election.cc:336] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.708308 11242 raft_consensus.cc:493] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
W20260709 13:04:14.717228 10556 leader_election.cc:336] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.717552 11242 raft_consensus.cc:515] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.718338 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67449a01ef99467887627b70924e3efc" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:14.719666 11242 leader_election.cc:290] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.710155 11184 raft_consensus.cc:493] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.720163 10706 leader_election.cc:304] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.720360 11184 raft_consensus.cc:515] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.722402 11184 leader_election.cc:290] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:14.711822 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48aefb05bb248e78e9e5cfd8aa2739c" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:14.712986 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0040a4a12604d64862fe91f215f2174" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:14.713195 10704 leader_election.cc:336] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:14.735090 10556 leader_election.cc:336] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.725014 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2513a3510ad1457d9962458d169aab59" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:14.722491 11118 raft_consensus.cc:2804] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:14.738700 11323 tablet_bootstrap.cc:492] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:14.722558 11335 raft_consensus.cc:515] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.740080 11323 ts_tablet_manager.cc:1403] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.000s
I20260709 13:04:14.740787 11337 raft_consensus.cc:493] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.741351 11337 raft_consensus.cc:515] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.742151 10704 leader_election.cc:304] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.742316 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1e8b005258a4a419135d144d4674208" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:14.742861 10662 raft_consensus.cc:3060] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.742887 11117 raft_consensus.cc:2749] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.743340 11337 leader_election.cc:290] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:14.743925 11117 raft_consensus.cc:493] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.744406 11117 raft_consensus.cc:515] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
W20260709 13:04:14.746464 10704 leader_election.cc:336] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.749353 11117 leader_election.cc:290] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:14.746557 11335 leader_election.cc:290] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.750368 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50643b87db25412f916733ea13f10554" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:14.752100 10662 raft_consensus.cc:2468] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 2.
W20260709 13:04:14.752744 10704 leader_election.cc:336] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.753177 10705 leader_election.cc:304] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:14.753909 11117 raft_consensus.cc:2804] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:14.753191 10704 leader_election.cc:304] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.755044 11117 raft_consensus.cc:697] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:14.756255 11117 consensus_queue.cc:237] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.756304 11335 raft_consensus.cc:2749] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.746644 10558 leader_election.cc:304] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.760408 10558 leader_election.cc:304] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.738787 11118 raft_consensus.cc:493] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.760983 11118 raft_consensus.cc:3060] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:14.761076 10704 leader_election.cc:336] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.761533 11327 raft_consensus.cc:493] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
W20260709 13:04:14.761909 10704 leader_election.cc:336] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.762094 11327 raft_consensus.cc:515] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.764283 11327 leader_election.cc:290] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.764757 11327 raft_consensus.cc:2749] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.765280 11327 raft_consensus.cc:2749] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.767140 11335 raft_consensus.cc:493] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.767710 11335 raft_consensus.cc:515] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.768708 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:14.770229 11335 leader_election.cc:290] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:14.772531 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:14.773253 10739 raft_consensus.cc:2468] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:14.778407 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78ad4d54fb4014a07b4cbee983af70" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:14.779167 10558 leader_election.cc:304] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:14.780966 11184 raft_consensus.cc:2804] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:14.781494 11184 raft_consensus.cc:493] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.781752 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79b841e581468e84cf2701211496e9" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:14.782164 11296 raft_consensus.cc:493] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.782487 11335 raft_consensus.cc:493] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
W20260709 13:04:14.782922 10704 leader_election.cc:336] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.783799 11296 raft_consensus.cc:515] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.784264 11335 raft_consensus.cc:515] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.785840 11296 leader_election.cc:290] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.787606 11335 leader_election.cc:290] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
W20260709 13:04:14.783294 10556 leader_election.cc:336] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.789235 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67449a01ef99467887627b70924e3efc" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:14.789405 10556 leader_election.cc:336] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.787897 11184 raft_consensus.cc:3060] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.791042 10556 leader_election.cc:304] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:14.791967 10630 leader_election.cc:336] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.792469 11118 raft_consensus.cc:515] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.792492 10739 raft_consensus.cc:2468] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:14.793641 10738 raft_consensus.cc:2393] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a3b379dbfc7437e99aa8bb10ef958cb in current term 2: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
I20260709 13:04:14.794641 10632 leader_election.cc:304] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.795426 11325 raft_consensus.cc:2804] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:14.795751 10704 leader_election.cc:336] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.795851 11325 raft_consensus.cc:493] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.796582 11325 raft_consensus.cc:3060] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.797088 10558 leader_election.cc:304] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.798205 11242 raft_consensus.cc:2749] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.799072 11242 raft_consensus.cc:3060] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.797717 11296 raft_consensus.cc:493] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.806322 11296 raft_consensus.cc:515] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.807746 10706 leader_election.cc:304] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.808495 11337 raft_consensus.cc:493] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.809036 11337 raft_consensus.cc:515] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.809715 11224 raft_consensus.cc:2749] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.811192 11118 leader_election.cc:290] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:14.811331 11300 raft_consensus.cc:493] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.811862 11300 raft_consensus.cc:515] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.814141 11300 leader_election.cc:290] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:14.814671 11300 raft_consensus.cc:493] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.815403 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:14.815696 11337 leader_election.cc:290] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.819573 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:14.819939 10706 leader_election.cc:304] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.820382 10738 raft_consensus.cc:2468] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:14.819475 11296 leader_election.cc:290] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.821115 11118 raft_consensus.cc:2749] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:14.818903 10704 leader_election.cc:336] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.823547 10632 leader_election.cc:304] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
W20260709 13:04:14.822106 10556 leader_election.cc:336] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.824779 10556 leader_election.cc:304] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.826200 11337 raft_consensus.cc:493] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.826560 11345 raft_consensus.cc:2804] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:14.826861 10630 leader_election.cc:336] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.827020 11345 raft_consensus.cc:493] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.827435 11345 raft_consensus.cc:3060] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.826959 11300 raft_consensus.cc:515] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.827380 10630 leader_election.cc:304] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.826844 11337 raft_consensus.cc:515] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.830427 11296 raft_consensus.cc:2749] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.830667 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79b841e581468e84cf2701211496e9" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:14.831378 10738 raft_consensus.cc:2468] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:14.832816 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50643b87db25412f916733ea13f10554" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:14.833426 10558 leader_election.cc:304] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:14.833467 10587 raft_consensus.cc:2468] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:14.840193 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:14.841074 10587 raft_consensus.cc:2468] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:14.844046 11224 raft_consensus.cc:493] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.844815 11224 raft_consensus.cc:515] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.846362 11296 raft_consensus.cc:493] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.847182 11296 raft_consensus.cc:515] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.847637 11224 leader_election.cc:290] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.836030 11300 leader_election.cc:290] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:14.842489 11327 raft_consensus.cc:2749] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.874112 11296 leader_election.cc:290] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
W20260709 13:04:14.878479 10558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 45161.1us
I20260709 13:04:14.880558 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78ad4d54fb4014a07b4cbee983af70" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:14.881359 10738 raft_consensus.cc:2468] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:14.881944 10632 leader_election.cc:304] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:14.876896 11323 raft_consensus.cc:359] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.882560 10558 leader_election.cc:304] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:14.882710 11323 raft_consensus.cc:740] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:14.883559 11323 consensus_queue.cc:260] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.871589 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0040a4a12604d64862fe91f215f2174" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:14.888235 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:14.888094 11296 raft_consensus.cc:2804] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:14.889014 10662 raft_consensus.cc:2468] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:14.889022 11296 raft_consensus.cc:493] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.886346 11300 raft_consensus.cc:493] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.889642 11296 raft_consensus.cc:3060] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.889882 11300 raft_consensus.cc:515] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.892045 11300 leader_election.cc:290] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:14.893702 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20701090c4f4bd5ba6c754ccbcd41e1" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:14.894613 10587 raft_consensus.cc:2468] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:14.895463 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:14.896075 10738 raft_consensus.cc:2468] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:14.896232 11337 leader_election.cc:290] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.896764 11337 raft_consensus.cc:493] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.897372 11337 raft_consensus.cc:515] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.897817 11347 raft_consensus.cc:493] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.898416 11347 raft_consensus.cc:515] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.899832 10705 leader_election.cc:304] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:14.886642 11327 raft_consensus.cc:2804] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:14.902558 10632 leader_election.cc:304] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:14.902684 11323 ts_tablet_manager.cc:1434] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.162s	user 0.006s	sys 0.001s
I20260709 13:04:14.905560 11323 tablet_bootstrap.cc:492] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:14.900116 11337 leader_election.cc:290] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
W20260709 13:04:14.886426 10630 leader_election.cc:336] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:14.913257 10556 leader_election.cc:336] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:14.916335 10556 leader_election.cc:304] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.917547 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716d74aced19425b839452e8495dfd2a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:14.903512 11348 raft_consensus.cc:2804] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:14.920261 11348 raft_consensus.cc:493] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.920796 11348 raft_consensus.cc:3060] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.909483 11327 raft_consensus.cc:493] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.926293 11327 raft_consensus.cc:3060] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.930918 11242 raft_consensus.cc:2749] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:14.931671 10704 leader_election.cc:336] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:14.931751 10630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 48896.5us
I20260709 13:04:14.903079 11300 raft_consensus.cc:493] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.925421 11184 raft_consensus.cc:515] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
W20260709 13:04:14.938265 10558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 55781.3us
I20260709 13:04:14.943886 10706 leader_election.cc:304] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:14.944713 10412 catalog_manager.cc:5697] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.954419 11352 raft_consensus.cc:2804] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:14.954993 11353 raft_consensus.cc:493] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.955197 11352 raft_consensus.cc:493] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.955821 11352 raft_consensus.cc:3060] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.955715 11353 raft_consensus.cc:515] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:14.957767 11325 raft_consensus.cc:515] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:14.929708 11345 raft_consensus.cc:515] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:14.958428 10556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 45221us
I20260709 13:04:14.971976 11118 raft_consensus.cc:2804] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:14.983974 11118 raft_consensus.cc:493] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.984342 11118 raft_consensus.cc:3060] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.989194 11325 leader_election.cc:290] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.962074 11184 leader_election.cc:290] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:14.990011 11325 raft_consensus.cc:2804] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:14.990512 11325 raft_consensus.cc:493] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.990963 11325 raft_consensus.cc:3060] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:14.991763 11184 raft_consensus.cc:493] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.995245 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:14.995975 10738 raft_consensus.cc:3060] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:15.006094 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 104962us
I20260709 13:04:15.016554 11118 raft_consensus.cc:515] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.960270 11242 raft_consensus.cc:2749] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:14.962719 11337 raft_consensus.cc:493] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:14.960064 11345 leader_election.cc:290] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:15.032392 10738 raft_consensus.cc:2468] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:14.957996 11353 leader_election.cc:290] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:14.958906 11346 raft_consensus.cc:493] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.030805 11118 leader_election.cc:290] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:14.938197 11300 raft_consensus.cc:515] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.035522 10558 leader_election.cc:304] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:15.019999 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67449a01ef99467887627b70924e3efc" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:14.988618 11327 raft_consensus.cc:515] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:14.992551 11184 raft_consensus.cc:515] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.054430 11118 raft_consensus.cc:493] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.055015 11118 raft_consensus.cc:515] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:15.056869 11345 raft_consensus.cc:493] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.057451 11345 raft_consensus.cc:515] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.059438 11345 leader_election.cc:290] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:15.059895 11345 raft_consensus.cc:493] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.060348 11345 raft_consensus.cc:515] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.053718 10736 raft_consensus.cc:3060] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.041302 11337 raft_consensus.cc:515] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.091092 11118 leader_election.cc:290] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.071271 10735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:15.105785 10735 raft_consensus.cc:3060] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.106012 11363 raft_consensus.cc:493] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.106666 11363 raft_consensus.cc:515] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.052469 11346 raft_consensus.cc:515] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.099541 11345 leader_election.cc:290] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.102072 11347 leader_election.cc:290] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.120138 11118 raft_consensus.cc:493] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.120926 11118 raft_consensus.cc:515] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
W20260709 13:04:15.130884 10556 leader_election.cc:336] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.138175 11118 leader_election.cc:290] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.140013 11348 raft_consensus.cc:515] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.144991 11348 leader_election.cc:290] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:15.146129 11184 leader_election.cc:290] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.146306 11357 raft_consensus.cc:493] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.147222 11337 leader_election.cc:290] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.147006 11357 raft_consensus.cc:515] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.148732 11363 leader_election.cc:290] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.149482 11357 leader_election.cc:290] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.149578 11300 leader_election.cc:290] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:15.147531 11359 raft_consensus.cc:493] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.150637 11359 raft_consensus.cc:515] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.153414 11359 leader_election.cc:290] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.154174 11362 raft_consensus.cc:2804] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.154786 11362 raft_consensus.cc:697] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:15.155844 11327 leader_election.cc:290] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:15.155623 11362 consensus_queue.cc:237] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:15.124423 11345 raft_consensus.cc:493] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.184026 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79b841e581468e84cf2701211496e9" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:15.184836 10738 raft_consensus.cc:3060] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.188941 11296 raft_consensus.cc:515] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.191944 10735 raft_consensus.cc:2468] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
I20260709 13:04:15.193619 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:15.194360 10590 raft_consensus.cc:2468] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:15.194761 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48aefb05bb248e78e9e5cfd8aa2739c" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:15.195362 10587 raft_consensus.cc:2468] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 1.
I20260709 13:04:15.195852 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:15.192112 11353 raft_consensus.cc:493] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.196486 10586 raft_consensus.cc:3060] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.196756 11353 raft_consensus.cc:515] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.197631 11346 leader_election.cc:290] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.198192 11345 raft_consensus.cc:515] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.200374 11345 leader_election.cc:290] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:15.205474 10706 leader_election.cc:304] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:15.207765 10706 leader_election.cc:304] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:15.209008 11335 raft_consensus.cc:2804] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.209408 11335 raft_consensus.cc:493] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.209745 11335 raft_consensus.cc:3060] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.211793 11352 raft_consensus.cc:515] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:15.214143 11118 raft_consensus.cc:2804] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.214656 11118 raft_consensus.cc:493] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.215093 11118 raft_consensus.cc:3060] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.216907 10738 raft_consensus.cc:2468] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:15.198724 11353 leader_election.cc:290] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.225499 10586 raft_consensus.cc:2468] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 2.
I20260709 13:04:15.226857 11325 raft_consensus.cc:515] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.229635 11325 leader_election.cc:290] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.216959 10736 raft_consensus.cc:2468] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
W20260709 13:04:15.234160 10704 leader_election.cc:336] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.213984 11352 leader_election.cc:290] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
W20260709 13:04:15.230327 10556 leader_election.cc:336] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.231966 11296 leader_election.cc:290] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.225767 10585 raft_consensus.cc:2468] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 2.
W20260709 13:04:15.236402 10704 leader_election.cc:336] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.245645 10704 leader_election.cc:336] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.246511 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b78ad4d54fb4014a07b4cbee983af70" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
W20260709 13:04:15.246831 10704 leader_election.cc:336] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.247383 10738 raft_consensus.cc:3060] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:15.243824 10556 leader_election.cc:336] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.236891 10705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:46191, user_credentials={real_user=slave}} blocked reactor thread for 179422us
I20260709 13:04:15.249034 10556 leader_election.cc:304] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:15.250558 10556 leader_election.cc:336] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.250628 11364 raft_consensus.cc:2749] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:15.253099 10632 leader_election.cc:304] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:15.242794 11335 raft_consensus.cc:515] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:15.248167 11118 raft_consensus.cc:515] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:15.258901 10558 leader_election.cc:304] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
W20260709 13:04:15.264008 10556 leader_election.cc:336] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.264725 10556 leader_election.cc:336] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.266821 11364 raft_consensus.cc:2804] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.267388 11364 raft_consensus.cc:697] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:15.267467 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:15.268119 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99676c8e7e874fe98cb48b3d570c6275" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:15.268236 11364 consensus_queue.cc:237] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:15.268690 10736 raft_consensus.cc:2468] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:15.269797 10706 leader_election.cc:304] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.270164 11355 raft_consensus.cc:2804] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.276367 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8dbc2680fd461c836d48a8f8692e50" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:15.277046 10592 raft_consensus.cc:2468] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:15.256562 11345 raft_consensus.cc:493] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.265306 11325 raft_consensus.cc:493] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.280069 11325 raft_consensus.cc:515] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.281620 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc85e60ff26b4709aec0629bef9390f6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:15.282128 11325 leader_election.cc:290] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:15.282264 10736 raft_consensus.cc:2468] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:15.282608 11345 raft_consensus.cc:515] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.284694 11345 leader_election.cc:290] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.286423 11323 tablet_bootstrap.cc:492] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:15.286479 10556 leader_election.cc:336] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.266873 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:15.287653 11325 raft_consensus.cc:493] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.287919 10586 raft_consensus.cc:2468] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:15.289036 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d54a6a210240e8994f2e4a34596f81" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:15.289659 10586 raft_consensus.cc:2468] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:15.288194 11325 raft_consensus.cc:515] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
W20260709 13:04:15.287690 10556 leader_election.cc:336] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.270625 11355 raft_consensus.cc:493] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.291348 11355 raft_consensus.cc:3060] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:15.293493 10630 leader_election.cc:336] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.297839 10556 leader_election.cc:336] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.296046 11335 leader_election.cc:290] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.296901 11325 leader_election.cc:290] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.298277 10664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dc87c50f6e4a299ba01b42bb08af51" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:15.305265 10664 raft_consensus.cc:2468] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:15.277437 11324 raft_consensus.cc:2804] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.305624 10706 leader_election.cc:304] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.306246 11324 raft_consensus.cc:697] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:15.306308 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:15.307058 10662 raft_consensus.cc:2468] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
W20260709 13:04:15.307475 10556 leader_election.cc:336] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.308094 10556 leader_election.cc:336] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.308274 11118 leader_election.cc:290] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
W20260709 13:04:15.308532 10556 leader_election.cc:336] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.308686 11117 raft_consensus.cc:2804] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:15.309018 10556 leader_election.cc:336] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.309394 11117 raft_consensus.cc:697] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:15.286839 10738 raft_consensus.cc:2468] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:15.310856 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:15.311436 10587 raft_consensus.cc:3060] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.314805 10558 leader_election.cc:304] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.319533 11117 consensus_queue.cc:237] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:15.323796 11324 consensus_queue.cc:237] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:15.325299 11323 tablet_bootstrap.cc:492] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:15.326323 10587 raft_consensus.cc:2468] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 2.
I20260709 13:04:15.328173 11323 ts_tablet_manager.cc:1403] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.423s	user 0.033s	sys 0.006s
I20260709 13:04:15.329334 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20701090c4f4bd5ba6c754ccbcd41e1" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:15.329926 10587 raft_consensus.cc:3060] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.330097 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50643b87db25412f916733ea13f10554" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:15.330889 10592 raft_consensus.cc:3060] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.335702 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d54a6a210240e8994f2e4a34596f81" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:15.336319 10662 raft_consensus.cc:2468] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:15.320355 11362 raft_consensus.cc:2804] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.338322 10587 raft_consensus.cc:2468] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
I20260709 13:04:15.345826 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e31d4d9ec6473caabd94052248c686" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:15.346757 10587 raft_consensus.cc:2468] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:15.346782 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5066d6e3bb46aeb08e655bfe8ad7f2" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:15.347738 10738 raft_consensus.cc:2468] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:15.349218 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2513a3510ad1457d9962458d169aab59" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:15.349895 10590 raft_consensus.cc:2468] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:15.351002 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8dbc2680fd461c836d48a8f8692e50" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:15.351614 10662 raft_consensus.cc:2468] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:15.354933 10592 raft_consensus.cc:2468] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
I20260709 13:04:15.353775 10632 leader_election.cc:304] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:15.363511 10632 leader_election.cc:304] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:15.364372 10632 leader_election.cc:304] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:15.365082 11371 raft_consensus.cc:2804] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.365548 11371 raft_consensus.cc:493] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.351264 11362 raft_consensus.cc:697] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:15.367270 10632 leader_election.cc:304] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:15.373472 10632 leader_election.cc:304] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:15.371105 11371 raft_consensus.cc:3060] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.378355 11369 raft_consensus.cc:493] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.378983 11369 raft_consensus.cc:515] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.380452 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091d4dadcee40108323abee07cb66e4" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:15.381088 10665 raft_consensus.cc:2468] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
W20260709 13:04:15.381253 11374 log.cc:927] Time spent T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:04:15.371261 11367 raft_consensus.cc:2804] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.381974 11367 raft_consensus.cc:493] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.382385 11367 raft_consensus.cc:3060] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:15.384156 10630 leader_election.cc:336] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.385268 10630 leader_election.cc:336] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.387784 11360 raft_consensus.cc:2804] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.388345 11360 raft_consensus.cc:697] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:15.389165 11360 consensus_queue.cc:237] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.369853 11357 raft_consensus.cc:2804] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.390281 11357 raft_consensus.cc:493] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.390738 11357 raft_consensus.cc:3060] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.390952 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:15.391691 10662 raft_consensus.cc:2468] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
W20260709 13:04:15.392704 10704 leader_election.cc:336] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.394767 10704 consensus_peers.cc:597] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.395288 10704 leader_election.cc:336] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.372103 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 65355.1us
I20260709 13:04:15.377605 11323 raft_consensus.cc:359] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.399806 11323 raft_consensus.cc:740] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.400636 11323 consensus_queue.cc:260] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.401407 10662 raft_consensus.cc:1275] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer bd6ac4ec789b459bbbfa3d6952103df5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:15.398893 10557 leader_election.cc:304] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.398891 10632 leader_election.cc:304] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:15.404040 10557 leader_election.cc:304] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.400941 10706 leader_election.cc:304] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.409104 10632 leader_election.cc:304] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:15.409622 11118 consensus_queue.cc:1048] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:15.410355 10557 leader_election.cc:304] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.412199 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e48aefb05bb248e78e9e5cfd8aa2739c" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:15.413007 10585 raft_consensus.cc:3060] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:15.408887 10630 leader_election.cc:336] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.418789 11365 raft_consensus.cc:2804] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:15.419013 10630 leader_election.cc:336] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.419391 11365 raft_consensus.cc:697] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
W20260709 13:04:15.419795 10630 leader_election.cc:336] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.420466 10630 leader_election.cc:336] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.420306 11365 consensus_queue.cc:237] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:15.418345 11364 raft_consensus.cc:2804] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.422200 11364 raft_consensus.cc:493] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.422662 11364 raft_consensus.cc:3060] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.423923 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dc87c50f6e4a299ba01b42bb08af51" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:15.425025 11362 consensus_queue.cc:237] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:15.377799 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:15.402266 11345 raft_consensus.cc:2804] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.431679 10557 leader_election.cc:304] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.405503 11353 raft_consensus.cc:2804] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.434547 10411 catalog_manager.cc:5697] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.437259 10632 leader_election.cc:304] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.439370 10632 leader_election.cc:304] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.426661 11368 raft_consensus.cc:2804] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.428704 10661 raft_consensus.cc:2468] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 1.
I20260709 13:04:15.435343 11363 raft_consensus.cc:2804] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.456826 10557 leader_election.cc:304] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.434226 11345 raft_consensus.cc:493] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.435132 11359 raft_consensus.cc:2804] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.442598 11361 raft_consensus.cc:2804] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.461020 11345 raft_consensus.cc:3060] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.442687 11353 raft_consensus.cc:493] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.447242 11300 raft_consensus.cc:2804] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.464392 11369 leader_election.cc:290] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.457413 11296 raft_consensus.cc:2804] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:15.466007 10630 leader_election.cc:336] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.448393 11368 raft_consensus.cc:493] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.457834 11352 raft_consensus.cc:2804] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.456887 11363 raft_consensus.cc:493] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.454810 11355 raft_consensus.cc:515] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.484732 10557 leader_election.cc:304] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.484140 11323 ts_tablet_manager.cc:1434] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.156s	user 0.006s	sys 0.004s
I20260709 13:04:15.483948 11368 raft_consensus.cc:3060] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.463092 11361 raft_consensus.cc:493] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.475322 11353 raft_consensus.cc:3060] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.499200 11323 tablet_bootstrap.cc:492] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:15.475502 11359 raft_consensus.cc:697] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:15.472968 10585 raft_consensus.cc:2468] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 2.
W20260709 13:04:15.518944 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 63632.4us
I20260709 13:04:15.484335 11352 raft_consensus.cc:493] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.492785 11363 raft_consensus.cc:3060] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.502914 10557 leader_election.cc:304] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.472663 11367 raft_consensus.cc:515] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.520520 10632 leader_election.cc:304] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.503991 11361 raft_consensus.cc:3060] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.510795 11362 raft_consensus.cc:2804] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:15.511159 10630 leader_election.cc:336] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.523021 11352 raft_consensus.cc:3060] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.529417 10663 raft_consensus.cc:2393] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bd6ac4ec789b459bbbfa3d6952103df5 in current term 2: Already voted for candidate 8b82fdd6486e40d180a9d1c7c320e38b in this term.
I20260709 13:04:15.526094 11351 raft_consensus.cc:2804] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.532895 11359 consensus_queue.cc:237] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.527920 11362 raft_consensus.cc:493] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.536448 10706 leader_election.cc:304] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.547430 11360 raft_consensus.cc:2804] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.547940 11360 raft_consensus.cc:493] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.548314 11360 raft_consensus.cc:3060] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.544135 11362 raft_consensus.cc:3060] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.549810 11370 raft_consensus.cc:2804] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.556772 11370 raft_consensus.cc:697] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:15.554946 11296 raft_consensus.cc:697] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:15.557799 11296 consensus_queue.cc:237] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.559695 10705 leader_election.cc:304] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:15.531395 10630 leader_election.cc:336] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.563189 10411 catalog_manager.cc:5697] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.544698 11351 raft_consensus.cc:493] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.568185 10411 catalog_manager.cc:5697] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.557736 11370 consensus_queue.cc:237] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:15.577513 10738 raft_consensus.cc:1275] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:15.581075 10411 catalog_manager.cc:5697] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.561172 11367 leader_election.cc:290] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.563714 11300 raft_consensus.cc:697] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:15.565773 11324 raft_consensus.cc:2749] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:15.589236 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 62621.8us
I20260709 13:04:15.590229 10632 leader_election.cc:304] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.591858 10632 leader_election.cc:304] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:15.534261 11371 raft_consensus.cc:515] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.581712 11351 raft_consensus.cc:3060] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.599125 10412 catalog_manager.cc:5697] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:15.586710 10630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 56006.2us
W20260709 13:04:15.605811 11383 log.cc:927] Time spent T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:04:15.595731 11369 raft_consensus.cc:2804] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.580968 11357 raft_consensus.cc:515] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.615110 11355 leader_election.cc:290] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:15.614243 11327 consensus_queue.cc:1048] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:04:15.604470 11364 raft_consensus.cc:515] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.623557 11371 leader_election.cc:290] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.625424 11364 leader_election.cc:290] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.626014 11357 leader_election.cc:290] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.635864 11363 raft_consensus.cc:515] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.603533 11391 raft_consensus.cc:2804] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:15.613230 10630 leader_election.cc:336] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.666688 10630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 56047.8us
W20260709 13:04:15.667326 10630 leader_election.cc:336] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.667472 10556 consensus_peers.cc:597] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.657527 11300 consensus_queue.cc:237] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:15.668263 10630 leader_election.cc:336] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.658178 11352 raft_consensus.cc:515] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.660959 11351 raft_consensus.cc:515] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.661926 11363 leader_election.cc:290] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.662680 11361 raft_consensus.cc:515] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.613032 11369 raft_consensus.cc:493] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.677665 11369 raft_consensus.cc:3060] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.663430 10661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:15.664742 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d54a6a210240e8994f2e4a34596f81" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:15.653954 11391 raft_consensus.cc:493] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.684036 10662 raft_consensus.cc:2393] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a3b379dbfc7437e99aa8bb10ef958cb in current term 2: Already voted for candidate 8b82fdd6486e40d180a9d1c7c320e38b in this term.
I20260709 13:04:15.684351 11391 raft_consensus.cc:3060] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.685415 11361 leader_election.cc:290] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.686925 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8dbc2680fd461c836d48a8f8692e50" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:15.687831 10662 raft_consensus.cc:2393] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a3b379dbfc7437e99aa8bb10ef958cb in current term 2: Already voted for candidate 8b82fdd6486e40d180a9d1c7c320e38b in this term.
I20260709 13:04:15.689210 11362 raft_consensus.cc:515] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.695648 10661 raft_consensus.cc:2393] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1a3b379dbfc7437e99aa8bb10ef958cb in current term 2: Already voted for candidate 8b82fdd6486e40d180a9d1c7c320e38b in this term.
W20260709 13:04:15.696377 10556 leader_election.cc:336] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.696940 10556 leader_election.cc:336] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.697204 10557 leader_election.cc:304] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.697283 10556 leader_election.cc:304] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.683060 10414 catalog_manager.cc:5697] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:15.670517 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 77765.4us
I20260709 13:04:15.708562 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:15.709466 10736 raft_consensus.cc:2393] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 2: Already voted for candidate bd6ac4ec789b459bbbfa3d6952103df5 in this term.
I20260709 13:04:15.710722 10414 catalog_manager.cc:5697] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.713562 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716d74aced19425b839452e8495dfd2a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:15.718473 10592 raft_consensus.cc:2468] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 1.
I20260709 13:04:15.704219 11327 raft_consensus.cc:2749] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:15.724201 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d54a6a210240e8994f2e4a34596f81" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:15.724577 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8dbc2680fd461c836d48a8f8692e50" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:15.725802 10587 raft_consensus.cc:2393] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 2: Already voted for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in this term.
I20260709 13:04:15.726094 10632 leader_election.cc:304] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:15.726998 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
W20260709 13:04:15.728010 10556 leader_election.cc:336] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.728511 10556 leader_election.cc:304] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.714568 11364 raft_consensus.cc:2749] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:15.720762 10630 leader_election.cc:336] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.699927 11345 raft_consensus.cc:515] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.737004 10592 raft_consensus.cc:2393] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 2: Already voted for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in this term.
I20260709 13:04:15.742483 11386 raft_consensus.cc:493] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.750998 11386 raft_consensus.cc:515] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.735731 11363 raft_consensus.cc:2749] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:15.714064 11368 raft_consensus.cc:515] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.737648 11399 raft_consensus.cc:2804] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:15.766261 11362 leader_election.cc:290] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.766628 11345 leader_election.cc:290] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.767015 11351 leader_election.cc:290] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.765244 11399 raft_consensus.cc:493] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting leader election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:15.767751 11399 raft_consensus.cc:3060] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.768838 10411 catalog_manager.cc:5697] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.774471 11360 raft_consensus.cc:515] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.775439 11368 leader_election.cc:290] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
W20260709 13:04:15.778677 10556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 50695.6us
I20260709 13:04:15.779208 10590 raft_consensus.cc:2393] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 2: Already voted for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in this term.
W20260709 13:04:15.791581 10630 leader_election.cc:336] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.814967 11360 leader_election.cc:290] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:15.816287 10739 raft_consensus.cc:1275] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:15.821167 10630 leader_election.cc:336] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:15.824368 10556 leader_election.cc:336] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.822003 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99676c8e7e874fe98cb48b3d570c6275" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:15.806959 11352 leader_election.cc:290] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.821311 11369 raft_consensus.cc:515] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:15.827296 10556 leader_election.cc:336] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.826041 10739 raft_consensus.cc:3060] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.821871 11391 raft_consensus.cc:515] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:15.835493 10704 consensus_peers.cc:597] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.811218 11353 raft_consensus.cc:515] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
W20260709 13:04:15.841173 10556 consensus_peers.cc:597] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.842254 10556 leader_election.cc:336] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.844202 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e31d4d9ec6473caabd94052248c686" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:15.844801 10592 raft_consensus.cc:3060] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.846155 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2513a3510ad1457d9962458d169aab59" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:15.846791 10587 raft_consensus.cc:3060] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.849782 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:15.853724 10662 raft_consensus.cc:3060] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.853785 10587 raft_consensus.cc:2468] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
I20260709 13:04:15.858940 10586 raft_consensus.cc:2393] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8b82fdd6486e40d180a9d1c7c320e38b in current term 2: Already voted for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in this term.
I20260709 13:04:15.858934 10662 raft_consensus.cc:2468] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:15.860997 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:15.861550 10663 raft_consensus.cc:3060] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.853291 11386 leader_election.cc:290] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:15.865069 11386 raft_consensus.cc:493] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.865507 11386 raft_consensus.cc:515] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.867736 11386 leader_election.cc:290] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.868253 11386 raft_consensus.cc:493] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.880859 10557 leader_election.cc:304] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.885492 10587 raft_consensus.cc:1275] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer bd6ac4ec789b459bbbfa3d6952103df5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:15.867731 10739 raft_consensus.cc:2468] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
I20260709 13:04:15.886837 10592 raft_consensus.cc:2468] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
I20260709 13:04:15.883810 10632 leader_election.cc:304] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:15.848418 11364 consensus_queue.cc:1048] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:04:15.891158 10632 leader_election.cc:304] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:15.898433 11369 leader_election.cc:290] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:15.894347 10659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091d4dadcee40108323abee07cb66e4" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:15.870950 11399 raft_consensus.cc:515] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.908044 10632 leader_election.cc:304] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:15.868647 11386 raft_consensus.cc:515] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:15.908689 10659 raft_consensus.cc:3060] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.891948 11371 raft_consensus.cc:2804] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.912897 11353 leader_election.cc:290] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:15.913025 11371 raft_consensus.cc:697] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:15.913064 10663 raft_consensus.cc:2468] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:15.914076 11371 consensus_queue.cc:237] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.915850 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43dc87c50f6e4a299ba01b42bb08af51" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:15.916455 10663 raft_consensus.cc:3060] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:15.892333 11351 raft_consensus.cc:2804] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.909713 11369 raft_consensus.cc:2804] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.898907 11368 raft_consensus.cc:2804] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.889499 11365 consensus_queue.cc:1048] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:04:15.917342 10557 leader_election.cc:304] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.912150 11386 leader_election.cc:290] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.926261 11323 tablet_bootstrap.cc:492] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:15.928977 11352 raft_consensus.cc:2804] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:15.929791 11369 raft_consensus.cc:697] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:15.927364 11351 raft_consensus.cc:697] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:15.940582 11323 tablet_bootstrap.cc:492] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:15.930613 11368 raft_consensus.cc:697] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:15.945142 11323 ts_tablet_manager.cc:1403] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.446s	user 0.017s	sys 0.009s
I20260709 13:04:15.950230 11323 raft_consensus.cc:359] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.950466 11351 consensus_queue.cc:237] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.951031 11323 raft_consensus.cc:740] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.934706 11352 raft_consensus.cc:697] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:15.952759 11399 leader_election.cc:290] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:15.941426 11411 raft_consensus.cc:493] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.968384 11411 raft_consensus.cc:515] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.954279 11323 consensus_queue.cc:260] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.964054 11369 consensus_queue.cc:237] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:15.970011 11410 raft_consensus.cc:493] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.970572 11410 raft_consensus.cc:515] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:15.969527 11368 consensus_queue.cc:237] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
W20260709 13:04:15.974548 10556 leader_election.cc:336] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:15.978230 10587 raft_consensus.cc:1275] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer bd6ac4ec789b459bbbfa3d6952103df5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:15.981274 10632 leader_election.cc:304] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:15.984882 11365 consensus_queue.cc:1048] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:15.989416 11400 log.cc:927] Time spent T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5: Append to log took a long time: real 0.266s	user 0.001s	sys 0.003s
I20260709 13:04:16.007062 11323 ts_tablet_manager.cc:1434] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.002s
I20260709 13:04:16.008354 11323 tablet_bootstrap.cc:492] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:16.012851 10663 raft_consensus.cc:2468] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:16.013582 11360 raft_consensus.cc:2749] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:16.013981 11352 consensus_queue.cc:237] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:16.026944 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc85e60ff26b4709aec0629bef9390f6" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:16.027690 10738 raft_consensus.cc:3060] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.028748 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716d74aced19425b839452e8495dfd2a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:16.029392 10587 raft_consensus.cc:3060] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.029448 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d5066d6e3bb46aeb08e655bfe8ad7f2" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:16.030189 10739 raft_consensus.cc:3060] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.034921 11391 leader_election.cc:290] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:16.035823 10738 raft_consensus.cc:2468] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
W20260709 13:04:16.036893 10556 consensus_peers.cc:597] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:16.042424 10632 leader_election.cc:304] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:16.042903 10557 leader_election.cc:304] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:16.045238 10587 raft_consensus.cc:2468] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
I20260709 13:04:16.048125 10632 leader_election.cc:304] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:16.049193 11296 raft_consensus.cc:2804] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.049788 11296 raft_consensus.cc:697] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:16.046545 11361 raft_consensus.cc:2804] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.062258 10659 raft_consensus.cc:2468] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:16.062623 11361 raft_consensus.cc:697] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:16.045387 11391 raft_consensus.cc:2804] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.044019 11410 leader_election.cc:290] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:16.079388 10739 raft_consensus.cc:2468] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
I20260709 13:04:16.088582 11391 raft_consensus.cc:697] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:16.047240 11411 leader_election.cc:290] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
W20260709 13:04:16.098979 10630 leader_election.cc:336] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:16.111019 10632 leader_election.cc:304] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:16.115676 11390 raft_consensus.cc:2804] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.117244 11390 raft_consensus.cc:697] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:16.118427 11390 consensus_queue.cc:237] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:16.119244 10590 raft_consensus.cc:1275] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer bd6ac4ec789b459bbbfa3d6952103df5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.050685 11296 consensus_queue.cc:237] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
W20260709 13:04:16.126407 10630 leader_election.cc:336] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:16.127135 10557 leader_election.cc:304] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:16.127128 10630 leader_election.cc:304] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:16.133976 10630 leader_election.cc:336] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:16.143121 10630 leader_election.cc:304] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:16.144517 10630 leader_election.cc:336] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:16.063890 11361 consensus_queue.cc:237] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
W20260709 13:04:16.147905 10630 leader_election.cc:336] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:16.149571 10630 leader_election.cc:336] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:16.150372 10630 leader_election.cc:336] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:16.141914 11352 raft_consensus.cc:2804] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.134748 11399 raft_consensus.cc:2749] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:16.163141 10590 raft_consensus.cc:1275] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.165464 11411 raft_consensus.cc:493] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.166020 11411 raft_consensus.cc:515] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:16.166582 10735 raft_consensus.cc:1275] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.146341 11365 consensus_queue.cc:1048] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:04:16.168316 11411 leader_election.cc:290] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:16.149761 11391 consensus_queue.cc:237] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:16.147074 11369 raft_consensus.cc:2749] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:16.178540 11359 consensus_queue.cc:1048] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:16.174360 11352 raft_consensus.cc:697] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:16.180928 11352 consensus_queue.cc:237] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
W20260709 13:04:16.191826 10630 leader_election.cc:336] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
W20260709 13:04:16.196110 10630 leader_election.cc:336] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:16.189121 11371 consensus_queue.cc:1048] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260709 13:04:16.205030 10630 leader_election.cc:336] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:16.207180 10630 leader_election.cc:304] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:16.208263 11369 raft_consensus.cc:2749] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:16.208465 10630 leader_election.cc:336] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:16.209120 10630 leader_election.cc:304] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b; no voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:16.209889 11369 raft_consensus.cc:2749] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:16.218111 11411 raft_consensus.cc:493] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.218701 11411 raft_consensus.cc:515] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
W20260709 13:04:16.263144 10630 consensus_peers.cc:597] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.263803 10630 consensus_peers.cc:597] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.264375 10630 consensus_peers.cc:597] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.309661 11411 leader_election.cc:290] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:16.331306 11411 raft_consensus.cc:493] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.332154 11411 raft_consensus.cc:515] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:16.335624 11411 leader_election.cc:290] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
W20260709 13:04:16.340746 10704 consensus_peers.cc:597] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.341435 10704 consensus_peers.cc:597] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.341890 10704 consensus_peers.cc:597] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.346171 10585 raft_consensus.cc:1275] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer bd6ac4ec789b459bbbfa3d6952103df5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:16.327422 11382 log.cc:927] Time spent T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:04:16.355633 11365 consensus_queue.cc:1048] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.373303 11323 tablet_bootstrap.cc:492] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:16.378469 10556 consensus_peers.cc:597] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:16.379037 10556 consensus_peers.cc:597] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:16.400898 11323 tablet_bootstrap.cc:492] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:16.401779 11323 ts_tablet_manager.cc:1403] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.394s	user 0.023s	sys 0.016s
W20260709 13:04:16.458202 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 77271.6us
W20260709 13:04:16.468483 10630 consensus_peers.cc:597] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.468359 10556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 56774.1us
W20260709 13:04:16.469161 10630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 57396.4us
W20260709 13:04:16.469594 10556 consensus_peers.cc:597] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:16.489545 10587 raft_consensus.cc:1275] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:16.556435 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 46414.7us
I20260709 13:04:16.556880 11323 raft_consensus.cc:359] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:16.565631 11323 raft_consensus.cc:740] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.567934 11323 consensus_queue.cc:260] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:16.575040 11323 ts_tablet_manager.cc:1434] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.173s	user 0.005s	sys 0.002s
I20260709 13:04:16.577782 10585 raft_consensus.cc:1275] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.589659 11323 tablet_bootstrap.cc:492] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:16.562469 11367 consensus_queue.cc:1048] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 13:04:16.621309 10630 consensus_peers.cc:597] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.625133 10740 raft_consensus.cc:1275] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.630317 10739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:16.631011 10704 consensus_peers.cc:597] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:16.631153 10734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6efd752eb04cadb27f38108369d56d" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:16.585595 11369 consensus_queue.cc:1048] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:04:16.631464 10732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:16.631922 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fe36fcadfd4768a963dc396271497c" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:16.631528 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e3368943d24f409949b4a22082867d" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
W20260709 13:04:16.651727 10704 consensus_peers.cc:597] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:16.652312 10704 consensus_peers.cc:597] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:16.653082 10704 consensus_peers.cc:597] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:16.653493 10704 consensus_peers.cc:597] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:16.653887 10704 consensus_peers.cc:597] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:16.654280 10704 consensus_peers.cc:597] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:16.658941 10630 consensus_peers.cc:597] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.662520 10630 consensus_peers.cc:597] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.663111 10630 consensus_peers.cc:597] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.664408 10704 consensus_peers.cc:597] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:16.665869 10704 consensus_peers.cc:597] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:16.676642 10737 raft_consensus.cc:1275] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.677486 11368 consensus_queue.cc:1048] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.678122 10732 raft_consensus.cc:1275] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.682313 11369 consensus_queue.cc:1048] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:16.685900 11357 consensus_queue.cc:1048] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:16.691154 10412 catalog_manager.cc:5697] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.693316 10412 catalog_manager.cc:5697] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:16.696233 10630 consensus_peers.cc:597] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:16.698300 10412 catalog_manager.cc:5697] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.702613 10412 catalog_manager.cc:5697] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.719230 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e3368943d24f409949b4a22082867d" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:16.738230 10736 raft_consensus.cc:1275] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.741801 10733 raft_consensus.cc:1275] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.744437 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:16.744863 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:16.745333 10662 raft_consensus.cc:2393] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbba8b78b34443bcb2be4b73f86fac96 in current term 2: Already voted for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in this term.
I20260709 13:04:16.747006 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:16.747828 10592 raft_consensus.cc:2393] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbba8b78b34443bcb2be4b73f86fac96 in current term 2: Already voted for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in this term.
I20260709 13:04:16.749109 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6efd752eb04cadb27f38108369d56d" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:16.749365 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:16.750106 10662 raft_consensus.cc:2393] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbba8b78b34443bcb2be4b73f86fac96 in current term 2: Already voted for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in this term.
I20260709 13:04:16.702993 10411 catalog_manager.cc:5697] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.753247 10411 catalog_manager.cc:5697] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.755509 10587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:16.755338 10411 catalog_manager.cc:5697] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.760550 10411 catalog_manager.cc:5697] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.762566 10411 catalog_manager.cc:5697] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.752264 10662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:16.766602 10662 raft_consensus.cc:2393] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbba8b78b34443bcb2be4b73f86fac96 in current term 2: Already voted for candidate 8b82fdd6486e40d180a9d1c7c320e38b in this term.
W20260709 13:04:16.752257 10630 consensus_peers.cc:597] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.749400 10585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddadabec8df04c90812c121230deefd6" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:16.774166 10589 raft_consensus.cc:1275] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.779327 11320 leader_election.cc:304] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:16.779505 10590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:16.780944 11320 leader_election.cc:304] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:16.781020 10589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fe36fcadfd4768a963dc396271497c" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:16.773464 10411 catalog_manager.cc:5697] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.774554 10587 raft_consensus.cc:1275] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:16.797628 10556 consensus_peers.cc:597] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.805539 10662 raft_consensus.cc:1275] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.784616 11411 raft_consensus.cc:2749] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:16.790743 11451 consensus_queue.cc:1048] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:04:16.830044 11327 consensus_queue.cc:1048] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:16.794885 11368 consensus_queue.cc:1048] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:04:16.810575 10663 raft_consensus.cc:1275] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.822558 11319 leader_election.cc:304] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:16.824450 11392 consensus_queue.cc:1048] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:04:16.837587 10662 raft_consensus.cc:1275] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.841192 11363 consensus_queue.cc:1048] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:16.846271 11320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 65394us
I20260709 13:04:16.832801 11411 raft_consensus.cc:2749] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:16.877190 10556 consensus_peers.cc:597] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.878358 10556 consensus_peers.cc:597] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:16.894685 11319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:46191, user_credentials={real_user=slave}} blocked reactor thread for 97427.6us
I20260709 13:04:16.910575 11320 leader_election.cc:304] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:16.938189 11411 raft_consensus.cc:2749] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:16.939868 11319 leader_election.cc:304] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:16.943081 11411 raft_consensus.cc:3060] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.944795 11323 tablet_bootstrap.cc:492] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:16.922142 11466 raft_consensus.cc:2749] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:16.956067 10663 raft_consensus.cc:1275] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:16.977041 10630 consensus_peers.cc:597] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:16.943838 11320 leader_election.cc:304] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:16.994544 11364 consensus_queue.cc:1048] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:16.941780 11319 leader_election.cc:304] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:17.013978 11323 tablet_bootstrap.cc:492] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:17.014995 11323 ts_tablet_manager.cc:1403] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.426s	user 0.045s	sys 0.028s
W20260709 13:04:17.020512 11467 log.cc:927] Time spent T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb: Append to log took a long time: real 0.107s	user 0.003s	sys 0.001s
I20260709 13:04:16.986016 11352 consensus_queue.cc:1048] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:16.986711 11346 consensus_queue.cc:1048] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:17.013769 11464 log.cc:927] Time spent T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
W20260709 13:04:16.984140 10556 consensus_peers.cc:597] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:17.036603 10556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 52512.6us
W20260709 13:04:17.037147 10556 consensus_peers.cc:597] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:17.042474 10556 consensus_peers.cc:597] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:17.043025 10556 consensus_peers.cc:597] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:17.043430 10556 consensus_peers.cc:597] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:17.045233 10706 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 142519us
I20260709 13:04:17.081420 11323 raft_consensus.cc:359] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:17.086187 11323 raft_consensus.cc:740] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.089219 11323 consensus_queue.cc:260] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:17.064109 11466 raft_consensus.cc:2749] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:17.083544 11411 raft_consensus.cc:2749] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:17.078658 11320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 134910us
I20260709 13:04:17.115762 11466 raft_consensus.cc:3060] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.155946 11323 ts_tablet_manager.cc:1434] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.141s	user 0.014s	sys 0.009s
I20260709 13:04:17.156939 11323 tablet_bootstrap.cc:492] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:17.179490 10704 consensus_peers.cc:597] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:17.131502 11320 leader_election.cc:304] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:17.199117 11411 raft_consensus.cc:3060] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:17.199311 11320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 75144us
W20260709 13:04:17.168659 11373 log.cc:927] Time spent T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
W20260709 13:04:17.250715 10630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 68722.8us
I20260709 13:04:17.221647 11411 raft_consensus.cc:2749] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:17.301465 11480 log.cc:927] Time spent T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb: Append to log took a long time: real 0.120s	user 0.003s	sys 0.002s
W20260709 13:04:17.341240 11319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:46191, user_credentials={real_user=slave}} blocked reactor thread for 399490us
W20260709 13:04:17.371312 10630 consensus_peers.cc:597] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:17.361227 11486 raft_consensus.cc:493] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.408663 11486 raft_consensus.cc:515] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:17.411823 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7af85d78c0c41aeb882be10181161bf" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:17.412138 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7af85d78c0c41aeb882be10181161bf" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:17.414252 11320 leader_election.cc:304] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:17.415274 11411 raft_consensus.cc:2749] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:17.424968 11486 leader_election.cc:290] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
W20260709 13:04:17.483702 11487 log.cc:927] Time spent T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:04:17.501425 11466 raft_consensus.cc:2749] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:17.518432 10411 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40232 (request call id 100) took 1168 ms. Trace:
I20260709 13:04:17.539845 11475 raft_consensus.cc:493] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:17.545991 11494 log.cc:927] Time spent T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:04:17.549891 11475 raft_consensus.cc:515] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:17.556670 11475 leader_election.cc:290] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:17.558205 11323 tablet_bootstrap.cc:492] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:17.559195 11323 tablet_bootstrap.cc:492] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:17.559816 11323 ts_tablet_manager.cc:1403] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.403s	user 0.021s	sys 0.023s
I20260709 13:04:17.562294 11323 raft_consensus.cc:359] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:17.563225 11466 raft_consensus.cc:493] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.563944 11466 raft_consensus.cc:515] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:17.566342 11466 leader_election.cc:290] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:17.535131 10411 rpcz_store.cc:276] 0709 13:04:16.348519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.348718 (+   199us) service_pool.cc:224] Handling call
0709 13:04:17.516787 (+1168069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:16.917952 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:16.918720 (+   768us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:16.918766 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:04:16.918785 (+    19us) tablet.cc:662] Decoding operations
0709 13:04:16.919635 (+   850us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:16.919698 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:16.919738 (+    40us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:04:16.920423 (+   685us) tablet.cc:701] Row locks acquired
0709 13:04:16.920450 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:04:16.920616 (+   166us) write_op.cc:270] Start()
0709 13:04:16.920736 (+   120us) write_op.cc:276] Timestamp: P: 1783602256920560 usec, L: 0
0709 13:04:16.920774 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:04:16.921582 (+   808us) log.cc:844] Serialized 2481 byte log entry
0709 13:04:17.438554 (+516972us) op_driver.cc:464] REPLICATION: finished
0709 13:04:17.446770 (+  8216us) write_op.cc:301] APPLY: starting
0709 13:04:17.448562 (+  1792us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:17.463659 (+ 15097us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:17.469271 (+  5612us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:17.505720 (+ 36449us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:17.505919 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:04:17.505969 (+    50us) write_op.cc:312] APPLY: finished
0709 13:04:17.506219 (+   250us) log.cc:844] Serialized 52 byte log entry
0709 13:04:17.506377 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:17.506483 (+   106us) write_op.cc:454] Released schema lock
0709 13:04:17.506526 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:17.506866 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:17.506894 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":93277,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":3472,"apply.run_cpu_time_us":2797,"apply.run_wall_time_us":60919,"num_ops":6,"prepare.queue_time_us":87502,"prepare.run_cpu_time_us":3640,"prepare.run_wall_time_us":3903,"replication_time_us":505782}]]}
I20260709 13:04:17.603678 10412 catalog_manager.cc:5697] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } }
I20260709 13:04:17.646832 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d54a6a210240e8994f2e4a34596f81" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:17.648301 10665 raft_consensus.cc:2468] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:17.652529 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0539b460f174e8b80e242e8ae3c3801" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:17.651305 10557 leader_election.cc:304] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:17.563226 11323 raft_consensus.cc:740] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.663264 11323 consensus_queue.cc:260] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:17.668686 11475 raft_consensus.cc:2804] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:17.669498 11475 raft_consensus.cc:493] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.670019 11475 raft_consensus.cc:3060] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.674337 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0539b460f174e8b80e242e8ae3c3801" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:17.679141 11319 leader_election.cc:304] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:17.677366 11352 raft_consensus.cc:493] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.682518 11117 raft_consensus.cc:493] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.683566 11486 raft_consensus.cc:2749] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:17.683521 11117 raft_consensus.cc:515] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:17.683183 11352 raft_consensus.cc:515] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:17.717221 11352 leader_election.cc:290] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:17.719022 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8dbc2680fd461c836d48a8f8692e50" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:17.720005 10665 raft_consensus.cc:2468] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:17.722360 10557 leader_election.cc:304] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:17.725909 11352 raft_consensus.cc:2804] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:17.726516 11352 raft_consensus.cc:493] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.726943 11352 raft_consensus.cc:3060] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.743736 11117 leader_election.cc:290] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:17.745107 11323 ts_tablet_manager.cc:1434] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.185s	user 0.012s	sys 0.000s
I20260709 13:04:17.771873 11323 tablet_bootstrap.cc:492] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:17.803583 10556 leader_election.cc:336] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:17.803668 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:17.804867 10663 raft_consensus.cc:2468] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 2.
I20260709 13:04:17.837610 11325 raft_consensus.cc:493] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.838433 11325 raft_consensus.cc:515] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:17.841501 11325 leader_election.cc:290] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
W20260709 13:04:17.849452 10704 leader_election.cc:336] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:17.851063 10411 catalog_manager.cc:5697] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } }
I20260709 13:04:17.854171 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:17.855057 10591 raft_consensus.cc:2468] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
I20260709 13:04:17.862860 11352 raft_consensus.cc:515] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:17.867110 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8dbc2680fd461c836d48a8f8692e50" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:17.868058 10663 raft_consensus.cc:3060] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.853581 10411 catalog_manager.cc:5697] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 1 to 2, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } }
I20260709 13:04:17.870484 11352 leader_election.cc:290] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 3 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
W20260709 13:04:17.873615 10556 leader_election.cc:336] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:17.884225 11475 raft_consensus.cc:515] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:17.932727 11475 leader_election.cc:290] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 3 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
W20260709 13:04:17.934173 10630 leader_election.cc:336] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:17.934378 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4d54a6a210240e8994f2e4a34596f81" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:17.935009 10665 raft_consensus.cc:3060] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.939455 10632 leader_election.cc:304] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:17.945318 10663 raft_consensus.cc:2468] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 3.
I20260709 13:04:17.952179 10557 leader_election.cc:304] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:17.946019 11325 raft_consensus.cc:2804] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:17.959525 11475 raft_consensus.cc:2804] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:17.960537 11475 raft_consensus.cc:697] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:17.961709 11475 consensus_queue.cc:237] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:17.956987 11325 raft_consensus.cc:493] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.965227 11325 raft_consensus.cc:3060] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.957301 10705 leader_election.cc:304] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:17.974650 10705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:46191, user_credentials={real_user=slave}} blocked reactor thread for 57321.2us
I20260709 13:04:17.975658 11117 raft_consensus.cc:2804] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:17.976023 11117 raft_consensus.cc:493] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.976384 11117 raft_consensus.cc:3060] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.983650 10665 raft_consensus.cc:2468] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 3.
I20260709 13:04:17.987186 10557 leader_election.cc:304] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
W20260709 13:04:17.991604 10556 leader_election.cc:336] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:17.992715 11361 raft_consensus.cc:2804] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:17.993381 11361 raft_consensus.cc:697] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:17.994508 11361 consensus_queue.cc:237] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:17.985468 11117 raft_consensus.cc:515] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:18.012334 11323 tablet_bootstrap.cc:492] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:18.015838 11117 leader_election.cc:290] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:18.018107 11323 tablet_bootstrap.cc:492] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:18.019019 11323 ts_tablet_manager.cc:1403] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.248s	user 0.021s	sys 0.013s
I20260709 13:04:18.023200 10665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:18.023859 10665 raft_consensus.cc:3060] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:18.028115 11323 raft_consensus.cc:359] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:18.001452 11325 raft_consensus.cc:515] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:18.038446 11325 leader_election.cc:290] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 3 election: Requested vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
W20260709 13:04:18.042326 10630 leader_election.cc:336] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:18.028934 11323 raft_consensus.cc:740] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.044135 11323 consensus_queue.cc:260] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
W20260709 13:04:18.045023 10704 leader_election.cc:336] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:18.049077 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:18.049829 10591 raft_consensus.cc:3060] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:18.051299 11323 ts_tablet_manager.cc:1434] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.001s
I20260709 13:04:18.041678 10665 raft_consensus.cc:2468] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd6ac4ec789b459bbbfa3d6952103df5 in term 3.
I20260709 13:04:18.056945 10705 leader_election.cc:304] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5; no voters: cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:18.063658 10556 leader_election.cc:336] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111)
I20260709 13:04:18.065573 11365 raft_consensus.cc:2804] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:18.072257 11365 raft_consensus.cc:697] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 LEADER]: Becoming Leader. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:18.081542 11365 consensus_queue.cc:237] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:18.086855 11323 tablet_bootstrap.cc:492] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:18.093585 10591 raft_consensus.cc:2468] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 3.
I20260709 13:04:18.117892 10632 leader_election.cc:304] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:18.118216 10704 consensus_peers.cc:597] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:18.119804 11397 raft_consensus.cc:2804] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:18.120311 11397 raft_consensus.cc:697] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:18.121299 11397 consensus_queue.cc:237] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:18.149358 10414 catalog_manager.cc:5697] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 3, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.162595 10414 catalog_manager.cc:5697] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 3, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.206921 10411 catalog_manager.cc:5697] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 reported cstate change: term changed from 1 to 3, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.229926 10412 catalog_manager.cc:5697] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 1 to 3, leader changed from cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193) to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 3 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:18.239068 11466 raft_consensus.cc:493] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.239705 11466 raft_consensus.cc:515] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:18.242229 11466 leader_election.cc:290] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:18.245640 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6dbf486214445a8d6a624d253a2a24" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:18.245477 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d6dbf486214445a8d6a624d253a2a24" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:18.264882 11320 leader_election.cc:304] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:18.272583 11466 raft_consensus.cc:2749] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:18.289215 11323 tablet_bootstrap.cc:492] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:18.305855 11323 tablet_bootstrap.cc:492] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:18.306561 11323 ts_tablet_manager.cc:1403] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.236s	user 0.026s	sys 0.006s
I20260709 13:04:18.309408 11323 raft_consensus.cc:359] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:18.311311 11323 raft_consensus.cc:740] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.313005 11323 consensus_queue.cc:260] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:18.321885 11323 ts_tablet_manager.cc:1434] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:04:18.323053 11323 tablet_bootstrap.cc:492] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:18.340405 10556 consensus_peers.cc:597] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:18.351490 11466 raft_consensus.cc:493] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.352150 11466 raft_consensus.cc:515] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:18.359050 11466 leader_election.cc:290] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:18.368180 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59be6ff2ab0e47f8b55843170279fc38" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:18.369045 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59be6ff2ab0e47f8b55843170279fc38" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:18.375941 11319 leader_election.cc:304] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:18.383253 11466 raft_consensus.cc:2749] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:18.390537 10663 raft_consensus.cc:1275] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:18.393466 11473 consensus_queue.cc:1048] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:18.414289 10665 raft_consensus.cc:1275] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:18.416824 11473 consensus_queue.cc:1048] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:18.488538 11466 raft_consensus.cc:493] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.489416 11466 raft_consensus.cc:515] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:18.494868 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6efd752eb04cadb27f38108369d56d" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:18.503717 11466 leader_election.cc:290] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:18.505950 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6efd752eb04cadb27f38108369d56d" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:18.513176 10662 raft_consensus.cc:1275] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Refusing update from remote peer bd6ac4ec789b459bbbfa3d6952103df5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:18.515699 11320 leader_election.cc:304] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:18.518152 11466 raft_consensus.cc:2749] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:18.523909 11365 consensus_queue.cc:1048] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:18.533459 11466 raft_consensus.cc:493] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.534125 11466 raft_consensus.cc:515] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:18.543222 11466 leader_election.cc:290] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:18.546901 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e3368943d24f409949b4a22082867d" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:18.553021 10659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7e3368943d24f409949b4a22082867d" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" is_pre_election: true
I20260709 13:04:18.563802 11319 leader_election.cc:304] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:18.565132 11466 raft_consensus.cc:2749] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:18.570381 11323 tablet_bootstrap.cc:492] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:18.571468 11323 tablet_bootstrap.cc:492] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:18.572109 11323 ts_tablet_manager.cc:1403] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.249s	user 0.023s	sys 0.005s
I20260709 13:04:18.575265   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:45489
I20260709 13:04:18.575512 11533 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:45489 every 8 connection(s)
I20260709 13:04:18.617147 11323 raft_consensus.cc:359] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:18.620872 11323 raft_consensus.cc:740] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.622056 11323 consensus_queue.cc:260] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:18.630549 11323 ts_tablet_manager.cc:1434] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:04:18.668423 11323 tablet_bootstrap.cc:492] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:18.689800 11496 raft_consensus.cc:3060] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.694857 10591 raft_consensus.cc:1275] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:18.697086 11345 consensus_queue.cc:1048] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:18.697834 11463 raft_consensus.cc:3060] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:18.751756 11448 raft_consensus.cc:3060] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.767313 11435 raft_consensus.cc:3060] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.781572 11447 raft_consensus.cc:3060] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.788952 11463 raft_consensus.cc:1275] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:04:18.813839 10630 consensus_peers.cc:597] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:18.814714 10704 consensus_peers.cc:597] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:18.822842 10704 consensus_peers.cc:597] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:18.848382 10556 consensus_peers.cc:597] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:18.849282 10556 consensus_peers.cc:597] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:18.851646 10556 consensus_peers.cc:597] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:18.863082 10704 consensus_peers.cc:597] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:18.863703 10704 consensus_peers.cc:597] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:18.865993 11359 consensus_queue.cc:1048] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:04:18.873344 11323 tablet_bootstrap.cc:492] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:18.874615 11323 tablet_bootstrap.cc:492] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:18.877302 11323 ts_tablet_manager.cc:1403] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.225s	user 0.022s	sys 0.045s
W20260709 13:04:18.886116 10704 consensus_peers.cc:597] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:18.895527 10704 consensus_peers.cc:597] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:18.901269 11544 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33053
I20260709 13:04:18.901080 11323 raft_consensus.cc:359] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:18.901964 11323 raft_consensus.cc:740] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.901815 11544 heartbeater.cc:461] Registering TS with master...
W20260709 13:04:18.903374 10556 consensus_peers.cc:597] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:18.909607 11544 heartbeater.cc:507] Master 127.0.107.254:33053 requested a full tablet report, sending...
I20260709 13:04:18.907297 11323 consensus_queue.cc:260] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:18.917001 11466 raft_consensus.cc:493] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bd6ac4ec789b459bbbfa3d6952103df5)
I20260709 13:04:18.917619 11466 raft_consensus.cc:515] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:18.922612 11466 leader_election.cc:290] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:18.925563 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:18.925683 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ec3c36841f4761b2a802c2592154f3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:18.928243 11320 leader_election.cc:304] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:18.929582 11561 raft_consensus.cc:2749] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:18.933427 10704 consensus_peers.cc:597] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:18.940912 10704 consensus_peers.cc:597] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:18.946388 11552 raft_consensus.cc:493] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1a3b379dbfc7437e99aa8bb10ef958cb)
I20260709 13:04:18.949272 11552 raft_consensus.cc:515] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:18.960318 11323 ts_tablet_manager.cc:1434] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.000s
I20260709 13:04:18.966501 11552 leader_election.cc:290] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
W20260709 13:04:18.956779 10630 consensus_peers.cc:597] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:18.975047 10630 consensus_peers.cc:597] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:18.978559 10733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" is_pre_election: true
I20260709 13:04:18.983964 10591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2950e99d7eff498ab8a6edfd044d2178" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" is_pre_election: true
I20260709 13:04:18.985766 11320 leader_election.cc:304] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbba8b78b34443bcb2be4b73f86fac96; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5
I20260709 13:04:18.987537 11552 raft_consensus.cc:2749] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:18.988576 11448 raft_consensus.cc:3060] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.992923 11323 tablet_bootstrap.cc:492] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:19.008466 10630 consensus_peers.cc:597] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:19.012138 10411 ts_manager.cc:194] Re-registered known tserver with Master: cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
W20260709 13:04:19.046478 10704 consensus_peers.cc:597] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:19.064504 11323 tablet_bootstrap.cc:492] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.065801 11323 tablet_bootstrap.cc:492] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.066481 11323 ts_tablet_manager.cc:1403] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.001s
I20260709 13:04:19.071437 11323 raft_consensus.cc:359] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.072176 11323 raft_consensus.cc:740] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.072978 11323 consensus_queue.cc:260] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
W20260709 13:04:19.079591 10704 consensus_peers.cc:597] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:19.081332 11323 ts_tablet_manager.cc:1434] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:04:19.082374 11323 tablet_bootstrap.cc:492] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:19.116835 10704 consensus_peers.cc:597] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:19.118297 10411 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36514
I20260709 13:04:19.122159 11323 tablet_bootstrap.cc:492] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.122771 11544 heartbeater.cc:499] Master 127.0.107.254:33053 was elected leader, sending a full tablet report...
I20260709 13:04:19.123397 11323 tablet_bootstrap.cc:492] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.124136 11323 ts_tablet_manager.cc:1403] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.012s
I20260709 13:04:19.126974 11323 raft_consensus.cc:359] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:19.127653 11323 raft_consensus.cc:740] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.128304 11323 consensus_queue.cc:260] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:19.130426 11323 ts_tablet_manager.cc:1434] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:19.131395 11323 tablet_bootstrap.cc:492] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:19.180110 11323 tablet_bootstrap.cc:492] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.181113 11323 tablet_bootstrap.cc:492] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.181790 11323 ts_tablet_manager.cc:1403] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.051s	user 0.034s	sys 0.012s
I20260709 13:04:19.184501 11323 raft_consensus.cc:359] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:19.185187 11323 raft_consensus.cc:740] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.185889 11323 consensus_queue.cc:260] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:19.188414 11323 ts_tablet_manager.cc:1434] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:19.189191 11323 tablet_bootstrap.cc:492] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:19.222227 10630 consensus_peers.cc:597] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:19.227201 11323 tablet_bootstrap.cc:492] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.228243 11323 tablet_bootstrap.cc:492] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.228919 11323 ts_tablet_manager.cc:1403] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.017s
I20260709 13:04:19.233122 11323 raft_consensus.cc:359] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:19.233814 11323 raft_consensus.cc:740] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.234997 11323 consensus_queue.cc:260] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:19.236759 11323 ts_tablet_manager.cc:1434] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:04:19.237550 11323 tablet_bootstrap.cc:492] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:19.255390 11323 tablet_bootstrap.cc:492] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.256428 11323 tablet_bootstrap.cc:492] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.257172 11323 ts_tablet_manager.cc:1403] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 13:04:19.260874 11323 raft_consensus.cc:359] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:19.261569 11323 raft_consensus.cc:740] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.262251 11323 consensus_queue.cc:260] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:19.265151 11323 ts_tablet_manager.cc:1434] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:04:19.266160 11323 tablet_bootstrap.cc:492] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:19.284030 10630 consensus_peers.cc:597] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:19.291227 11323 tablet_bootstrap.cc:492] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.292409 11323 tablet_bootstrap.cc:492] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.293111 11323 ts_tablet_manager.cc:1403] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.010s
I20260709 13:04:19.296106 11323 raft_consensus.cc:359] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.296868 11323 raft_consensus.cc:740] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.297602 11323 consensus_queue.cc:260] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.299889 11323 ts_tablet_manager.cc:1434] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:19.301545 11323 tablet_bootstrap.cc:492] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:19.321784 10704 consensus_peers.cc:597] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:19.327308 11323 tablet_bootstrap.cc:492] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.328346 11323 tablet_bootstrap.cc:492] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.329041 11323 ts_tablet_manager.cc:1403] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.006s
I20260709 13:04:19.332021 11323 raft_consensus.cc:359] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.332787 11323 raft_consensus.cc:740] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.333510 11323 consensus_queue.cc:260] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.335836 11323 ts_tablet_manager.cc:1434] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:04:19.337536 11323 tablet_bootstrap.cc:492] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:19.366247 11323 tablet_bootstrap.cc:492] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.367276 11323 tablet_bootstrap.cc:492] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.368021 11323 ts_tablet_manager.cc:1403] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.004s
I20260709 13:04:19.370770 11323 raft_consensus.cc:359] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:19.371519 11323 raft_consensus.cc:740] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.372239 11323 consensus_queue.cc:260] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:19.374379 11323 ts_tablet_manager.cc:1434] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:19.375232 11323 tablet_bootstrap.cc:492] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:19.401310 11323 tablet_bootstrap.cc:492] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.402740 11323 tablet_bootstrap.cc:492] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.403450 11323 ts_tablet_manager.cc:1403] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.016s
I20260709 13:04:19.406431 11323 raft_consensus.cc:359] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:19.407217 11323 raft_consensus.cc:740] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.408146 11323 consensus_queue.cc:260] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:19.410458 11323 ts_tablet_manager.cc:1434] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:19.436350 11435 raft_consensus.cc:3060] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:19.442449 11323 tablet_bootstrap.cc:492] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:19.446143 11465 raft_consensus.cc:3060] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:19.545260 10630 consensus_peers.cc:597] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:19.550797 11465 raft_consensus.cc:3060] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:19.621219 10556 consensus_peers.cc:597] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:19.661794 11435 raft_consensus.cc:3060] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:19.670794 11323 tablet_bootstrap.cc:492] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.672055 11323 tablet_bootstrap.cc:492] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.672801 11323 ts_tablet_manager.cc:1403] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.231s	user 0.093s	sys 0.116s
I20260709 13:04:19.675527 11323 raft_consensus.cc:359] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:19.676322 11323 raft_consensus.cc:740] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.677695 11323 consensus_queue.cc:260] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:19.680316 11323 ts_tablet_manager.cc:1434] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:19.681347 11323 tablet_bootstrap.cc:492] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:19.722223 11323 tablet_bootstrap.cc:492] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.723279 11323 tablet_bootstrap.cc:492] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.724050 11323 ts_tablet_manager.cc:1403] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.001s
I20260709 13:04:19.726774 11323 raft_consensus.cc:359] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.727480 11323 raft_consensus.cc:740] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.728205 11323 consensus_queue.cc:260] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.730511 11323 ts_tablet_manager.cc:1434] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:19.731489 11323 tablet_bootstrap.cc:492] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:19.748653 11323 tablet_bootstrap.cc:492] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.749656 11323 tablet_bootstrap.cc:492] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.750379 11323 ts_tablet_manager.cc:1403] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:04:19.753147 11323 raft_consensus.cc:359] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:19.753841 11323 raft_consensus.cc:740] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.754521 11323 consensus_queue.cc:260] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:19.756668 11323 ts_tablet_manager.cc:1434] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:19.758265 11323 tablet_bootstrap.cc:492] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:19.761548 11435 raft_consensus.cc:3060] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:19.775731 11465 raft_consensus.cc:3060] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:19.817709 11323 tablet_bootstrap.cc:492] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.818815 11323 tablet_bootstrap.cc:492] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.820962 11323 ts_tablet_manager.cc:1403] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.063s	user 0.036s	sys 0.021s
I20260709 13:04:19.832257 11323 raft_consensus.cc:359] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.832960 11323 raft_consensus.cc:740] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.833637 11323 consensus_queue.cc:260] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.835711 11323 ts_tablet_manager.cc:1434] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:04:19.843293 11323 tablet_bootstrap.cc:492] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:19.900414 11323 tablet_bootstrap.cc:492] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.901196 11323 tablet_bootstrap.cc:492] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.901718 11323 ts_tablet_manager.cc:1403] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.059s	user 0.005s	sys 0.015s
I20260709 13:04:19.904184 11323 raft_consensus.cc:359] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.904796 11323 raft_consensus.cc:740] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.905462 11323 consensus_queue.cc:260] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.909271 11323 ts_tablet_manager.cc:1434] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:04:19.912039 11323 tablet_bootstrap.cc:492] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:19.919905 11488 raft_consensus.cc:3060] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:19.942425 11323 tablet_bootstrap.cc:492] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.943501 11323 tablet_bootstrap.cc:492] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.944130 11323 ts_tablet_manager.cc:1403] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.004s
I20260709 13:04:19.946620 11323 raft_consensus.cc:359] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.947288 11323 raft_consensus.cc:740] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.947930 11323 consensus_queue.cc:260] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:19.949760 11323 ts_tablet_manager.cc:1434] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:19.950591 11323 tablet_bootstrap.cc:492] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:19.992355 11323 tablet_bootstrap.cc:492] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:19.993316 11323 tablet_bootstrap.cc:492] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:19.993991 11323 ts_tablet_manager.cc:1403] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.012s
I20260709 13:04:19.999044 11323 raft_consensus.cc:359] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:19.999716 11323 raft_consensus.cc:740] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.000480 11323 consensus_queue.cc:260] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:20.007839 11323 ts_tablet_manager.cc:1434] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:20.008744 11323 tablet_bootstrap.cc:492] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:20.026132 11323 tablet_bootstrap.cc:492] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:20.026890 11323 tablet_bootstrap.cc:492] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:20.027452 11323 ts_tablet_manager.cc:1403] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 13:04:20.029901 11323 raft_consensus.cc:359] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:20.030581 11323 raft_consensus.cc:740] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.031373 11323 consensus_queue.cc:260] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:20.033452 11323 ts_tablet_manager.cc:1434] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:20.034406 11323 tablet_bootstrap.cc:492] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:20.055666 11323 tablet_bootstrap.cc:492] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:20.056456 11323 tablet_bootstrap.cc:492] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:20.057042 11323 ts_tablet_manager.cc:1403] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:04:20.059199 11323 raft_consensus.cc:359] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:20.059731 11323 raft_consensus.cc:740] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.060379 11323 consensus_queue.cc:260] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:20.063159 11323 ts_tablet_manager.cc:1434] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:20.063962 11323 tablet_bootstrap.cc:492] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:20.071046 11435 raft_consensus.cc:3060] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.101827 11488 raft_consensus.cc:3060] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:04:20.149158 11465 raft_consensus.cc:3060] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.300392 11448 raft_consensus.cc:3060] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.336648 11323 tablet_bootstrap.cc:492] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:20.337997 11323 tablet_bootstrap.cc:492] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:20.338755 11323 ts_tablet_manager.cc:1403] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.275s	user 0.048s	sys 0.061s
I20260709 13:04:20.341493 11323 raft_consensus.cc:359] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:20.353601 11323 raft_consensus.cc:740] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.354492 11323 consensus_queue.cc:260] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:20.378082 11323 ts_tablet_manager.cc:1434] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:04:20.379806 11323 tablet_bootstrap.cc:492] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:20.416826 11323 tablet_bootstrap.cc:492] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:20.417816 11323 tablet_bootstrap.cc:492] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:20.418588 11323 ts_tablet_manager.cc:1403] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.009s
I20260709 13:04:20.426668 11323 raft_consensus.cc:359] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:20.427435 11323 raft_consensus.cc:740] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.428265 11323 consensus_queue.cc:260] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:20.430747 11323 ts_tablet_manager.cc:1434] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:04:20.431988 11323 tablet_bootstrap.cc:492] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:20.453495 11323 tablet_bootstrap.cc:492] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:20.454510 11323 tablet_bootstrap.cc:492] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:20.455229 11323 ts_tablet_manager.cc:1403] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.000s
I20260709 13:04:20.457856 11323 raft_consensus.cc:359] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:20.458581 11323 raft_consensus.cc:740] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.459275 11323 consensus_queue.cc:260] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:20.461740 11323 ts_tablet_manager.cc:1434] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:20.462725 11323 tablet_bootstrap.cc:492] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:20.485651 11323 tablet_bootstrap.cc:492] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:20.486701 11323 tablet_bootstrap.cc:492] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:20.487401 11323 ts_tablet_manager.cc:1403] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.003s
I20260709 13:04:20.491676 11323 raft_consensus.cc:359] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:20.492390 11323 raft_consensus.cc:740] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.493103 11323 consensus_queue.cc:260] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:20.662544 11323 ts_tablet_manager.cc:1434] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.175s	user 0.032s	sys 0.023s
W20260709 13:04:20.661442 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 160561us
I20260709 13:04:20.665463 11323 tablet_bootstrap.cc:492] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
W20260709 13:04:20.769170 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:46841, user_credentials={real_user=slave}} blocked reactor thread for 103950us
I20260709 13:04:20.950565 11496 raft_consensus.cc:3060] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:20.993507 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 46885.1us
I20260709 13:04:21.055378 11435 raft_consensus.cc:3060] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:21.085521 10704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 76069.5us
W20260709 13:04:21.082371 10630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 135448us
I20260709 13:04:21.139173 11476 raft_consensus.cc:3060] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:21.157848 11453 raft_consensus.cc:3060] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:21.190550 10704 consensus_peers.cc:597] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:21.196376 10556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 60960.6us
W20260709 13:04:21.203388 10556 consensus_peers.cc:597] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:21.211651 10632 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 46162.1us
I20260709 13:04:21.282172 11323 tablet_bootstrap.cc:492] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.288165 11323 tablet_bootstrap.cc:492] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:21.288928 11323 ts_tablet_manager.cc:1403] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.626s	user 0.048s	sys 0.036s
I20260709 13:04:21.291756 11323 raft_consensus.cc:359] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:21.292510 11323 raft_consensus.cc:740] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.293283 11323 consensus_queue.cc:260] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:21.302500 11323 ts_tablet_manager.cc:1434] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:04:21.303593 11323 tablet_bootstrap.cc:492] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:21.343880 11323 tablet_bootstrap.cc:492] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.344676 11323 tablet_bootstrap.cc:492] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:21.345327 11323 ts_tablet_manager.cc:1403] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.007s
I20260709 13:04:21.353440 11323 raft_consensus.cc:359] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:21.354153 11323 raft_consensus.cc:740] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.354715 11323 consensus_queue.cc:260] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:21.358600 11323 ts_tablet_manager.cc:1434] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.008s
I20260709 13:04:21.359301 11323 tablet_bootstrap.cc:492] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:21.373121 11323 tablet_bootstrap.cc:492] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:21.373747 10556 consensus_peers.cc:597] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:21.374082 11323 tablet_bootstrap.cc:492] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:21.374809 11323 ts_tablet_manager.cc:1403] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.001s
I20260709 13:04:21.376809 11323 raft_consensus.cc:359] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:21.377318 11323 raft_consensus.cc:740] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.377907 11323 consensus_queue.cc:260] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:21.379633 11323 ts_tablet_manager.cc:1434] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:21.380739 11323 tablet_bootstrap.cc:492] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:21.394730 11323 tablet_bootstrap.cc:492] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.395701 11323 tablet_bootstrap.cc:492] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:21.396315 11323 ts_tablet_manager.cc:1403] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:04:21.403715 11323 raft_consensus.cc:359] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:21.404376 11323 raft_consensus.cc:740] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.405005 11323 consensus_queue.cc:260] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:21.412626 11323 ts_tablet_manager.cc:1434] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:04:21.413440 11323 tablet_bootstrap.cc:492] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:21.433921 11323 tablet_bootstrap.cc:492] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.434909 11323 tablet_bootstrap.cc:492] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:21.435590 11323 ts_tablet_manager.cc:1403] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:04:21.438380 11323 raft_consensus.cc:359] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:21.439067 11323 raft_consensus.cc:740] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.439822 11323 consensus_queue.cc:260] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:21.447955 11323 ts_tablet_manager.cc:1434] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:21.448848 11323 tablet_bootstrap.cc:492] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap starting.
I20260709 13:04:21.467026 11323 tablet_bootstrap.cc:492] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:21.467904 11323 tablet_bootstrap.cc:492] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96: Bootstrap complete.
I20260709 13:04:21.468608 11323 ts_tablet_manager.cc:1403] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:04:21.471735 11323 raft_consensus.cc:359] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:21.472389 11323 raft_consensus.cc:740] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.473054 11323 consensus_queue.cc:260] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:21.475251 11323 ts_tablet_manager.cc:1434] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:21.480737 11463 raft_consensus.cc:3060] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:21.509691 11476 raft_consensus.cc:3060] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:21.635519 11496 raft_consensus.cc:3060] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:26.555203 10613 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac000 after lost signal to thread 434
W20260709 13:04:26.556195 10613 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd820 after lost signal to thread 10449
W20260709 13:04:26.557178 10613 debug-util.cc:398] Leaking SignalData structure 0x7b0800135fa0 after lost signal to thread 10616
W20260709 13:04:26.558194 10613 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7720 after lost signal to thread 10690
W20260709 13:04:26.559284 10613 debug-util.cc:398] Leaking SignalData structure 0x7b08001530a0 after lost signal to thread 10764
W20260709 13:04:26.560393 10613 debug-util.cc:398] Leaking SignalData structure 0x7b08001b5560 after lost signal to thread 11533
W20260709 13:04:27.772346 10630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 65355us
W20260709 13:04:27.818193 10705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:46191, user_credentials={real_user=slave}} blocked reactor thread for 43611.2us
W20260709 13:04:27.891904 10704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 70766.8us
W20260709 13:04:27.896255 10558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 93654.8us
I20260709 13:04:28.671139   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:28.737042 10584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8"
dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:50840
I20260709 13:04:28.738005 10584 raft_consensus.cc:606] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:28.742048 10584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59be6ff2ab0e47f8b55843170279fc38"
dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:50840
I20260709 13:04:28.742628 10584 raft_consensus.cc:606] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:28.755177 10663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b67ee136262443e819e7ca67628050a"
dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:58378
I20260709 13:04:28.755882 10663 raft_consensus.cc:606] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:28.758883 10663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67449a01ef99467887627b70924e3efc"
dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:58378
I20260709 13:04:28.759563 10663 raft_consensus.cc:606] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:28.812253 11679 raft_consensus.cc:993] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:28.812687 10736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "775092b557874c49bfae75484c568a37"
dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
mode: GRACEFUL
new_leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
 from {username='slave'} at 127.0.0.1:59134
I20260709 13:04:28.813382 10736 raft_consensus.cc:606] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Received request to transfer leadership to TS 1a3b379dbfc7437e99aa8bb10ef958cb
I20260709 13:04:28.812803 11679 raft_consensus.cc:1081] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:28.816061 10663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3"
dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:58378
I20260709 13:04:28.816534 10663 raft_consensus.cc:606] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:28.816298 11435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67449a01ef99467887627b70924e3efc"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35906
I20260709 13:04:28.817121 11435 raft_consensus.cc:493] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.817642 11435 raft_consensus.cc:3060] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.818006   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:28.819440   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:28.828907 11435 raft_consensus.cc:515] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:28.832304 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67449a01ef99467887627b70924e3efc" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:28.833098 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67449a01ef99467887627b70924e3efc" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:28.833259 10663 raft_consensus.cc:3055] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:28.833899 10736 raft_consensus.cc:3060] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.833985 11435 leader_election.cc:290] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:28.833911 10663 raft_consensus.cc:740] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:28.836107 10663 consensus_queue.cc:260] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:28.837356 10663 raft_consensus.cc:3060] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.844182 10736 raft_consensus.cc:2468] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:28.846155 11320 leader_election.cc:304] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:28.849426 10663 raft_consensus.cc:2468] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:28.851475 11690 raft_consensus.cc:2804] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:28.856024 11690 raft_consensus.cc:697] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:28.857272 11690 consensus_queue.cc:237] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:28.866627 11684 raft_consensus.cc:993] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:28.867120 11684 raft_consensus.cc:1081] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:28.868948 11435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35922
I20260709 13:04:28.869510 11435 raft_consensus.cc:493] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.870151 11435 raft_consensus.cc:3060] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.877869 11435 raft_consensus.cc:515] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:28.881160 11435 leader_election.cc:290] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:28.881593 11682 raft_consensus.cc:993] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:28.882138 11682 raft_consensus.cc:1081] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:28.883049 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:28.883759 10584 raft_consensus.cc:3055] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:28.884090 10584 raft_consensus.cc:740] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:28.884984 10584 consensus_queue.cc:260] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:28.888845 11435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b67ee136262443e819e7ca67628050a"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35906
I20260709 13:04:28.881383 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13eb6fc681c5467a922827af47067ab8" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:28.889642 10663 raft_consensus.cc:3060] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.889501 11435 raft_consensus.cc:493] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.890331 11435 raft_consensus.cc:3060] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:28.894253 10584 raft_consensus.cc:3060] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.902387 11435 raft_consensus.cc:515] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:28.905869 11435 leader_election.cc:290] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 4 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:28.906348 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:28.907025 10659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b67ee136262443e819e7ca67628050a" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:28.907680 10659 raft_consensus.cc:3055] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:28.907975 10659 raft_consensus.cc:740] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:28.908771 10659 consensus_queue.cc:260] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:28.910455 10659 raft_consensus.cc:3060] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:28.907110 10592 raft_consensus.cc:3060] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:28.920737 10412 catalog_manager.cc:5697] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 2 to 3, leader changed from 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.927277 10659 raft_consensus.cc:2468] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 4.
I20260709 13:04:28.928617 11319 leader_election.cc:304] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:28.929544 11690 raft_consensus.cc:2804] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:28.930105 11690 raft_consensus.cc:697] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 4 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:28.931067 11690 consensus_queue.cc:237] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:28.921720 10592 raft_consensus.cc:2468] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 4.
I20260709 13:04:28.938341 10663 raft_consensus.cc:2468] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:28.941614 10584 raft_consensus.cc:2468] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:28.941831 11319 leader_election.cc:304] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:28.944470 11691 raft_consensus.cc:2804] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:28.948699 11691 raft_consensus.cc:697] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:28.949906 11691 consensus_queue.cc:237] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:28.986096 10412 catalog_manager.cc:5697] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 3 to 4, leader changed from 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.987318 10412 catalog_manager.cc:5697] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 2 to 3, leader changed from 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.160501 11681 raft_consensus.cc:993] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5: : Instructing follower 1a3b379dbfc7437e99aa8bb10ef958cb to start an election
I20260709 13:04:29.161125 11693 raft_consensus.cc:1081] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Signalling peer 1a3b379dbfc7437e99aa8bb10ef958cb to start an election
I20260709 13:04:29.162588 10592 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "775092b557874c49bfae75484c568a37"
dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
 from {username='slave'} at 127.0.0.1:40048
I20260709 13:04:29.163156 10592 raft_consensus.cc:493] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.163493 10592 raft_consensus.cc:3060] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.171412 10592 raft_consensus.cc:515] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:29.174407 10592 leader_election.cc:290] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:29.175202 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775092b557874c49bfae75484c568a37" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:29.174654 11684 raft_consensus.cc:993] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:29.175817 10737 raft_consensus.cc:3055] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:29.176100 11657 raft_consensus.cc:1081] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:29.176192 10737 raft_consensus.cc:740] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:29.177197 10737 consensus_queue.cc:260] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:29.178442 11488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59be6ff2ab0e47f8b55843170279fc38"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35922
I20260709 13:04:29.178993 11488 raft_consensus.cc:493] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.179386 11488 raft_consensus.cc:3060] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.179600 10737 raft_consensus.cc:3060] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.174590 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "775092b557874c49bfae75484c568a37" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:29.181422 10663 raft_consensus.cc:3060] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.193871 10737 raft_consensus.cc:2468] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:29.195437 10558 leader_election.cc:304] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, bd6ac4ec789b459bbbfa3d6952103df5; no voters: 
I20260709 13:04:29.197173 11657 raft_consensus.cc:2804] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:29.197613 11657 raft_consensus.cc:697] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:29.198431 11657 consensus_queue.cc:237] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:29.209497 10663 raft_consensus.cc:2468] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:29.209839 11488 raft_consensus.cc:515] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:29.220618 11488 leader_election.cc:290] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:29.222970 11668 raft_consensus.cc:993] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:29.223274 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59be6ff2ab0e47f8b55843170279fc38" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:29.223618 11668 raft_consensus.cc:1081] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:29.223938 10584 raft_consensus.cc:3055] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:29.224347 10584 raft_consensus.cc:740] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:29.225246 10584 consensus_queue.cc:260] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:29.226469 10584 raft_consensus.cc:3060] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.227795 10412 catalog_manager.cc:5697] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 2, leader changed from bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.234620 11488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35906
I20260709 13:04:29.236688 11488 raft_consensus.cc:493] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.237138 11488 raft_consensus.cc:3060] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:29.244827 10584 raft_consensus.cc:2468] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 2.
I20260709 13:04:29.246089 11320 leader_election.cc:304] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:29.247565 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59be6ff2ab0e47f8b55843170279fc38" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:29.248049 11691 raft_consensus.cc:2804] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:29.248216 10663 raft_consensus.cc:3060] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.248636 11691 raft_consensus.cc:697] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:29.249581 11691 consensus_queue.cc:237] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:29.265431 10663 raft_consensus.cc:2468] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 2.
I20260709 13:04:29.286379 10663 raft_consensus.cc:1275] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:29.289153 11691 consensus_queue.cc:1048] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.293179 11488 raft_consensus.cc:515] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:29.295413 11488 leader_election.cc:290] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:29.297866 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:29.298502 10737 raft_consensus.cc:3060] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:29.312361 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5e544a9bf947f29b531ce9027580d3" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:29.313117 10666 raft_consensus.cc:3055] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:29.313429 10666 raft_consensus.cc:740] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:29.314282 10666 consensus_queue.cc:260] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:29.315972 10666 raft_consensus.cc:3060] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:29.323235 10411 catalog_manager.cc:5697] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 1 to 2, leader changed from 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.338424 10737 raft_consensus.cc:2468] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:29.340086 10738 raft_consensus.cc:1275] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:29.341797 11691 consensus_queue.cc:1048] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.343051 11320 leader_election.cc:304] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:29.344415 11695 raft_consensus.cc:2804] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:29.355238 11695 raft_consensus.cc:697] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:29.356549 11695 consensus_queue.cc:237] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:29.359541 10592 raft_consensus.cc:1275] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:29.361938 11709 consensus_queue.cc:1048] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:29.377948 10666 raft_consensus.cc:2468] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:29.401288 10411 catalog_manager.cc:5697] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 2 to 3, leader changed from 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:29.431329 10663 raft_consensus.cc:1275] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 4 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:29.439391 10659 raft_consensus.cc:1275] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:29.471101 10591 raft_consensus.cc:1275] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 4 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:29.483688 11695 consensus_queue.cc:1048] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.543881 11710 consensus_queue.cc:1048] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.549932 11710 consensus_queue.cc:1048] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.642999 10659 raft_consensus.cc:1275] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.644563 11710 consensus_queue.cc:1048] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.662714 10592 raft_consensus.cc:1275] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.664307 11691 consensus_queue.cc:1048] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.700706 10666 raft_consensus.cc:1275] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.702277 11702 consensus_queue.cc:1048] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:29.718974 10737 raft_consensus.cc:1275] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.721175 11701 consensus_queue.cc:1048] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:29.820567   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:29.845923 10737 raft_consensus.cc:1275] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:29.848321 11710 consensus_queue.cc:1048] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:29.868537 10666 raft_consensus.cc:1275] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:29.870851 11709 consensus_queue.cc:1048] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:29.909351   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:29.964035 10659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "830eb73bc1564d2bb6e76e82e123c6e6"
dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
mode: GRACEFUL
new_leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
 from {username='slave'} at 127.0.0.1:58378
I20260709 13:04:29.964689 10659 raft_consensus.cc:606] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Received request to transfer leadership to TS 1a3b379dbfc7437e99aa8bb10ef958cb
I20260709 13:04:29.967641 10592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b091d4dadcee40108323abee07cb66e4"
dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:50840
I20260709 13:04:29.968325 10592 raft_consensus.cc:606] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:29.971074 10737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b19c6fe03f9244a78476037b279a7bea"
dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
mode: GRACEFUL
new_leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
 from {username='slave'} at 127.0.0.1:59134
I20260709 13:04:29.971540 10737 raft_consensus.cc:606] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Received request to transfer leadership to TS 8b82fdd6486e40d180a9d1c7c320e38b
I20260709 13:04:29.976053 10737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76"
dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:59134
I20260709 13:04:29.976708 10737 raft_consensus.cc:606] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:29.980443 10659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbd5b2ba1e5c4fd09fb5e1e6b14da9d6"
dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
mode: GRACEFUL
new_leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
 from {username='slave'} at 127.0.0.1:58378
I20260709 13:04:29.980937 10659 raft_consensus.cc:606] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Received request to transfer leadership to TS 1a3b379dbfc7437e99aa8bb10ef958cb
I20260709 13:04:29.982098   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:29.983636   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:30.047089 11684 raft_consensus.cc:993] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:30.047776 11702 raft_consensus.cc:1081] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:30.049439 11435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b091d4dadcee40108323abee07cb66e4"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35922
I20260709 13:04:30.049949 11435 raft_consensus.cc:493] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.050311 11435 raft_consensus.cc:3060] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:30.057220 11435 raft_consensus.cc:515] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:30.060114 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091d4dadcee40108323abee07cb66e4" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:30.060745 10586 raft_consensus.cc:3055] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:30.061053 10586 raft_consensus.cc:740] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:30.062096 10586 consensus_queue.cc:260] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:30.064338 11435 leader_election.cc:290] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:30.063313 10586 raft_consensus.cc:3060] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:30.066512 10659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b091d4dadcee40108323abee07cb66e4" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:30.067111 10659 raft_consensus.cc:3060] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:30.068434 11719 raft_consensus.cc:993] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:30.069041 11719 raft_consensus.cc:1081] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:30.075513 10586 raft_consensus.cc:2468] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:30.076936 11320 leader_election.cc:304] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:30.077873 11709 raft_consensus.cc:2804] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:30.078354 11709 raft_consensus.cc:697] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:30.079324 11709 consensus_queue.cc:237] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:30.098143 10414 catalog_manager.cc:5697] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 2 to 3, leader changed from 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.103864 11435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35930
I20260709 13:04:30.104925 11435 raft_consensus.cc:493] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.105756 11435 raft_consensus.cc:3060] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:30.102958 10659 raft_consensus.cc:2468] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:30.116142 11435 raft_consensus.cc:515] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:30.119940 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:30.120517 10737 raft_consensus.cc:3055] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:30.120802 10737 raft_consensus.cc:740] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:30.121572 10737 consensus_queue.cc:260] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:30.122622 10737 raft_consensus.cc:3060] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:30.132190 10737 raft_consensus.cc:2468] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:30.132359 10592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9f43d189428086d7fc6781e9ac76" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:30.132907 11435 leader_election.cc:290] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:30.133035 10592 raft_consensus.cc:3060] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:30.133309 11320 leader_election.cc:304] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:30.134502 11709 raft_consensus.cc:2804] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:30.134877 11709 raft_consensus.cc:697] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:30.135661 11709 consensus_queue.cc:237] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:30.145344 10592 raft_consensus.cc:2468] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:30.166076 10414 catalog_manager.cc:5697] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 2 to 3, leader changed from bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.257401 11722 raft_consensus.cc:993] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b: : Instructing follower 1a3b379dbfc7437e99aa8bb10ef958cb to start an election
I20260709 13:04:30.258069 11668 raft_consensus.cc:1081] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Signalling peer 1a3b379dbfc7437e99aa8bb10ef958cb to start an election
I20260709 13:04:30.262219 10592 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbd5b2ba1e5c4fd09fb5e1e6b14da9d6"
dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
 from {username='slave'} at 127.0.0.1:40054
I20260709 13:04:30.262820 10592 raft_consensus.cc:493] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.263231 10592 raft_consensus.cc:3060] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.272279 10592 raft_consensus.cc:515] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:30.276482 10659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd5b2ba1e5c4fd09fb5e1e6b14da9d6" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:30.277113 10659 raft_consensus.cc:3055] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:30.277397 10659 raft_consensus.cc:740] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:30.278240 10659 consensus_queue.cc:260] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:30.278842 10592 leader_election.cc:290] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:30.279376 10659 raft_consensus.cc:3060] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.280019 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd5b2ba1e5c4fd09fb5e1e6b14da9d6" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:30.280601 10737 raft_consensus.cc:3060] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.287791 10659 raft_consensus.cc:2468] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:30.287988 10737 raft_consensus.cc:2468] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:30.289353 10557 leader_election.cc:304] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:30.290539 11684 raft_consensus.cc:2804] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:30.291326 11684 raft_consensus.cc:697] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:30.292373 11684 consensus_queue.cc:237] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:30.308254 10414 catalog_manager.cc:5697] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 2, leader changed from 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.316464 11722 raft_consensus.cc:993] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b: : Instructing follower 1a3b379dbfc7437e99aa8bb10ef958cb to start an election
I20260709 13:04:30.316715 11681 raft_consensus.cc:993] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5: : Instructing follower 8b82fdd6486e40d180a9d1c7c320e38b to start an election
I20260709 13:04:30.316968 11722 raft_consensus.cc:1081] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Signalling peer 1a3b379dbfc7437e99aa8bb10ef958cb to start an election
I20260709 13:04:30.317263 11681 raft_consensus.cc:1081] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Signalling peer 8b82fdd6486e40d180a9d1c7c320e38b to start an election
I20260709 13:04:30.318852 10592 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "830eb73bc1564d2bb6e76e82e123c6e6"
dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
 from {username='slave'} at 127.0.0.1:40054
I20260709 13:04:30.318997 10666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b19c6fe03f9244a78476037b279a7bea"
dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
 from {username='slave'} at 127.0.0.1:35844
I20260709 13:04:30.319397 10592 raft_consensus.cc:493] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.319631 10666 raft_consensus.cc:493] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:30.319842 10592 raft_consensus.cc:3060] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.320087 10666 raft_consensus.cc:3060] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.328444 10592 raft_consensus.cc:515] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:30.331282 10663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830eb73bc1564d2bb6e76e82e123c6e6" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:30.331876 10663 raft_consensus.cc:3055] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:30.332180 10663 raft_consensus.cc:740] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:30.333035 10663 consensus_queue.cc:260] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:30.334146 10663 raft_consensus.cc:3060] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.345153 10666 raft_consensus.cc:515] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:30.346998 10592 leader_election.cc:290] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:30.347548 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830eb73bc1564d2bb6e76e82e123c6e6" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:30.350019 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19c6fe03f9244a78476037b279a7bea" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:30.349999 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b19c6fe03f9244a78476037b279a7bea" candidate_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:30.350826 10586 raft_consensus.cc:3060] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.351193 10738 raft_consensus.cc:3055] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:30.351512 10738 raft_consensus.cc:740] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:30.348997 10666 leader_election.cc:290] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:30.350314 10737 raft_consensus.cc:3060] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.352291 10738 consensus_queue.cc:260] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:30.353766 10738 raft_consensus.cc:3060] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.359753 10586 raft_consensus.cc:2468] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
I20260709 13:04:30.363461 10632 leader_election.cc:304] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:30.364480 11679 raft_consensus.cc:2804] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:30.364997 11679 raft_consensus.cc:697] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Becoming Leader. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:30.365979 11679 consensus_queue.cc:237] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:30.368153 10737 raft_consensus.cc:2468] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:30.348366 10663 raft_consensus.cc:2468] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:30.370225 10557 leader_election.cc:304] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:30.371168 11702 raft_consensus.cc:2804] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:30.371680 11702 raft_consensus.cc:697] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:30.372680 11702 consensus_queue.cc:237] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:30.400369 10414 catalog_manager.cc:5697] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 2, leader changed from 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.368089 10738 raft_consensus.cc:2468] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b82fdd6486e40d180a9d1c7c320e38b in term 2.
I20260709 13:04:30.419647 10414 catalog_manager.cc:5697] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b reported cstate change: term changed from 1 to 2, leader changed from bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196) to 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.566672 10586 raft_consensus.cc:1275] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:30.568204 11710 consensus_queue.cc:1048] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:30.581650 10666 raft_consensus.cc:1275] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:30.583290 11709 consensus_queue.cc:1048] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:30.648967 10738 raft_consensus.cc:1275] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:30.650257 11709 consensus_queue.cc:1048] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:30.674474 10592 raft_consensus.cc:1275] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:30.675930 11690 consensus_queue.cc:1048] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:30.720542 10666 raft_consensus.cc:1275] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:30.721858 11736 consensus_queue.cc:1048] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:30.736335 10738 raft_consensus.cc:1275] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:30.737931 11701 consensus_queue.cc:1048] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:30.902410 10666 raft_consensus.cc:1275] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:30.907833 11701 consensus_queue.cc:1048] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:30.911515 10738 raft_consensus.cc:1275] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:30.914822 11754 consensus_queue.cc:1048] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:30.919725 10592 raft_consensus.cc:1275] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:30.973950 11679 consensus_queue.cc:1048] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:30.984314 10736 raft_consensus.cc:1275] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 8b82fdd6486e40d180a9d1c7c320e38b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:30.984668   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:31.010555 11755 consensus_queue.cc:1048] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:31.120831   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:31.159235 10737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d84f52b275445629ba8545f2f1f3773"
dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:59134
I20260709 13:04:31.159909 10737 raft_consensus.cc:606] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:31.166741 10737 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52dae8a5daed4ae996d7df5a97147747"
dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
mode: GRACEFUL
new_leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
 from {username='slave'} at 127.0.0.1:59134
I20260709 13:04:31.167280 10737 raft_consensus.cc:606] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Received request to transfer leadership to TS 1a3b379dbfc7437e99aa8bb10ef958cb
I20260709 13:04:31.171669 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca79b841e581468e84cf2701211496e9"
dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:50840
I20260709 13:04:31.172252 10586 raft_consensus.cc:606] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:31.175113 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec6efd752eb04cadb27f38108369d56d"
dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:50840
I20260709 13:04:31.175700 10586 raft_consensus.cc:606] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:31.178280 10666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0539b460f174e8b80e242e8ae3c3801"
dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:58378
I20260709 13:04:31.178735 10666 raft_consensus.cc:606] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:31.179800   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:31.181591   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:31.331188 11683 raft_consensus.cc:993] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:31.331756 11681 raft_consensus.cc:1081] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:31.333720 11488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d84f52b275445629ba8545f2f1f3773"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35930
I20260709 13:04:31.334249 11488 raft_consensus.cc:493] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:31.334659 11488 raft_consensus.cc:3060] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.341898 11488 raft_consensus.cc:515] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:31.355815 11488 leader_election.cc:290] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:31.361750 10737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d84f52b275445629ba8545f2f1f3773" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:31.920152 10737 raft_consensus.cc:3055] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:31.920528 10737 raft_consensus.cc:740] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:31.921344 10737 consensus_queue.cc:260] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:31.922518 10737 raft_consensus.cc:3060] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.948150 11754 raft_consensus.cc:993] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:31.966456 11754 raft_consensus.cc:1081] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:31.972007 11488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca79b841e581468e84cf2701211496e9"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35922
I20260709 13:04:31.972604 11488 raft_consensus.cc:493] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:31.972929 11488 raft_consensus.cc:3060] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:31.983659 11488 raft_consensus.cc:515] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:31.991019 10737 raft_consensus.cc:2468] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 2.
I20260709 13:04:32.009243 11320 leader_election.cc:304] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:32.010298 11764 raft_consensus.cc:2804] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.013357 11764 raft_consensus.cc:697] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:32.014382 11764 consensus_queue.cc:237] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:32.027164 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d84f52b275445629ba8545f2f1f3773" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:32.027809 10586 raft_consensus.cc:3060] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.040910 10586 raft_consensus.cc:2468] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 2.
I20260709 13:04:32.063555 11752 raft_consensus.cc:993] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5: : Instructing follower 1a3b379dbfc7437e99aa8bb10ef958cb to start an election
I20260709 13:04:32.100215 11752 raft_consensus.cc:1081] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Signalling peer 1a3b379dbfc7437e99aa8bb10ef958cb to start an election
W20260709 13:04:32.069420 10704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:45489, user_credentials={real_user=slave}} blocked reactor thread for 69511.9us
I20260709 13:04:32.108003 11736 raft_consensus.cc:993] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:32.108552 11736 raft_consensus.cc:1081] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
W20260709 13:04:32.092017 10705 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:46191, user_credentials={real_user=slave}} blocked reactor thread for 44900.5us
I20260709 13:04:32.124852 11496 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec6efd752eb04cadb27f38108369d56d"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35922
I20260709 13:04:32.125408 11496 raft_consensus.cc:493] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.125792 11496 raft_consensus.cc:3060] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.144845 11496 raft_consensus.cc:515] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:32.149434 10414 catalog_manager.cc:5697] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 1 to 2, leader changed from bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.157459 11488 leader_election.cc:290] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:32.160226 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79b841e581468e84cf2701211496e9" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:32.160877 10738 raft_consensus.cc:3060] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:32.161903 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca79b841e581468e84cf2701211496e9" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:32.162482 10584 raft_consensus.cc:3055] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:32.162580 10586 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52dae8a5daed4ae996d7df5a97147747"
dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
 from {username='slave'} at 127.0.0.1:40048
I20260709 13:04:32.162824 10584 raft_consensus.cc:740] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:32.163228 10586 raft_consensus.cc:493] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.163600 10586 raft_consensus.cc:3060] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.163641 10584 consensus_queue.cc:260] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:32.164832 10584 raft_consensus.cc:3060] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:32.166498 11755 raft_consensus.cc:993] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:32.167001 11755 raft_consensus.cc:1081] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:32.174090 10738 raft_consensus.cc:2468] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:32.179013 11320 leader_election.cc:304] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:32.179739 11488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0539b460f174e8b80e242e8ae3c3801"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35906
I20260709 13:04:32.179920 11764 raft_consensus.cc:2804] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:32.180437 11764 raft_consensus.cc:697] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:32.181293 11764 consensus_queue.cc:237] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
W20260709 13:04:32.182006 10558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42289, user_credentials={real_user=slave}} blocked reactor thread for 67862.2us
I20260709 13:04:32.184998 11488 raft_consensus.cc:493] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.185456 11488 raft_consensus.cc:3060] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.189875 11496 leader_election.cc:290] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:32.190382 10584 raft_consensus.cc:2468] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:32.192514 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6efd752eb04cadb27f38108369d56d" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:32.193231 10738 raft_consensus.cc:3060] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.199880 10738 raft_consensus.cc:2468] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 2.
I20260709 13:04:32.201884 10584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6efd752eb04cadb27f38108369d56d" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:32.202500 10584 raft_consensus.cc:3055] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.192329 10586 raft_consensus.cc:515] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:32.202798 10584 raft_consensus.cc:740] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:32.203666 10584 consensus_queue.cc:260] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:32.204805 10584 raft_consensus.cc:3060] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.205844 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dae8a5daed4ae996d7df5a97147747" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:32.206663 10666 raft_consensus.cc:3060] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.212924 11320 leader_election.cc:304] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:32.213976 11774 raft_consensus.cc:2804] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.214478 10584 raft_consensus.cc:2468] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 2.
I20260709 13:04:32.214505 11774 raft_consensus.cc:697] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 2 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:32.215444 10666 raft_consensus.cc:2468] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:32.215725 11774 consensus_queue.cc:237] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:32.217095 10557 leader_election.cc:304] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, 8b82fdd6486e40d180a9d1c7c320e38b; no voters: 
I20260709 13:04:32.218128 11684 raft_consensus.cc:2804] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.218607 11684 raft_consensus.cc:697] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Becoming Leader. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:32.221319 10586 leader_election.cc:290] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [CANDIDATE]: Term 2 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:32.221148 11684 consensus_queue.cc:237] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:32.222420 10738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dae8a5daed4ae996d7df5a97147747" candidate_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:32.192327 11488 raft_consensus.cc:515] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:32.223774 10738 raft_consensus.cc:3055] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.226984 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0539b460f174e8b80e242e8ae3c3801" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:32.227717 10666 raft_consensus.cc:3055] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.228190 10666 raft_consensus.cc:740] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8b82fdd6486e40d180a9d1c7c320e38b, State: Running, Role: LEADER
I20260709 13:04:32.226012 10738 raft_consensus.cc:740] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:32.229400 10666 consensus_queue.cc:260] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:32.230990 10666 raft_consensus.cc:3060] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.239578 11488 leader_election.cc:290] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:32.230772 10738 consensus_queue.cc:260] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } }
I20260709 13:04:32.241272 10738 raft_consensus.cc:3060] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.244158 10666 raft_consensus.cc:2468] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 2.
I20260709 13:04:32.245751 11319 leader_election.cc:304] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:32.246387 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0539b460f174e8b80e242e8ae3c3801" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:32.246815 11774 raft_consensus.cc:2804] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.247013 10736 raft_consensus.cc:3060] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.247366 11774 raft_consensus.cc:697] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:32.248310 11774 consensus_queue.cc:237] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:32.252022 10738 raft_consensus.cc:2468] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a3b379dbfc7437e99aa8bb10ef958cb in term 2.
I20260709 13:04:32.253975 10736 raft_consensus.cc:2468] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 2.
I20260709 13:04:32.265264 10414 catalog_manager.cc:5697] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 2 to 3, leader changed from 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.267014 10414 catalog_manager.cc:5697] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 1 to 2, leader changed from 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.268446 10414 catalog_manager.cc:5697] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 1 to 2, leader changed from 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.271648   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:32.287775 10411 catalog_manager.cc:5697] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb reported cstate change: term changed from 1 to 2, leader changed from bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196) to 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.331552   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:32.372509 10613 debug-util.cc:398] Leaking SignalData structure 0x7b08001ec5a0 after lost signal to thread 434
I20260709 13:04:32.372463 10738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5"
dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:59134
I20260709 13:04:32.373279 10738 raft_consensus.cc:606] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:32.373842 10613 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3340 after lost signal to thread 10449
W20260709 13:04:32.375377 10613 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5940 after lost signal to thread 10616
W20260709 13:04:32.376613 10613 debug-util.cc:398] Leaking SignalData structure 0x7b08002abec0 after lost signal to thread 10690
I20260709 13:04:32.376729 10586 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83877eedc15a406e8656b628afec0bd5"
dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:50840
I20260709 13:04:32.377420 10586 raft_consensus.cc:606] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:32.377864 10613 debug-util.cc:398] Leaking SignalData structure 0x7b0800293ba0 after lost signal to thread 10764
W20260709 13:04:32.379227 10613 debug-util.cc:398] Leaking SignalData structure 0x7b0800176040 after lost signal to thread 11533
I20260709 13:04:32.387652 10738 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9"
dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
mode: GRACEFUL
new_leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:59134
I20260709 13:04:32.400823 10738 raft_consensus.cc:606] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Received request to transfer leadership to TS cbba8b78b34443bcb2be4b73f86fac96
I20260709 13:04:32.403107   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:32.405114   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:32.455556 11763 raft_consensus.cc:993] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:32.456207 11763 raft_consensus.cc:1081] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:32.467882 11488 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83877eedc15a406e8656b628afec0bd5"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35922
I20260709 13:04:32.468504 11488 raft_consensus.cc:493] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.468858 11488 raft_consensus.cc:3060] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.471424 11752 raft_consensus.cc:993] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:32.472069 11768 raft_consensus.cc:1081] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:32.474921 11435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35930
I20260709 13:04:32.475757 11435 raft_consensus.cc:493] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.476461 11435 raft_consensus.cc:3060] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:32.480438 11488 raft_consensus.cc:515] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:32.483860 10586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83877eedc15a406e8656b628afec0bd5" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb"
I20260709 13:04:32.484449 10586 raft_consensus.cc:3055] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.484750 10586 raft_consensus.cc:740] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a3b379dbfc7437e99aa8bb10ef958cb, State: Running, Role: LEADER
I20260709 13:04:32.485615 10586 consensus_queue.cc:260] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:32.486833 10586 raft_consensus.cc:3060] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.501201 10586 raft_consensus.cc:2468] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 2.
I20260709 13:04:32.502465 11320 leader_election.cc:304] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:32.503837 11488 leader_election.cc:290] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 2 election: Requested vote from peers 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:32.503968 11774 raft_consensus.cc:2804] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.504580 11774 raft_consensus.cc:697] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:32.505563 11774 consensus_queue.cc:237] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } }
I20260709 13:04:32.521404 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83877eedc15a406e8656b628afec0bd5" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:32.522255 10666 raft_consensus.cc:3060] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.533383 10666 raft_consensus.cc:2468] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 2.
I20260709 13:04:32.563196 10736 raft_consensus.cc:1275] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.570276 11683 raft_consensus.cc:993] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5: : Instructing follower cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:32.582479 10587 raft_consensus.cc:1275] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.570263 11435 raft_consensus.cc:515] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:32.600771 11435 leader_election.cc:290] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 4 election: Requested vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289)
I20260709 13:04:32.600603 11764 consensus_queue.cc:1048] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.604063 11690 consensus_queue.cc:1048] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.607663 11683 raft_consensus.cc:1081] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Signalling peer cbba8b78b34443bcb2be4b73f86fac96 to start an election
I20260709 13:04:32.609947 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:32.610790 10736 raft_consensus.cc:3055] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:32.611187 10736 raft_consensus.cc:740] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:32.612465 10736 consensus_queue.cc:260] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:32.614287 10736 raft_consensus.cc:3060] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:32.616285 10660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b87229f79a4fbca5482dfc3a4438b5" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:32.617950 10660 raft_consensus.cc:3060] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:32.628278 10736 raft_consensus.cc:2468] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 4.
I20260709 13:04:32.630403 11435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9"
dest_uuid: "cbba8b78b34443bcb2be4b73f86fac96"
 from {username='slave'} at 127.0.0.1:35930
I20260709 13:04:32.631366 11435 raft_consensus.cc:493] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.631865 11435 raft_consensus.cc:3060] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:32.634693 11320 leader_election.cc:304] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:32.641651 11764 raft_consensus.cc:2804] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:32.644321 11764 raft_consensus.cc:697] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 4 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:32.645267 11764 consensus_queue.cc:237] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:32.660054 10658 raft_consensus.cc:1275] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.664912 11684 consensus_queue.cc:1048] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:32.674728 11435 raft_consensus.cc:515] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:32.678764 11435 leader_election.cc:290] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Requested vote from peers bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196:42289), 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191)
I20260709 13:04:32.681542 10666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8b82fdd6486e40d180a9d1c7c320e38b"
I20260709 13:04:32.682353 10666 raft_consensus.cc:3060] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:32.682663 10736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea5737b68ca4d8ab303923d787668e9" candidate_uuid: "cbba8b78b34443bcb2be4b73f86fac96" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "bd6ac4ec789b459bbbfa3d6952103df5"
I20260709 13:04:32.683202 10660 raft_consensus.cc:2468] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 4.
I20260709 13:04:32.684208 10738 raft_consensus.cc:1275] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer 1a3b379dbfc7437e99aa8bb10ef958cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.683387 10736 raft_consensus.cc:3055] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:32.685520 10736 raft_consensus.cc:740] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bd6ac4ec789b459bbbfa3d6952103df5, State: Running, Role: LEADER
I20260709 13:04:32.680799 10414 catalog_manager.cc:5697] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 1 to 2, leader changed from 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.690361 11684 consensus_queue.cc:1048] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:32.691030 10736 consensus_queue.cc:260] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:32.692589 10736 raft_consensus.cc:3060] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:32.701879 10732 raft_consensus.cc:1275] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:32.702831 10736 raft_consensus.cc:2468] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:32.704763 11320 leader_election.cc:304] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5, cbba8b78b34443bcb2be4b73f86fac96; no voters: 
I20260709 13:04:32.705659 11774 raft_consensus.cc:2804] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:32.705561 11690 consensus_queue.cc:1048] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:32.706305 11774 raft_consensus.cc:697] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Becoming Leader. State: Replica: cbba8b78b34443bcb2be4b73f86fac96, State: Running, Role: LEADER
I20260709 13:04:32.707279 11774 consensus_queue.cc:237] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:32.697714 10666 raft_consensus.cc:2468] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbba8b78b34443bcb2be4b73f86fac96 in term 3.
I20260709 13:04:32.731757 10586 raft_consensus.cc:1275] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.734540 11776 consensus_queue.cc:1048] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:32.778630 10666 raft_consensus.cc:1275] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.780633 11776 consensus_queue.cc:1048] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:32.814774 10738 raft_consensus.cc:1275] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.815287 10586 raft_consensus.cc:1275] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:32.818627 11764 consensus_queue.cc:1048] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.830904 11690 consensus_queue.cc:1048] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:32.836071 10733 raft_consensus.cc:1275] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.836871 10415 catalog_manager.cc:5697] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 3 to 4, leader changed from bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.841250 11804 consensus_queue.cc:1048] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:32.838609 10415 catalog_manager.cc:5697] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 reported cstate change: term changed from 2 to 3, leader changed from bd6ac4ec789b459bbbfa3d6952103df5 (127.0.107.196) to cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "cbba8b78b34443bcb2be4b73f86fac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.090170 10660 raft_consensus.cc:1275] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.091605 11764 consensus_queue.cc:1048] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.101576 10587 raft_consensus.cc:1275] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.103003 11804 consensus_queue.cc:1048] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.105724 10666 raft_consensus.cc:1275] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 4 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:33.110601 11764 consensus_queue.cc:1048] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:04:33.144282 10736 raft_consensus.cc:1275] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 4 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:33.149502 11804 consensus_queue.cc:1048] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:33.288458 10658 raft_consensus.cc:1275] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:33.289788 11764 consensus_queue.cc:1048] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.302750 10736 raft_consensus.cc:1275] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Refusing update from remote peer cbba8b78b34443bcb2be4b73f86fac96: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:33.304538 11804 consensus_queue.cc:1048] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.406108   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:33.464423   431 tablet_server.cc:179] TabletServer@127.0.107.193:45489 shutting down...
W20260709 13:04:33.471849 10630 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 365 similar messages]
W20260709 13:04:33.507642 10556 consensus_peers.cc:597] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.509027 10556 consensus_peers.cc:597] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.504841 10630 consensus_peers.cc:597] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.510897 10630 consensus_peers.cc:597] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.520344 10704 consensus_peers.cc:597] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.520613 10630 consensus_peers.cc:597] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.521493 10630 consensus_peers.cc:597] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.523439 10704 consensus_peers.cc:597] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.539155   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.540639   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.541884   431 raft_consensus.cc:2243] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.542578   431 raft_consensus.cc:2272] T c1e8b005258a4a419135d144d4674208 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.548791   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.550071   431 raft_consensus.cc:2243] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.550626   431 raft_consensus.cc:2272] T d68c56443fa044b5865e4dd944d2e929 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.553650   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.554703   431 raft_consensus.cc:2243] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.555208   431 raft_consensus.cc:2272] T e20701090c4f4bd5ba6c754ccbcd41e1 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.558266   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.559144   431 raft_consensus.cc:2243] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.560233   431 raft_consensus.cc:2272] T cea5737b68ca4d8ab303923d787668e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.560437 10630 consensus_peers.cc:597] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.563769   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.564954   431 raft_consensus.cc:2243] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.565457   431 raft_consensus.cc:2272] T 3acf8caca63d426eb5b16065fee6b938 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.568256   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.569077   431 raft_consensus.cc:2243] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.569692   431 raft_consensus.cc:2272] T 99676c8e7e874fe98cb48b3d570c6275 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.571683 10704 consensus_peers.cc:597] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.573645   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.574689   431 raft_consensus.cc:2243] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.575780   431 raft_consensus.cc:2272] T 83877eedc15a406e8656b628afec0bd5 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.579967   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.580914   431 raft_consensus.cc:2243] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.581601   431 raft_consensus.cc:2272] T 716d74aced19425b839452e8495dfd2a P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.585044   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.586162   431 raft_consensus.cc:2243] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.586884   431 raft_consensus.cc:2272] T 2513a3510ad1457d9962458d169aab59 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.590013   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.590878   431 raft_consensus.cc:2243] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.592080   431 raft_consensus.cc:2272] T 1d84f52b275445629ba8545f2f1f3773 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.595257   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.596196   431 raft_consensus.cc:2243] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.596844   431 raft_consensus.cc:2272] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.599063 10704 consensus_peers.cc:597] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.600168   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.601188   431 raft_consensus.cc:2243] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.601735   431 raft_consensus.cc:2272] T 994595b7f94b4aac870d2234e0693b6b P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.605062   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.605907   431 raft_consensus.cc:2243] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.606521   431 raft_consensus.cc:2272] T c0040a4a12604d64862fe91f215f2174 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.609766   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.610689   431 raft_consensus.cc:2243] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.611256   431 raft_consensus.cc:2272] T e48aefb05bb248e78e9e5cfd8aa2739c P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.614552   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:33.615031 10556 consensus_peers.cc:597] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.615140 10704 consensus_peers.cc:597] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.615526   431 raft_consensus.cc:2243] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.616204   431 raft_consensus.cc:2272] T 50643b87db25412f916733ea13f10554 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.619481   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.620335   431 raft_consensus.cc:2243] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.621361   431 raft_consensus.cc:2272] T ca79b841e581468e84cf2701211496e9 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.625213   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.626166   431 raft_consensus.cc:2243] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.626791   431 raft_consensus.cc:2272] T 67c4c3a7a6b84e2fa267292d100e1f4a P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.628719 10630 consensus_peers.cc:597] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.629830   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.630816   431 raft_consensus.cc:2243] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.631433   431 raft_consensus.cc:2272] T ddadabec8df04c90812c121230deefd6 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.632550 10704 consensus_peers.cc:597] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.634586 10704 consensus_peers.cc:597] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.634833   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.635833   431 raft_consensus.cc:2243] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.636454   431 raft_consensus.cc:2272] T fa8dbc2680fd461c836d48a8f8692e50 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.639745   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.640390   431 raft_consensus.cc:2243] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.641160   431 raft_consensus.cc:2272] T 53b87229f79a4fbca5482dfc3a4438b5 P cbba8b78b34443bcb2be4b73f86fac96 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.644168   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.644857   431 raft_consensus.cc:2243] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.645392   431 raft_consensus.cc:2272] T 5397c6b857924714a103d579232e1f74 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.647840   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.648610   431 raft_consensus.cc:2243] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.649107   431 raft_consensus.cc:2272] T a4d54a6a210240e8994f2e4a34596f81 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.652000   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.652635   431 raft_consensus.cc:2243] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.653083   431 raft_consensus.cc:2272] T 6824db2b4d464925b19c786450677fb2 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.655506   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.656109   431 raft_consensus.cc:2243] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.657068   431 raft_consensus.cc:2272] T 5b67ee136262443e819e7ca67628050a P cbba8b78b34443bcb2be4b73f86fac96 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.660084   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.661000   431 raft_consensus.cc:2243] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.661597   431 raft_consensus.cc:2272] T 7b78ad4d54fb4014a07b4cbee983af70 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.664625   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:33.665045 10704 consensus_peers.cc:597] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.665516   431 raft_consensus.cc:2243] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.666213   431 raft_consensus.cc:2272] T 97e31d4d9ec6473caabd94052248c686 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.669155   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:33.669623 10704 consensus_peers.cc:597] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.670172   431 raft_consensus.cc:2243] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.671070   431 raft_consensus.cc:2272] T 13eb6fc681c5467a922827af47067ab8 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.674329   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.675113   431 raft_consensus.cc:2243] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.675909   431 raft_consensus.cc:2272] T 67449a01ef99467887627b70924e3efc P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.685724   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.686676   431 raft_consensus.cc:2243] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:04:33.687328 10704 consensus_peers.cc:597] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.687628   431 raft_consensus.cc:2272] T b091d4dadcee40108323abee07cb66e4 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.690152   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.691067   431 raft_consensus.cc:2243] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.692070   431 raft_consensus.cc:2272] T ee9f9f43d189428086d7fc6781e9ac76 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.695858   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.696591   431 raft_consensus.cc:2243] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.697196   431 raft_consensus.cc:2272] T 5811d78dc99d4c6ab232228c36f59fa4 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.699136 10704 consensus_peers.cc:597] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.700753   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.702481   431 raft_consensus.cc:2243] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.703418   431 raft_consensus.cc:2272] T 59be6ff2ab0e47f8b55843170279fc38 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.706938   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.707674   431 raft_consensus.cc:2243] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.708236   431 raft_consensus.cc:2272] T 96ec3c36841f4761b2a802c2592154f3 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.710891 10556 consensus_peers.cc:597] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.711486   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.712387   431 raft_consensus.cc:2243] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.712913   431 raft_consensus.cc:2272] T b7e3368943d24f409949b4a22082867d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.715406   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.715977   431 raft_consensus.cc:2243] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.716511   431 raft_consensus.cc:2272] T 1d6dbf486214445a8d6a624d253a2a24 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.719120   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.719800   431 raft_consensus.cc:2243] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.720322   431 raft_consensus.cc:2272] T 43dc87c50f6e4a299ba01b42bb08af51 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.724035   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.724836   431 raft_consensus.cc:2243] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.725411   431 raft_consensus.cc:2272] T 700134865ef74506af01723a1857195d P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.726691 10556 consensus_peers.cc:597] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.729147   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.729795   431 raft_consensus.cc:2243] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.731040   431 raft_consensus.cc:2272] T f0539b460f174e8b80e242e8ae3c3801 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.733539   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.734174   431 raft_consensus.cc:2243] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.734627   431 raft_consensus.cc:2272] T 244fe231b85a49a9a997bfe10e6e31f5 P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.736856   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.737372   431 raft_consensus.cc:2243] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.738282   431 raft_consensus.cc:2272] T 7a5e544a9bf947f29b531ce9027580d3 P cbba8b78b34443bcb2be4b73f86fac96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.740520   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.741178   431 raft_consensus.cc:2243] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.741721   431 raft_consensus.cc:2272] T 19fe36fcadfd4768a963dc396271497c P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.748147   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.749157   431 raft_consensus.cc:2243] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.749997   431 raft_consensus.cc:2272] T 2950e99d7eff498ab8a6edfd044d2178 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.753352   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.754362   431 raft_consensus.cc:2243] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.755106   431 raft_consensus.cc:2272] T fc85e60ff26b4709aec0629bef9390f6 P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.758081   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.758772   431 raft_consensus.cc:2243] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.759299   431 raft_consensus.cc:2272] T d7af85d78c0c41aeb882be10181161bf P cbba8b78b34443bcb2be4b73f86fac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.762068   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:33.762735   431 raft_consensus.cc:2243] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.763806   431 raft_consensus.cc:2272] T ec6efd752eb04cadb27f38108369d56d P cbba8b78b34443bcb2be4b73f86fac96 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.777614 10630 consensus_peers.cc:597] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.795637 10556 consensus_peers.cc:597] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.849409   431 tablet_server.cc:196] TabletServer@127.0.107.193:45489 shutdown complete.
W20260709 13:04:33.877830 10630 consensus_peers.cc:597] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.882004 10704 consensus_peers.cc:597] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.889724 10556 consensus_peers.cc:597] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.894815 10630 consensus_peers.cc:597] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.904382 10556 consensus_peers.cc:597] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.910248 10556 consensus_peers.cc:597] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.931970 10556 consensus_peers.cc:597] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb -> Peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Couldn't send request to peer cbba8b78b34443bcb2be4b73f86fac96. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.953320   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:04:33.975639 10632 consensus_peers.cc:597] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.983987 10706 consensus_peers.cc:597] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:33.986339 10706 consensus_peers.cc:597] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.004374   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:34.005189   431 tablet_replica.cc:333] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.005945   431 raft_consensus.cc:2243] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.006484   431 raft_consensus.cc:2272] T 19fe36fcadfd4768a963dc396271497c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.008615   431 tablet_replica.cc:333] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.009430   431 raft_consensus.cc:2243] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.010013   431 raft_consensus.cc:2272] T 92ec17bb1b33495d9caa05a15cbd16e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.013058   431 tablet_replica.cc:333] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.013943   431 raft_consensus.cc:2243] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.014503   431 raft_consensus.cc:2272] T ec6efd752eb04cadb27f38108369d56d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.017014   431 tablet_replica.cc:333] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.017845   431 raft_consensus.cc:2243] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.018380   431 raft_consensus.cc:2272] T 247484525e554724a7ec4defcf27b19c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.021011   431 tablet_replica.cc:333] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.021874   431 raft_consensus.cc:2243] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.022480   431 raft_consensus.cc:2272] T 50643b87db25412f916733ea13f10554 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.025360   431 tablet_replica.cc:333] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.026250   431 raft_consensus.cc:2243] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:04:34.026804 10706 consensus_peers.cc:597] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.027264   431 raft_consensus.cc:2272] T 830eb73bc1564d2bb6e76e82e123c6e6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.030151   431 tablet_replica.cc:333] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.031057   431 raft_consensus.cc:2243] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.032002   431 raft_consensus.cc:2272] T 2950e99d7eff498ab8a6edfd044d2178 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.032667 10632 consensus_peers.cc:597] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.034412   431 tablet_replica.cc:333] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.035023   431 raft_consensus.cc:2243] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.035797   431 raft_consensus.cc:2272] T 52dae8a5daed4ae996d7df5a97147747 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.038517   431 tablet_replica.cc:333] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.039523   431 raft_consensus.cc:2243] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.040095   431 raft_consensus.cc:2272] T e20701090c4f4bd5ba6c754ccbcd41e1 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.042848   431 tablet_replica.cc:333] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.043643   431 raft_consensus.cc:2243] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.044751   431 raft_consensus.cc:2272] T e9a34b42baf84d3781f0a69c5722c1bb P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.047185   431 tablet_replica.cc:333] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.047858   431 raft_consensus.cc:2243] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.048333   431 raft_consensus.cc:2272] T e48aefb05bb248e78e9e5cfd8aa2739c P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.050935   431 tablet_replica.cc:333] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.051808   431 raft_consensus.cc:2243] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.056629   431 raft_consensus.cc:2272] T 2513a3510ad1457d9962458d169aab59 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.059608   431 tablet_replica.cc:333] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.060428   431 raft_consensus.cc:2243] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.061468   431 raft_consensus.cc:2272] T 1d6dbf486214445a8d6a624d253a2a24 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.064705   431 tablet_replica.cc:333] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.065451   431 raft_consensus.cc:2243] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.066452   431 raft_consensus.cc:2272] T 5811d78dc99d4c6ab232228c36f59fa4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.069509   431 tablet_replica.cc:333] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.070365   431 raft_consensus.cc:2243] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.070981   431 raft_consensus.cc:2272] T ee9f9f43d189428086d7fc6781e9ac76 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.073899   431 tablet_replica.cc:333] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
W20260709 13:04:34.074548 10706 consensus_peers.cc:597] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.074793   431 raft_consensus.cc:2243] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:34.075232 10706 consensus_peers.cc:597] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.075459   431 raft_consensus.cc:2272] T 1d84f52b275445629ba8545f2f1f3773 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.078459   431 tablet_replica.cc:333] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.079442   431 raft_consensus.cc:2243] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.080468   431 raft_consensus.cc:2272] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.083348   431 tablet_replica.cc:333] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.084174   431 raft_consensus.cc:2243] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.084759   431 raft_consensus.cc:2272] T b19c6fe03f9244a78476037b279a7bea P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.086144 10632 consensus_peers.cc:597] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.087756   431 tablet_replica.cc:333] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.088904   431 raft_consensus.cc:2243] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.089524   431 raft_consensus.cc:2272] T 994595b7f94b4aac870d2234e0693b6b P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.091950   431 tablet_replica.cc:333] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.092593   431 raft_consensus.cc:2243] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.093104   431 raft_consensus.cc:2272] T c0040a4a12604d64862fe91f215f2174 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.093357 10632 consensus_peers.cc:597] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.096279   431 tablet_replica.cc:333] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.097303   431 raft_consensus.cc:2243] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.097851   431 raft_consensus.cc:2272] T b091d4dadcee40108323abee07cb66e4 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.100867   431 tablet_replica.cc:333] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.101891   431 raft_consensus.cc:2243] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.103756   431 raft_consensus.cc:2272] T ff7453e3b1834c1b90a795fcb9778191 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.107209   431 tablet_replica.cc:333] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.108328   431 raft_consensus.cc:2243] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.109745   431 raft_consensus.cc:2272] T fa8dbc2680fd461c836d48a8f8692e50 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.110888 10706 consensus_peers.cc:597] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.112764   431 tablet_replica.cc:333] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.113425   431 raft_consensus.cc:2243] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.113857   431 raft_consensus.cc:2272] T ca79b841e581468e84cf2701211496e9 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.116329   431 tablet_replica.cc:333] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.117067   431 raft_consensus.cc:2243] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.117995   431 raft_consensus.cc:2272] T ddadabec8df04c90812c121230deefd6 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.132608   431 tablet_replica.cc:333] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.136863   431 raft_consensus.cc:2243] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:34.137269 10706 consensus_peers.cc:597] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.137972   431 raft_consensus.cc:2272] T 67c4c3a7a6b84e2fa267292d100e1f4a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.140245 10632 consensus_peers.cc:597] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.141192   431 tablet_replica.cc:333] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.142099   431 raft_consensus.cc:2243] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.142592   431 raft_consensus.cc:2272] T 5b67ee136262443e819e7ca67628050a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.145112   431 tablet_replica.cc:333] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.145924   431 raft_consensus.cc:2243] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.147126   431 raft_consensus.cc:2272] T 7b78ad4d54fb4014a07b4cbee983af70 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.150243   431 tablet_replica.cc:333] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.151027   431 raft_consensus.cc:2243] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.151511   431 raft_consensus.cc:2272] T 716d74aced19425b839452e8495dfd2a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.153419   431 tablet_replica.cc:333] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.153959   431 raft_consensus.cc:2243] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.154415   431 raft_consensus.cc:2272] T 83877eedc15a406e8656b628afec0bd5 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.156258   431 tablet_replica.cc:333] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.156787   431 raft_consensus.cc:2243] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.157276   431 raft_consensus.cc:2272] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.159111   431 tablet_replica.cc:333] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.159869   431 raft_consensus.cc:2243] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.160391   431 raft_consensus.cc:2272] T 59be6ff2ab0e47f8b55843170279fc38 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.162588   431 tablet_replica.cc:333] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.163121   431 raft_consensus.cc:2243] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.163594   431 raft_consensus.cc:2272] T e802f2e4188a44849dff275987bb46ec P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.165633   431 tablet_replica.cc:333] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.166162   431 raft_consensus.cc:2243] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.166841   431 raft_consensus.cc:2272] T a4d54a6a210240e8994f2e4a34596f81 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.168735   431 tablet_replica.cc:333] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.169397   431 raft_consensus.cc:2243] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.169863   431 raft_consensus.cc:2272] T 3bdad68bdd98451886fae7cb5cb4d10a P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.172369   431 tablet_replica.cc:333] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.172955   431 raft_consensus.cc:2243] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.173779   431 raft_consensus.cc:2272] T 6824db2b4d464925b19c786450677fb2 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.176080   431 tablet_replica.cc:333] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
W20260709 13:04:34.175995 10706 consensus_peers.cc:597] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.176864   431 raft_consensus.cc:2243] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.177354   431 raft_consensus.cc:2272] T 96ec3c36841f4761b2a802c2592154f3 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.179471   431 tablet_replica.cc:333] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.180009   431 raft_consensus.cc:2243] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.180431   431 raft_consensus.cc:2272] T 0627ec961e5d45079cc5672bdcab5121 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.182358   431 tablet_replica.cc:333] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.182868   431 raft_consensus.cc:2243] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.183298   431 raft_consensus.cc:2272] T 13eb6fc681c5467a922827af47067ab8 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.185179   431 tablet_replica.cc:333] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.185705   431 raft_consensus.cc:2243] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.186533   431 raft_consensus.cc:2272] T 775092b557874c49bfae75484c568a37 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.188241   431 tablet_replica.cc:333] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.188678   431 raft_consensus.cc:2243] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.189005   431 raft_consensus.cc:2272] T be358e09d0714fa2bd4ca5cd34df4a29 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.190825   431 tablet_replica.cc:333] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.191265   431 raft_consensus.cc:2243] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.191609   431 raft_consensus.cc:2272] T 97e31d4d9ec6473caabd94052248c686 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.193374   431 tablet_replica.cc:333] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.193791   431 raft_consensus.cc:2243] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.194221   431 raft_consensus.cc:2272] T 700134865ef74506af01723a1857195d P 1a3b379dbfc7437e99aa8bb10ef958cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.196013   431 tablet_replica.cc:333] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb: stopping tablet replica
I20260709 13:04:34.196427   431 raft_consensus.cc:2243] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.197117   431 raft_consensus.cc:2272] T 43dc87c50f6e4a299ba01b42bb08af51 P 1a3b379dbfc7437e99aa8bb10ef958cb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.208344 10632 consensus_peers.cc:597] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.255414 10632 consensus_peers.cc:597] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.299499 10706 consensus_peers.cc:597] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.301712 10632 consensus_peers.cc:597] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.326530   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:04:34.331059 10632 consensus_peers.cc:597] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:34.368943 10632 consensus_peers.cc:597] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.405639   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:34.442162 10705 consensus_peers.cc:597] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.445605   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:34.446709   431 tablet_replica.cc:333] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.447671   431 raft_consensus.cc:2243] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.448765   431 raft_consensus.cc:2272] T 99676c8e7e874fe98cb48b3d570c6275 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.453431   431 tablet_replica.cc:333] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.454305   431 raft_consensus.cc:2243] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.454873   431 raft_consensus.cc:2272] T 92ec17bb1b33495d9caa05a15cbd16e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.455479 10705 consensus_peers.cc:597] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.458164   431 tablet_replica.cc:333] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.459491   431 raft_consensus.cc:2243] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.460227   431 raft_consensus.cc:2272] T b7e3368943d24f409949b4a22082867d P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.463737   431 tablet_replica.cc:333] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.464545   431 raft_consensus.cc:2243] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.467208   431 raft_consensus.cc:2272] T c1e8b005258a4a419135d144d4674208 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.470152   431 tablet_replica.cc:333] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.470911   431 raft_consensus.cc:2243] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.471469   431 raft_consensus.cc:2272] T 247484525e554724a7ec4defcf27b19c P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.474301   431 tablet_replica.cc:333] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.475118   431 raft_consensus.cc:2243] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.475948   431 raft_consensus.cc:2272] T 50643b87db25412f916733ea13f10554 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.479306   431 tablet_replica.cc:333] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.480093   431 raft_consensus.cc:2243] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:34.480422 10632 consensus_peers.cc:597] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b -> Peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Couldn't send request to peer 1a3b379dbfc7437e99aa8bb10ef958cb. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:46841: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.481132   431 raft_consensus.cc:2272] T d7af85d78c0c41aeb882be10181161bf P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.485092   431 tablet_replica.cc:333] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.486337   431 raft_consensus.cc:2243] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.487035   431 raft_consensus.cc:2272] T 830eb73bc1564d2bb6e76e82e123c6e6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.490082   431 tablet_replica.cc:333] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.490919   431 raft_consensus.cc:2243] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.491422   431 raft_consensus.cc:2272] T 5b67ee136262443e819e7ca67628050a P 8b82fdd6486e40d180a9d1c7c320e38b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.493958   431 tablet_replica.cc:333] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.494814   431 raft_consensus.cc:2243] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.495316   431 raft_consensus.cc:2272] T 52dae8a5daed4ae996d7df5a97147747 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.497699   431 tablet_replica.cc:333] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.498400   431 raft_consensus.cc:2243] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:34.498438 10705 consensus_peers.cc:597] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.499050   431 raft_consensus.cc:2272] T 5397c6b857924714a103d579232e1f74 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.501780   431 tablet_replica.cc:333] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.502518   431 raft_consensus.cc:2243] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.503542   431 raft_consensus.cc:2272] T fc85e60ff26b4709aec0629bef9390f6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.506253   431 tablet_replica.cc:333] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.506820   431 raft_consensus.cc:2243] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.507567   431 raft_consensus.cc:2272] T e20701090c4f4bd5ba6c754ccbcd41e1 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.509675   431 tablet_replica.cc:333] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.510281   431 raft_consensus.cc:2243] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.510700   431 raft_consensus.cc:2272] T a4d54a6a210240e8994f2e4a34596f81 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.512950   431 tablet_replica.cc:333] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.513502   431 raft_consensus.cc:2243] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.514298   431 raft_consensus.cc:2272] T 3bdad68bdd98451886fae7cb5cb4d10a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.516827   431 tablet_replica.cc:333] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.517369   431 raft_consensus.cc:2243] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.518266   431 raft_consensus.cc:2272] T b19c6fe03f9244a78476037b279a7bea P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.520108   431 tablet_replica.cc:333] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.520644   431 raft_consensus.cc:2243] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.521364   431 raft_consensus.cc:2272] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.523325   431 tablet_replica.cc:333] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.523854   431 raft_consensus.cc:2243] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.524256   431 raft_consensus.cc:2272] T 775092b557874c49bfae75484c568a37 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.526657   431 tablet_replica.cc:333] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.527491   431 raft_consensus.cc:2243] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.528035   431 raft_consensus.cc:2272] T 13eb6fc681c5467a922827af47067ab8 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.530443   431 tablet_replica.cc:333] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.531211   431 raft_consensus.cc:2243] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.532191   431 raft_consensus.cc:2272] T be358e09d0714fa2bd4ca5cd34df4a29 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.534664   431 tablet_replica.cc:333] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.535384   431 raft_consensus.cc:2243] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.536345   431 raft_consensus.cc:2272] T 97e31d4d9ec6473caabd94052248c686 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.538455   431 tablet_replica.cc:333] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.539026   431 raft_consensus.cc:2243] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.539448   431 raft_consensus.cc:2272] T 67449a01ef99467887627b70924e3efc P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.541388   431 tablet_replica.cc:333] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.541940   431 raft_consensus.cc:2243] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.542724   431 raft_consensus.cc:2272] T 2513a3510ad1457d9962458d169aab59 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.544822   431 tablet_replica.cc:333] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.545773   431 raft_consensus.cc:2243] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.546360   431 raft_consensus.cc:2272] T fa8dbc2680fd461c836d48a8f8692e50 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.548440   431 tablet_replica.cc:333] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.548995   431 raft_consensus.cc:2243] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.549403   431 raft_consensus.cc:2272] T 53b87229f79a4fbca5482dfc3a4438b5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.551211   431 tablet_replica.cc:333] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.551753   431 raft_consensus.cc:2243] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.552151   431 raft_consensus.cc:2272] T ddadabec8df04c90812c121230deefd6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.554448   431 tablet_replica.cc:333] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.555105   431 raft_consensus.cc:2243] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.555580   431 raft_consensus.cc:2272] T 67c4c3a7a6b84e2fa267292d100e1f4a P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.558211   431 tablet_replica.cc:333] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.558943   431 raft_consensus.cc:2243] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.559402   431 raft_consensus.cc:2272] T 244fe231b85a49a9a997bfe10e6e31f5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.561100 10705 consensus_peers.cc:597] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.561883   431 tablet_replica.cc:333] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.562613   431 raft_consensus.cc:2243] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.563035   431 raft_consensus.cc:2272] T 7a5e544a9bf947f29b531ce9027580d3 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.564981   431 tablet_replica.cc:333] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.565543   431 raft_consensus.cc:2243] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.565954   431 raft_consensus.cc:2272] T f0539b460f174e8b80e242e8ae3c3801 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.567982   431 tablet_replica.cc:333] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.568514   431 raft_consensus.cc:2243] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.568912   431 raft_consensus.cc:2272] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.570748   431 tablet_replica.cc:333] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.571275   431 raft_consensus.cc:2243] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.571677   431 raft_consensus.cc:2272] T d68c56443fa044b5865e4dd944d2e929 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.573473   431 tablet_replica.cc:333] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.573995   431 raft_consensus.cc:2243] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.574466   431 raft_consensus.cc:2272] T b091d4dadcee40108323abee07cb66e4 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.576198   431 tablet_replica.cc:333] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.576756   431 raft_consensus.cc:2243] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.577510   431 raft_consensus.cc:2272] T ff7453e3b1834c1b90a795fcb9778191 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.579340   431 tablet_replica.cc:333] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.579856   431 raft_consensus.cc:2243] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.580256   431 raft_consensus.cc:2272] T 3acf8caca63d426eb5b16065fee6b938 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.582096   431 tablet_replica.cc:333] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.582640   431 raft_consensus.cc:2243] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.583379   431 raft_consensus.cc:2272] T 716d74aced19425b839452e8495dfd2a P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.585561   431 tablet_replica.cc:333] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.586172   431 raft_consensus.cc:2243] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:34.586544 10705 consensus_peers.cc:597] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.586589   431 raft_consensus.cc:2272] T 83877eedc15a406e8656b628afec0bd5 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.589198   431 tablet_replica.cc:333] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.589803   431 raft_consensus.cc:2243] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.590279   431 raft_consensus.cc:2272] T e9a34b42baf84d3781f0a69c5722c1bb P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.590435 10705 consensus_peers.cc:597] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.592135   431 tablet_replica.cc:333] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.592752   431 raft_consensus.cc:2243] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.593183   431 raft_consensus.cc:2272] T d73b5dbe2dea4e249d33a2bac3dee4e2 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.595101   431 tablet_replica.cc:333] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.595602   431 raft_consensus.cc:2243] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.596077   431 raft_consensus.cc:2272] T 59be6ff2ab0e47f8b55843170279fc38 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.597810   431 tablet_replica.cc:333] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.598354   431 raft_consensus.cc:2243] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.599187   431 raft_consensus.cc:2272] T e802f2e4188a44849dff275987bb46ec P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.601001   431 tablet_replica.cc:333] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.601475   431 raft_consensus.cc:2243] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.602293   431 raft_consensus.cc:2272] T 0627ec961e5d45079cc5672bdcab5121 P 8b82fdd6486e40d180a9d1c7c320e38b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.604101   431 tablet_replica.cc:333] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.604578   431 raft_consensus.cc:2243] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.604974   431 raft_consensus.cc:2272] T 43dc87c50f6e4a299ba01b42bb08af51 P 8b82fdd6486e40d180a9d1c7c320e38b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.606751   431 tablet_replica.cc:333] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b: stopping tablet replica
I20260709 13:04:34.607185   431 raft_consensus.cc:2243] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.607570   431 raft_consensus.cc:2272] T cea5737b68ca4d8ab303923d787668e9 P 8b82fdd6486e40d180a9d1c7c320e38b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.653692 11788 raft_consensus.cc:493] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:34.654354 11788 raft_consensus.cc:515] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:34.657464 11788 leader_election.cc:290] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
W20260709 13:04:34.661864 10705 leader_election.cc:336] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Network error: Client connection negotiation failed: client connection to 127.0.107.195:46191: connect: Connection refused (error 111)
I20260709 13:04:34.666126 11788 raft_consensus.cc:493] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:34.666589 11788 raft_consensus.cc:515] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:34.668115 11788 leader_election.cc:290] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
W20260709 13:04:34.671808 10706 leader_election.cc:336] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46841: connect: Connection refused (error 111)
I20260709 13:04:34.674919   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:34.735294 11788 raft_consensus.cc:493] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:34.735931 11788 raft_consensus.cc:515] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:34.737921 11788 leader_election.cc:290] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
W20260709 13:04:34.741917 10706 leader_election.cc:336] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46841: connect: Connection refused (error 111)
I20260709 13:04:34.741994   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:04:34.782521   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:34.783514   431 tablet_replica.cc:333] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.784567   431 raft_consensus.cc:2243] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.785188   431 raft_consensus.cc:2272] T 99676c8e7e874fe98cb48b3d570c6275 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.787865   431 tablet_replica.cc:333] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.788769   431 raft_consensus.cc:2243] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.789594   431 raft_consensus.cc:2272] T 19fe36fcadfd4768a963dc396271497c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.791965   431 tablet_replica.cc:333] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.792595   431 raft_consensus.cc:2243] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:34.792812 10705 consensus_peers.cc:597] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:46191: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.793414   431 raft_consensus.cc:2272] T 92ec17bb1b33495d9caa05a15cbd16e4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.795645   431 tablet_replica.cc:333] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.796255   431 raft_consensus.cc:2243] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.797152   431 raft_consensus.cc:2272] T 247484525e554724a7ec4defcf27b19c P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.799405   431 tablet_replica.cc:333] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.800025   431 raft_consensus.cc:2243] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.800722   431 raft_consensus.cc:2272] T c1e8b005258a4a419135d144d4674208 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.802963   431 tablet_replica.cc:333] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.803614   431 raft_consensus.cc:2243] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.804052   431 raft_consensus.cc:2272] T ec6efd752eb04cadb27f38108369d56d P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.806253   431 tablet_replica.cc:333] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.806857   431 raft_consensus.cc:2243] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.807272   431 raft_consensus.cc:2272] T d7af85d78c0c41aeb882be10181161bf P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.809258   431 tablet_replica.cc:333] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.809756 11788 raft_consensus.cc:493] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:34.809998   431 raft_consensus.cc:2243] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.810607   431 raft_consensus.cc:2272] T 830eb73bc1564d2bb6e76e82e123c6e6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.810346 11788 raft_consensus.cc:515] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:34.812500 11788 leader_election.cc:290] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:34.813280   431 tablet_replica.cc:333] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.813974   431 raft_consensus.cc:2243] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.814566   431 raft_consensus.cc:2272] T 2950e99d7eff498ab8a6edfd044d2178 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.816391 10705 leader_election.cc:336] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Network error: Client connection negotiation failed: client connection to 127.0.107.195:46191: connect: Connection refused (error 111)
I20260709 13:04:34.816960   431 tablet_replica.cc:333] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.817620   431 raft_consensus.cc:2243] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.818079   431 raft_consensus.cc:2272] T 52dae8a5daed4ae996d7df5a97147747 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.819985   431 tablet_replica.cc:333] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.820533   431 raft_consensus.cc:2243] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.821179   431 raft_consensus.cc:2272] T 5397c6b857924714a103d579232e1f74 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.823210   431 tablet_replica.cc:333] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.823776   431 raft_consensus.cc:2243] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.824209   431 raft_consensus.cc:2272] T fc85e60ff26b4709aec0629bef9390f6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.826243   431 tablet_replica.cc:333] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.826795   431 raft_consensus.cc:2243] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.827430   431 raft_consensus.cc:2272] T 700134865ef74506af01723a1857195d P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.829433   431 tablet_replica.cc:333] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.830233   431 raft_consensus.cc:2243] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.831007   431 raft_consensus.cc:2272] T e48aefb05bb248e78e9e5cfd8aa2739c P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.833530   431 tablet_replica.cc:333] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
W20260709 13:04:34.834262 10705 consensus_peers.cc:597] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 -> Peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Couldn't send request to peer 8b82fdd6486e40d180a9d1c7c320e38b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:46191: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.834398   431 raft_consensus.cc:2243] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.835256   431 raft_consensus.cc:2272] T 994595b7f94b4aac870d2234e0693b6b P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.837481   431 tablet_replica.cc:333] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.838165   431 raft_consensus.cc:2243] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.838613   431 raft_consensus.cc:2272] T b19c6fe03f9244a78476037b279a7bea P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.840677   431 tablet_replica.cc:333] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.841287   431 raft_consensus.cc:2243] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.842067   431 raft_consensus.cc:2272] T c0040a4a12604d64862fe91f215f2174 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.844172   431 tablet_replica.cc:333] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.844759   431 raft_consensus.cc:2243] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.845227   431 raft_consensus.cc:2272] T 3d5066d6e3bb46aeb08e655bfe8ad7f2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.847340   431 tablet_replica.cc:333] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.847939   431 raft_consensus.cc:2243] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.848414   431 raft_consensus.cc:2272] T e9a34b42baf84d3781f0a69c5722c1bb P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.850489   431 tablet_replica.cc:333] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.851075   431 raft_consensus.cc:2243] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.851526   431 raft_consensus.cc:2272] T 775092b557874c49bfae75484c568a37 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.853453   431 tablet_replica.cc:333] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.854077   431 raft_consensus.cc:2243] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.854532   431 raft_consensus.cc:2272] T be358e09d0714fa2bd4ca5cd34df4a29 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.856443   431 tablet_replica.cc:333] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.857012   431 raft_consensus.cc:2243] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.857446   431 raft_consensus.cc:2272] T 67449a01ef99467887627b70924e3efc P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.860016   431 tablet_replica.cc:333] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.860914   431 raft_consensus.cc:2243] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.861637   431 raft_consensus.cc:2272] T b7e3368943d24f409949b4a22082867d P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.864248   431 tablet_replica.cc:333] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.864836   431 raft_consensus.cc:2243] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.865283   431 raft_consensus.cc:2272] T 1d6dbf486214445a8d6a624d253a2a24 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.866367 11788 raft_consensus.cc:493] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:34.866791 11788 raft_consensus.cc:515] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b82fdd6486e40d180a9d1c7c320e38b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46191 } } peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } }
I20260709 13:04:34.867575   431 tablet_replica.cc:333] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.868255   431 raft_consensus.cc:2243] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.868621 11788 leader_election.cc:290] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191), cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489)
I20260709 13:04:34.868827   431 raft_consensus.cc:2272] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.871523   431 tablet_replica.cc:333] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.872179   431 raft_consensus.cc:2243] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:34.872218 10705 leader_election.cc:336] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8b82fdd6486e40d180a9d1c7c320e38b (127.0.107.195:46191): Network error: Client connection negotiation failed: client connection to 127.0.107.195:46191: connect: Connection refused (error 111)
I20260709 13:04:34.872798   431 raft_consensus.cc:2272] T fbd5b2ba1e5c4fd09fb5e1e6b14da9d6 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.873508 11788 raft_consensus.cc:493] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cbba8b78b34443bcb2be4b73f86fac96)
I20260709 13:04:34.873947 11788 raft_consensus.cc:515] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd6ac4ec789b459bbbfa3d6952103df5" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42289 } } peers { permanent_uuid: "cbba8b78b34443bcb2be4b73f86fac96" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45489 } } peers { permanent_uuid: "1a3b379dbfc7437e99aa8bb10ef958cb" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46841 } }
I20260709 13:04:34.875067   431 tablet_replica.cc:333] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.875744 11788 leader_election.cc:290] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489), 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841)
I20260709 13:04:34.875934   431 raft_consensus.cc:2243] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.877094   431 raft_consensus.cc:2272] T d73b5dbe2dea4e249d33a2bac3dee4e2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.879912   431 tablet_replica.cc:333] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
W20260709 13:04:34.879943 10706 leader_election.cc:336] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1a3b379dbfc7437e99aa8bb10ef958cb (127.0.107.194:46841): Network error: Client connection negotiation failed: client connection to 127.0.107.194:46841: connect: Connection refused (error 111)
I20260709 13:04:34.880590   431 raft_consensus.cc:2243] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.881129   431 raft_consensus.cc:2272] T e802f2e4188a44849dff275987bb46ec P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.883175   431 tablet_replica.cc:333] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.883761   431 raft_consensus.cc:2243] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.884251   431 raft_consensus.cc:2272] T 7b78ad4d54fb4014a07b4cbee983af70 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.886234   431 tablet_replica.cc:333] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.886801   431 raft_consensus.cc:2243] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.887408   431 raft_consensus.cc:2272] T 3acf8caca63d426eb5b16065fee6b938 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.889467   431 tablet_replica.cc:333] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.890196   431 raft_consensus.cc:2243] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.891036   431 raft_consensus.cc:2272] T 244fe231b85a49a9a997bfe10e6e31f5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.893302   431 tablet_replica.cc:333] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.893941   431 raft_consensus.cc:2243] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.894496   431 raft_consensus.cc:2272] T 7a5e544a9bf947f29b531ce9027580d3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.896488   431 tablet_replica.cc:333] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.897047   431 raft_consensus.cc:2243] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.897488   431 raft_consensus.cc:2272] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.899572   431 tablet_replica.cc:333] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.900120   431 raft_consensus.cc:2243] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.900568   431 raft_consensus.cc:2272] T 5811d78dc99d4c6ab232228c36f59fa4 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.902653   431 tablet_replica.cc:333] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.903227   431 raft_consensus.cc:2243] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.903661   431 raft_consensus.cc:2272] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.905563   431 tablet_replica.cc:333] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.906167   431 raft_consensus.cc:2243] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:34.906525 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.907022   431 raft_consensus.cc:2272] T d68c56443fa044b5865e4dd944d2e929 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.909068   431 tablet_replica.cc:333] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.909575   431 raft_consensus.cc:2243] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.909940   431 raft_consensus.cc:2272] T ff7453e3b1834c1b90a795fcb9778191 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.912313   431 tablet_replica.cc:333] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.913133   431 raft_consensus.cc:2243] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.913781   431 raft_consensus.cc:2272] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.916191   431 tablet_replica.cc:333] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.916841   431 raft_consensus.cc:2243] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.917227   431 raft_consensus.cc:2272] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.919111   431 tablet_replica.cc:333] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.919590   431 raft_consensus.cc:2243] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.919943   431 raft_consensus.cc:2272] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.922268   431 tablet_replica.cc:333] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.922968   431 raft_consensus.cc:2243] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:34.923848   431 raft_consensus.cc:2272] T 96ec3c36841f4761b2a802c2592154f3 P bd6ac4ec789b459bbbfa3d6952103df5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.926604   431 tablet_replica.cc:333] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.927294   431 raft_consensus.cc:2243] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.927819   431 raft_consensus.cc:2272] T 0627ec961e5d45079cc5672bdcab5121 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.930145   431 tablet_replica.cc:333] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.930667   431 raft_consensus.cc:2243] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.931141   431 raft_consensus.cc:2272] T 3bdad68bdd98451886fae7cb5cb4d10a P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:34.933141   431 tablet_replica.cc:333] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5: stopping tablet replica
I20260709 13:04:34.933632   431 raft_consensus.cc:2243] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:34.934151   431 raft_consensus.cc:2272] T 6824db2b4d464925b19c786450677fb2 P bd6ac4ec789b459bbbfa3d6952103df5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:34.981550 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:34.983265 10705 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:35.005402 10703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:35.040313 11820 leader_election.cc:336] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Service unavailable: reactor is shutting down (error 108)
I20260709 13:04:35.040845 11820 leader_election.cc:304] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:35.041538 11820 raft_consensus.cc:2686] T f0539b460f174e8b80e242e8ae3c3801 P bd6ac4ec789b459bbbfa3d6952103df5: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:04:35.043077   431 leader_election.cc:336] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Aborted: reactor is shutting down (error 108)
I20260709 13:04:35.043485   431 leader_election.cc:304] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:35.043697 11820 leader_election.cc:336] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Service unavailable: reactor is shutting down (error 108)
W20260709 13:04:35.043984   431 raft_consensus.cc:2686] T ca79b841e581468e84cf2701211496e9 P bd6ac4ec789b459bbbfa3d6952103df5: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:35.044154 11820 leader_election.cc:304] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:35.044716 11820 raft_consensus.cc:2686] T cea5737b68ca4d8ab303923d787668e9 P bd6ac4ec789b459bbbfa3d6952103df5: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:04:35.045125 10706 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:35.046607 11820 leader_election.cc:336] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Service unavailable: reactor is shutting down (error 108)
I20260709 13:04:35.047034 11820 leader_election.cc:304] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:35.047566 11820 raft_consensus.cc:2686] T 1d84f52b275445629ba8545f2f1f3773 P bd6ac4ec789b459bbbfa3d6952103df5: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:04:35.049639 11820 leader_election.cc:336] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Service unavailable: reactor is shutting down (error 108)
I20260709 13:04:35.050000 11820 leader_election.cc:304] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 1a3b379dbfc7437e99aa8bb10ef958cb, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:35.050535 11820 raft_consensus.cc:2686] T ee9f9f43d189428086d7fc6781e9ac76 P bd6ac4ec789b459bbbfa3d6952103df5: unable to run election callback: Service unavailable: The pool has been shut down.
W20260709 13:04:35.051924 11820 leader_election.cc:336] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cbba8b78b34443bcb2be4b73f86fac96 (127.0.107.193:45489): Service unavailable: reactor is shutting down (error 108)
I20260709 13:04:35.052255 11820 leader_election.cc:304] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bd6ac4ec789b459bbbfa3d6952103df5; no voters: 8b82fdd6486e40d180a9d1c7c320e38b, cbba8b78b34443bcb2be4b73f86fac96
W20260709 13:04:35.052709 11820 raft_consensus.cc:2686] T 53b87229f79a4fbca5482dfc3a4438b5 P bd6ac4ec789b459bbbfa3d6952103df5: unable to run election callback: Service unavailable: The pool has been shut down.
I20260709 13:04:35.063623   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:04:35.127194   431 master.cc:562] Master@127.0.107.254:33053 shutting down...
I20260709 13:04:35.150470   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:35.151031   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:35.151357   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1cb84adc31994c80bd5c448e72a26605: stopping tablet replica
I20260709 13:04:35.199498   431 master.cc:584] Master@127.0.107.254:33053 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (35340 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:04:35.293932   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:40939
I20260709 13:04:35.295234   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:35.300803 11834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:35.301808 11835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:35.303473 11837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:35.303756   431 server_base.cc:1061] running on GCE node
I20260709 13:04:35.305022   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:35.305246   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:35.305408   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602275305391 us; error 0 us; skew 500 ppm
I20260709 13:04:35.305958   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:35.308959   431 webserver.cc:533] Webserver started at http://127.0.107.254:36073/ using document root <none> and password file <none>
I20260709 13:04:35.309602   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:35.309804   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:35.310159   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:35.311272   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/master-0-root/instance:
uuid: "4de49779f9d749faafe70b45dc34f344"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-nr1f"
I20260709 13:04:35.315744   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:35.319144 11842 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:35.319916   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:35.320250   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/master-0-root
uuid: "4de49779f9d749faafe70b45dc34f344"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-nr1f"
I20260709 13:04:35.320549   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:35.349664   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:35.351537   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:35.390787   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:40939
I20260709 13:04:35.390920 11893 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:40939 every 8 connection(s)
I20260709 13:04:35.394901 11894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.406831 11894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344: Bootstrap starting.
I20260709 13:04:35.412145 11894 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.416644 11894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344: No bootstrap required, opened a new log
I20260709 13:04:35.418889 11894 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de49779f9d749faafe70b45dc34f344" member_type: VOTER }
I20260709 13:04:35.419281 11894 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.419530 11894 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de49779f9d749faafe70b45dc34f344, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.420176 11894 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de49779f9d749faafe70b45dc34f344" member_type: VOTER }
I20260709 13:04:35.420640 11894 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:35.420866 11894 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:35.421133 11894 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.425926 11894 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de49779f9d749faafe70b45dc34f344" member_type: VOTER }
I20260709 13:04:35.426518 11894 leader_election.cc:304] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4de49779f9d749faafe70b45dc34f344; no voters: 
I20260709 13:04:35.427632 11894 leader_election.cc:290] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:35.428107 11897 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.429587 11897 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [term 1 LEADER]: Becoming Leader. State: Replica: 4de49779f9d749faafe70b45dc34f344, State: Running, Role: LEADER
I20260709 13:04:35.430317 11897 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de49779f9d749faafe70b45dc34f344" member_type: VOTER }
I20260709 13:04:35.430635 11894 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:35.434897 11898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4de49779f9d749faafe70b45dc34f344" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de49779f9d749faafe70b45dc34f344" member_type: VOTER } }
I20260709 13:04:35.435724 11898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:35.435815 11899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4de49779f9d749faafe70b45dc34f344. Latest consensus state: current_term: 1 leader_uuid: "4de49779f9d749faafe70b45dc34f344" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4de49779f9d749faafe70b45dc34f344" member_type: VOTER } }
I20260709 13:04:35.436734 11899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:35.442365 11904 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:35.448002 11904 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:35.449205   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:35.456683 11904 catalog_manager.cc:1383] Generated new cluster ID: 4ff0e2aec9db4a9487e2b2d9f74bbff1
I20260709 13:04:35.456980 11904 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:35.475773 11904 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:35.477058 11904 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:35.489274 11904 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344: Generated new TSK 0
I20260709 13:04:35.489972 11904 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:35.516165   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:35.522825 11915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:35.523890 11916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:35.526698   431 server_base.cc:1061] running on GCE node
W20260709 13:04:35.526698 11918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:35.527925   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:35.528146   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:35.528318   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602275528284 us; error 0 us; skew 500 ppm
I20260709 13:04:35.528862   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:35.531580   431 webserver.cc:533] Webserver started at http://127.0.107.193:44779/ using document root <none> and password file <none>
I20260709 13:04:35.532217   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:35.532477   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:35.532817   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:35.533915   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-0-root/instance:
uuid: "4d90a5439aef4c36a3b161fee511acbf"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-nr1f"
I20260709 13:04:35.538550   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:35.542601 11923 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:35.543469   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:04:35.543820   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-0-root
uuid: "4d90a5439aef4c36a3b161fee511acbf"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-nr1f"
I20260709 13:04:35.544092   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:35.560829   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:35.562090   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:35.563589   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:35.565864   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:35.566107   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:35.566366   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:35.566562   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:35.607734   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43727
I20260709 13:04:35.607837 11985 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43727 every 8 connection(s)
I20260709 13:04:35.613013   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:35.619695 11990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:35.621635 11991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:35.623147 11993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:35.624351   431 server_base.cc:1061] running on GCE node
I20260709 13:04:35.626072   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:35.626099 11986 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40939
W20260709 13:04:35.626341   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:35.626628   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602275626611 us; error 0 us; skew 500 ppm
I20260709 13:04:35.626645 11986 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:35.627254   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:35.627605 11986 heartbeater.cc:507] Master 127.0.107.254:40939 requested a full tablet report, sending...
I20260709 13:04:35.630092   431 webserver.cc:533] Webserver started at http://127.0.107.194:36531/ using document root <none> and password file <none>
I20260709 13:04:35.630123 11859 ts_manager.cc:194] Registered new tserver with Master: 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727)
I20260709 13:04:35.630726   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:35.630973   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:35.631254   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:35.632385   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-1-root/instance:
uuid: "998f562f369843189bd6c362e61297fd"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-nr1f"
I20260709 13:04:35.632504 11859 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33640
I20260709 13:04:35.637032   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:35.640655 11998 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:35.641597   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:35.641907   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-1-root
uuid: "998f562f369843189bd6c362e61297fd"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-nr1f"
I20260709 13:04:35.642267   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:35.664317   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:35.665572   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:35.667184   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:35.669416   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:35.669653   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:35.669905   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:35.670104   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:35.710321   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45405
I20260709 13:04:35.710433 12060 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45405 every 8 connection(s)
I20260709 13:04:35.715044   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:35.722229 12064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:35.723912 12065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:35.726969   431 server_base.cc:1061] running on GCE node
W20260709 13:04:35.727569 12068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:35.727891 12061 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40939
I20260709 13:04:35.728390 12061 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:35.728690   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:35.728965   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:35.729146   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602275729132 us; error 0 us; skew 500 ppm
I20260709 13:04:35.729208 12061 heartbeater.cc:507] Master 127.0.107.254:40939 requested a full tablet report, sending...
I20260709 13:04:35.729737   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:35.731539 11859 ts_manager.cc:194] Registered new tserver with Master: 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:35.732795   431 webserver.cc:533] Webserver started at http://127.0.107.195:36239/ using document root <none> and password file <none>
I20260709 13:04:35.733511   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:35.733428 11859 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33648
I20260709 13:04:35.733904   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:35.734282   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:35.735587   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-2-root/instance:
uuid: "1631155115174ae48423c73ac623c181"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-nr1f"
I20260709 13:04:35.739995   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:35.743434 12072 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:35.744307   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:35.744625   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-2-root
uuid: "1631155115174ae48423c73ac623c181"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-nr1f"
I20260709 13:04:35.744870   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:35.766233   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:35.767457   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:35.768940   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:35.771198   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:35.771376   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:35.771672   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:35.771889   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:35.812671   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:46697
I20260709 13:04:35.812803 12134 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:46697 every 8 connection(s)
I20260709 13:04:35.827513 12135 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40939
I20260709 13:04:35.828008 12135 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:35.828787 12135 heartbeater.cc:507] Master 127.0.107.254:40939 requested a full tablet report, sending...
I20260709 13:04:35.830950 11859 ts_manager.cc:194] Registered new tserver with Master: 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:35.831633   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015800775s
I20260709 13:04:35.832340 11859 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33662
I20260709 13:04:35.857714 11859 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33678:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:35.860666 11859 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:35.932371 11950 tablet_service.cc:1511] Processing CreateTablet for tablet 6be5503eb855455496fb5ba80872b7a2 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:35.933818 11949 tablet_service.cc:1511] Processing CreateTablet for tablet bb4a9d5896ae46ba99aeb28c0adc9223 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:35.934566 11950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be5503eb855455496fb5ba80872b7a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.932251 11951 tablet_service.cc:1511] Processing CreateTablet for tablet dc50619ad0c84784949a25c646a37da5 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:35.936004 11949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4a9d5896ae46ba99aeb28c0adc9223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.937955 11948 tablet_service.cc:1511] Processing CreateTablet for tablet 07baa7056dec43cd8d5d53ca7ba95adf (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:35.940272 11951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc50619ad0c84784949a25c646a37da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.942414 11948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07baa7056dec43cd8d5d53ca7ba95adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.951872 11947 tablet_service.cc:1511] Processing CreateTablet for tablet 882f4a494f1d4f8d90eb0287df129998 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:35.953329 11947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882f4a494f1d4f8d90eb0287df129998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.953706 12023 tablet_service.cc:1511] Processing CreateTablet for tablet 07baa7056dec43cd8d5d53ca7ba95adf (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:35.955256 12023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07baa7056dec43cd8d5d53ca7ba95adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.959227 12025 tablet_service.cc:1511] Processing CreateTablet for tablet 6be5503eb855455496fb5ba80872b7a2 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:35.959455 11946 tablet_service.cc:1511] Processing CreateTablet for tablet dbbc06d75d1b48e59bacbb85bfecaa24 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:35.960899 11946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbc06d75d1b48e59bacbb85bfecaa24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.961105 12025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be5503eb855455496fb5ba80872b7a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.963721 12024 tablet_service.cc:1511] Processing CreateTablet for tablet bb4a9d5896ae46ba99aeb28c0adc9223 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:35.966131 11945 tablet_service.cc:1511] Processing CreateTablet for tablet 17dcec89e5e24b8e97c0eb7f4115c089 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:35.967552 11945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17dcec89e5e24b8e97c0eb7f4115c089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.967485 12026 tablet_service.cc:1511] Processing CreateTablet for tablet dc50619ad0c84784949a25c646a37da5 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:35.970016 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4a9d5896ae46ba99aeb28c0adc9223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.974459 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc50619ad0c84784949a25c646a37da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:35.987982 11944 tablet_service.cc:1511] Processing CreateTablet for tablet cc95ce27f2b64be7932d1466dff07bdd (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:35.989499 11944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc95ce27f2b64be7932d1466dff07bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.001108 12022 tablet_service.cc:1511] Processing CreateTablet for tablet 882f4a494f1d4f8d90eb0287df129998 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:36.003398 12022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882f4a494f1d4f8d90eb0287df129998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.004822 11943 tablet_service.cc:1511] Processing CreateTablet for tablet d96e7a6a26c141259cde7f22bda421ca (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:36.006283 11943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96e7a6a26c141259cde7f22bda421ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.017266 12021 tablet_service.cc:1511] Processing CreateTablet for tablet dbbc06d75d1b48e59bacbb85bfecaa24 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:36.019418 12021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbc06d75d1b48e59bacbb85bfecaa24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.031406 12020 tablet_service.cc:1511] Processing CreateTablet for tablet 17dcec89e5e24b8e97c0eb7f4115c089 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:36.032796 11942 tablet_service.cc:1511] Processing CreateTablet for tablet 78fc401c3eec4c4abee78918b01c0078 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:36.033456 12020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17dcec89e5e24b8e97c0eb7f4115c089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.034336 11942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78fc401c3eec4c4abee78918b01c0078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.035877 12019 tablet_service.cc:1511] Processing CreateTablet for tablet cc95ce27f2b64be7932d1466dff07bdd (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:36.037259 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc95ce27f2b64be7932d1466dff07bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.051806 12149 tablet_bootstrap.cc:492] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:36.062734 12150 tablet_bootstrap.cc:492] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd: Bootstrap starting.
I20260709 13:04:36.068526 12150 tablet_bootstrap.cc:654] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.071885 12098 tablet_service.cc:1511] Processing CreateTablet for tablet bb4a9d5896ae46ba99aeb28c0adc9223 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:36.073637 12098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4a9d5896ae46ba99aeb28c0adc9223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.075521 12019 tablet_service.cc:1511] Processing CreateTablet for tablet d96e7a6a26c141259cde7f22bda421ca (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:36.077894 12019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96e7a6a26c141259cde7f22bda421ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.073876 12100 tablet_service.cc:1511] Processing CreateTablet for tablet dc50619ad0c84784949a25c646a37da5 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:36.079434 12100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc50619ad0c84784949a25c646a37da5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.089450 12092 tablet_service.cc:1511] Processing CreateTablet for tablet d96e7a6a26c141259cde7f22bda421ca (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:36.091054 12092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d96e7a6a26c141259cde7f22bda421ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.090695 12096 tablet_service.cc:1511] Processing CreateTablet for tablet 882f4a494f1d4f8d90eb0287df129998 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:36.092031 12096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882f4a494f1d4f8d90eb0287df129998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.095131 12093 tablet_service.cc:1511] Processing CreateTablet for tablet cc95ce27f2b64be7932d1466dff07bdd (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:36.095131 12095 tablet_service.cc:1511] Processing CreateTablet for tablet dbbc06d75d1b48e59bacbb85bfecaa24 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:36.089483 12097 tablet_service.cc:1511] Processing CreateTablet for tablet 07baa7056dec43cd8d5d53ca7ba95adf (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:36.096622 12093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc95ce27f2b64be7932d1466dff07bdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.097669 12094 tablet_service.cc:1511] Processing CreateTablet for tablet 17dcec89e5e24b8e97c0eb7f4115c089 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:36.097782 12099 tablet_service.cc:1511] Processing CreateTablet for tablet 6be5503eb855455496fb5ba80872b7a2 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:36.099058 12094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17dcec89e5e24b8e97c0eb7f4115c089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.100272 12095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbc06d75d1b48e59bacbb85bfecaa24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.101826 12099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be5503eb855455496fb5ba80872b7a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.102681 12097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07baa7056dec43cd8d5d53ca7ba95adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.098610 12149 tablet_bootstrap.cc:654] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.107873 12024 tablet_service.cc:1511] Processing CreateTablet for tablet 78fc401c3eec4c4abee78918b01c0078 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:36.109812 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78fc401c3eec4c4abee78918b01c0078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.110100 12091 tablet_service.cc:1511] Processing CreateTablet for tablet 78fc401c3eec4c4abee78918b01c0078 (DEFAULT_TABLE table=test-workload [id=ec5d6114c3c747c1a27ec228a8b34ec2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:36.111440 12091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78fc401c3eec4c4abee78918b01c0078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:36.181160 12149 tablet_bootstrap.cc:492] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf: No bootstrap required, opened a new log
I20260709 13:04:36.181726 12149 ts_tablet_manager.cc:1403] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.130s	user 0.018s	sys 0.020s
I20260709 13:04:36.184667 12149 raft_consensus.cc:359] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.185405 12149 raft_consensus.cc:385] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.185712 12149 raft_consensus.cc:740] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.186522 12149 consensus_queue.cc:260] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.187168 12153 tablet_bootstrap.cc:492] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181: Bootstrap starting.
I20260709 13:04:36.189198 12150 tablet_bootstrap.cc:492] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd: No bootstrap required, opened a new log
I20260709 13:04:36.189734 12150 ts_tablet_manager.cc:1403] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd: Time spent bootstrapping tablet: real 0.127s	user 0.034s	sys 0.039s
I20260709 13:04:36.192759 12150 raft_consensus.cc:359] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.193488 12150 raft_consensus.cc:385] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.193795 12150 raft_consensus.cc:740] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.194363 12153 tablet_bootstrap.cc:654] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.194571 12150 consensus_queue.cc:260] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.197980 11986 heartbeater.cc:499] Master 127.0.107.254:40939 was elected leader, sending a full tablet report...
I20260709 13:04:36.198524 12149 ts_tablet_manager.cc:1434] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:04:36.199599 12149 tablet_bootstrap.cc:492] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:36.209012 12149 tablet_bootstrap.cc:654] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.213927 12061 heartbeater.cc:499] Master 127.0.107.254:40939 was elected leader, sending a full tablet report...
I20260709 13:04:36.214314 12150 ts_tablet_manager.cc:1434] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.010s
W20260709 13:04:36.214466 12062 tablet.cc:2406] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:36.215415 12150 tablet_bootstrap.cc:492] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd: Bootstrap starting.
I20260709 13:04:36.227593 12150 tablet_bootstrap.cc:654] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.234246 12153 tablet_bootstrap.cc:492] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181: No bootstrap required, opened a new log
I20260709 13:04:36.234992 12153 ts_tablet_manager.cc:1403] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.028s
I20260709 13:04:36.239233 12153 raft_consensus.cc:359] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.240304 12153 raft_consensus.cc:385] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.240715 12153 raft_consensus.cc:740] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.242009 12153 consensus_queue.cc:260] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.245497 12149 tablet_bootstrap.cc:492] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf: No bootstrap required, opened a new log
I20260709 13:04:36.246526 12149 ts_tablet_manager.cc:1403] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.014s
I20260709 13:04:36.250438 12149 raft_consensus.cc:359] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.251291 12149 raft_consensus.cc:385] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.251619 12153 ts_tablet_manager.cc:1434] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.007s
I20260709 13:04:36.251713 12149 raft_consensus.cc:740] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.252583 12135 heartbeater.cc:499] Master 127.0.107.254:40939 was elected leader, sending a full tablet report...
I20260709 13:04:36.252979 12149 consensus_queue.cc:260] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.256131 12154 raft_consensus.cc:493] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.256630 12154 raft_consensus.cc:515] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.259410 12154 leader_election.cc:290] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.255594 12149 ts_tablet_manager.cc:1434] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:04:36.262521 12153 tablet_bootstrap.cc:492] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181: Bootstrap starting.
I20260709 13:04:36.280342 12149 tablet_bootstrap.cc:492] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:36.283180 12150 tablet_bootstrap.cc:492] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd: No bootstrap required, opened a new log
I20260709 13:04:36.283872 12150 ts_tablet_manager.cc:1403] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd: Time spent bootstrapping tablet: real 0.069s	user 0.025s	sys 0.037s
I20260709 13:04:36.286823 12153 tablet_bootstrap.cc:654] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.287463 12149 tablet_bootstrap.cc:654] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.286849 12150 raft_consensus.cc:359] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.288074 12150 raft_consensus.cc:385] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.288443 12150 raft_consensus.cc:740] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.289306 12150 consensus_queue.cc:260] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.291698 12150 ts_tablet_manager.cc:1434] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:04:36.292768 12150 tablet_bootstrap.cc:492] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd: Bootstrap starting.
I20260709 13:04:36.299724 12149 tablet_bootstrap.cc:492] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf: No bootstrap required, opened a new log
I20260709 13:04:36.299799 12150 tablet_bootstrap.cc:654] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.300325 12149 ts_tablet_manager.cc:1403] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.016s
I20260709 13:04:36.301283 12155 raft_consensus.cc:493] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.301887 12155 raft_consensus.cc:515] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.303685 12149 raft_consensus.cc:359] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.304503 12149 raft_consensus.cc:385] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.304818 12149 raft_consensus.cc:740] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.305797 12149 consensus_queue.cc:260] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.308459 12149 ts_tablet_manager.cc:1434] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:36.309551 12149 tablet_bootstrap.cc:492] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:36.317672 12149 tablet_bootstrap.cc:654] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.319674 12155 leader_election.cc:290] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.324542 12153 tablet_bootstrap.cc:492] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181: No bootstrap required, opened a new log
I20260709 13:04:36.325150 12153 ts_tablet_manager.cc:1403] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.015s
I20260709 13:04:36.325387 12149 tablet_bootstrap.cc:492] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf: No bootstrap required, opened a new log
I20260709 13:04:36.325917 12149 ts_tablet_manager.cc:1403] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:04:36.328225 12153 raft_consensus.cc:359] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.329011 12153 raft_consensus.cc:385] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.329341 12153 raft_consensus.cc:740] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.329144 12149 raft_consensus.cc:359] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.329916 12149 raft_consensus.cc:385] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.330243 12149 raft_consensus.cc:740] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.330317 12153 consensus_queue.cc:260] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.331207 12149 consensus_queue.cc:260] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.333976 12149 ts_tablet_manager.cc:1434] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:36.334972 12149 tablet_bootstrap.cc:492] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:36.339550 12153 ts_tablet_manager.cc:1434] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:04:36.341471 12149 tablet_bootstrap.cc:654] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.348451 12153 tablet_bootstrap.cc:492] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181: Bootstrap starting.
I20260709 13:04:36.359205 12153 tablet_bootstrap.cc:654] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.403391 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbc06d75d1b48e59bacbb85bfecaa24" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
W20260709 13:04:36.405055 11925 leader_election.cc:343] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998f562f369843189bd6c362e61297fd (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.406160 12149 tablet_bootstrap.cc:492] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: No bootstrap required, opened a new log
I20260709 13:04:36.406615 12150 tablet_bootstrap.cc:492] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd: No bootstrap required, opened a new log
I20260709 13:04:36.406720 12149 ts_tablet_manager.cc:1403] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.072s	user 0.025s	sys 0.039s
I20260709 13:04:36.407414 12150 ts_tablet_manager.cc:1403] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd: Time spent bootstrapping tablet: real 0.115s	user 0.045s	sys 0.063s
I20260709 13:04:36.410092 12149 raft_consensus.cc:359] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.410876 12149 raft_consensus.cc:385] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.410449 12150 raft_consensus.cc:359] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.411190 12149 raft_consensus.cc:740] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.411398 12150 raft_consensus.cc:385] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.411870 12150 raft_consensus.cc:740] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.412115 12149 consensus_queue.cc:260] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.412832 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbc06d75d1b48e59bacbb85bfecaa24" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:36.412930 12150 consensus_queue.cc:260] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
W20260709 13:04:36.414536 11925 leader_election.cc:343] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1631155115174ae48423c73ac623c181 (127.0.107.195:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.414958 11925 leader_election.cc:304] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf; no voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd
I20260709 13:04:36.415167 12149 ts_tablet_manager.cc:1434] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:36.415740 12154 raft_consensus.cc:2749] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:36.417062 12149 tablet_bootstrap.cc:492] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:36.419955 11961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d90a5439aef4c36a3b161fee511acbf" is_pre_election: true
I20260709 13:04:36.421865 12150 ts_tablet_manager.cc:1434] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:36.422776 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:36.423347 12150 tablet_bootstrap.cc:492] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd: Bootstrap starting.
I20260709 13:04:36.423413 12110 raft_consensus.cc:2468] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 0.
I20260709 13:04:36.409114 12153 tablet_bootstrap.cc:492] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181: No bootstrap required, opened a new log
I20260709 13:04:36.426090 12153 ts_tablet_manager.cc:1403] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.027s
I20260709 13:04:36.427403 12149 tablet_bootstrap.cc:654] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.429143 12153 raft_consensus.cc:359] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.429970 12150 tablet_bootstrap.cc:654] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:36.422094 11999 leader_election.cc:343] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.430562 12154 raft_consensus.cc:493] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.429946 12153 raft_consensus.cc:385] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.431108 12154 raft_consensus.cc:515] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.431777 12153 raft_consensus.cc:740] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.432685 12149 tablet_bootstrap.cc:492] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf: No bootstrap required, opened a new log
I20260709 13:04:36.432904 12000 leader_election.cc:304] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 4d90a5439aef4c36a3b161fee511acbf
I20260709 13:04:36.432869 12153 consensus_queue.cc:260] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.433243 12149 ts_tablet_manager.cc:1403] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.001s
I20260709 13:04:36.433925 12155 raft_consensus.cc:2804] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.434945 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:36.435386 12155 raft_consensus.cc:493] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.435837 12155 raft_consensus.cc:3060] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:36.436879 11925 leader_election.cc:343] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998f562f369843189bd6c362e61297fd (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.437317 12153 ts_tablet_manager.cc:1434] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:04:36.433326 12154 leader_election.cc:290] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.438582 12153 tablet_bootstrap.cc:492] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181: Bootstrap starting.
I20260709 13:04:36.438874 12149 raft_consensus.cc:359] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.439956 12149 raft_consensus.cc:385] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.440392 12149 raft_consensus.cc:740] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.440903 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
W20260709 13:04:36.442494 11925 leader_election.cc:343] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1631155115174ae48423c73ac623c181 (127.0.107.195:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.442955 11925 leader_election.cc:304] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf; no voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd
W20260709 13:04:36.443595 11907 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:36.444119 12154 raft_consensus.cc:2749] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:36.444165 12149 consensus_queue.cc:260] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.445858 12153 tablet_bootstrap.cc:654] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.448340 12149 ts_tablet_manager.cc:1434] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:04:36.449682 12149 tablet_bootstrap.cc:492] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:36.452406 12155 raft_consensus.cc:515] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.459054 12153 tablet_bootstrap.cc:492] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181: No bootstrap required, opened a new log
I20260709 13:04:36.457798 12149 tablet_bootstrap.cc:654] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.459699 12153 ts_tablet_manager.cc:1403] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:04:36.463044 12153 raft_consensus.cc:359] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.463881 12153 raft_consensus.cc:385] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.464176 12153 raft_consensus.cc:740] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.465061 12153 consensus_queue.cc:260] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.466168 12154 raft_consensus.cc:493] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.466686 12154 raft_consensus.cc:515] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.468360 12153 ts_tablet_manager.cc:1434] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:36.468695 12154 leader_election.cc:290] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.469817 12153 tablet_bootstrap.cc:492] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181: Bootstrap starting.
I20260709 13:04:36.472388 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:36.473125 12036 raft_consensus.cc:2468] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 0.
I20260709 13:04:36.474124 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:36.474798 12110 raft_consensus.cc:2468] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 0.
I20260709 13:04:36.476634 11925 leader_election.cc:304] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:36.478482 12154 raft_consensus.cc:2804] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.478863 12154 raft_consensus.cc:493] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.479213 12154 raft_consensus.cc:3060] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.479597 12155 leader_election.cc:290] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.479794 11961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:36.480619 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:36.481297 12110 raft_consensus.cc:3060] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:36.481824 11999 leader_election.cc:343] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.483834 12150 tablet_bootstrap.cc:492] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd: No bootstrap required, opened a new log
I20260709 13:04:36.484445 12150 ts_tablet_manager.cc:1403] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.011s
I20260709 13:04:36.486908 12154 raft_consensus.cc:515] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.487421 12150 raft_consensus.cc:359] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.488268 12150 raft_consensus.cc:385] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.488631 12150 raft_consensus.cc:740] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.489494 12150 consensus_queue.cc:260] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.489902 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:36.490523 12036 raft_consensus.cc:3060] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.498180 12036 raft_consensus.cc:2468] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 1.
I20260709 13:04:36.499075 12150 ts_tablet_manager.cc:1434] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:36.499387 11925 leader_election.cc:304] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:36.501339 12153 tablet_bootstrap.cc:654] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.501250 12149 tablet_bootstrap.cc:492] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: No bootstrap required, opened a new log
I20260709 13:04:36.502044 12149 ts_tablet_manager.cc:1403] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.027s
I20260709 13:04:36.503926 12150 tablet_bootstrap.cc:492] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd: Bootstrap starting.
I20260709 13:04:36.505156 12154 leader_election.cc:290] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 election: Requested vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.508067 12149 raft_consensus.cc:359] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.508940 12154 raft_consensus.cc:2804] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.509241 12149 raft_consensus.cc:385] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.510020 12149 raft_consensus.cc:740] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.510190 12154 raft_consensus.cc:697] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: Becoming Leader. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Running, Role: LEADER
I20260709 13:04:36.511373 12149 consensus_queue.cc:260] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.504940 12110 raft_consensus.cc:2468] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 1.
I20260709 13:04:36.513267 12150 tablet_bootstrap.cc:654] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.511898 12154 consensus_queue.cc:237] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.514971 12000 leader_election.cc:304] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 4d90a5439aef4c36a3b161fee511acbf
I20260709 13:04:36.517509 12155 raft_consensus.cc:2804] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.522146 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:36.523121 12110 raft_consensus.cc:3060] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.532255 12149 ts_tablet_manager.cc:1434] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.030s	user 0.016s	sys 0.000s
I20260709 13:04:36.533787 12149 tablet_bootstrap.cc:492] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:36.535226 12155 raft_consensus.cc:697] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:36.536340 12155 consensus_queue.cc:237] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.540490 12150 tablet_bootstrap.cc:492] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd: No bootstrap required, opened a new log
I20260709 13:04:36.541139 12150 ts_tablet_manager.cc:1403] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.001s
I20260709 13:04:36.541283 12110 raft_consensus.cc:2468] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 1.
I20260709 13:04:36.544708 12150 raft_consensus.cc:359] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.544412 11858 catalog_manager.cc:5697] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "4d90a5439aef4c36a3b161fee511acbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.545571 12150 raft_consensus.cc:385] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.547047 12150 raft_consensus.cc:740] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.547616 12153 tablet_bootstrap.cc:492] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181: No bootstrap required, opened a new log
I20260709 13:04:36.548188 12153 ts_tablet_manager.cc:1403] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.017s
I20260709 13:04:36.544771 12149 tablet_bootstrap.cc:654] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.548108 12150 consensus_queue.cc:260] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.551241 12150 ts_tablet_manager.cc:1434] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:36.551637 12153 raft_consensus.cc:359] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.552340 12150 tablet_bootstrap.cc:492] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd: Bootstrap starting.
I20260709 13:04:36.552505 12153 raft_consensus.cc:385] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.552984 12153 raft_consensus.cc:740] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.553848 12153 consensus_queue.cc:260] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.560979 12153 ts_tablet_manager.cc:1434] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:04:36.561259 12150 tablet_bootstrap.cc:654] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.562166 12153 tablet_bootstrap.cc:492] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181: Bootstrap starting.
I20260709 13:04:36.569800 12153 tablet_bootstrap.cc:654] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.572808 12149 tablet_bootstrap.cc:492] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: No bootstrap required, opened a new log
I20260709 13:04:36.576671 12149 ts_tablet_manager.cc:1403] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.001s
I20260709 13:04:36.579780 12149 raft_consensus.cc:359] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.580528 12149 raft_consensus.cc:385] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.581103 12149 raft_consensus.cc:740] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.580503 11859 catalog_manager.cc:5697] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.581830 12149 consensus_queue.cc:260] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.584196 12149 ts_tablet_manager.cc:1434] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:36.584517 12153 tablet_bootstrap.cc:492] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181: No bootstrap required, opened a new log
I20260709 13:04:36.584699 12150 tablet_bootstrap.cc:492] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd: No bootstrap required, opened a new log
I20260709 13:04:36.585083 12153 ts_tablet_manager.cc:1403] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181: Time spent bootstrapping tablet: real 0.023s	user 0.002s	sys 0.010s
I20260709 13:04:36.585168 12149 tablet_bootstrap.cc:492] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:36.585271 12150 ts_tablet_manager.cc:1403] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.007s
I20260709 13:04:36.588150 12153 raft_consensus.cc:359] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.588434 12150 raft_consensus.cc:359] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.589331 12150 raft_consensus.cc:385] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.589730 12150 raft_consensus.cc:740] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.590672 12150 consensus_queue.cc:260] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.592935 12149 tablet_bootstrap.cc:654] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.588949 12153 raft_consensus.cc:385] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.593477 12153 raft_consensus.cc:740] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.594731 12153 consensus_queue.cc:260] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.598021 12153 ts_tablet_manager.cc:1434] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:04:36.598346 12150 ts_tablet_manager.cc:1434] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:04:36.599356 12150 tablet_bootstrap.cc:492] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd: Bootstrap starting.
I20260709 13:04:36.599356 12153 tablet_bootstrap.cc:492] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181: Bootstrap starting.
I20260709 13:04:36.606882 12153 tablet_bootstrap.cc:654] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.612385 12150 tablet_bootstrap.cc:654] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.625635 12154 raft_consensus.cc:493] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.626479 12154 raft_consensus.cc:515] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.629315 12154 leader_election.cc:290] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.632899 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882f4a494f1d4f8d90eb0287df129998" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:36.635006 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882f4a494f1d4f8d90eb0287df129998" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:36.636078 12110 raft_consensus.cc:2468] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 0.
I20260709 13:04:36.638336 12155 raft_consensus.cc:493] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.639151 12155 raft_consensus.cc:515] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.643596 11961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d90a5439aef4c36a3b161fee511acbf" is_pre_election: true
I20260709 13:04:36.644632 11961 raft_consensus.cc:2468] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 0.
I20260709 13:04:36.652333 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:36.653263 12110 raft_consensus.cc:2468] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 0.
I20260709 13:04:36.654434 12000 leader_election.cc:304] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 
W20260709 13:04:36.654722 11925 leader_election.cc:343] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 998f562f369843189bd6c362e61297fd (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.655553 11925 leader_election.cc:304] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 998f562f369843189bd6c362e61297fd
I20260709 13:04:36.655565 12179 raft_consensus.cc:2804] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.656342 12179 raft_consensus.cc:493] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.656767 12179 raft_consensus.cc:3060] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.656996 12155 leader_election.cc:290] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.658334 12154 raft_consensus.cc:2804] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.658943 12154 raft_consensus.cc:493] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.659399 12154 raft_consensus.cc:3060] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.680966 12179 raft_consensus.cc:515] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.682097 12154 raft_consensus.cc:515] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.685885 12149 tablet_bootstrap.cc:492] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf: No bootstrap required, opened a new log
I20260709 13:04:36.686544 12149 ts_tablet_manager.cc:1403] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.102s	user 0.046s	sys 0.040s
I20260709 13:04:36.687175 12153 tablet_bootstrap.cc:492] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181: No bootstrap required, opened a new log
I20260709 13:04:36.687762 12153 ts_tablet_manager.cc:1403] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181: Time spent bootstrapping tablet: real 0.089s	user 0.024s	sys 0.029s
I20260709 13:04:36.688084 12150 tablet_bootstrap.cc:492] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd: No bootstrap required, opened a new log
I20260709 13:04:36.688179 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882f4a494f1d4f8d90eb0287df129998" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:36.688802 12150 ts_tablet_manager.cc:1403] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd: Time spent bootstrapping tablet: real 0.090s	user 0.037s	sys 0.040s
W20260709 13:04:36.689916 11925 leader_election.cc:343] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 998f562f369843189bd6c362e61297fd (127.0.107.194:45405): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.689661 12149 raft_consensus.cc:359] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.690532 12149 raft_consensus.cc:385] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.690864 12149 raft_consensus.cc:740] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.691659 12149 consensus_queue.cc:260] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.691937 12150 raft_consensus.cc:359] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.692193 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882f4a494f1d4f8d90eb0287df129998" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:36.692759 12150 raft_consensus.cc:385] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.692977 11961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:36.693121 12150 raft_consensus.cc:740] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.693778 11961 raft_consensus.cc:3060] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.693957 12149 ts_tablet_manager.cc:1434] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:36.694232 12150 consensus_queue.cc:260] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.696925 12109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:36.697638 12109 raft_consensus.cc:3060] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.692916 12110 raft_consensus.cc:3060] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.698638 12150 ts_tablet_manager.cc:1434] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:04:36.699865 12150 tablet_bootstrap.cc:492] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd: Bootstrap starting.
I20260709 13:04:36.705199 12110 raft_consensus.cc:2468] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 1.
I20260709 13:04:36.706738 12150 tablet_bootstrap.cc:654] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.706668 11925 leader_election.cc:304] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 998f562f369843189bd6c362e61297fd
I20260709 13:04:36.707279 12149 tablet_bootstrap.cc:492] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:36.707644 12177 raft_consensus.cc:2804] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.709110 12177 raft_consensus.cc:697] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: Becoming Leader. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Running, Role: LEADER
I20260709 13:04:36.710289 12177 consensus_queue.cc:237] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.708032 12159 raft_consensus.cc:493] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.713001 11961 raft_consensus.cc:2468] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 1.
I20260709 13:04:36.713384 12159 raft_consensus.cc:515] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.714457 11999 leader_election.cc:304] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:36.715399 12155 raft_consensus.cc:2804] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.721113 12154 leader_election.cc:290] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 election: Requested vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.727035 12159 leader_election.cc:290] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:36.728484 12155 raft_consensus.cc:697] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:36.695022 12153 raft_consensus.cc:359] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.729522 12155 consensus_queue.cc:237] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.730322 12153 raft_consensus.cc:385] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.731627 12153 raft_consensus.cc:740] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.731119 12109 raft_consensus.cc:2468] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 1.
I20260709 13:04:36.729741 12179 leader_election.cc:290] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.734467 12153 consensus_queue.cc:260] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.737681 12153 ts_tablet_manager.cc:1434] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:04:36.741768 12153 tablet_bootstrap.cc:492] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181: Bootstrap starting.
I20260709 13:04:36.749118 12150 tablet_bootstrap.cc:492] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd: No bootstrap required, opened a new log
I20260709 13:04:36.749724 12150 ts_tablet_manager.cc:1403] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.029s
I20260709 13:04:36.752314 12154 raft_consensus.cc:493] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.752679 12150 raft_consensus.cc:359] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.752991 12154 raft_consensus.cc:515] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.753532 12150 raft_consensus.cc:385] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.753876 12150 raft_consensus.cc:740] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.754878 12150 consensus_queue.cc:260] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.755524 12154 leader_election.cc:290] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.757045 12150 ts_tablet_manager.cc:1434] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:36.757632 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95ce27f2b64be7932d1466dff07bdd" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:36.758271 12150 tablet_bootstrap.cc:492] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd: Bootstrap starting.
I20260709 13:04:36.758435 12036 raft_consensus.cc:2468] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 0.
I20260709 13:04:36.758018 11855 catalog_manager.cc:5697] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "4d90a5439aef4c36a3b161fee511acbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.761029 12109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95ce27f2b64be7932d1466dff07bdd" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:36.761119 11925 leader_election.cc:304] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:36.761868 12109 raft_consensus.cc:2468] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 0.
I20260709 13:04:36.762208 12154 raft_consensus.cc:2804] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.762684 12154 raft_consensus.cc:493] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.763092 12154 raft_consensus.cc:3060] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.763576 11961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbc06d75d1b48e59bacbb85bfecaa24" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d90a5439aef4c36a3b161fee511acbf" is_pre_election: true
I20260709 13:04:36.764302 11961 raft_consensus.cc:2468] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 0.
I20260709 13:04:36.765755 12150 tablet_bootstrap.cc:654] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.765830 12073 leader_election.cc:304] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:36.766901 12159 raft_consensus.cc:2804] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.767328 12159 raft_consensus.cc:493] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.767689 12159 raft_consensus.cc:3060] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.770188 12153 tablet_bootstrap.cc:654] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.779649 12177 raft_consensus.cc:493] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.780471 12177 raft_consensus.cc:515] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.783527 12177 leader_election.cc:290] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.785734 12149 tablet_bootstrap.cc:654] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.796005 12149 tablet_bootstrap.cc:492] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: No bootstrap required, opened a new log
I20260709 13:04:36.791894 12109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07baa7056dec43cd8d5d53ca7ba95adf" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:36.788539 11855 catalog_manager.cc:5697] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:36.797508 11925 leader_election.cc:343] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1631155115174ae48423c73ac623c181 (127.0.107.195:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.792472 12159 raft_consensus.cc:515] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.790505 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07baa7056dec43cd8d5d53ca7ba95adf" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:36.798650 12036 raft_consensus.cc:2468] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 0.
I20260709 13:04:36.795239 12150 tablet_bootstrap.cc:492] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd: No bootstrap required, opened a new log
I20260709 13:04:36.800385 12150 ts_tablet_manager.cc:1403] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.012s
I20260709 13:04:36.801424 11961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbc06d75d1b48e59bacbb85bfecaa24" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:36.802088 11961 raft_consensus.cc:3060] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.799655 12159 leader_election.cc:290] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:36.803413 12150 raft_consensus.cc:359] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.804396 12150 raft_consensus.cc:385] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.804735 12150 raft_consensus.cc:740] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.795212 12154 raft_consensus.cc:515] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.807761 12154 leader_election.cc:290] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 election: Requested vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.807932 12035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbc06d75d1b48e59bacbb85bfecaa24" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:36.808648 12035 raft_consensus.cc:3060] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.808545 12150 consensus_queue.cc:260] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.810567 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbc06d75d1b48e59bacbb85bfecaa24" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:36.811069 12150 ts_tablet_manager.cc:1434] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:36.811532 12149 ts_tablet_manager.cc:1403] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.001s
I20260709 13:04:36.812199 12150 tablet_bootstrap.cc:492] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd: Bootstrap starting.
I20260709 13:04:36.813305 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95ce27f2b64be7932d1466dff07bdd" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:36.813932 12036 raft_consensus.cc:3060] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.819140 12150 tablet_bootstrap.cc:654] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.823573 12109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95ce27f2b64be7932d1466dff07bdd" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:36.824303 12109 raft_consensus.cc:3060] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.810798 11961 raft_consensus.cc:2468] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 1.
I20260709 13:04:36.827229 12073 leader_election.cc:304] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:36.828395 12159 raft_consensus.cc:2804] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.832489 12153 tablet_bootstrap.cc:492] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181: No bootstrap required, opened a new log
I20260709 13:04:36.833133 12153 ts_tablet_manager.cc:1403] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181: Time spent bootstrapping tablet: real 0.092s	user 0.025s	sys 0.033s
I20260709 13:04:36.833470 11925 leader_election.cc:304] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 1631155115174ae48423c73ac623c181
I20260709 13:04:36.834412 12154 raft_consensus.cc:2804] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.834816 12154 raft_consensus.cc:493] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.835196 12154 raft_consensus.cc:3060] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.835951 12109 raft_consensus.cc:2468] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 1.
I20260709 13:04:36.836145 12149 raft_consensus.cc:359] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.836583 12153 raft_consensus.cc:359] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.837165 12149 raft_consensus.cc:385] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.832859 12150 tablet_bootstrap.cc:492] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd: No bootstrap required, opened a new log
I20260709 13:04:36.837363 12153 raft_consensus.cc:385] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.838016 12150 ts_tablet_manager.cc:1403] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.007s
I20260709 13:04:36.837986 12153 raft_consensus.cc:740] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.839135 12035 raft_consensus.cc:2468] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 1.
I20260709 13:04:36.839686 12153 consensus_queue.cc:260] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.841188 12150 raft_consensus.cc:359] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.837533 12149 raft_consensus.cc:740] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.837400 11925 leader_election.cc:304] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:36.841847 12153 ts_tablet_manager.cc:1434] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:36.843036 12177 raft_consensus.cc:2804] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.843693 12177 raft_consensus.cc:697] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: Becoming Leader. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Running, Role: LEADER
I20260709 13:04:36.843513 12154 raft_consensus.cc:515] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.844177 12153 tablet_bootstrap.cc:492] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181: Bootstrap starting.
I20260709 13:04:36.844681 12177 consensus_queue.cc:237] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.846138 12159 raft_consensus.cc:697] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 1 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:36.847213 12159 consensus_queue.cc:237] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.849573 12036 raft_consensus.cc:2468] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 1.
I20260709 13:04:36.850867 12153 tablet_bootstrap.cc:654] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.845922 12154 leader_election.cc:290] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 election: Requested vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.851478 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07baa7056dec43cd8d5d53ca7ba95adf" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:36.852123 12036 raft_consensus.cc:3060] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.841965 12150 raft_consensus.cc:385] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.842486 12149 consensus_queue.cc:260] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.854874 12150 raft_consensus.cc:740] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.858515 12149 ts_tablet_manager.cc:1434] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 13:04:36.860203 12109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07baa7056dec43cd8d5d53ca7ba95adf" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:36.870080 12036 raft_consensus.cc:2468] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 1.
I20260709 13:04:36.871924 11925 leader_election.cc:304] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:36.861320 12150 consensus_queue.cc:260] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.874097 12177 raft_consensus.cc:2804] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.866377 11855 catalog_manager.cc:5697] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "4d90a5439aef4c36a3b161fee511acbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.875330 12202 raft_consensus.cc:493] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.876309 12202 raft_consensus.cc:515] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.875330 12177 raft_consensus.cc:697] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: Becoming Leader. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Running, Role: LEADER
I20260709 13:04:36.878846 12202 leader_election.cc:290] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:36.880038 12150 ts_tablet_manager.cc:1434] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 13:04:36.880681 11961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d90a5439aef4c36a3b161fee511acbf" is_pre_election: true
I20260709 13:04:36.881443 11961 raft_consensus.cc:2468] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 0.
I20260709 13:04:36.882731 12073 leader_election.cc:304] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:36.877743 12177 consensus_queue.cc:237] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.883690 12202 raft_consensus.cc:2804] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.884346 12202 raft_consensus.cc:493] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.884750 12202 raft_consensus.cc:3060] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.888100 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:36.889040 12036 raft_consensus.cc:2468] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 0.
I20260709 13:04:36.892843 12202 raft_consensus.cc:515] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.895802 11961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:36.896366 11961 raft_consensus.cc:3060] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:36.904230 11925 leader_election.cc:343] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1631155115174ae48423c73ac623c181 (127.0.107.195:46697): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:36.904804 12153 tablet_bootstrap.cc:492] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181: No bootstrap required, opened a new log
I20260709 13:04:36.905478 12153 ts_tablet_manager.cc:1403] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181: Time spent bootstrapping tablet: real 0.062s	user 0.027s	sys 0.026s
I20260709 13:04:36.908012 12202 leader_election.cc:290] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:36.908706 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:36.908918 12153 raft_consensus.cc:359] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.909379 12036 raft_consensus.cc:3060] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.909634 12153 raft_consensus.cc:385] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.909996 12153 raft_consensus.cc:740] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.910777 12153 consensus_queue.cc:260] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.912990 12153 ts_tablet_manager.cc:1434] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:04:36.915112 12153 tablet_bootstrap.cc:492] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181: Bootstrap starting.
I20260709 13:04:36.917873 12036 raft_consensus.cc:2468] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 1.
I20260709 13:04:36.920121 12074 leader_election.cc:304] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:36.921663 12202 raft_consensus.cc:2804] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.921917 12154 consensus_queue.cc:1048] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:36.922334 12153 tablet_bootstrap.cc:654] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:36.922305 12202 raft_consensus.cc:697] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 1 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:36.923382 12202 consensus_queue.cc:237] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.924039 11961 raft_consensus.cc:2468] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 1.
I20260709 13:04:36.912562 11855 catalog_manager.cc:5697] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:36.928371 11856 catalog_manager.cc:5697] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "4d90a5439aef4c36a3b161fee511acbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:36.936291 12154 raft_consensus.cc:493] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.936861 12154 raft_consensus.cc:515] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.938848 12154 leader_election.cc:290] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.942813 12153 tablet_bootstrap.cc:492] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181: No bootstrap required, opened a new log
I20260709 13:04:36.942914 12109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:36.943813 12153 ts_tablet_manager.cc:1403] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.014s
I20260709 13:04:36.943423 12154 consensus_queue.cc:1048] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:36.943956 12109 raft_consensus.cc:2468] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 0.
I20260709 13:04:36.943096 12035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:36.946192 12035 raft_consensus.cc:2468] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 0.
I20260709 13:04:36.946938 12153 raft_consensus.cc:359] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.947620 11925 leader_election.cc:304] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:36.947607 12153 raft_consensus.cc:385] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:36.949067 12154 raft_consensus.cc:2804] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.949364 12153 raft_consensus.cc:740] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.949602 12154 raft_consensus.cc:493] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.950081 12154 raft_consensus.cc:3060] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.950215 12153 consensus_queue.cc:260] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.951709 11855 catalog_manager.cc:5697] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:36.961246 12153 ts_tablet_manager.cc:1434] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:04:36.964836 12154 raft_consensus.cc:515] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.967183 12154 leader_election.cc:290] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 election: Requested vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.967514 12155 raft_consensus.cc:493] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.968853 12155 raft_consensus.cc:515] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.969741 12035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:36.970433 12035 raft_consensus.cc:3060] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.971369 12155 leader_election.cc:290] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.973109 12202 raft_consensus.cc:493] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.973299 11961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d90a5439aef4c36a3b161fee511acbf" is_pre_election: true
I20260709 13:04:36.973698 12202 raft_consensus.cc:515] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.974148 12108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:36.974748 12108 raft_consensus.cc:3060] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.974795 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:36.975546 12110 raft_consensus.cc:2468] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 0.
I20260709 13:04:36.976212 12202 leader_election.cc:290] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:36.977072 11960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d90a5439aef4c36a3b161fee511acbf" is_pre_election: true
I20260709 13:04:36.974043 11961 raft_consensus.cc:2468] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 0.
I20260709 13:04:36.979846 11999 leader_election.cc:304] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:36.980758 12193 raft_consensus.cc:2804] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:36.981202 12193 raft_consensus.cc:493] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.981799 12193 raft_consensus.cc:3060] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.983922 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:36.981170 12108 raft_consensus.cc:2468] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 1.
I20260709 13:04:36.985462 11925 leader_election.cc:304] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:36.986483 12154 raft_consensus.cc:2804] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:36.986708 12035 raft_consensus.cc:2468] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 1.
I20260709 13:04:36.987751 12154 raft_consensus.cc:697] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: Becoming Leader. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Running, Role: LEADER
I20260709 13:04:36.988626 12154 consensus_queue.cc:237] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.989270 12193 raft_consensus.cc:515] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:36.990530 12036 raft_consensus.cc:2393] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1631155115174ae48423c73ac623c181 in current term 1: Already voted for candidate 998f562f369843189bd6c362e61297fd in this term.
I20260709 13:04:36.992390 12193 leader_election.cc:290] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:36.992477 11961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:36.993197 11961 raft_consensus.cc:3060] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.994359 12074 leader_election.cc:304] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1631155115174ae48423c73ac623c181; no voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd
I20260709 13:04:36.994730 12108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:36.995505 12202 raft_consensus.cc:3060] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:36.999953 11960 raft_consensus.cc:3060] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.003099 12202 raft_consensus.cc:2749] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:37.009475 11961 raft_consensus.cc:2468] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 1.
I20260709 13:04:37.011127 11999 leader_election.cc:304] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:37.012657 12193 raft_consensus.cc:2804] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:37.012879 12177 raft_consensus.cc:493] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.013535 12193 raft_consensus.cc:697] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:37.013505 12177 raft_consensus.cc:515] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:37.015069 12193 consensus_queue.cc:237] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:37.016486 12177 leader_election.cc:290] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:37.018523 12107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:37.018612 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:37.019299 12107 raft_consensus.cc:2468] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 1.
I20260709 13:04:37.020648 11925 leader_election.cc:304] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 998f562f369843189bd6c362e61297fd
I20260709 13:04:37.020820 12108 raft_consensus.cc:2468] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 1.
I20260709 13:04:37.022243 12155 consensus_queue.cc:1048] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.022274 12177 raft_consensus.cc:2804] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:37.025682 12177 raft_consensus.cc:493] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.026095 12177 raft_consensus.cc:3060] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.029043 11855 catalog_manager.cc:5697] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193). New cstate: current_term: 1 leader_uuid: "4d90a5439aef4c36a3b161fee511acbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.032341 11856 catalog_manager.cc:5697] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 1 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.033619 12177 raft_consensus.cc:515] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:37.036147 12177 leader_election.cc:290] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 2 election: Requested vote from peers 998f562f369843189bd6c362e61297fd (127.0.107.194:45405), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:37.037837 11960 raft_consensus.cc:1240] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Rejecting Update request from peer 998f562f369843189bd6c362e61297fd for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:04:37.038237 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:37.039424 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2" candidate_uuid: "4d90a5439aef4c36a3b161fee511acbf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:37.040019 12110 raft_consensus.cc:3060] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.041603 12193 consensus_queue.cc:1059] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.042493 12193 raft_consensus.cc:3055] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:37.042876 12193 raft_consensus.cc:740] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:37.043846 12193 consensus_queue.cc:260] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:37.045181 12193 raft_consensus.cc:3060] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.055753 12110 raft_consensus.cc:2468] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d90a5439aef4c36a3b161fee511acbf in term 2.
I20260709 13:04:37.056910 11925 leader_election.cc:304] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 998f562f369843189bd6c362e61297fd
I20260709 13:04:37.057591 12177 raft_consensus.cc:2804] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:37.057955 12177 raft_consensus.cc:697] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 2 LEADER]: Becoming Leader. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Running, Role: LEADER
I20260709 13:04:37.058702 12177 consensus_queue.cc:237] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:37.064447 12193 raft_consensus.cc:493] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.064941 12193 raft_consensus.cc:515] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:37.065865 11856 catalog_manager.cc:5697] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf reported cstate change: term changed from 1 to 2, leader changed from 998f562f369843189bd6c362e61297fd (127.0.107.194) to 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193). New cstate: current_term: 2 leader_uuid: "4d90a5439aef4c36a3b161fee511acbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.067139 12193 leader_election.cc:290] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:37.067363 11960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882f4a494f1d4f8d90eb0287df129998" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d90a5439aef4c36a3b161fee511acbf" is_pre_election: true
I20260709 13:04:37.067770 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882f4a494f1d4f8d90eb0287df129998" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:37.068570 12110 raft_consensus.cc:2393] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 998f562f369843189bd6c362e61297fd in current term 1: Already voted for candidate 4d90a5439aef4c36a3b161fee511acbf in this term.
I20260709 13:04:37.069507 12000 leader_election.cc:304] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998f562f369843189bd6c362e61297fd; no voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf
I20260709 13:04:37.070281 12193 raft_consensus.cc:3060] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.076056 12193 raft_consensus.cc:2749] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:37.098347   431 ts_manager.cc:295] Set tserver state for 4d90a5439aef4c36a3b161fee511acbf to MAINTENANCE_MODE
I20260709 13:04:37.099121   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:04:37.118189 12177 consensus_queue.cc:1048] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:37.119025   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:37.119940   431 tablet_replica.cc:333] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: stopping tablet replica
I20260709 13:04:37.120666   431 raft_consensus.cc:2243] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.121277   431 pending_rounds.cc:70] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Trying to abort 1 pending ops.
I20260709 13:04:37.121508   431 pending_rounds.cc:77] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634925972762624 op_type: NO_OP noop_request { }
I20260709 13:04:37.121909   431 raft_consensus.cc:2889] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:37.122473   431 raft_consensus.cc:2272] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.125257   431 tablet_replica.cc:333] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: stopping tablet replica
I20260709 13:04:37.126173   431 raft_consensus.cc:2243] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.126914   431 pending_rounds.cc:70] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Trying to abort 1 pending ops.
I20260709 13:04:37.127152   431 pending_rounds.cc:77] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634926237052928 op_type: NO_OP noop_request { }
I20260709 13:04:37.127465   431 raft_consensus.cc:2889] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:37.127794   431 raft_consensus.cc:2272] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.132506   431 tablet_replica.cc:333] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf: stopping tablet replica
I20260709 13:04:37.133335   431 raft_consensus.cc:2243] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.133966   431 raft_consensus.cc:2272] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.135296 12177 consensus_queue.cc:1048] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:37.137181   431 tablet_replica.cc:333] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf: stopping tablet replica
I20260709 13:04:37.138269   431 raft_consensus.cc:2243] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.138895   431 raft_consensus.cc:2272] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.141988   431 tablet_replica.cc:333] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf: stopping tablet replica
I20260709 13:04:37.143066   431 raft_consensus.cc:2243] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.144197   431 raft_consensus.cc:2272] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:37.147792 11999 consensus_peers.cc:597] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.148970   431 tablet_replica.cc:333] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: stopping tablet replica
I20260709 13:04:37.149619   431 raft_consensus.cc:2243] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.150305   431 pending_rounds.cc:70] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Trying to abort 1 pending ops.
I20260709 13:04:37.150557   431 pending_rounds.cc:77] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634926566739968 op_type: NO_OP noop_request { }
I20260709 13:04:37.150856   431 raft_consensus.cc:2889] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:37.151203   431 raft_consensus.cc:2272] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.154104   431 tablet_replica.cc:333] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf: stopping tablet replica
I20260709 13:04:37.154860   431 raft_consensus.cc:2243] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.155262   431 raft_consensus.cc:2272] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.156903   431 tablet_replica.cc:333] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf: stopping tablet replica
I20260709 13:04:37.157397   431 raft_consensus.cc:2243] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:37.157752   431 raft_consensus.cc:2272] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.159699   431 tablet_replica.cc:333] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: stopping tablet replica
I20260709 13:04:37.160220   431 raft_consensus.cc:2243] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.160794   431 pending_rounds.cc:70] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Trying to abort 1 pending ops.
I20260709 13:04:37.160998   431 pending_rounds.cc:77] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7305634926839410688 op_type: NO_OP noop_request { }
I20260709 13:04:37.161264   431 raft_consensus.cc:2889] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:37.161547   431 raft_consensus.cc:2272] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.163581   431 tablet_replica.cc:333] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf: stopping tablet replica
I20260709 13:04:37.164057   431 raft_consensus.cc:2243] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:37.164765   431 raft_consensus.cc:2272] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:37.195473   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:04:37.271193 12193 consensus_queue.cc:1048] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.300064 12202 raft_consensus.cc:493] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.300575 12202 raft_consensus.cc:515] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:37.302500 12202 leader_election.cc:290] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:37.303682 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07baa7056dec43cd8d5d53ca7ba95adf" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:37.304664 12036 raft_consensus.cc:2393] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1631155115174ae48423c73ac623c181 in current term 1: Already voted for candidate 4d90a5439aef4c36a3b161fee511acbf in this term.
W20260709 13:04:37.306893 12073 leader_election.cc:336] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:37.307284 12073 leader_election.cc:304] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1631155115174ae48423c73ac623c181; no voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd
I20260709 13:04:37.307953 12202 raft_consensus.cc:3060] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:37.311403 12159 consensus_queue.cc:1048] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.315162 12202 raft_consensus.cc:2749] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:37.326191 12073 consensus_peers.cc:597] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:37.340643 12073 consensus_peers.cc:597] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.404115 12222 consensus_queue.cc:1048] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:37.419214 11999 consensus_peers.cc:597] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:37.420395 12225 consensus_queue.cc:1048] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:37.444623 11907 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:38.445752 11907 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:38.457408 12193 raft_consensus.cc:493] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d90a5439aef4c36a3b161fee511acbf)
I20260709 13:04:38.458235 12193 raft_consensus.cc:515] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.460438 12193 leader_election.cc:290] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:38.461881 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
W20260709 13:04:38.464665 11999 leader_election.cc:336] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:38.465073 11999 leader_election.cc:304] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 998f562f369843189bd6c362e61297fd; no voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf
I20260709 13:04:38.465740 12193 raft_consensus.cc:2749] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:38.508132 12225 raft_consensus.cc:493] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d90a5439aef4c36a3b161fee511acbf)
I20260709 13:04:38.508896 12225 raft_consensus.cc:515] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.511250 12225 leader_election.cc:290] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:38.512658 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
W20260709 13:04:38.512938 12073 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111) [suppressed 126 similar messages]
I20260709 13:04:38.513420 12036 raft_consensus.cc:2468] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 1.
I20260709 13:04:38.514932 12074 leader_election.cc:304] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:38.515779 12225 raft_consensus.cc:2804] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:38.515797 12073 leader_election.cc:336] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:38.516263 12225 raft_consensus.cc:493] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d90a5439aef4c36a3b161fee511acbf)
I20260709 13:04:38.516665 12225 raft_consensus.cc:3060] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.525328 12225 raft_consensus.cc:515] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.527220 12225 leader_election.cc:290] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:38.528443 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:38.529068 12036 raft_consensus.cc:3060] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:38.530997 12073 leader_election.cc:336] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:38.536237 12036 raft_consensus.cc:2468] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 2.
I20260709 13:04:38.537398 12074 leader_election.cc:304] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 4d90a5439aef4c36a3b161fee511acbf
I20260709 13:04:38.538185 12225 raft_consensus.cc:2804] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.539104 12225 raft_consensus.cc:697] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:38.540186 12225 consensus_queue.cc:237] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.548357 11856 catalog_manager.cc:5697] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 1 to 2, leader changed from 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193) to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.590657 12193 raft_consensus.cc:493] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.591336 12193 raft_consensus.cc:515] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.593348 12193 leader_election.cc:290] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:38.594700 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95ce27f2b64be7932d1466dff07bdd" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:38.595476 12110 raft_consensus.cc:2468] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 1.
I20260709 13:04:38.596580 12000 leader_election.cc:304] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:38.597249 12193 raft_consensus.cc:2804] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:38.597309 11999 leader_election.cc:336] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:38.597587 12193 raft_consensus.cc:493] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.598011 12193 raft_consensus.cc:3060] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.606411 12193 raft_consensus.cc:515] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.608136 12193 leader_election.cc:290] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:38.609200 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc95ce27f2b64be7932d1466dff07bdd" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:38.609761 12110 raft_consensus.cc:3060] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:38.611937 11999 leader_election.cc:336] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:38.616050 12110 raft_consensus.cc:2468] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 2.
I20260709 13:04:38.617182 12000 leader_election.cc:304] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 4d90a5439aef4c36a3b161fee511acbf
I20260709 13:04:38.617875 12193 raft_consensus.cc:2804] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.619058 12193 raft_consensus.cc:697] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:38.620105 12193 consensus_queue.cc:237] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.629246 11856 catalog_manager.cc:5697] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 1 to 2, leader changed from 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193) to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.633490 12225 raft_consensus.cc:493] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4d90a5439aef4c36a3b161fee511acbf)
I20260709 13:04:38.634385 12225 raft_consensus.cc:515] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.636790 12225 leader_election.cc:290] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:38.638079 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882f4a494f1d4f8d90eb0287df129998" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:38.638876 12036 raft_consensus.cc:2468] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 1.
I20260709 13:04:38.639967 12074 leader_election.cc:304] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:38.640777 12225 raft_consensus.cc:2804] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:38.641149 12225 raft_consensus.cc:493] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4d90a5439aef4c36a3b161fee511acbf)
W20260709 13:04:38.641260 12073 leader_election.cc:336] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:38.641525 12225 raft_consensus.cc:3060] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.647433 12225 raft_consensus.cc:515] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.648975 12225 leader_election.cc:290] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:38.649999 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882f4a494f1d4f8d90eb0287df129998" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:38.650579 12036 raft_consensus.cc:3060] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:38.652648 12073 leader_election.cc:336] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:38.655578 12036 raft_consensus.cc:2468] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 2.
I20260709 13:04:38.656587 12074 leader_election.cc:304] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 4d90a5439aef4c36a3b161fee511acbf
I20260709 13:04:38.657248 12225 raft_consensus.cc:2804] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.657722 12225 raft_consensus.cc:697] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:38.658701 12225 consensus_queue.cc:237] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.666597 11856 catalog_manager.cc:5697] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 1 to 2, leader changed from 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193) to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.688128 12193 raft_consensus.cc:493] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.688854 12193 raft_consensus.cc:515] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.690765 12193 leader_election.cc:290] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:38.691968 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:38.692858 12110 raft_consensus.cc:2468] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 2.
I20260709 13:04:38.693953 12000 leader_election.cc:304] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 
W20260709 13:04:38.694504 11999 leader_election.cc:336] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:38.694765 12193 raft_consensus.cc:2804] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:38.695209 12193 raft_consensus.cc:493] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.695649 12193 raft_consensus.cc:3060] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:38.702114 12193 raft_consensus.cc:515] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.703922 12193 leader_election.cc:290] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:38.705204 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:38.705822 12110 raft_consensus.cc:3060] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:38.708184 11999 leader_election.cc:336] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:38.712375 12110 raft_consensus.cc:2468] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 3.
I20260709 13:04:38.713498 12000 leader_election.cc:304] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 4d90a5439aef4c36a3b161fee511acbf
I20260709 13:04:38.714237 12193 raft_consensus.cc:2804] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:38.714659 12193 raft_consensus.cc:697] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:38.715626 12193 consensus_queue.cc:237] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.722906 11856 catalog_manager.cc:5697] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 2 to 3, leader changed from 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193) to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 3 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.920897 12193 raft_consensus.cc:493] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.921497 12193 raft_consensus.cc:515] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.923473 12193 leader_election.cc:290] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:38.924611 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07baa7056dec43cd8d5d53ca7ba95adf" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181" is_pre_election: true
I20260709 13:04:38.925312 12110 raft_consensus.cc:2468] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 1.
I20260709 13:04:38.926266 12000 leader_election.cc:304] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:38.927011 12193 raft_consensus.cc:2804] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:38.927254 11999 leader_election.cc:336] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:38.927392 12193 raft_consensus.cc:493] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.927804 12193 raft_consensus.cc:3060] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:38.934173 12193 raft_consensus.cc:515] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.935993 12193 leader_election.cc:290] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:38.937158 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07baa7056dec43cd8d5d53ca7ba95adf" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:38.938009 12110 raft_consensus.cc:3060] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:38.939997 11999 leader_election.cc:336] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:38.943634 12110 raft_consensus.cc:2468] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 2.
I20260709 13:04:38.945047 12000 leader_election.cc:304] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 4d90a5439aef4c36a3b161fee511acbf
I20260709 13:04:38.945909 12193 raft_consensus.cc:2804] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:38.946431 12193 raft_consensus.cc:697] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:38.947479 12193 consensus_queue.cc:237] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:38.955721 11856 catalog_manager.cc:5697] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 1 to 2, leader changed from 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193) to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:39.023074 11999 consensus_peers.cc:597] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:39.054515 12225 raft_consensus.cc:493] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.055162 12225 raft_consensus.cc:515] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:39.057155 12225 leader_election.cc:290] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:39.058420 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd" is_pre_election: true
I20260709 13:04:39.059314 12036 raft_consensus.cc:2468] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 1.
I20260709 13:04:39.060343 12074 leader_election.cc:304] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 
W20260709 13:04:39.060876 12073 leader_election.cc:336] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:39.060992 12225 raft_consensus.cc:2804] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:39.061400 12225 raft_consensus.cc:493] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:39.061544 12073 consensus_peers.cc:597] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:39.061659 12225 raft_consensus.cc:3060] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:39.067392 12225 raft_consensus.cc:515] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:39.069128 12225 leader_election.cc:290] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:39.070297 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:39.070962 12036 raft_consensus.cc:3060] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:39.073267 12073 leader_election.cc:336] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111)
I20260709 13:04:39.076602 12036 raft_consensus.cc:2468] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 2.
I20260709 13:04:39.077620 12074 leader_election.cc:304] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1631155115174ae48423c73ac623c181, 998f562f369843189bd6c362e61297fd; no voters: 4d90a5439aef4c36a3b161fee511acbf
I20260709 13:04:39.078349 12225 raft_consensus.cc:2804] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:39.078769 12225 raft_consensus.cc:697] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:39.079849 12225 consensus_queue.cc:237] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:39.082448 12036 raft_consensus.cc:1275] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.083864 12225 consensus_queue.cc:1048] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:39.089557 11856 catalog_manager.cc:5697] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 1 to 2, leader changed from 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193) to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:39.100976 12073 consensus_peers.cc:597] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:39.161123 12110 raft_consensus.cc:1275] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:39.162701 12193 consensus_queue.cc:1048] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:39.177768 11999 consensus_peers.cc:597] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:39.207566 12110 raft_consensus.cc:1275] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:39.208900 12193 consensus_queue.cc:1048] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:39.213158 12036 raft_consensus.cc:1275] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:39.214715 12230 consensus_queue.cc:1048] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:39.416785 12110 raft_consensus.cc:1275] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:39.418239 12251 consensus_queue.cc:1048] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:39.431936 11999 consensus_peers.cc:597] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:39.447031 11907 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:39.544034 12036 raft_consensus.cc:1275] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:39.545423 12243 consensus_queue.cc:1048] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:39.560837 12073 consensus_peers.cc:597] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:39.721602 11999 consensus_peers.cc:597] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:39.852907 12073 consensus_peers.cc:597] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:39.922132 12073 consensus_peers.cc:597] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:40.282831 11999 consensus_peers.cc:597] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:40.448172 11907 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:41.449220 11907 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:41.538906 11999 consensus_peers.cc:597] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:41.610702 12073 consensus_peers.cc:597] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:41.681701 11999 consensus_peers.cc:597] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:41.695258 12073 consensus_peers.cc:597] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:41.932641 12073 consensus_peers.cc:597] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:42.058604 11999 consensus_peers.cc:597] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:42.213956   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:42.221596 12259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:42.221980 12260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:42.223834 12262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:42.224984   431 server_base.cc:1061] running on GCE node
I20260709 13:04:42.228901   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:42.229161   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:42.229370   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602282229350 us; error 0 us; skew 500 ppm
I20260709 13:04:42.230012   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:42.233156   431 webserver.cc:533] Webserver started at http://127.0.107.193:44779/ using document root <none> and password file <none>
I20260709 13:04:42.233702   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:42.233902   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:04:42.237910   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:42.242179 12267 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:42.242970   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:04:42.243300   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-0-root
uuid: "4d90a5439aef4c36a3b161fee511acbf"
format_stamp: "Formatted at 2026-07-09 13:04:35 on dist-test-slave-nr1f"
I20260709 13:04:42.243718   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601903731679-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:42.259801   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:42.261117   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:42.262665   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:42.266335 12274 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:04:42.307662 11999 consensus_peers.cc:597] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:42.319623   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:04:42.319986   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.055s	user 0.000s	sys 0.003s
I20260709 13:04:42.320219   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:04:42.325906 12274 tablet_bootstrap.cc:492] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:42.339113 12274 tablet_bootstrap.cc:492] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:42.339937 12274 tablet_bootstrap.cc:492] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap complete.
I20260709 13:04:42.340519 12274 ts_tablet_manager.cc:1403] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:04:42.342836 12274 raft_consensus.cc:359] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.343554 12274 raft_consensus.cc:740] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.344209 12274 consensus_queue.cc:260] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.346695 12274 ts_tablet_manager.cc:1434] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:42.347383 12274 tablet_bootstrap.cc:492] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:42.359575 12274 tablet_bootstrap.cc:492] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:42.360244   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:04:42.360360 12274 tablet_bootstrap.cc:492] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap complete.
I20260709 13:04:42.360563   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.040s	user 0.038s	sys 0.001s
I20260709 13:04:42.361109 12274 ts_tablet_manager.cc:1403] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:04:42.363248 12274 raft_consensus.cc:359] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.363936 12274 raft_consensus.cc:740] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.364624 12274 consensus_queue.cc:260] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.366222 12274 ts_tablet_manager.cc:1434] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:04:42.366882 12274 tablet_bootstrap.cc:492] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:42.380545 12274 tablet_bootstrap.cc:492] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:42.381340 12274 tablet_bootstrap.cc:492] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap complete.
I20260709 13:04:42.381915 12274 ts_tablet_manager.cc:1403] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:04:42.384608 12274 raft_consensus.cc:359] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.385327 12274 raft_consensus.cc:740] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.386132 12274 consensus_queue.cc:260] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.387977 12274 ts_tablet_manager.cc:1434] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:04:42.388624 12274 tablet_bootstrap.cc:492] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:42.402755 12274 tablet_bootstrap.cc:492] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.403883 12274 tablet_bootstrap.cc:492] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap complete.
I20260709 13:04:42.404673 12274 ts_tablet_manager.cc:1403] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.001s
I20260709 13:04:42.407801 12274 raft_consensus.cc:359] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.408540 12274 raft_consensus.cc:740] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.409330 12274 consensus_queue.cc:260] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.411860 12274 ts_tablet_manager.cc:1434] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:42.412870 12274 tablet_bootstrap.cc:492] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:42.424779   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43727
I20260709 13:04:42.424878 12336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43727 every 8 connection(s)
I20260709 13:04:42.430083 12274 tablet_bootstrap.cc:492] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.431092 12274 tablet_bootstrap.cc:492] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap complete.
I20260709 13:04:42.431172   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:42.431834 12274 ts_tablet_manager.cc:1403] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:04:42.434790 12274 raft_consensus.cc:359] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.435495 12274 raft_consensus.cc:740] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.436276 12274 consensus_queue.cc:260] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.438501 12274 ts_tablet_manager.cc:1434] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:42.439309 12274 tablet_bootstrap.cc:492] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
W20260709 13:04:42.450278 11907 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:42.457629 12274 tablet_bootstrap.cc:492] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.458559 12274 tablet_bootstrap.cc:492] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap complete.
I20260709 13:04:42.459216 12274 ts_tablet_manager.cc:1403] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 13:04:42.462296 12036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07baa7056dec43cd8d5d53ca7ba95adf"
dest_uuid: "998f562f369843189bd6c362e61297fd"
mode: GRACEFUL
new_leader_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:54448
I20260709 13:04:42.463151 12036 raft_consensus.cc:606] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Received request to transfer leadership to TS 1631155115174ae48423c73ac623c181
I20260709 13:04:42.463379 12274 raft_consensus.cc:359] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.463824 12338 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40939
I20260709 13:04:42.464149 12274 raft_consensus.cc:740] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.464371 12338 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:42.464882 12274 consensus_queue.cc:260] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.465348 12338 heartbeater.cc:507] Master 127.0.107.254:40939 requested a full tablet report, sending...
I20260709 13:04:42.466681 12274 ts_tablet_manager.cc:1434] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:42.467463 12274 tablet_bootstrap.cc:492] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:42.468144 12036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223"
dest_uuid: "998f562f369843189bd6c362e61297fd"
mode: GRACEFUL
new_leader_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:54448
I20260709 13:04:42.468859 12036 raft_consensus.cc:606] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Received request to transfer leadership to TS 1631155115174ae48423c73ac623c181
I20260709 13:04:42.472168 11855 ts_manager.cc:194] Re-registered known tserver with Master: 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727)
I20260709 13:04:42.482841 11855 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39498
I20260709 13:04:42.487109 12338 heartbeater.cc:499] Master 127.0.107.254:40939 was elected leader, sending a full tablet report...
I20260709 13:04:42.491547 12108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca"
dest_uuid: "1631155115174ae48423c73ac623c181"
mode: GRACEFUL
new_leader_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:38204
I20260709 13:04:42.492247 12108 raft_consensus.cc:606] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 1 LEADER]: Received request to transfer leadership to TS 998f562f369843189bd6c362e61297fd
I20260709 13:04:42.493764   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:42.494724   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:42.495759   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:42.498960 12274 tablet_bootstrap.cc:492] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.499918 12274 tablet_bootstrap.cc:492] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap complete.
I20260709 13:04:42.500597 12274 ts_tablet_manager.cc:1403] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.012s
I20260709 13:04:42.503268 12274 raft_consensus.cc:359] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.503998 12274 raft_consensus.cc:740] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.504763 12274 consensus_queue.cc:260] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.506637 12274 ts_tablet_manager.cc:1434] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:42.507349 12274 tablet_bootstrap.cc:492] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:42.520388 12274 tablet_bootstrap.cc:492] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.521211 12274 tablet_bootstrap.cc:492] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap complete.
I20260709 13:04:42.521920 12274 ts_tablet_manager.cc:1403] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:04:42.524520 12274 raft_consensus.cc:359] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.525115 12274 raft_consensus.cc:740] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.525688 12274 consensus_queue.cc:260] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.527477 12274 ts_tablet_manager.cc:1434] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:42.528280 12274 tablet_bootstrap.cc:492] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:42.537177 12310 raft_consensus.cc:3060] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.541894 12274 tablet_bootstrap.cc:492] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:42.542806 12274 tablet_bootstrap.cc:492] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap complete.
I20260709 13:04:42.543349 12274 ts_tablet_manager.cc:1403] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:04:42.544188 12310 pending_rounds.cc:85] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Aborting all ops after (but not including) 0
I20260709 13:04:42.544529 12310 pending_rounds.cc:107] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:42.544740 12310 raft_consensus.cc:2889] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:42.545562 12274 raft_consensus.cc:359] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.546518 12274 raft_consensus.cc:740] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.547279 12274 consensus_queue.cc:260] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.549427 12274 ts_tablet_manager.cc:1434] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:42.550215 12274 tablet_bootstrap.cc:492] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap starting.
I20260709 13:04:42.566278 12274 tablet_bootstrap.cc:492] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.567375 12274 tablet_bootstrap.cc:492] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf: Bootstrap complete.
I20260709 13:04:42.568125 12274 ts_tablet_manager.cc:1403] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:04:42.570856 12274 raft_consensus.cc:359] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.571408 12274 raft_consensus.cc:740] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d90a5439aef4c36a3b161fee511acbf, State: Initialized, Role: FOLLOWER
I20260709 13:04:42.572028 12274 consensus_queue.cc:260] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.573911 12274 ts_tablet_manager.cc:1434] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:04:42.661394 12230 raft_consensus.cc:993] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181: : Instructing follower 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:42.661958 12356 raft_consensus.cc:1081] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 1 LEADER]: Signalling peer 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:42.663707 12036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca"
dest_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:42.664206 12036 raft_consensus.cc:493] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:42.664515 12036 raft_consensus.cc:3060] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.669732 12036 raft_consensus.cc:515] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.671301 12036 leader_election.cc:290] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:42.672314 12108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:42.672339 12309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:42.673197 12108 raft_consensus.cc:3055] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:42.673257 12309 raft_consensus.cc:3060] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.673646 12108 raft_consensus.cc:740] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:42.674649 12108 consensus_queue.cc:260] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.676126 12108 raft_consensus.cc:3060] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.677211 12310 raft_consensus.cc:3060] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:42.681990 12309 raft_consensus.cc:2468] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 2.
I20260709 13:04:42.682721 12310 pending_rounds.cc:85] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Aborting all ops after (but not including) 0
I20260709 13:04:42.683084 12310 pending_rounds.cc:107] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf: Aborting uncommitted NO_OP operation due to leader change: 2.1
I20260709 13:04:42.683362 12310 raft_consensus.cc:2889] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:42.683346 11999 leader_election.cc:304] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:42.684412 12108 raft_consensus.cc:2468] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 2.
I20260709 13:04:42.684621 12333 raft_consensus.cc:2804] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:42.685109 12333 raft_consensus.cc:697] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:42.686064 12333 consensus_queue.cc:237] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.689941 12256 consensus_queue.cc:1050] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [LEADER]: Got LMP mismatch error from peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:42.694020 11855 catalog_manager.cc:5697] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 1 to 2, leader changed from 1631155115174ae48423c73ac623c181 (127.0.107.195) to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:42.699452 12309 raft_consensus.cc:3060] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.748921 12309 raft_consensus.cc:3060] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.753811 12309 pending_rounds.cc:85] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Aborting all ops after (but not including) 0
I20260709 13:04:42.754067 12309 pending_rounds.cc:107] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:42.754238 12309 raft_consensus.cc:2889] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:42.803748 12333 raft_consensus.cc:993] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd: : Instructing follower 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:42.804286 12256 raft_consensus.cc:1081] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Signalling peer 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:42.806054 12108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223"
dest_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:50904
I20260709 13:04:42.806723 12108 raft_consensus.cc:493] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:42.807082 12108 raft_consensus.cc:3060] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.812628 12108 raft_consensus.cc:515] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.814687 12108 leader_election.cc:290] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:42.815831 12309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:42.816027 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:42.817878 12036 raft_consensus.cc:3055] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:42.818248 12036 raft_consensus.cc:740] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:42.817878 12309 raft_consensus.cc:3060] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.819099 12036 consensus_queue.cc:260] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.820509 12036 raft_consensus.cc:3060] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.826041 12309 raft_consensus.cc:2468] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 2.
I20260709 13:04:42.827315 12073 leader_election.cc:304] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:42.827386 12036 raft_consensus.cc:2468] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 2.
I20260709 13:04:42.828244 12356 raft_consensus.cc:2804] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:42.828683 12356 raft_consensus.cc:697] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:42.829453 12356 consensus_queue.cc:237] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.833333 12333 raft_consensus.cc:993] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd: : Instructing follower 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:42.833921 12333 raft_consensus.cc:1081] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Signalling peer 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:42.835606 12108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07baa7056dec43cd8d5d53ca7ba95adf"
dest_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:50904
I20260709 13:04:42.836073 12108 raft_consensus.cc:493] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:42.836436 12108 raft_consensus.cc:3060] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:42.837754 11855 catalog_manager.cc:5697] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 1 to 2, leader changed from 998f562f369843189bd6c362e61297fd (127.0.107.194) to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.841606 12108 raft_consensus.cc:515] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.843778 12108 leader_election.cc:290] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 3 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:42.844636 12309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07baa7056dec43cd8d5d53ca7ba95adf" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:42.845310 12309 raft_consensus.cc:3060] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:42.845355 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07baa7056dec43cd8d5d53ca7ba95adf" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:42.846477 12036 raft_consensus.cc:3055] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:42.846881 12036 raft_consensus.cc:740] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:42.847591 12036 consensus_queue.cc:260] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.848587 12036 raft_consensus.cc:3060] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:42.851168 12309 raft_consensus.cc:2468] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 3.
I20260709 13:04:42.852330 12073 leader_election.cc:304] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:42.853040 12036 raft_consensus.cc:2468] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 3.
I20260709 13:04:42.853075 12356 raft_consensus.cc:2804] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:42.853772 12356 raft_consensus.cc:697] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 3 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:42.854828 12356 consensus_queue.cc:237] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:42.861696 11855 catalog_manager.cc:5697] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 2 to 3, leader changed from 998f562f369843189bd6c362e61297fd (127.0.107.194) to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.909188 12309 raft_consensus.cc:3060] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:42.914608 12309 pending_rounds.cc:85] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Aborting all ops after (but not including) 0
I20260709 13:04:42.914815 12309 pending_rounds.cc:107] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:42.915081 12309 raft_consensus.cc:2889] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:43.139849 12309 raft_consensus.cc:3060] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:43.156831 12108 raft_consensus.cc:1275] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.158329 12368 consensus_queue.cc:1048] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.168296 12309 raft_consensus.cc:1275] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.169867 12333 consensus_queue.cc:1048] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.294953 12309 raft_consensus.cc:1275] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.296288 12356 consensus_queue.cc:1048] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:43.306208 12036 raft_consensus.cc:1275] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:43.308261 12230 consensus_queue.cc:1048] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:43.311823 12036 raft_consensus.cc:1275] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:43.313634 12369 consensus_queue.cc:1048] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:43.327350 12309 raft_consensus.cc:1275] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:43.328876 12377 consensus_queue.cc:1048] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:43.451306 11907 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:43.506331   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:43.513728 12108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078"
dest_uuid: "1631155115174ae48423c73ac623c181"
mode: GRACEFUL
new_leader_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:38204
I20260709 13:04:43.514348 12108 raft_consensus.cc:606] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Received request to transfer leadership to TS 998f562f369843189bd6c362e61297fd
I20260709 13:04:43.516803 12036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca"
dest_uuid: "998f562f369843189bd6c362e61297fd"
mode: GRACEFUL
new_leader_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:54448
I20260709 13:04:43.517261 12036 raft_consensus.cc:606] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Received request to transfer leadership to TS 1631155115174ae48423c73ac623c181
I20260709 13:04:43.519562 12108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5"
dest_uuid: "1631155115174ae48423c73ac623c181"
mode: GRACEFUL
new_leader_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:38204
I20260709 13:04:43.520182 12108 raft_consensus.cc:606] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Received request to transfer leadership to TS 998f562f369843189bd6c362e61297fd
I20260709 13:04:43.521224   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:43.521643   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:43.522271   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:43.700656 12369 raft_consensus.cc:993] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181: : Instructing follower 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:43.701126 12377 raft_consensus.cc:1081] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Signalling peer 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:43.702739 12036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5"
dest_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:43.703212 12036 raft_consensus.cc:493] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.703511 12036 raft_consensus.cc:3060] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.708287 12036 raft_consensus.cc:515] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:43.709991 12036 leader_election.cc:290] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:43.710805 12309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:43.711140 12108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:43.711524 12309 raft_consensus.cc:3060] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.711776 12108 raft_consensus.cc:3055] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:43.712205 12108 raft_consensus.cc:740] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:43.712975 12108 consensus_queue.cc:260] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:43.713945 12108 raft_consensus.cc:3060] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.717011 12309 raft_consensus.cc:2468] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 3.
I20260709 13:04:43.718109 11999 leader_election.cc:304] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:43.718781 12368 raft_consensus.cc:2804] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:43.719281 12368 raft_consensus.cc:697] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:43.719333 12108 raft_consensus.cc:2468] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 3.
I20260709 13:04:43.720358 12368 consensus_queue.cc:237] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:43.724169 12368 raft_consensus.cc:993] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd: : Instructing follower 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:43.724773 12333 raft_consensus.cc:1081] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Signalling peer 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:43.726612 12108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca"
dest_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:50904
I20260709 13:04:43.727188 12108 raft_consensus.cc:493] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.727505 12108 raft_consensus.cc:3060] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.728572 11855 catalog_manager.cc:5697] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 2 to 3, leader changed from 1631155115174ae48423c73ac623c181 (127.0.107.195) to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 3 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.732506 12108 raft_consensus.cc:515] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:43.735041 12108 leader_election.cc:290] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 3 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:43.735214 12309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:43.735875 12309 raft_consensus.cc:3060] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.735997 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:43.736701 12036 raft_consensus.cc:3055] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:43.737025 12036 raft_consensus.cc:740] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:43.737775 12036 consensus_queue.cc:260] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:43.738930 12036 raft_consensus.cc:3060] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.743090 12309 raft_consensus.cc:2468] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 3.
I20260709 13:04:43.744244 12036 raft_consensus.cc:2468] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 3.
I20260709 13:04:43.744369 12073 leader_election.cc:304] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:43.745182 12377 raft_consensus.cc:2804] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:43.745749 12377 raft_consensus.cc:697] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 3 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:43.746472 12377 consensus_queue.cc:237] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:43.752543 11855 catalog_manager.cc:5697] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 2 to 3, leader changed from 998f562f369843189bd6c362e61297fd (127.0.107.194) to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.794860 12369 raft_consensus.cc:993] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181: : Instructing follower 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:43.795364 12377 raft_consensus.cc:1081] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Signalling peer 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:43.796814 12036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078"
dest_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:43.797271 12036 raft_consensus.cc:493] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.797500 12036 raft_consensus.cc:3060] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.802698 12036 raft_consensus.cc:515] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:43.804217 12036 leader_election.cc:290] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:43.805083 12309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:43.805249 12108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:43.805794 12309 raft_consensus.cc:3060] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.805886 12108 raft_consensus.cc:3055] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:43.806380 12108 raft_consensus.cc:740] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:43.807144 12108 consensus_queue.cc:260] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:43.808598 12108 raft_consensus.cc:3060] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:43.812896 12309 raft_consensus.cc:2468] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 3.
I20260709 13:04:43.814149 11999 leader_election.cc:304] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:43.814462 12108 raft_consensus.cc:2468] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 3.
I20260709 13:04:43.814899 12333 raft_consensus.cc:2804] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:43.815482 12333 raft_consensus.cc:697] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:43.816375 12333 consensus_queue.cc:237] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:43.825086 11855 catalog_manager.cc:5697] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 2 to 3, leader changed from 1631155115174ae48423c73ac623c181 (127.0.107.195) to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 3 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:44.194763 12108 raft_consensus.cc:1275] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:44.196112 12333 consensus_queue.cc:1048] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:44.199577 12309 raft_consensus.cc:1275] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:44.202391 12368 consensus_queue.cc:1048] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:44.218264 12310 raft_consensus.cc:1275] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:44.223026 12256 consensus_queue.cc:1048] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:04:44.230782 12309 raft_consensus.cc:1275] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:44.230867 12110 raft_consensus.cc:1275] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:44.237115 12377 consensus_queue.cc:1048] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:44.250299 12389 consensus_queue.cc:1048] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:44.257970 12036 raft_consensus.cc:1275] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:44.259415 12230 consensus_queue.cc:1048] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:44.452286 11907 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:44.528630   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:44.536109 12036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089"
dest_uuid: "998f562f369843189bd6c362e61297fd"
mode: GRACEFUL
new_leader_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:54448
I20260709 13:04:44.536576 12036 raft_consensus.cc:606] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Received request to transfer leadership to TS 1631155115174ae48423c73ac623c181
I20260709 13:04:44.538790 12036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2"
dest_uuid: "998f562f369843189bd6c362e61297fd"
mode: GRACEFUL
new_leader_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:54448
I20260709 13:04:44.539188 12036 raft_consensus.cc:606] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Received request to transfer leadership to TS 1631155115174ae48423c73ac623c181
I20260709 13:04:44.541267 12110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca"
dest_uuid: "1631155115174ae48423c73ac623c181"
mode: GRACEFUL
new_leader_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:38204
I20260709 13:04:44.541777 12110 raft_consensus.cc:606] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 3 LEADER]: Received request to transfer leadership to TS 998f562f369843189bd6c362e61297fd
I20260709 13:04:44.542925   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:44.543393   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:44.543983   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:44.661371 12369 raft_consensus.cc:993] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181: : Instructing follower 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:44.661976 12230 raft_consensus.cc:1081] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 3 LEADER]: Signalling peer 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:44.663818 12036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca"
dest_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:44.664391 12036 raft_consensus.cc:493] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:44.664752 12036 raft_consensus.cc:3060] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.669494 12036 raft_consensus.cc:515] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:44.672003 12308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:44.672528 12308 raft_consensus.cc:3060] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.673025 12036 leader_election.cc:290] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 4 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:44.674798 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d96e7a6a26c141259cde7f22bda421ca" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:44.675446 12110 raft_consensus.cc:3055] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:44.675778 12110 raft_consensus.cc:740] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:44.676579 12110 consensus_queue.cc:260] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:44.677742 12110 raft_consensus.cc:3060] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:44.681589 12308 raft_consensus.cc:2468] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 4.
I20260709 13:04:44.683043 11999 leader_election.cc:304] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:44.683990 12390 raft_consensus.cc:2804] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:44.684413 12390 raft_consensus.cc:697] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 4 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:44.685286 12110 raft_consensus.cc:2468] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 4.
I20260709 13:04:44.685137 12390 consensus_queue.cc:237] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:44.691313 11859 catalog_manager.cc:5697] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 3 to 4, leader changed from 1631155115174ae48423c73ac623c181 (127.0.107.195) to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 4 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:44.905627 12390 raft_consensus.cc:993] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd: : Instructing follower 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:44.906108 12333 raft_consensus.cc:1081] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Signalling peer 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:44.907498 12110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089"
dest_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:50904
I20260709 13:04:44.907966 12110 raft_consensus.cc:493] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:44.908257 12110 raft_consensus.cc:3060] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.912724 12110 raft_consensus.cc:515] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:44.914300 12110 leader_election.cc:290] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:44.915289 12309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:44.915372 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:44.915983 12309 raft_consensus.cc:3060] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.916056 12036 raft_consensus.cc:3055] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:44.916517 12036 raft_consensus.cc:740] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:44.917241 12036 consensus_queue.cc:260] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:44.918246 12036 raft_consensus.cc:3060] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:44.921955 12309 raft_consensus.cc:2468] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 2.
I20260709 13:04:44.922863 12036 raft_consensus.cc:2468] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 2.
I20260709 13:04:44.923584 12073 leader_election.cc:304] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:44.924660 12230 raft_consensus.cc:2804] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:44.925272 12230 raft_consensus.cc:697] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:44.926263 12230 consensus_queue.cc:237] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:44.935424 11859 catalog_manager.cc:5697] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 1 to 2, leader changed from 998f562f369843189bd6c362e61297fd (127.0.107.194) to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:45.028231 12390 raft_consensus.cc:993] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd: : Instructing follower 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:45.028779 12333 raft_consensus.cc:1081] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Signalling peer 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:45.030462 12110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2"
dest_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:50904
I20260709 13:04:45.031064 12110 raft_consensus.cc:493] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:45.031455 12110 raft_consensus.cc:3060] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:45.038309 12110 raft_consensus.cc:515] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:45.040098 12110 leader_election.cc:290] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 4 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:45.040930 12309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:45.041178 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6be5503eb855455496fb5ba80872b7a2" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:45.041531 12309 raft_consensus.cc:3060] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:45.041776 12036 raft_consensus.cc:3055] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:45.042155 12036 raft_consensus.cc:740] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:45.042886 12036 consensus_queue.cc:260] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:45.043781 12036 raft_consensus.cc:3060] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:45.047215 12309 raft_consensus.cc:2468] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 4.
I20260709 13:04:45.048264 12073 leader_election.cc:304] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:45.049001 12230 raft_consensus.cc:2804] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:45.049041 12036 raft_consensus.cc:2468] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 4.
I20260709 13:04:45.049515 12230 raft_consensus.cc:697] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 4 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:45.050376 12230 consensus_queue.cc:237] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:45.057657 11859 catalog_manager.cc:5697] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 3 to 4, leader changed from 998f562f369843189bd6c362e61297fd (127.0.107.194) to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:45.075843 12110 raft_consensus.cc:1275] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:45.077109 12333 consensus_queue.cc:1048] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:45.085144 12309 raft_consensus.cc:1275] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:45.086783 12333 consensus_queue.cc:1048] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:45.351009 12309 raft_consensus.cc:1275] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:45.352291 12230 consensus_queue.cc:1048] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:45.360616 12036 raft_consensus.cc:1275] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:45.361953 12408 consensus_queue.cc:1048] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:45.453279 11907 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:45.481278 12309 raft_consensus.cc:1275] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:45.482554 12408 consensus_queue.cc:1048] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:45.490924 12036 raft_consensus.cc:1275] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:45.492569 12411 consensus_queue.cc:1048] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:45.550415   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:45.557961 12110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089"
dest_uuid: "1631155115174ae48423c73ac623c181"
mode: GRACEFUL
new_leader_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:38204
I20260709 13:04:45.558504 12110 raft_consensus.cc:606] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Received request to transfer leadership to TS 998f562f369843189bd6c362e61297fd
I20260709 13:04:45.561017 12036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078"
dest_uuid: "998f562f369843189bd6c362e61297fd"
mode: GRACEFUL
new_leader_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:54448
I20260709 13:04:45.561506 12036 raft_consensus.cc:606] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Received request to transfer leadership to TS 1631155115174ae48423c73ac623c181
I20260709 13:04:45.564050 12110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223"
dest_uuid: "1631155115174ae48423c73ac623c181"
mode: GRACEFUL
new_leader_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:38204
I20260709 13:04:45.564493 12110 raft_consensus.cc:606] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Received request to transfer leadership to TS 998f562f369843189bd6c362e61297fd
I20260709 13:04:45.565582   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:45.566186   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:45.566748   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:45.904534 12411 raft_consensus.cc:993] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181: : Instructing follower 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:45.904989 12408 raft_consensus.cc:1081] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Signalling peer 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:45.906481 12036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089"
dest_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:45.906963 12036 raft_consensus.cc:493] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:45.907244 12036 raft_consensus.cc:3060] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.912094 12036 raft_consensus.cc:515] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:45.913638 12036 leader_election.cc:290] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:45.914420 12309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:45.914697 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17dcec89e5e24b8e97c0eb7f4115c089" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:45.915053 12309 raft_consensus.cc:3060] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.915228 12110 raft_consensus.cc:3055] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:45.915582 12110 raft_consensus.cc:740] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:45.916339 12110 consensus_queue.cc:260] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:45.917485 12110 raft_consensus.cc:3060] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.921705 12309 raft_consensus.cc:2468] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 3.
I20260709 13:04:45.922931 11999 leader_election.cc:304] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:45.923699 12333 raft_consensus.cc:2804] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:45.923986 12110 raft_consensus.cc:2468] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 3.
I20260709 13:04:45.924192 12333 raft_consensus.cc:697] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:45.925216 12333 consensus_queue.cc:237] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:45.932662 11858 catalog_manager.cc:5697] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 2 to 3, leader changed from 1631155115174ae48423c73ac623c181 (127.0.107.195) to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 3 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.018350 12388 raft_consensus.cc:993] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd: : Instructing follower 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:46.018854 12333 raft_consensus.cc:1081] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Signalling peer 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:46.020354 12110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078"
dest_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:50904
I20260709 13:04:46.020848 12110 raft_consensus.cc:493] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.021130 12110 raft_consensus.cc:3060] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:46.026389 12110 raft_consensus.cc:515] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:46.028147 12110 leader_election.cc:290] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 4 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:46.029068 12309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:46.029171 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78fc401c3eec4c4abee78918b01c0078" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:46.029680 12309 raft_consensus.cc:3060] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:46.029811 12036 raft_consensus.cc:3055] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:46.030272 12036 raft_consensus.cc:740] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:46.030975 12036 consensus_queue.cc:260] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:46.031967 12036 raft_consensus.cc:3060] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:46.034462 12309 raft_consensus.cc:2468] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 4.
I20260709 13:04:46.035631 12073 leader_election.cc:304] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:46.036432 12408 raft_consensus.cc:2804] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:46.036870 12408 raft_consensus.cc:697] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 4 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:46.037081 12036 raft_consensus.cc:2468] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 4.
I20260709 13:04:46.037689 12408 consensus_queue.cc:237] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:46.044425 11858 catalog_manager.cc:5697] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 3 to 4, leader changed from 998f562f369843189bd6c362e61297fd (127.0.107.194) to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.048749 12411 raft_consensus.cc:993] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181: : Instructing follower 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:46.049276 12408 raft_consensus.cc:1081] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Signalling peer 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:46.050782 12036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223"
dest_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:46.051232 12036 raft_consensus.cc:493] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.051512 12036 raft_consensus.cc:3060] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.056545 12036 raft_consensus.cc:515] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:46.058014 12036 leader_election.cc:290] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:46.059010 12309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:46.059149 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:46.059562 12309 raft_consensus.cc:3060] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.059749 12110 raft_consensus.cc:3055] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:46.060083 12110 raft_consensus.cc:740] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:46.060702 12110 consensus_queue.cc:260] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:46.061589 12110 raft_consensus.cc:3060] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.064826 12309 raft_consensus.cc:2468] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 3.
I20260709 13:04:46.065938 11999 leader_election.cc:304] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:46.066370 12110 raft_consensus.cc:2468] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 3.
I20260709 13:04:46.066937 12333 raft_consensus.cc:2804] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:46.067478 12333 raft_consensus.cc:697] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:46.068204 12333 consensus_queue.cc:237] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:46.075318 11858 catalog_manager.cc:5697] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 2 to 3, leader changed from 1631155115174ae48423c73ac623c181 (127.0.107.195) to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 3 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.388660 12110 raft_consensus.cc:1275] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:46.389928 12333 consensus_queue.cc:1048] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:46.400830 12309 raft_consensus.cc:1275] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:46.403272 12420 consensus_queue.cc:1048] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.451107 12309 raft_consensus.cc:1275] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:46.452304 12408 consensus_queue.cc:1048] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:46.454288 11907 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:46.462647 12036 raft_consensus.cc:1275] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:46.467792 12408 consensus_queue.cc:1048] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.503202 12110 raft_consensus.cc:1275] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:46.504391 12420 consensus_queue.cc:1048] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.512066 12309 raft_consensus.cc:1275] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:46.513705 12333 consensus_queue.cc:1048] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.573140   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:46.580195 12036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223"
dest_uuid: "998f562f369843189bd6c362e61297fd"
mode: GRACEFUL
new_leader_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:54448
I20260709 13:04:46.580720 12036 raft_consensus.cc:606] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Received request to transfer leadership to TS 1631155115174ae48423c73ac623c181
I20260709 13:04:46.583314 12110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbbc06d75d1b48e59bacbb85bfecaa24"
dest_uuid: "1631155115174ae48423c73ac623c181"
mode: GRACEFUL
new_leader_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:38204
I20260709 13:04:46.583792 12110 raft_consensus.cc:606] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 1 LEADER]: Received request to transfer leadership to TS 998f562f369843189bd6c362e61297fd
I20260709 13:04:46.586330 12036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5"
dest_uuid: "998f562f369843189bd6c362e61297fd"
mode: GRACEFUL
new_leader_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:54448
I20260709 13:04:46.586771 12036 raft_consensus.cc:606] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Received request to transfer leadership to TS 1631155115174ae48423c73ac623c181
I20260709 13:04:46.587740   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:46.588181   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:46.588696   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:46.656555 12333 raft_consensus.cc:993] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd: : Instructing follower 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:46.657116 12388 raft_consensus.cc:1081] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Signalling peer 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:46.658490 12110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5"
dest_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:50904
I20260709 13:04:46.658944 12110 raft_consensus.cc:493] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.659215 12110 raft_consensus.cc:3060] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:46.663728 12110 raft_consensus.cc:515] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:46.665200 12110 leader_election.cc:290] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 4 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:46.666121 12309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:46.666147 12036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc50619ad0c84784949a25c646a37da5" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:46.666666 12309 raft_consensus.cc:3060] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:46.666791 12036 raft_consensus.cc:3055] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:46.667161 12036 raft_consensus.cc:740] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:46.667867 12036 consensus_queue.cc:260] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:46.668979 12036 raft_consensus.cc:3060] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:46.671343 12309 raft_consensus.cc:2468] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 4.
I20260709 13:04:46.672355 12073 leader_election.cc:304] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:46.673031 12408 raft_consensus.cc:2804] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:46.673455 12408 raft_consensus.cc:697] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 4 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:46.673655 12036 raft_consensus.cc:2468] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 4.
I20260709 13:04:46.674191 12408 consensus_queue.cc:237] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:46.682087 11858 catalog_manager.cc:5697] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 3 to 4, leader changed from 998f562f369843189bd6c362e61297fd (127.0.107.194) to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.087320 12427 raft_consensus.cc:993] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181: : Instructing follower 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:47.087826 12427 raft_consensus.cc:1081] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 1 LEADER]: Signalling peer 998f562f369843189bd6c362e61297fd to start an election
I20260709 13:04:47.089340 12034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbbc06d75d1b48e59bacbb85bfecaa24"
dest_uuid: "998f562f369843189bd6c362e61297fd"
 from {username='slave'} at 127.0.0.1:59332
I20260709 13:04:47.089947 12034 raft_consensus.cc:493] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.090387 12034 raft_consensus.cc:3060] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.098340 12034 raft_consensus.cc:515] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:47.100239 12034 leader_election.cc:290] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 1631155115174ae48423c73ac623c181 (127.0.107.195:46697)
I20260709 13:04:47.101292 12308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbc06d75d1b48e59bacbb85bfecaa24" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:47.101419 12110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbc06d75d1b48e59bacbb85bfecaa24" candidate_uuid: "998f562f369843189bd6c362e61297fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1631155115174ae48423c73ac623c181"
I20260709 13:04:47.102062 12308 raft_consensus.cc:3060] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.102139 12110 raft_consensus.cc:3055] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.102643 12110 raft_consensus.cc:740] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:47.103521 12110 consensus_queue.cc:260] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:47.104818 12110 raft_consensus.cc:3060] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.108000 12308 raft_consensus.cc:2468] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 2.
I20260709 13:04:47.109297 11999 leader_election.cc:304] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d90a5439aef4c36a3b161fee511acbf, 998f562f369843189bd6c362e61297fd; no voters: 
I20260709 13:04:47.110049 12110 raft_consensus.cc:2468] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 998f562f369843189bd6c362e61297fd in term 2.
I20260709 13:04:47.110141 12388 raft_consensus.cc:2804] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:47.110790 12388 raft_consensus.cc:697] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Becoming Leader. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:47.111658 12388 consensus_queue.cc:237] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:47.114018 12333 raft_consensus.cc:993] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd: : Instructing follower 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:47.114620 12420 raft_consensus.cc:1081] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Signalling peer 1631155115174ae48423c73ac623c181 to start an election
I20260709 13:04:47.116284 12108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223"
dest_uuid: "1631155115174ae48423c73ac623c181"
 from {username='slave'} at 127.0.0.1:50904
I20260709 13:04:47.116999 12108 raft_consensus.cc:493] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.117368 12108 raft_consensus.cc:3060] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.124550 12108 raft_consensus.cc:515] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:47.126616 11858 catalog_manager.cc:5697] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd reported cstate change: term changed from 1 to 2, leader changed from 1631155115174ae48423c73ac623c181 (127.0.107.195) to 998f562f369843189bd6c362e61297fd (127.0.107.194). New cstate: current_term: 2 leader_uuid: "998f562f369843189bd6c362e61297fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.127177 12108 leader_election.cc:290] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 4 election: Requested vote from peers 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727), 998f562f369843189bd6c362e61297fd (127.0.107.194:45405)
I20260709 13:04:47.127449 12308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d90a5439aef4c36a3b161fee511acbf"
I20260709 13:04:47.128158 12308 raft_consensus.cc:3060] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.130640 12034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4a9d5896ae46ba99aeb28c0adc9223" candidate_uuid: "1631155115174ae48423c73ac623c181" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "998f562f369843189bd6c362e61297fd"
I20260709 13:04:47.131192 12034 raft_consensus.cc:3055] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:47.131459 12034 raft_consensus.cc:740] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 998f562f369843189bd6c362e61297fd, State: Running, Role: LEADER
I20260709 13:04:47.132361 12034 consensus_queue.cc:260] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:47.133473 12034 raft_consensus.cc:3060] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:47.135928 12308 raft_consensus.cc:2468] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 4.
I20260709 13:04:47.137077 12073 leader_election.cc:304] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1631155115174ae48423c73ac623c181, 4d90a5439aef4c36a3b161fee511acbf; no voters: 
I20260709 13:04:47.137744 12437 raft_consensus.cc:2804] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:47.138181 12437 raft_consensus.cc:697] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 4 LEADER]: Becoming Leader. State: Replica: 1631155115174ae48423c73ac623c181, State: Running, Role: LEADER
I20260709 13:04:47.138865 12437 consensus_queue.cc:237] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } }
I20260709 13:04:47.139683 12034 raft_consensus.cc:2468] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1631155115174ae48423c73ac623c181 in term 4.
I20260709 13:04:47.145301 11858 catalog_manager.cc:5697] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 reported cstate change: term changed from 3 to 4, leader changed from 998f562f369843189bd6c362e61297fd (127.0.107.194) to 1631155115174ae48423c73ac623c181 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "1631155115174ae48423c73ac623c181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.224393 12034 raft_consensus.cc:1275] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:47.225548 12437 consensus_queue.cc:1048] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:47.234838 12308 raft_consensus.cc:1275] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:47.236696 12408 consensus_queue.cc:1048] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:04:47.455338 11907 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:47.613847 12034 raft_consensus.cc:1275] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:47.615233 12437 consensus_queue.cc:1048] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "998f562f369843189bd6c362e61297fd" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:47.625430 12308 raft_consensus.cc:1275] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Refusing update from remote peer 1631155115174ae48423c73ac623c181: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:47.627342 12427 consensus_queue.cc:1048] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:47.707472 12108 raft_consensus.cc:1275] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:47.707791 12308 raft_consensus.cc:1275] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Refusing update from remote peer 998f562f369843189bd6c362e61297fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:47.708791 12447 consensus_queue.cc:1048] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1631155115174ae48423c73ac623c181" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 46697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:47.709483 12388 consensus_queue.cc:1048] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d90a5439aef4c36a3b161fee511acbf" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:47.723482   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:47.763672   431 tablet_server.cc:179] TabletServer@127.0.107.193:43727 shutting down...
I20260709 13:04:47.785928   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:47.786659   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:47.787273   431 raft_consensus.cc:2243] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.787775   431 raft_consensus.cc:2272] T bb4a9d5896ae46ba99aeb28c0adc9223 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.790401   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:47.791055   431 raft_consensus.cc:2243] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.791561   431 raft_consensus.cc:2272] T 17dcec89e5e24b8e97c0eb7f4115c089 P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.793546   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:47.794183   431 raft_consensus.cc:2243] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.794651   431 raft_consensus.cc:2272] T 78fc401c3eec4c4abee78918b01c0078 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.796535   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:47.797256   431 raft_consensus.cc:2243] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.797863   431 raft_consensus.cc:2272] T dbbc06d75d1b48e59bacbb85bfecaa24 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.800311   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:47.800912   431 raft_consensus.cc:2243] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.801365   431 raft_consensus.cc:2272] T 882f4a494f1d4f8d90eb0287df129998 P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.803352   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:47.803936   431 raft_consensus.cc:2243] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.804417   431 raft_consensus.cc:2272] T dc50619ad0c84784949a25c646a37da5 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.806752   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:47.807283   431 raft_consensus.cc:2243] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.807731   431 raft_consensus.cc:2272] T d96e7a6a26c141259cde7f22bda421ca P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.809442   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:47.810086   431 raft_consensus.cc:2243] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.810586   431 raft_consensus.cc:2272] T 6be5503eb855455496fb5ba80872b7a2 P 4d90a5439aef4c36a3b161fee511acbf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.812428   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:47.812916   431 raft_consensus.cc:2243] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.813323   431 raft_consensus.cc:2272] T 07baa7056dec43cd8d5d53ca7ba95adf P 4d90a5439aef4c36a3b161fee511acbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.815132   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:47.815630   431 raft_consensus.cc:2243] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.816079   431 raft_consensus.cc:2272] T cc95ce27f2b64be7932d1466dff07bdd P 4d90a5439aef4c36a3b161fee511acbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.864830   431 tablet_server.cc:196] TabletServer@127.0.107.193:43727 shutdown complete.
W20260709 13:04:47.915591 11999 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111) [suppressed 82 similar messages]
I20260709 13:04:47.916828   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:04:47.921537 12073 consensus_peers.cc:597] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:47.922163 11999 consensus_peers.cc:597] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:47.922674 11999 consensus_peers.cc:597] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:47.926194 12073 consensus_peers.cc:597] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:47.955009   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:47.956053   431 tablet_replica.cc:333] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd: stopping tablet replica
I20260709 13:04:47.957062   431 raft_consensus.cc:2243] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.957777   431 raft_consensus.cc:2272] T 78fc401c3eec4c4abee78918b01c0078 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.960409   431 tablet_replica.cc:333] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd: stopping tablet replica
I20260709 13:04:47.961023   431 raft_consensus.cc:2243] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:47.962471   431 raft_consensus.cc:2272] T dbbc06d75d1b48e59bacbb85bfecaa24 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:47.964578 11890 debug-util.cc:398] Leaking SignalData structure 0x7b08003eda80 after lost signal to thread 434
W20260709 13:04:47.966334 11890 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff1c0 after lost signal to thread 11893
I20260709 13:04:47.966388   431 tablet_replica.cc:333] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd: stopping tablet replica
I20260709 13:04:47.967324   431 raft_consensus.cc:2243] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.968241   431 raft_consensus.cc:2272] T 882f4a494f1d4f8d90eb0287df129998 P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:47.968331 11890 debug-util.cc:398] Leaking SignalData structure 0x7b0800241980 after lost signal to thread 12060
W20260709 13:04:47.970152 11890 debug-util.cc:398] Leaking SignalData structure 0x7b0800235b40 after lost signal to thread 12134
I20260709 13:04:47.971762   431 tablet_replica.cc:333] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd: stopping tablet replica
I20260709 13:04:47.972558   431 raft_consensus.cc:2243] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.973307   431 raft_consensus.cc:2272] T bb4a9d5896ae46ba99aeb28c0adc9223 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.977501   431 tablet_replica.cc:333] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd: stopping tablet replica
I20260709 13:04:47.978366   431 raft_consensus.cc:2243] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:47.979569   431 raft_consensus.cc:2272] T 17dcec89e5e24b8e97c0eb7f4115c089 P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.982481   431 tablet_replica.cc:333] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd: stopping tablet replica
I20260709 13:04:47.983121   431 raft_consensus.cc:2243] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.983896   431 raft_consensus.cc:2272] T 07baa7056dec43cd8d5d53ca7ba95adf P 998f562f369843189bd6c362e61297fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.987478   431 tablet_replica.cc:333] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd: stopping tablet replica
I20260709 13:04:47.988297   431 raft_consensus.cc:2243] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:47.990087   431 raft_consensus.cc:2272] T cc95ce27f2b64be7932d1466dff07bdd P 998f562f369843189bd6c362e61297fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.993085   431 tablet_replica.cc:333] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd: stopping tablet replica
I20260709 13:04:47.993714   431 raft_consensus.cc:2243] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:47.995138   431 raft_consensus.cc:2272] T d96e7a6a26c141259cde7f22bda421ca P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:47.998133   431 tablet_replica.cc:333] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd: stopping tablet replica
I20260709 13:04:47.998768   431 raft_consensus.cc:2243] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:47.999444   431 raft_consensus.cc:2272] T dc50619ad0c84784949a25c646a37da5 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.003165   431 tablet_replica.cc:333] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd: stopping tablet replica
I20260709 13:04:48.003716   431 raft_consensus.cc:2243] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.004319   431 raft_consensus.cc:2272] T 6be5503eb855455496fb5ba80872b7a2 P 998f562f369843189bd6c362e61297fd [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:48.038560 12073 consensus_peers.cc:597] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:48.043730   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:04:48.061731 12074 consensus_peers.cc:597] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 -> Peer 998f562f369843189bd6c362e61297fd (127.0.107.194:45405): Couldn't send request to peer 998f562f369843189bd6c362e61297fd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:48.085937   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:48.106560 12073 consensus_peers.cc:597] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 -> Peer 4d90a5439aef4c36a3b161fee511acbf (127.0.107.193:43727): Couldn't send request to peer 4d90a5439aef4c36a3b161fee511acbf. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43727: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:48.136293   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:48.137228   431 tablet_replica.cc:333] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181: stopping tablet replica
I20260709 13:04:48.138963   431 raft_consensus.cc:2243] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.140590   431 raft_consensus.cc:2272] T 07baa7056dec43cd8d5d53ca7ba95adf P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.143604   431 tablet_replica.cc:333] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181: stopping tablet replica
I20260709 13:04:48.144292   431 raft_consensus.cc:2243] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.144909   431 raft_consensus.cc:2272] T cc95ce27f2b64be7932d1466dff07bdd P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.147405   431 tablet_replica.cc:333] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181: stopping tablet replica
I20260709 13:04:48.148001   431 raft_consensus.cc:2243] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.149349   431 raft_consensus.cc:2272] T 882f4a494f1d4f8d90eb0287df129998 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.152613   431 tablet_replica.cc:333] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181: stopping tablet replica
I20260709 13:04:48.153584   431 raft_consensus.cc:2243] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.154241   431 raft_consensus.cc:2272] T 17dcec89e5e24b8e97c0eb7f4115c089 P 1631155115174ae48423c73ac623c181 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.156944   431 tablet_replica.cc:333] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181: stopping tablet replica
I20260709 13:04:48.157582   431 raft_consensus.cc:2243] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.158746   431 raft_consensus.cc:2272] T bb4a9d5896ae46ba99aeb28c0adc9223 P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.162423   431 tablet_replica.cc:333] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181: stopping tablet replica
I20260709 13:04:48.163033   431 raft_consensus.cc:2243] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.164323   431 raft_consensus.cc:2272] T 78fc401c3eec4c4abee78918b01c0078 P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.166844   431 tablet_replica.cc:333] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181: stopping tablet replica
I20260709 13:04:48.167541   431 raft_consensus.cc:2243] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.168251   431 raft_consensus.cc:2272] T dbbc06d75d1b48e59bacbb85bfecaa24 P 1631155115174ae48423c73ac623c181 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.171873   431 tablet_replica.cc:333] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181: stopping tablet replica
I20260709 13:04:48.172458   431 raft_consensus.cc:2243] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:48.173090   431 raft_consensus.cc:2272] T d96e7a6a26c141259cde7f22bda421ca P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.175750   431 tablet_replica.cc:333] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181: stopping tablet replica
I20260709 13:04:48.176327   431 raft_consensus.cc:2243] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.177341   431 raft_consensus.cc:2272] T 6be5503eb855455496fb5ba80872b7a2 P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.179800   431 tablet_replica.cc:333] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181: stopping tablet replica
I20260709 13:04:48.180332   431 raft_consensus.cc:2243] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.181869   431 raft_consensus.cc:2272] T dc50619ad0c84784949a25c646a37da5 P 1631155115174ae48423c73ac623c181 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.220096   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:48.252769   431 master.cc:562] Master@127.0.107.254:40939 shutting down...
I20260709 13:04:48.287070   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:48.287860   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:48.288262   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4de49779f9d749faafe70b45dc34f344: stopping tablet replica
W20260709 13:04:49.306802   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11890)
W20260709 13:04:50.307327   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 11890)
I20260709 13:04:50.745460   431 master.cc:584] Master@127.0.107.254:40939 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (15502 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:04:50.796497   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34549
I20260709 13:04:50.797742   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:50.804327 12458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:50.804893 12459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:50.805243 12461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:50.805763   431 server_base.cc:1061] running on GCE node
I20260709 13:04:50.806846   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:50.807077   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:50.807269   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602290807247 us; error 0 us; skew 500 ppm
I20260709 13:04:50.807869   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:50.810551   431 webserver.cc:533] Webserver started at http://127.0.107.254:35293/ using document root <none> and password file <none>
I20260709 13:04:50.811066   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:50.811257   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:50.811547   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:50.812671   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/master-0-root/instance:
uuid: "56dcae785ea449c5ac1d9864fd7d6e4c"
format_stamp: "Formatted at 2026-07-09 13:04:50 on dist-test-slave-nr1f"
I20260709 13:04:50.817281   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:04:50.820879 12466 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:50.821888   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:04:50.822213   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/master-0-root
uuid: "56dcae785ea449c5ac1d9864fd7d6e4c"
format_stamp: "Formatted at 2026-07-09 13:04:50 on dist-test-slave-nr1f"
I20260709 13:04:50.822459   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:50.833379   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:50.834645   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:50.876020   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34549
I20260709 13:04:50.876214 12517 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34549 every 8 connection(s)
I20260709 13:04:50.880252 12518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:50.897394 12518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c: Bootstrap starting.
I20260709 13:04:50.902884 12518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:50.907326 12518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c: No bootstrap required, opened a new log
I20260709 13:04:50.909700 12518 raft_consensus.cc:359] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56dcae785ea449c5ac1d9864fd7d6e4c" member_type: VOTER }
I20260709 13:04:50.910233 12518 raft_consensus.cc:385] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:50.910440 12518 raft_consensus.cc:740] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56dcae785ea449c5ac1d9864fd7d6e4c, State: Initialized, Role: FOLLOWER
I20260709 13:04:50.910967 12518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56dcae785ea449c5ac1d9864fd7d6e4c" member_type: VOTER }
I20260709 13:04:50.911442 12518 raft_consensus.cc:399] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:50.911648 12518 raft_consensus.cc:493] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:50.911880 12518 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:50.917878 12518 raft_consensus.cc:515] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56dcae785ea449c5ac1d9864fd7d6e4c" member_type: VOTER }
I20260709 13:04:50.918547 12518 leader_election.cc:304] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56dcae785ea449c5ac1d9864fd7d6e4c; no voters: 
I20260709 13:04:50.919778 12518 leader_election.cc:290] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:50.920295 12521 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:50.921918 12521 raft_consensus.cc:697] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [term 1 LEADER]: Becoming Leader. State: Replica: 56dcae785ea449c5ac1d9864fd7d6e4c, State: Running, Role: LEADER
I20260709 13:04:50.922776 12521 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56dcae785ea449c5ac1d9864fd7d6e4c" member_type: VOTER }
I20260709 13:04:50.923031 12518 sys_catalog.cc:565] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:50.931125 12522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56dcae785ea449c5ac1d9864fd7d6e4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56dcae785ea449c5ac1d9864fd7d6e4c" member_type: VOTER } }
I20260709 13:04:50.931265 12523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56dcae785ea449c5ac1d9864fd7d6e4c. Latest consensus state: current_term: 1 leader_uuid: "56dcae785ea449c5ac1d9864fd7d6e4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56dcae785ea449c5ac1d9864fd7d6e4c" member_type: VOTER } }
I20260709 13:04:50.932106 12522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:50.932155 12523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:50.934530 12531 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:50.941064 12531 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:50.942345   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:50.951133 12531 catalog_manager.cc:1383] Generated new cluster ID: 51e8808997b946328bffd3e93d018a17
I20260709 13:04:50.951465 12531 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:50.973764 12531 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:50.975183 12531 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:50.987351 12531 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c: Generated new TSK 0
I20260709 13:04:50.987983 12531 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:51.008888   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.015316 12539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.016319 12540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.018126   431 server_base.cc:1061] running on GCE node
W20260709 13:04:51.018056 12542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.019418   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:51.019605   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:51.019734   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602291019723 us; error 0 us; skew 500 ppm
I20260709 13:04:51.020208   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:51.022434   431 webserver.cc:533] Webserver started at http://127.0.107.193:33689/ using document root <none> and password file <none>
I20260709 13:04:51.022872   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:51.023023   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:51.023226   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:51.024519   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-0-root/instance:
uuid: "19bd6b7efe61486f89ace98b71dd8508"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-nr1f"
I20260709 13:04:51.029280   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:04:51.033387 12547 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.034413   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:51.034780   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-0-root
uuid: "19bd6b7efe61486f89ace98b71dd8508"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-nr1f"
I20260709 13:04:51.035149   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:51.061286   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:51.062477   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:51.063902   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:51.066215   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:51.066432   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.066699   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:51.066882   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.107434   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39525
I20260709 13:04:51.107533 12609 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39525 every 8 connection(s)
I20260709 13:04:51.112608   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.120550 12614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.123092 12615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.127926 12610 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34549
I20260709 13:04:51.128456 12610 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:51.129060   431 server_base.cc:1061] running on GCE node
W20260709 13:04:51.129151 12617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.129535 12610 heartbeater.cc:507] Master 127.0.107.254:34549 requested a full tablet report, sending...
I20260709 13:04:51.130513   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:51.130801   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:51.131013   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602291130996 us; error 0 us; skew 500 ppm
I20260709 13:04:51.131699   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:51.132031 12483 ts_manager.cc:194] Registered new tserver with Master: 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193:39525)
I20260709 13:04:51.134245 12483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58140
I20260709 13:04:51.134256   431 webserver.cc:533] Webserver started at http://127.0.107.194:38941/ using document root <none> and password file <none>
I20260709 13:04:51.134967   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:51.135186   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:51.135527   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:51.137163   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-1-root/instance:
uuid: "74b91e5851074db88adc7b9c2a10c254"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-nr1f"
I20260709 13:04:51.141639   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:04:51.144984 12622 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.146100   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:51.146442   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-1-root
uuid: "74b91e5851074db88adc7b9c2a10c254"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-nr1f"
I20260709 13:04:51.146747   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:51.182523   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:51.183825   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:51.185443   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:51.187862   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:51.188105   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.188375   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:51.188572   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.231767   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33299
I20260709 13:04:51.231884 12684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33299 every 8 connection(s)
I20260709 13:04:51.237416   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:51.246501 12688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:51.248606 12689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.250694 12685 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34549
I20260709 13:04:51.251178 12685 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:51.252090   431 server_base.cc:1061] running on GCE node
W20260709 13:04:51.252126 12691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:51.252388 12685 heartbeater.cc:507] Master 127.0.107.254:34549 requested a full tablet report, sending...
I20260709 13:04:51.253651   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:51.253968   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:51.254242   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602291254196 us; error 0 us; skew 500 ppm
I20260709 13:04:51.254961   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:51.254999 12483 ts_manager.cc:194] Registered new tserver with Master: 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194:33299)
I20260709 13:04:51.256896 12483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58148
I20260709 13:04:51.257975   431 webserver.cc:533] Webserver started at http://127.0.107.195:35167/ using document root <none> and password file <none>
I20260709 13:04:51.258846   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:51.259119   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:51.259457   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:51.260834   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-2-root/instance:
uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-nr1f"
I20260709 13:04:51.265734   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:04:51.269308 12696 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.270129   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:51.270399   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-2-root
uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc"
format_stamp: "Formatted at 2026-07-09 13:04:51 on dist-test-slave-nr1f"
I20260709 13:04:51.270643   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601903731679-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:51.283694   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:51.284832   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:51.286228   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:51.288475   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:51.288687   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.288964   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:51.289127   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:51.330528   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:37499
I20260709 13:04:51.330619 12758 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:37499 every 8 connection(s)
I20260709 13:04:51.344698 12759 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34549
I20260709 13:04:51.345127 12759 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:51.345818 12759 heartbeater.cc:507] Master 127.0.107.254:34549 requested a full tablet report, sending...
I20260709 13:04:51.347756 12483 ts_manager.cc:194] Registered new tserver with Master: 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195:37499)
I20260709 13:04:51.348285   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014596007s
I20260709 13:04:51.349268 12483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58158
I20260709 13:04:51.373030 12483 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58168:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:51.375260 12483 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:51.426904 12574 tablet_service.cc:1511] Processing CreateTablet for tablet f8bc4f91364c4a059937ab099b2ed063 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a9f86a12f5094b2899e5f59a195b8fd0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:51.426904 12575 tablet_service.cc:1511] Processing CreateTablet for tablet 708e0130dbdd406c80683075781a65ab (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a9f86a12f5094b2899e5f59a195b8fd0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:51.428443 12574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bc4f91364c4a059937ab099b2ed063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.434515 12575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708e0130dbdd406c80683075781a65ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.433285 12724 tablet_service.cc:1511] Processing CreateTablet for tablet 708e0130dbdd406c80683075781a65ab (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a9f86a12f5094b2899e5f59a195b8fd0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:51.435812 12724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708e0130dbdd406c80683075781a65ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.436601 12650 tablet_service.cc:1511] Processing CreateTablet for tablet 708e0130dbdd406c80683075781a65ab (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a9f86a12f5094b2899e5f59a195b8fd0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:51.433414 12723 tablet_service.cc:1511] Processing CreateTablet for tablet f8bc4f91364c4a059937ab099b2ed063 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a9f86a12f5094b2899e5f59a195b8fd0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:51.438423 12650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708e0130dbdd406c80683075781a65ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.438875 12723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bc4f91364c4a059937ab099b2ed063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.443024 12649 tablet_service.cc:1511] Processing CreateTablet for tablet f8bc4f91364c4a059937ab099b2ed063 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a9f86a12f5094b2899e5f59a195b8fd0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:51.445036 12649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bc4f91364c4a059937ab099b2ed063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.459947 12774 tablet_bootstrap.cc:492] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508: Bootstrap starting.
I20260709 13:04:51.467399 12774 tablet_bootstrap.cc:654] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.480423 12775 tablet_bootstrap.cc:492] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254: Bootstrap starting.
I20260709 13:04:51.487808 12775 tablet_bootstrap.cc:654] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.490089 12774 tablet_bootstrap.cc:492] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508: No bootstrap required, opened a new log
I20260709 13:04:51.490727 12774 ts_tablet_manager.cc:1403] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.020s
I20260709 13:04:51.492268 12777 tablet_bootstrap.cc:492] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc: Bootstrap starting.
I20260709 13:04:51.494136 12774 raft_consensus.cc:359] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.494959 12774 raft_consensus.cc:385] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.495267 12774 raft_consensus.cc:740] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19bd6b7efe61486f89ace98b71dd8508, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.495958 12775 tablet_bootstrap.cc:492] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254: No bootstrap required, opened a new log
I20260709 13:04:51.496469 12775 ts_tablet_manager.cc:1403] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:04:51.496064 12774 consensus_queue.cc:260] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.498911 12610 heartbeater.cc:499] Master 127.0.107.254:34549 was elected leader, sending a full tablet report...
I20260709 13:04:51.499768 12777 tablet_bootstrap.cc:654] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.499493 12775 raft_consensus.cc:359] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.500351 12775 raft_consensus.cc:385] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.500680 12775 raft_consensus.cc:740] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74b91e5851074db88adc7b9c2a10c254, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.502394 12774 ts_tablet_manager.cc:1434] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.005s
I20260709 13:04:51.502192 12775 consensus_queue.cc:260] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.503818 12774 tablet_bootstrap.cc:492] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508: Bootstrap starting.
I20260709 13:04:51.507982 12685 heartbeater.cc:499] Master 127.0.107.254:34549 was elected leader, sending a full tablet report...
I20260709 13:04:51.511127 12775 ts_tablet_manager.cc:1434] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:04:51.512310 12774 tablet_bootstrap.cc:654] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.512399 12775 tablet_bootstrap.cc:492] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254: Bootstrap starting.
I20260709 13:04:51.519430 12774 tablet_bootstrap.cc:492] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508: No bootstrap required, opened a new log
I20260709 13:04:51.520151 12774 ts_tablet_manager.cc:1403] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:04:51.519205 12777 tablet_bootstrap.cc:492] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc: No bootstrap required, opened a new log
I20260709 13:04:51.521126 12777 ts_tablet_manager.cc:1403] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.006s
I20260709 13:04:51.521488 12775 tablet_bootstrap.cc:654] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.524426 12777 raft_consensus.cc:359] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.525354 12777 raft_consensus.cc:385] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.525693 12777 raft_consensus.cc:740] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e111f92a8e04cfcbcc5d5a4b63686bc, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.526235 12774 raft_consensus.cc:359] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.526532 12777 consensus_queue.cc:260] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.527201 12774 raft_consensus.cc:385] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.527601 12774 raft_consensus.cc:740] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19bd6b7efe61486f89ace98b71dd8508, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.528277 12775 tablet_bootstrap.cc:492] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254: No bootstrap required, opened a new log
I20260709 13:04:51.528892 12775 ts_tablet_manager.cc:1403] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:04:51.528466 12774 consensus_queue.cc:260] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.529399 12759 heartbeater.cc:499] Master 127.0.107.254:34549 was elected leader, sending a full tablet report...
I20260709 13:04:51.529937 12777 ts_tablet_manager.cc:1434] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:51.531960 12777 tablet_bootstrap.cc:492] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Bootstrap starting.
I20260709 13:04:51.532330 12775 raft_consensus.cc:359] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.533213 12775 raft_consensus.cc:385] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.533452 12774 ts_tablet_manager.cc:1434] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:04:51.533664 12775 raft_consensus.cc:740] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74b91e5851074db88adc7b9c2a10c254, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.534621 12775 consensus_queue.cc:260] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.536476 12775 ts_tablet_manager.cc:1434] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:04:51.541204 12777 tablet_bootstrap.cc:654] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.552448 12777 tablet_bootstrap.cc:492] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc: No bootstrap required, opened a new log
I20260709 13:04:51.552913 12777 ts_tablet_manager.cc:1403] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.011s
I20260709 13:04:51.555172 12777 raft_consensus.cc:359] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.555795 12777 raft_consensus.cc:385] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.556032 12777 raft_consensus.cc:740] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e111f92a8e04cfcbcc5d5a4b63686bc, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.556672 12777 consensus_queue.cc:260] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.558445 12777 ts_tablet_manager.cc:1434] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:04:51.621762 12781 raft_consensus.cc:493] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.622452 12781 raft_consensus.cc:515] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.625233 12781 leader_election.cc:290] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193:39525), 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195:37499)
I20260709 13:04:51.634804 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708e0130dbdd406c80683075781a65ab" candidate_uuid: "74b91e5851074db88adc7b9c2a10c254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19bd6b7efe61486f89ace98b71dd8508" is_pre_election: true
I20260709 13:04:51.635689 12585 raft_consensus.cc:2468] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74b91e5851074db88adc7b9c2a10c254 in term 0.
I20260709 13:04:51.636878 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708e0130dbdd406c80683075781a65ab" candidate_uuid: "74b91e5851074db88adc7b9c2a10c254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" is_pre_election: true
I20260709 13:04:51.636933 12626 leader_election.cc:304] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19bd6b7efe61486f89ace98b71dd8508, 74b91e5851074db88adc7b9c2a10c254; no voters: 
I20260709 13:04:51.637550 12734 raft_consensus.cc:2468] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74b91e5851074db88adc7b9c2a10c254 in term 0.
I20260709 13:04:51.638162 12781 raft_consensus.cc:2804] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:51.638688 12781 raft_consensus.cc:493] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.638963 12781 raft_consensus.cc:3060] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.644407 12781 raft_consensus.cc:515] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.646166 12781 leader_election.cc:290] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [CANDIDATE]: Term 1 election: Requested vote from peers 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193:39525), 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195:37499)
I20260709 13:04:51.647020 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708e0130dbdd406c80683075781a65ab" candidate_uuid: "74b91e5851074db88adc7b9c2a10c254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19bd6b7efe61486f89ace98b71dd8508"
I20260709 13:04:51.647269 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708e0130dbdd406c80683075781a65ab" candidate_uuid: "74b91e5851074db88adc7b9c2a10c254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc"
I20260709 13:04:51.647778 12585 raft_consensus.cc:3060] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.647809 12734 raft_consensus.cc:3060] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.655884 12734 raft_consensus.cc:2468] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b91e5851074db88adc7b9c2a10c254 in term 1.
I20260709 13:04:51.655884 12585 raft_consensus.cc:2468] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b91e5851074db88adc7b9c2a10c254 in term 1.
I20260709 13:04:51.657354 12624 leader_election.cc:304] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74b91e5851074db88adc7b9c2a10c254, 8e111f92a8e04cfcbcc5d5a4b63686bc; no voters: 
I20260709 13:04:51.658161 12781 raft_consensus.cc:2804] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:51.659081 12781 raft_consensus.cc:697] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 1 LEADER]: Becoming Leader. State: Replica: 74b91e5851074db88adc7b9c2a10c254, State: Running, Role: LEADER
I20260709 13:04:51.659897 12781 consensus_queue.cc:237] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.667327 12483 catalog_manager.cc:5697] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "74b91e5851074db88adc7b9c2a10c254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:51.746590 12784 raft_consensus.cc:493] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.747195 12784 raft_consensus.cc:515] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.749434 12784 leader_election.cc:290] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193:39525), 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194:33299)
I20260709 13:04:51.759233 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bc4f91364c4a059937ab099b2ed063" candidate_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19bd6b7efe61486f89ace98b71dd8508" is_pre_election: true
I20260709 13:04:51.759903 12585 raft_consensus.cc:2468] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e111f92a8e04cfcbcc5d5a4b63686bc in term 0.
I20260709 13:04:51.760938 12700 leader_election.cc:304] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19bd6b7efe61486f89ace98b71dd8508, 8e111f92a8e04cfcbcc5d5a4b63686bc; no voters: 
I20260709 13:04:51.761097 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bc4f91364c4a059937ab099b2ed063" candidate_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74b91e5851074db88adc7b9c2a10c254" is_pre_election: true
I20260709 13:04:51.761693 12784 raft_consensus.cc:2804] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:51.761857 12660 raft_consensus.cc:2468] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e111f92a8e04cfcbcc5d5a4b63686bc in term 0.
I20260709 13:04:51.762145 12784 raft_consensus.cc:493] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.762533 12784 raft_consensus.cc:3060] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.768229 12784 raft_consensus.cc:515] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.770076 12784 leader_election.cc:290] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [CANDIDATE]: Term 1 election: Requested vote from peers 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193:39525), 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194:33299)
I20260709 13:04:51.770921 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bc4f91364c4a059937ab099b2ed063" candidate_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19bd6b7efe61486f89ace98b71dd8508"
I20260709 13:04:51.771107 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bc4f91364c4a059937ab099b2ed063" candidate_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74b91e5851074db88adc7b9c2a10c254"
I20260709 13:04:51.771605 12585 raft_consensus.cc:3060] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.771694 12660 raft_consensus.cc:3060] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.777371 12585 raft_consensus.cc:2468] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e111f92a8e04cfcbcc5d5a4b63686bc in term 1.
I20260709 13:04:51.777719 12660 raft_consensus.cc:2468] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e111f92a8e04cfcbcc5d5a4b63686bc in term 1.
I20260709 13:04:51.778704 12700 leader_election.cc:304] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19bd6b7efe61486f89ace98b71dd8508, 8e111f92a8e04cfcbcc5d5a4b63686bc; no voters: 
I20260709 13:04:51.779467 12784 raft_consensus.cc:2804] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:51.780433 12784 raft_consensus.cc:697] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 LEADER]: Becoming Leader. State: Replica: 8e111f92a8e04cfcbcc5d5a4b63686bc, State: Running, Role: LEADER
I20260709 13:04:51.781139 12784 consensus_queue.cc:237] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.788448 12483 catalog_manager.cc:5697] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:51.819995 12482 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58174:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:51.822185 12482 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:51.847018 12574 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9915f8193f49e4a6a69665dd702539 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=05ff980706a8485d956d0e67f7036c07]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:51.848253 12574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9915f8193f49e4a6a69665dd702539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.849392 12650 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9915f8193f49e4a6a69665dd702539 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=05ff980706a8485d956d0e67f7036c07]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:51.849897 12724 tablet_service.cc:1511] Processing CreateTablet for tablet 2f9915f8193f49e4a6a69665dd702539 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=05ff980706a8485d956d0e67f7036c07]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:51.850773 12650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9915f8193f49e4a6a69665dd702539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.851171 12724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f9915f8193f49e4a6a69665dd702539. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.854538 12575 tablet_service.cc:1511] Processing CreateTablet for tablet e03c9fbe669f4bf2ae5c905c3d90b456 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=05ff980706a8485d956d0e67f7036c07]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:51.855901 12575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03c9fbe669f4bf2ae5c905c3d90b456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.856436 12723 tablet_service.cc:1511] Processing CreateTablet for tablet e03c9fbe669f4bf2ae5c905c3d90b456 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=05ff980706a8485d956d0e67f7036c07]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:51.857786 12723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03c9fbe669f4bf2ae5c905c3d90b456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.860162 12649 tablet_service.cc:1511] Processing CreateTablet for tablet e03c9fbe669f4bf2ae5c905c3d90b456 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=05ff980706a8485d956d0e67f7036c07]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:51.861554 12649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03c9fbe669f4bf2ae5c905c3d90b456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:51.866814 12774 tablet_bootstrap.cc:492] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508: Bootstrap starting.
I20260709 13:04:51.873584 12774 tablet_bootstrap.cc:654] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.877581 12777 tablet_bootstrap.cc:492] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Bootstrap starting.
I20260709 13:04:51.880600 12775 tablet_bootstrap.cc:492] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254: Bootstrap starting.
I20260709 13:04:51.886760 12777 tablet_bootstrap.cc:654] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.888868 12775 tablet_bootstrap.cc:654] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.891564 12774 tablet_bootstrap.cc:492] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508: No bootstrap required, opened a new log
I20260709 13:04:51.892156 12774 ts_tablet_manager.cc:1403] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.013s
I20260709 13:04:51.895625 12774 raft_consensus.cc:359] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.896353 12774 raft_consensus.cc:385] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.896631 12774 raft_consensus.cc:740] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19bd6b7efe61486f89ace98b71dd8508, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.897377 12774 consensus_queue.cc:260] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.901988 12774 ts_tablet_manager.cc:1434] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:04:51.903044 12775 tablet_bootstrap.cc:492] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254: No bootstrap required, opened a new log
I20260709 13:04:51.903692 12775 ts_tablet_manager.cc:1403] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 13:04:51.903041 12774 tablet_bootstrap.cc:492] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508: Bootstrap starting.
I20260709 13:04:51.908159 12777 tablet_bootstrap.cc:492] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc: No bootstrap required, opened a new log
I20260709 13:04:51.908749 12777 ts_tablet_manager.cc:1403] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.007s
I20260709 13:04:51.910761 12774 tablet_bootstrap.cc:654] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.910326 12775 raft_consensus.cc:359] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.911233 12775 raft_consensus.cc:385] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.911623 12775 raft_consensus.cc:740] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74b91e5851074db88adc7b9c2a10c254, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.911783 12777 raft_consensus.cc:359] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.912541 12777 raft_consensus.cc:385] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.912901 12777 raft_consensus.cc:740] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e111f92a8e04cfcbcc5d5a4b63686bc, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.912688 12775 consensus_queue.cc:260] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.913648 12777 consensus_queue.cc:260] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.915587 12775 ts_tablet_manager.cc:1434] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:04:51.915879 12777 ts_tablet_manager.cc:1434] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:51.920938 12775 tablet_bootstrap.cc:492] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254: Bootstrap starting.
I20260709 13:04:51.921294 12777 tablet_bootstrap.cc:492] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Bootstrap starting.
I20260709 13:04:51.922807 12774 tablet_bootstrap.cc:492] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508: No bootstrap required, opened a new log
I20260709 13:04:51.922940 12784 raft_consensus.cc:493] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.923504 12774 ts_tablet_manager.cc:1403] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:04:51.923475 12784 raft_consensus.cc:515] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.927241 12774 raft_consensus.cc:359] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.928098 12774 raft_consensus.cc:385] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.928318 12777 tablet_bootstrap.cc:654] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:51.928520 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03c9fbe669f4bf2ae5c905c3d90b456" candidate_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19bd6b7efe61486f89ace98b71dd8508" is_pre_election: true
I20260709 13:04:51.928862 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03c9fbe669f4bf2ae5c905c3d90b456" candidate_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74b91e5851074db88adc7b9c2a10c254" is_pre_election: true
I20260709 13:04:51.929486 12660 raft_consensus.cc:2468] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e111f92a8e04cfcbcc5d5a4b63686bc in term 0.
I20260709 13:04:51.928474 12774 raft_consensus.cc:740] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19bd6b7efe61486f89ace98b71dd8508, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.930714 12774 consensus_queue.cc:260] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.931216 12700 leader_election.cc:304] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74b91e5851074db88adc7b9c2a10c254, 8e111f92a8e04cfcbcc5d5a4b63686bc; no voters: 
I20260709 13:04:51.932240 12790 raft_consensus.cc:2804] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:51.925905 12784 leader_election.cc:290] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193:39525), 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194:33299)
I20260709 13:04:51.932629 12790 raft_consensus.cc:493] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.933018 12790 raft_consensus.cc:3060] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.928314 12775 tablet_bootstrap.cc:654] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:51.934533 12530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:51.934713 12585 raft_consensus.cc:2468] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e111f92a8e04cfcbcc5d5a4b63686bc in term 0.
I20260709 13:04:51.938510 12774 ts_tablet_manager.cc:1434] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:04:51.946569 12775 tablet_bootstrap.cc:492] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254: No bootstrap required, opened a new log
I20260709 13:04:51.947430 12775 ts_tablet_manager.cc:1403] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.007s
I20260709 13:04:51.947629 12790 raft_consensus.cc:515] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.951274 12790 leader_election.cc:290] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [CANDIDATE]: Term 1 election: Requested vote from peers 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193:39525), 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194:33299)
I20260709 13:04:51.951577 12775 raft_consensus.cc:359] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.952595 12775 raft_consensus.cc:385] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.952940 12775 raft_consensus.cc:740] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74b91e5851074db88adc7b9c2a10c254, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.953685 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03c9fbe669f4bf2ae5c905c3d90b456" candidate_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74b91e5851074db88adc7b9c2a10c254"
I20260709 13:04:51.953884 12775 consensus_queue.cc:260] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.954427 12660 raft_consensus.cc:3060] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.959280 12777 tablet_bootstrap.cc:492] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc: No bootstrap required, opened a new log
I20260709 13:04:51.959609 12775 ts_tablet_manager.cc:1434] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 13:04:51.959867 12777 ts_tablet_manager.cc:1403] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.011s
I20260709 13:04:51.953685 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03c9fbe669f4bf2ae5c905c3d90b456" candidate_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19bd6b7efe61486f89ace98b71dd8508"
I20260709 13:04:51.962316 12585 raft_consensus.cc:3060] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:51.963934 12777 raft_consensus.cc:359] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.964757 12777 raft_consensus.cc:385] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:51.965061 12777 raft_consensus.cc:740] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e111f92a8e04cfcbcc5d5a4b63686bc, State: Initialized, Role: FOLLOWER
I20260709 13:04:51.965838 12777 consensus_queue.cc:260] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.966682 12660 raft_consensus.cc:2468] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e111f92a8e04cfcbcc5d5a4b63686bc in term 1.
I20260709 13:04:51.968184 12777 ts_tablet_manager.cc:1434] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:51.968472 12700 leader_election.cc:304] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74b91e5851074db88adc7b9c2a10c254, 8e111f92a8e04cfcbcc5d5a4b63686bc; no voters: 
I20260709 13:04:51.969329 12790 raft_consensus.cc:2804] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:51.969784 12790 raft_consensus.cc:697] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 LEADER]: Becoming Leader. State: Replica: 8e111f92a8e04cfcbcc5d5a4b63686bc, State: Running, Role: LEADER
I20260709 13:04:51.969838 12585 raft_consensus.cc:2468] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e111f92a8e04cfcbcc5d5a4b63686bc in term 1.
I20260709 13:04:51.970710 12790 consensus_queue.cc:237] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:51.979683 12483 catalog_manager.cc:5697] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.051479 12781 consensus_queue.cc:1048] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.063817 12781 consensus_queue.cc:1048] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.075929 12781 raft_consensus.cc:493] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.076418 12781 raft_consensus.cc:515] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.078588 12781 leader_election.cc:290] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193:39525), 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195:37499)
I20260709 13:04:52.079362 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9915f8193f49e4a6a69665dd702539" candidate_uuid: "74b91e5851074db88adc7b9c2a10c254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19bd6b7efe61486f89ace98b71dd8508" is_pre_election: true
I20260709 13:04:52.079695 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9915f8193f49e4a6a69665dd702539" candidate_uuid: "74b91e5851074db88adc7b9c2a10c254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" is_pre_election: true
I20260709 13:04:52.080034 12585 raft_consensus.cc:2468] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74b91e5851074db88adc7b9c2a10c254 in term 0.
I20260709 13:04:52.080438 12734 raft_consensus.cc:2468] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74b91e5851074db88adc7b9c2a10c254 in term 0.
I20260709 13:04:52.081030 12626 leader_election.cc:304] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19bd6b7efe61486f89ace98b71dd8508, 74b91e5851074db88adc7b9c2a10c254; no voters: 
I20260709 13:04:52.082002 12781 raft_consensus.cc:2804] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:52.082465 12781 raft_consensus.cc:493] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.082824 12781 raft_consensus.cc:3060] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.088783 12781 raft_consensus.cc:515] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.090628 12781 leader_election.cc:290] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [CANDIDATE]: Term 1 election: Requested vote from peers 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193:39525), 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195:37499)
I20260709 13:04:52.091439 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9915f8193f49e4a6a69665dd702539" candidate_uuid: "74b91e5851074db88adc7b9c2a10c254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19bd6b7efe61486f89ace98b71dd8508"
I20260709 13:04:52.091631 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9915f8193f49e4a6a69665dd702539" candidate_uuid: "74b91e5851074db88adc7b9c2a10c254" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc"
I20260709 13:04:52.092150 12585 raft_consensus.cc:3060] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.092243 12734 raft_consensus.cc:3060] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:52.097337 12734 raft_consensus.cc:2468] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b91e5851074db88adc7b9c2a10c254 in term 1.
I20260709 13:04:52.097612 12585 raft_consensus.cc:2468] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b91e5851074db88adc7b9c2a10c254 in term 1.
I20260709 13:04:52.098433 12624 leader_election.cc:304] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74b91e5851074db88adc7b9c2a10c254, 8e111f92a8e04cfcbcc5d5a4b63686bc; no voters: 
I20260709 13:04:52.099236 12781 raft_consensus.cc:2804] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:52.099722 12781 raft_consensus.cc:697] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 1 LEADER]: Becoming Leader. State: Replica: 74b91e5851074db88adc7b9c2a10c254, State: Running, Role: LEADER
I20260709 13:04:52.100536 12781 consensus_queue.cc:237] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.107452 12483 catalog_manager.cc:5697] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "74b91e5851074db88adc7b9c2a10c254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.161785 12660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "708e0130dbdd406c80683075781a65ab"
dest_uuid: "74b91e5851074db88adc7b9c2a10c254"
mode: GRACEFUL
new_leader_uuid: "19bd6b7efe61486f89ace98b71dd8508"
 from {username='slave'} at 127.0.0.1:33180
I20260709 13:04:52.162452 12660 raft_consensus.cc:606] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 1 LEADER]: Received request to transfer leadership to TS 19bd6b7efe61486f89ace98b71dd8508
I20260709 13:04:52.175554 12734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8bc4f91364c4a059937ab099b2ed063"
dest_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc"
mode: GRACEFUL
new_leader_uuid: "74b91e5851074db88adc7b9c2a10c254"
 from {username='slave'} at 127.0.0.1:47062
I20260709 13:04:52.176103 12734 raft_consensus.cc:606] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 LEADER]: Received request to transfer leadership to TS 74b91e5851074db88adc7b9c2a10c254
I20260709 13:04:52.182154 12660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f9915f8193f49e4a6a69665dd702539"
dest_uuid: "74b91e5851074db88adc7b9c2a10c254"
mode: GRACEFUL
new_leader_uuid: "19bd6b7efe61486f89ace98b71dd8508"
 from {username='slave'} at 127.0.0.1:33180
I20260709 13:04:52.182675 12660 raft_consensus.cc:606] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 1 LEADER]: Received request to transfer leadership to TS 19bd6b7efe61486f89ace98b71dd8508
I20260709 13:04:52.187777 12734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e03c9fbe669f4bf2ae5c905c3d90b456"
dest_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc"
mode: GRACEFUL
new_leader_uuid: "19bd6b7efe61486f89ace98b71dd8508"
 from {username='slave'} at 127.0.0.1:47062
I20260709 13:04:52.188287 12734 raft_consensus.cc:606] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 LEADER]: Received request to transfer leadership to TS 19bd6b7efe61486f89ace98b71dd8508
I20260709 13:04:52.199121 12790 consensus_queue.cc:1048] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.213299 12784 consensus_queue.cc:1048] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.221199 12784 raft_consensus.cc:993] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc: : Instructing follower 74b91e5851074db88adc7b9c2a10c254 to start an election
I20260709 13:04:52.221746 12790 raft_consensus.cc:1081] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 LEADER]: Signalling peer 74b91e5851074db88adc7b9c2a10c254 to start an election
I20260709 13:04:52.223506 12660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8bc4f91364c4a059937ab099b2ed063"
dest_uuid: "74b91e5851074db88adc7b9c2a10c254"
 from {username='slave'} at 127.0.0.1:33176
I20260709 13:04:52.224180 12660 raft_consensus.cc:493] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:52.224586 12660 raft_consensus.cc:3060] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.230959 12660 raft_consensus.cc:515] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.233799 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bc4f91364c4a059937ab099b2ed063" candidate_uuid: "74b91e5851074db88adc7b9c2a10c254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc"
I20260709 13:04:52.234404 12734 raft_consensus.cc:3055] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:52.234520 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bc4f91364c4a059937ab099b2ed063" candidate_uuid: "74b91e5851074db88adc7b9c2a10c254" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19bd6b7efe61486f89ace98b71dd8508"
I20260709 13:04:52.234818 12734 raft_consensus.cc:740] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e111f92a8e04cfcbcc5d5a4b63686bc, State: Running, Role: LEADER
I20260709 13:04:52.235432 12585 raft_consensus.cc:3060] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.235814 12734 consensus_queue.cc:260] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.237138 12734 raft_consensus.cc:3060] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.243643 12585 raft_consensus.cc:2468] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b91e5851074db88adc7b9c2a10c254 in term 2.
I20260709 13:04:52.244091 12734 raft_consensus.cc:2468] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74b91e5851074db88adc7b9c2a10c254 in term 2.
I20260709 13:04:52.244489 12660 leader_election.cc:290] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [CANDIDATE]: Term 2 election: Requested vote from peers 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193:39525), 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195:37499)
I20260709 13:04:52.244968 12626 leader_election.cc:304] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19bd6b7efe61486f89ace98b71dd8508, 74b91e5851074db88adc7b9c2a10c254; no voters: 
I20260709 13:04:52.245915 12781 raft_consensus.cc:2804] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:52.246428 12781 raft_consensus.cc:697] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 2 LEADER]: Becoming Leader. State: Replica: 74b91e5851074db88adc7b9c2a10c254, State: Running, Role: LEADER
I20260709 13:04:52.247267 12781 consensus_queue.cc:237] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.254014 12482 catalog_manager.cc:5697] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 reported cstate change: term changed from 1 to 2, leader changed from 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195) to 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "74b91e5851074db88adc7b9c2a10c254" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.444974 12790 consensus_queue.cc:1048] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.451673 12784 raft_consensus.cc:993] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc: : Instructing follower 19bd6b7efe61486f89ace98b71dd8508 to start an election
I20260709 13:04:52.452468 12790 raft_consensus.cc:1081] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 LEADER]: Signalling peer 19bd6b7efe61486f89ace98b71dd8508 to start an election
I20260709 13:04:52.454399 12584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e03c9fbe669f4bf2ae5c905c3d90b456"
dest_uuid: "19bd6b7efe61486f89ace98b71dd8508"
 from {username='slave'} at 127.0.0.1:37052
I20260709 13:04:52.455003 12584 raft_consensus.cc:493] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:52.455396 12584 raft_consensus.cc:3060] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.458571 12784 consensus_queue.cc:1048] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.463858 12584 raft_consensus.cc:515] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.473376 12584 leader_election.cc:290] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [CANDIDATE]: Term 2 election: Requested vote from peers 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194:33299), 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195:37499)
I20260709 13:04:52.485502 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03c9fbe669f4bf2ae5c905c3d90b456" candidate_uuid: "19bd6b7efe61486f89ace98b71dd8508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74b91e5851074db88adc7b9c2a10c254"
I20260709 13:04:52.486176 12660 raft_consensus.cc:3060] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.488059 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03c9fbe669f4bf2ae5c905c3d90b456" candidate_uuid: "19bd6b7efe61486f89ace98b71dd8508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc"
I20260709 13:04:52.488754 12734 raft_consensus.cc:3055] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:52.489097 12734 raft_consensus.cc:740] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e111f92a8e04cfcbcc5d5a4b63686bc, State: Running, Role: LEADER
I20260709 13:04:52.489933 12734 consensus_queue.cc:260] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.491287 12734 raft_consensus.cc:3060] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.493840 12660 raft_consensus.cc:2468] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19bd6b7efe61486f89ace98b71dd8508 in term 2.
I20260709 13:04:52.495056 12551 leader_election.cc:304] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19bd6b7efe61486f89ace98b71dd8508, 74b91e5851074db88adc7b9c2a10c254; no voters: 
I20260709 13:04:52.495934 12779 raft_consensus.cc:2804] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:52.497852 12734 raft_consensus.cc:2468] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19bd6b7efe61486f89ace98b71dd8508 in term 2.
I20260709 13:04:52.498541 12779 raft_consensus.cc:697] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 LEADER]: Becoming Leader. State: Replica: 19bd6b7efe61486f89ace98b71dd8508, State: Running, Role: LEADER
I20260709 13:04:52.499578 12779 consensus_queue.cc:237] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.506116 12482 catalog_manager.cc:5697] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 reported cstate change: term changed from 1 to 2, leader changed from 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195) to 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "19bd6b7efe61486f89ace98b71dd8508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.585556 12787 raft_consensus.cc:993] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254: : Instructing follower 19bd6b7efe61486f89ace98b71dd8508 to start an election
I20260709 13:04:52.586110 12806 raft_consensus.cc:1081] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 1 LEADER]: Signalling peer 19bd6b7efe61486f89ace98b71dd8508 to start an election
I20260709 13:04:52.587575 12584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "708e0130dbdd406c80683075781a65ab"
dest_uuid: "19bd6b7efe61486f89ace98b71dd8508"
 from {username='slave'} at 127.0.0.1:37050
I20260709 13:04:52.588021 12584 raft_consensus.cc:493] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:52.588270 12584 raft_consensus.cc:3060] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.593531 12584 raft_consensus.cc:515] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.595630 12584 leader_election.cc:290] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [CANDIDATE]: Term 2 election: Requested vote from peers 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194:33299), 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195:37499)
I20260709 13:04:52.595525 12806 consensus_queue.cc:1048] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:52.596280 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708e0130dbdd406c80683075781a65ab" candidate_uuid: "19bd6b7efe61486f89ace98b71dd8508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74b91e5851074db88adc7b9c2a10c254"
I20260709 13:04:52.596650 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708e0130dbdd406c80683075781a65ab" candidate_uuid: "19bd6b7efe61486f89ace98b71dd8508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc"
I20260709 13:04:52.596890 12660 raft_consensus.cc:3055] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:52.597255 12734 raft_consensus.cc:3060] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.597323 12660 raft_consensus.cc:740] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74b91e5851074db88adc7b9c2a10c254, State: Running, Role: LEADER
I20260709 13:04:52.598346 12660 consensus_queue.cc:260] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.600138 12660 raft_consensus.cc:3060] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.603588 12787 raft_consensus.cc:993] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254: : Instructing follower 19bd6b7efe61486f89ace98b71dd8508 to start an election
I20260709 13:04:52.604081 12787 raft_consensus.cc:1081] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 1 LEADER]: Signalling peer 19bd6b7efe61486f89ace98b71dd8508 to start an election
I20260709 13:04:52.607323 12585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f9915f8193f49e4a6a69665dd702539"
dest_uuid: "19bd6b7efe61486f89ace98b71dd8508"
 from {username='slave'} at 127.0.0.1:37050
I20260709 13:04:52.607662 12660 raft_consensus.cc:2468] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19bd6b7efe61486f89ace98b71dd8508 in term 2.
I20260709 13:04:52.608932 12551 leader_election.cc:304] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19bd6b7efe61486f89ace98b71dd8508, 74b91e5851074db88adc7b9c2a10c254; no voters: 
I20260709 13:04:52.609050 12585 raft_consensus.cc:493] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:52.609555 12585 raft_consensus.cc:3060] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.609938 12820 raft_consensus.cc:2804] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:52.610680 12820 raft_consensus.cc:697] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 2 LEADER]: Becoming Leader. State: Replica: 19bd6b7efe61486f89ace98b71dd8508, State: Running, Role: LEADER
I20260709 13:04:52.611219 12734 raft_consensus.cc:2468] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19bd6b7efe61486f89ace98b71dd8508 in term 2.
I20260709 13:04:52.611524 12820 consensus_queue.cc:237] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.613009 12806 consensus_queue.cc:1048] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:52.618989 12585 raft_consensus.cc:515] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.623889 12585 leader_election.cc:290] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [CANDIDATE]: Term 2 election: Requested vote from peers 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194:33299), 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195:37499)
I20260709 13:04:52.625016 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9915f8193f49e4a6a69665dd702539" candidate_uuid: "19bd6b7efe61486f89ace98b71dd8508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74b91e5851074db88adc7b9c2a10c254"
I20260709 13:04:52.625692 12660 raft_consensus.cc:3055] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:52.625993 12660 raft_consensus.cc:740] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74b91e5851074db88adc7b9c2a10c254, State: Running, Role: LEADER
I20260709 13:04:52.625842 12734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9915f8193f49e4a6a69665dd702539" candidate_uuid: "19bd6b7efe61486f89ace98b71dd8508" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc"
I20260709 13:04:52.626605 12734 raft_consensus.cc:3060] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.626870 12660 consensus_queue.cc:260] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.627938 12660 raft_consensus.cc:3060] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:52.631470 12481 catalog_manager.cc:5697] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 reported cstate change: term changed from 1 to 2, leader changed from 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194) to 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "19bd6b7efe61486f89ace98b71dd8508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.634249 12734 raft_consensus.cc:2468] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19bd6b7efe61486f89ace98b71dd8508 in term 2.
I20260709 13:04:52.634747 12660 raft_consensus.cc:2468] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19bd6b7efe61486f89ace98b71dd8508 in term 2.
I20260709 13:04:52.635881 12551 leader_election.cc:304] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19bd6b7efe61486f89ace98b71dd8508, 74b91e5851074db88adc7b9c2a10c254; no voters: 
I20260709 13:04:52.637493 12820 raft_consensus.cc:2804] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:52.638000 12820 raft_consensus.cc:697] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 LEADER]: Becoming Leader. State: Replica: 19bd6b7efe61486f89ace98b71dd8508, State: Running, Role: LEADER
I20260709 13:04:52.638746 12820 consensus_queue.cc:237] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:52.649299 12483 catalog_manager.cc:5697] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 reported cstate change: term changed from 1 to 2, leader changed from 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194) to 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "19bd6b7efe61486f89ace98b71dd8508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.796769 12734 raft_consensus.cc:1275] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Refusing update from remote peer 74b91e5851074db88adc7b9c2a10c254: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:52.798066 12806 consensus_queue.cc:1048] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:52.805397 12585 raft_consensus.cc:1275] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Refusing update from remote peer 74b91e5851074db88adc7b9c2a10c254: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:52.806974 12787 consensus_queue.cc:1048] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:52.931232   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:04:52.932763   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:04:52.933146   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:04:52.949151 12585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f9915f8193f49e4a6a69665dd702539"
dest_uuid: "19bd6b7efe61486f89ace98b71dd8508"
mode: GRACEFUL
new_leader_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc"
 from {username='slave'} at 127.0.0.1:37054
I20260709 13:04:52.949723 12585 raft_consensus.cc:606] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 LEADER]: Received request to transfer leadership to TS 8e111f92a8e04cfcbcc5d5a4b63686bc
I20260709 13:04:52.950841   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:04:53.050298 12734 raft_consensus.cc:1275] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Refusing update from remote peer 19bd6b7efe61486f89ace98b71dd8508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.051553 12820 consensus_queue.cc:1048] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.059134 12660 raft_consensus.cc:1275] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Refusing update from remote peer 19bd6b7efe61486f89ace98b71dd8508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.060778 12825 consensus_queue.cc:1048] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.134349 12734 raft_consensus.cc:1275] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Refusing update from remote peer 19bd6b7efe61486f89ace98b71dd8508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.135771 12825 consensus_queue.cc:1048] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.146016 12660 raft_consensus.cc:1275] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Refusing update from remote peer 19bd6b7efe61486f89ace98b71dd8508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.147590 12825 consensus_queue.cc:1048] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.218962 12660 raft_consensus.cc:1275] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Refusing update from remote peer 19bd6b7efe61486f89ace98b71dd8508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.220299 12825 consensus_queue.cc:1048] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.227689 12734 raft_consensus.cc:1275] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Refusing update from remote peer 19bd6b7efe61486f89ace98b71dd8508: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:53.229748 12820 consensus_queue.cc:1048] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:53.235303 12825 raft_consensus.cc:993] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508: : Instructing follower 8e111f92a8e04cfcbcc5d5a4b63686bc to start an election
I20260709 13:04:53.235823 12820 raft_consensus.cc:1081] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 LEADER]: Signalling peer 8e111f92a8e04cfcbcc5d5a4b63686bc to start an election
I20260709 13:04:53.237519 12734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f9915f8193f49e4a6a69665dd702539"
dest_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc"
 from {username='slave'} at 127.0.0.1:47072
I20260709 13:04:53.238099 12734 raft_consensus.cc:493] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.238406 12734 raft_consensus.cc:3060] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.243649 12734 raft_consensus.cc:515] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:53.245389 12734 leader_election.cc:290] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [CANDIDATE]: Term 3 election: Requested vote from peers 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193:39525), 74b91e5851074db88adc7b9c2a10c254 (127.0.107.194:33299)
I20260709 13:04:53.246192 12585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9915f8193f49e4a6a69665dd702539" candidate_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "19bd6b7efe61486f89ace98b71dd8508"
I20260709 13:04:53.246485 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f9915f8193f49e4a6a69665dd702539" candidate_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74b91e5851074db88adc7b9c2a10c254"
I20260709 13:04:53.246877 12585 raft_consensus.cc:3055] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:53.247095 12660 raft_consensus.cc:3060] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.247262 12585 raft_consensus.cc:740] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 19bd6b7efe61486f89ace98b71dd8508, State: Running, Role: LEADER
I20260709 13:04:53.247973 12585 consensus_queue.cc:260] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:53.249023 12585 raft_consensus.cc:3060] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.253542 12660 raft_consensus.cc:2468] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e111f92a8e04cfcbcc5d5a4b63686bc in term 3.
I20260709 13:04:53.254122 12585 raft_consensus.cc:2468] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e111f92a8e04cfcbcc5d5a4b63686bc in term 3.
I20260709 13:04:53.254746 12700 leader_election.cc:304] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74b91e5851074db88adc7b9c2a10c254, 8e111f92a8e04cfcbcc5d5a4b63686bc; no voters: 
I20260709 13:04:53.255517 12784 raft_consensus.cc:2804] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:53.256325 12784 raft_consensus.cc:697] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 3 LEADER]: Becoming Leader. State: Replica: 8e111f92a8e04cfcbcc5d5a4b63686bc, State: Running, Role: LEADER
I20260709 13:04:53.257126 12784 consensus_queue.cc:237] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } }
I20260709 13:04:53.262555 12482 catalog_manager.cc:5697] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc reported cstate change: term changed from 2 to 3, leader changed from 19bd6b7efe61486f89ace98b71dd8508 (127.0.107.193) to 8e111f92a8e04cfcbcc5d5a4b63686bc (127.0.107.195). New cstate: current_term: 3 leader_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19bd6b7efe61486f89ace98b71dd8508" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74b91e5851074db88adc7b9c2a10c254" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e111f92a8e04cfcbcc5d5a4b63686bc" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37499 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:53.298745   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:04:53.317520   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:53.318243   431 tablet_replica.cc:333] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508: stopping tablet replica
I20260709 13:04:53.318842   431 raft_consensus.cc:2243] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:53.319710   431 raft_consensus.cc:2272] T e03c9fbe669f4bf2ae5c905c3d90b456 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.322374   431 tablet_replica.cc:333] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508: stopping tablet replica
I20260709 13:04:53.322929   431 raft_consensus.cc:2243] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:53.323724   431 raft_consensus.cc:2272] T 708e0130dbdd406c80683075781a65ab P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.326228   431 tablet_replica.cc:333] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508: stopping tablet replica
I20260709 13:04:53.326704   431 raft_consensus.cc:2243] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:53.327060   431 raft_consensus.cc:2272] T 2f9915f8193f49e4a6a69665dd702539 P 19bd6b7efe61486f89ace98b71dd8508 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.329097   431 tablet_replica.cc:333] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508: stopping tablet replica
I20260709 13:04:53.329566   431 raft_consensus.cc:2243] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:53.329909   431 raft_consensus.cc:2272] T f8bc4f91364c4a059937ab099b2ed063 P 19bd6b7efe61486f89ace98b71dd8508 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.354105   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:04:53.365929   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:04:53.383064   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:53.383689   431 tablet_replica.cc:333] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254: stopping tablet replica
I20260709 13:04:53.384244   431 raft_consensus.cc:2243] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:53.384711   431 raft_consensus.cc:2272] T e03c9fbe669f4bf2ae5c905c3d90b456 P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.386940   431 tablet_replica.cc:333] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254: stopping tablet replica
I20260709 13:04:53.387485   431 raft_consensus.cc:2243] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:53.387929   431 raft_consensus.cc:2272] T 2f9915f8193f49e4a6a69665dd702539 P 74b91e5851074db88adc7b9c2a10c254 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.389959   431 tablet_replica.cc:333] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254: stopping tablet replica
I20260709 13:04:53.390535   431 raft_consensus.cc:2243] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:53.391340   431 raft_consensus.cc:2272] T f8bc4f91364c4a059937ab099b2ed063 P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.393472   431 tablet_replica.cc:333] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254: stopping tablet replica
I20260709 13:04:53.393967   431 raft_consensus.cc:2243] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:53.394447   431 raft_consensus.cc:2272] T 708e0130dbdd406c80683075781a65ab P 74b91e5851074db88adc7b9c2a10c254 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.416611   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:04:53.428867   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:04:53.445941   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:53.446580   431 tablet_replica.cc:333] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc: stopping tablet replica
I20260709 13:04:53.447086   431 raft_consensus.cc:2243] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:53.447499   431 raft_consensus.cc:2272] T e03c9fbe669f4bf2ae5c905c3d90b456 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.449637   431 tablet_replica.cc:333] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc: stopping tablet replica
I20260709 13:04:53.450201   431 raft_consensus.cc:2243] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:53.450771   431 pending_rounds.cc:70] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Trying to abort 1 pending ops.
I20260709 13:04:53.450919   431 pending_rounds.cc:77] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634993188286464 op_type: NO_OP noop_request { }
I20260709 13:04:53.451169   431 raft_consensus.cc:2889] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:53.451388   431 raft_consensus.cc:2272] T 2f9915f8193f49e4a6a69665dd702539 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.453495   431 tablet_replica.cc:333] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc: stopping tablet replica
I20260709 13:04:53.453980   431 raft_consensus.cc:2243] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:53.454420   431 raft_consensus.cc:2272] T f8bc4f91364c4a059937ab099b2ed063 P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.456447   431 tablet_replica.cc:333] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc: stopping tablet replica
I20260709 13:04:53.456873   431 raft_consensus.cc:2243] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:53.457222   431 raft_consensus.cc:2272] T 708e0130dbdd406c80683075781a65ab P 8e111f92a8e04cfcbcc5d5a4b63686bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.480011   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:53.495119   431 master.cc:562] Master@127.0.107.254:34549 shutting down...
I20260709 13:04:53.509773   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:53.510386   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:53.510728   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 56dcae785ea449c5ac1d9864fd7d6e4c: stopping tablet replica
I20260709 13:04:53.528505   431 master.cc:584] Master@127.0.107.254:34549 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2759 ms)
[----------] 6 tests from LeaderRebalancerTest (389657 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:04:53.555805   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:32827
I20260709 13:04:53.556902   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:53.561944 12833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.562238 12834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.563386 12836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.564591   431 server_base.cc:1061] running on GCE node
I20260709 13:04:53.565377   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:53.565546   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:53.565658   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602293565647 us; error 0 us; skew 500 ppm
I20260709 13:04:53.566247   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:53.568411   431 webserver.cc:533] Webserver started at http://127.0.107.254:46673/ using document root <none> and password file <none>
I20260709 13:04:53.568825   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:53.568971   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:53.569186   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:53.570415   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/master-0-root/instance:
uuid: "452e43f5b02f478da9eb516ec03671f8"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-nr1f"
I20260709 13:04:53.574833   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:04:53.578218 12841 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.578970   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:53.579291   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/master-0-root
uuid: "452e43f5b02f478da9eb516ec03671f8"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-nr1f"
I20260709 13:04:53.579537   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:53.612725   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:53.613739   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:53.648561   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:32827
I20260709 13:04:53.648663 12892 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:32827 every 8 connection(s)
I20260709 13:04:53.652266 12893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.662580 12893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8: Bootstrap starting.
I20260709 13:04:53.666909 12893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:53.670830 12893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8: No bootstrap required, opened a new log
I20260709 13:04:53.672842 12893 raft_consensus.cc:359] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "452e43f5b02f478da9eb516ec03671f8" member_type: VOTER }
I20260709 13:04:53.673202 12893 raft_consensus.cc:385] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:53.673377 12893 raft_consensus.cc:740] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 452e43f5b02f478da9eb516ec03671f8, State: Initialized, Role: FOLLOWER
I20260709 13:04:53.673861 12893 consensus_queue.cc:260] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "452e43f5b02f478da9eb516ec03671f8" member_type: VOTER }
I20260709 13:04:53.674286 12893 raft_consensus.cc:399] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:53.674471 12893 raft_consensus.cc:493] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:53.674685 12893 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:53.679189 12893 raft_consensus.cc:515] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "452e43f5b02f478da9eb516ec03671f8" member_type: VOTER }
I20260709 13:04:53.679659 12893 leader_election.cc:304] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 452e43f5b02f478da9eb516ec03671f8; no voters: 
I20260709 13:04:53.680873 12893 leader_election.cc:290] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:53.681257 12896 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:53.682694 12896 raft_consensus.cc:697] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [term 1 LEADER]: Becoming Leader. State: Replica: 452e43f5b02f478da9eb516ec03671f8, State: Running, Role: LEADER
I20260709 13:04:53.683291 12896 consensus_queue.cc:237] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "452e43f5b02f478da9eb516ec03671f8" member_type: VOTER }
I20260709 13:04:53.683887 12893 sys_catalog.cc:565] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:53.686120 12898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 452e43f5b02f478da9eb516ec03671f8. Latest consensus state: current_term: 1 leader_uuid: "452e43f5b02f478da9eb516ec03671f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "452e43f5b02f478da9eb516ec03671f8" member_type: VOTER } }
I20260709 13:04:53.686120 12897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "452e43f5b02f478da9eb516ec03671f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "452e43f5b02f478da9eb516ec03671f8" member_type: VOTER } }
I20260709 13:04:53.686868 12898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:53.686962 12897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:53.691440 12901 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:53.698899 12901 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:53.699851   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:53.707789 12901 catalog_manager.cc:1383] Generated new cluster ID: 2ff380889c59461f9c87cba514791235
I20260709 13:04:53.708101 12901 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:53.744910 12901 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:53.746279 12901 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:53.758854 12901 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8: Generated new TSK 0
I20260709 13:04:53.759501 12901 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:53.766307   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:53.772022 12914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.773078 12915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.774912   431 server_base.cc:1061] running on GCE node
W20260709 13:04:53.775386 12917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.776257   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:53.776467   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:53.776647   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602293776628 us; error 0 us; skew 500 ppm
I20260709 13:04:53.777169   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:53.779404   431 webserver.cc:533] Webserver started at http://127.0.107.193:44581/ using document root <none> and password file <none>
I20260709 13:04:53.779877   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:53.780073   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:53.780337   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:53.781419   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-0-root/instance:
uuid: "e92b0579b8f94357b3044fdf31da0237"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-nr1f"
I20260709 13:04:53.785966   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:53.789673 12922 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.790515   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:53.790825   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-0-root
uuid: "e92b0579b8f94357b3044fdf31da0237"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-nr1f"
I20260709 13:04:53.791100   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:53.801028   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:53.802266   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:53.803658   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:53.805977   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:53.806270   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.806528   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:53.806697   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.844509   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:38287
I20260709 13:04:53.844630 12984 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:38287 every 8 connection(s)
I20260709 13:04:53.849478   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:53.856199 12989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.857924 12990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.859617 12992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.860678   431 server_base.cc:1061] running on GCE node
I20260709 13:04:53.861759   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:53.861860 12985 heartbeater.cc:344] Connected to a master server at 127.0.107.254:32827
W20260709 13:04:53.862025   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:53.862407   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602293862388 us; error 0 us; skew 500 ppm
I20260709 13:04:53.862455 12985 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:53.863050   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:53.863374 12985 heartbeater.cc:507] Master 127.0.107.254:32827 requested a full tablet report, sending...
I20260709 13:04:53.865779   431 webserver.cc:533] Webserver started at http://127.0.107.194:33769/ using document root <none> and password file <none>
I20260709 13:04:53.865799 12858 ts_manager.cc:194] Registered new tserver with Master: e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287)
I20260709 13:04:53.866434   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:53.866746   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:53.867074   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:53.867986 12858 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41746
I20260709 13:04:53.868352   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-1-root/instance:
uuid: "72bec038394a426c84cce96b38303bc1"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-nr1f"
I20260709 13:04:53.872818   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:53.876005 12997 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.876775   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:53.877066   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-1-root
uuid: "72bec038394a426c84cce96b38303bc1"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-nr1f"
I20260709 13:04:53.877307   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:53.888492   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:53.889567   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:53.891022   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:53.893395   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:53.893600   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.893862   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:53.894021   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.930528   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39751
I20260709 13:04:53.930632 13059 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39751 every 8 connection(s)
I20260709 13:04:53.935335   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:53.942106 13063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.943216 13064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:53.945917 13067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:53.946465   431 server_base.cc:1061] running on GCE node
I20260709 13:04:53.947419 13060 heartbeater.cc:344] Connected to a master server at 127.0.107.254:32827
I20260709 13:04:53.947572   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:53.947849 13060 heartbeater.cc:461] Registering TS with master...
W20260709 13:04:53.947944   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:53.948248   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602293948228 us; error 0 us; skew 500 ppm
I20260709 13:04:53.948733 13060 heartbeater.cc:507] Master 127.0.107.254:32827 requested a full tablet report, sending...
I20260709 13:04:53.948901   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:53.950842 12858 ts_manager.cc:194] Registered new tserver with Master: 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:04:53.951905   431 webserver.cc:533] Webserver started at http://127.0.107.195:33293/ using document root <none> and password file <none>
I20260709 13:04:53.952210 12858 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41756
I20260709 13:04:53.952437   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:53.952754   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:53.953023   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:53.954241   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-2-root/instance:
uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-nr1f"
I20260709 13:04:53.958570   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:04:53.961561 13071 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.962384   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:53.962714   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-2-root
uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
format_stamp: "Formatted at 2026-07-09 13:04:53 on dist-test-slave-nr1f"
I20260709 13:04:53.963064   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601903731679-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:53.984753   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:53.985880   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:53.987270   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:53.989425   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:53.989662   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:53.989905   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:53.990103   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:54.027236   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:41557
I20260709 13:04:54.027336 13133 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:41557 every 8 connection(s)
I20260709 13:04:54.047428 13134 heartbeater.cc:344] Connected to a master server at 127.0.107.254:32827
I20260709 13:04:54.047842 13134 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:54.048568 13134 heartbeater.cc:507] Master 127.0.107.254:32827 requested a full tablet report, sending...
I20260709 13:04:54.050464 12858 ts_manager.cc:194] Registered new tserver with Master: d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.051098   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020526605s
I20260709 13:04:54.052201 12858 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41762
I20260709 13:04:54.075901 12858 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41778:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:54.078739 12858 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:54.146289 13025 tablet_service.cc:1511] Processing CreateTablet for tablet 857e7dd3fb21456ca68c71a481dd2f17 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:54.147656 13025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857e7dd3fb21456ca68c71a481dd2f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.159981 13024 tablet_service.cc:1511] Processing CreateTablet for tablet 2614aad4af86416faef66125e8f51c1d (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:54.161474 13024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2614aad4af86416faef66125e8f51c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.163569 13023 tablet_service.cc:1511] Processing CreateTablet for tablet 3e19c33830544651b79096f802e2ab27 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:54.165017 13023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e19c33830544651b79096f802e2ab27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.167618 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 372857e85f894e04aede32b1b4ce5c10 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:54.167765 12950 tablet_service.cc:1511] Processing CreateTablet for tablet 857e7dd3fb21456ca68c71a481dd2f17 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:54.168990 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372857e85f894e04aede32b1b4ce5c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.169128 12950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857e7dd3fb21456ca68c71a481dd2f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.173851 13021 tablet_service.cc:1511] Processing CreateTablet for tablet 148102b2bce741609ec0150acefc71de (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:54.175287 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148102b2bce741609ec0150acefc71de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.179656 13020 tablet_service.cc:1511] Processing CreateTablet for tablet 86afd0d3921f423c84482aee647f459a (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:54.181066 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86afd0d3921f423c84482aee647f459a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.181100 12949 tablet_service.cc:1511] Processing CreateTablet for tablet 2614aad4af86416faef66125e8f51c1d (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:54.183362 12948 tablet_service.cc:1511] Processing CreateTablet for tablet 3e19c33830544651b79096f802e2ab27 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:54.183456 12949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2614aad4af86416faef66125e8f51c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.186937 12948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e19c33830544651b79096f802e2ab27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.188223 12947 tablet_service.cc:1511] Processing CreateTablet for tablet 372857e85f894e04aede32b1b4ce5c10 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:54.189543 12947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372857e85f894e04aede32b1b4ce5c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.192216 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 51e50340e84f48fb9e487a88c3bc584f (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:54.193542 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e50340e84f48fb9e487a88c3bc584f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.195173 12946 tablet_service.cc:1511] Processing CreateTablet for tablet 148102b2bce741609ec0150acefc71de (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:54.196492 12946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148102b2bce741609ec0150acefc71de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.199025 12944 tablet_service.cc:1511] Processing CreateTablet for tablet 51e50340e84f48fb9e487a88c3bc584f (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:54.202158 12943 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4f4c4de0d548319dff3a2fae108ad0 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:54.207597 12942 tablet_service.cc:1511] Processing CreateTablet for tablet 18607ea39bb34537bce328b2f38349a6 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:54.209522 12945 tablet_service.cc:1511] Processing CreateTablet for tablet 86afd0d3921f423c84482aee647f459a (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:54.212633 13099 tablet_service.cc:1511] Processing CreateTablet for tablet 857e7dd3fb21456ca68c71a481dd2f17 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:54.213991 13099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857e7dd3fb21456ca68c71a481dd2f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.215121 13098 tablet_service.cc:1511] Processing CreateTablet for tablet 2614aad4af86416faef66125e8f51c1d (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:54.235617 13098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2614aad4af86416faef66125e8f51c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.216118 13097 tablet_service.cc:1511] Processing CreateTablet for tablet 3e19c33830544651b79096f802e2ab27 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:54.239585 13097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e19c33830544651b79096f802e2ab27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.220911 13094 tablet_service.cc:1511] Processing CreateTablet for tablet 86afd0d3921f423c84482aee647f459a (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:54.243546 13094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86afd0d3921f423c84482aee647f459a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.223201 13093 tablet_service.cc:1511] Processing CreateTablet for tablet 51e50340e84f48fb9e487a88c3bc584f (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:54.252038 13093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e50340e84f48fb9e487a88c3bc584f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.228081 13095 tablet_service.cc:1511] Processing CreateTablet for tablet 148102b2bce741609ec0150acefc71de (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:54.262310 13095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 148102b2bce741609ec0150acefc71de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.212682 12944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51e50340e84f48fb9e487a88c3bc584f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.227274 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4f4c4de0d548319dff3a2fae108ad0 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:54.266095 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4f4c4de0d548319dff3a2fae108ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.227083 13096 tablet_service.cc:1511] Processing CreateTablet for tablet 372857e85f894e04aede32b1b4ce5c10 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:54.271642 13096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372857e85f894e04aede32b1b4ce5c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.229116 13092 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4f4c4de0d548319dff3a2fae108ad0 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:54.275012 13092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4f4c4de0d548319dff3a2fae108ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.229132 13017 tablet_service.cc:1511] Processing CreateTablet for tablet 18607ea39bb34537bce328b2f38349a6 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:54.279258 13017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18607ea39bb34537bce328b2f38349a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.282541 12945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86afd0d3921f423c84482aee647f459a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.286137 12942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18607ea39bb34537bce328b2f38349a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.287926 13091 tablet_service.cc:1511] Processing CreateTablet for tablet 18607ea39bb34537bce328b2f38349a6 (DEFAULT_TABLE table=test-workload [id=8101bfb50c384a51a611efab64282911]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:54.291566 13091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18607ea39bb34537bce328b2f38349a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.298235 12943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4f4c4de0d548319dff3a2fae108ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:54.337498 13149 tablet_bootstrap.cc:492] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:54.337767 13150 tablet_bootstrap.cc:492] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:54.343813 13149 tablet_bootstrap.cc:654] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.356330 13150 tablet_bootstrap.cc:654] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.388243 13149 tablet_bootstrap.cc:492] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:54.388748 13149 ts_tablet_manager.cc:1403] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.010s
I20260709 13:04:54.392066 13149 raft_consensus.cc:359] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.392768 13149 raft_consensus.cc:385] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.393043 13149 raft_consensus.cc:740] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.396914 13149 consensus_queue.cc:260] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.416105 13152 tablet_bootstrap.cc:492] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:54.416165 13150 tablet_bootstrap.cc:492] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:54.417011 13150 ts_tablet_manager.cc:1403] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.080s	user 0.022s	sys 0.000s
I20260709 13:04:54.417227 13149 ts_tablet_manager.cc:1434] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.011s
I20260709 13:04:54.418041 13060 heartbeater.cc:499] Master 127.0.107.254:32827 was elected leader, sending a full tablet report...
I20260709 13:04:54.418337 13149 tablet_bootstrap.cc:492] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:54.419947 13150 raft_consensus.cc:359] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.420733 13150 raft_consensus.cc:385] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.421016 13150 raft_consensus.cc:740] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.421882 13150 consensus_queue.cc:260] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.424279 13149 tablet_bootstrap.cc:654] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.441038 13149 tablet_bootstrap.cc:492] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:54.441574 13149 ts_tablet_manager.cc:1403] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.006s
I20260709 13:04:54.444075 13152 tablet_bootstrap.cc:654] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.451639 13150 ts_tablet_manager.cc:1434] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.034s	user 0.019s	sys 0.013s
I20260709 13:04:54.452767 13150 tablet_bootstrap.cc:492] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:54.452864 12985 heartbeater.cc:499] Master 127.0.107.254:32827 was elected leader, sending a full tablet report...
I20260709 13:04:54.455319 13157 raft_consensus.cc:493] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.455911 13157 raft_consensus.cc:515] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.459753 13150 tablet_bootstrap.cc:654] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.452605 13149 raft_consensus.cc:359] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.462299 13149 raft_consensus.cc:385] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.463253 13149 raft_consensus.cc:740] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.464403 13149 consensus_queue.cc:260] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.467592 13149 ts_tablet_manager.cc:1434] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 13:04:54.468998 13149 tablet_bootstrap.cc:492] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:54.470204 13152 tablet_bootstrap.cc:492] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:54.470788 13152 ts_tablet_manager.cc:1403] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.002s
I20260709 13:04:54.475680 13152 raft_consensus.cc:359] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.476526 13152 raft_consensus.cc:385] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.476828 13152 raft_consensus.cc:740] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.476840 13157 leader_election.cc:290] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.477669 13149 tablet_bootstrap.cc:654] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.491072 13149 tablet_bootstrap.cc:492] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:54.491838 13149 ts_tablet_manager.cc:1403] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:04:54.477711 13152 consensus_queue.cc:260] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.495932 13149 raft_consensus.cc:359] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.497195 13149 raft_consensus.cc:385] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.497642 13149 raft_consensus.cc:740] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.498656 13149 consensus_queue.cc:260] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.499619 13152 ts_tablet_manager.cc:1434] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 13:04:54.499920 13150 tablet_bootstrap.cc:492] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:54.500438 13150 ts_tablet_manager.cc:1403] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.033s
I20260709 13:04:54.503206 13150 raft_consensus.cc:359] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.503940 13150 raft_consensus.cc:385] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.504117 13134 heartbeater.cc:499] Master 127.0.107.254:32827 was elected leader, sending a full tablet report...
I20260709 13:04:54.504235 13150 raft_consensus.cc:740] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.507201 13150 consensus_queue.cc:260] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.507718 13149 ts_tablet_manager.cc:1434] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:04:54.508448 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e19c33830544651b79096f802e2ab27" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:54.509457 13150 ts_tablet_manager.cc:1434] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:04:54.510547 13150 tablet_bootstrap.cc:492] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:54.512610 13152 tablet_bootstrap.cc:492] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
W20260709 13:04:54.515273 12924 leader_election.cc:343] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.516713 13150 tablet_bootstrap.cc:654] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.519255 13152 tablet_bootstrap.cc:654] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.524750 13152 tablet_bootstrap.cc:492] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:54.525254 13152 ts_tablet_manager.cc:1403] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:04:54.525880 13149 tablet_bootstrap.cc:492] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:54.527448 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e19c33830544651b79096f802e2ab27" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:54.528112 13152 raft_consensus.cc:359] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.528777 13150 tablet_bootstrap.cc:492] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:54.528872 13152 raft_consensus.cc:385] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:54.529112 12924 leader_election.cc:343] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.529369 13152 raft_consensus.cc:740] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.529387 13150 ts_tablet_manager.cc:1403] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:04:54.529611 12924 leader_election.cc:304] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e92b0579b8f94357b3044fdf31da0237; no voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:04:54.530640 13157 raft_consensus.cc:2749] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.530378 13152 consensus_queue.cc:260] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.532107 13152 ts_tablet_manager.cc:1434] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:54.532994 13150 raft_consensus.cc:359] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.533665 13152 tablet_bootstrap.cc:492] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:54.533825 13150 raft_consensus.cc:385] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.534232 13150 raft_consensus.cc:740] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.534997 13150 consensus_queue.cc:260] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.536967 13149 tablet_bootstrap.cc:654] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.539137 13150 ts_tablet_manager.cc:1434] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:04:54.540391 13150 tablet_bootstrap.cc:492] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:54.542722 13154 raft_consensus.cc:493] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.543133 13154 raft_consensus.cc:515] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.545451 13154 leader_election.cc:290] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.548832 13149 tablet_bootstrap.cc:492] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:54.549523 13149 ts_tablet_manager.cc:1403] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.001s
I20260709 13:04:54.551303 13150 tablet_bootstrap.cc:654] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.552675 13149 raft_consensus.cc:359] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.553520 13149 raft_consensus.cc:385] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.553923 13149 raft_consensus.cc:740] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.557217 13149 consensus_queue.cc:260] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.561861 13152 tablet_bootstrap.cc:654] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.566372 13149 ts_tablet_manager.cc:1434] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:04:54.568658 13154 raft_consensus.cc:493] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.570967 13154 raft_consensus.cc:515] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.573902 13154 leader_election.cc:290] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.574355 13157 raft_consensus.cc:493] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.575083 13157 raft_consensus.cc:515] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.576184 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857e7dd3fb21456ca68c71a481dd2f17" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:54.576404 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372857e85f894e04aede32b1b4ce5c10" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:54.577176 13157 leader_election.cc:290] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
W20260709 13:04:54.578150 12999 leader_election.cc:343] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:54.578869 12999 leader_election.cc:343] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.579115 13149 tablet_bootstrap.cc:492] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:54.579506 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614aad4af86416faef66125e8f51c1d" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:54.579690 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614aad4af86416faef66125e8f51c1d" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
W20260709 13:04:54.581157 12924 leader_election.cc:343] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:54.581815 12924 leader_election.cc:343] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.582250 12924 leader_election.cc:304] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e92b0579b8f94357b3044fdf31da0237; no voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:04:54.582445 13152 tablet_bootstrap.cc:492] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:54.583042 13152 ts_tablet_manager.cc:1403] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.000s
I20260709 13:04:54.583367 13157 raft_consensus.cc:2749] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.585438 13152 raft_consensus.cc:359] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.586196 13152 raft_consensus.cc:385] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.586472 13152 raft_consensus.cc:740] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.586551 13149 tablet_bootstrap.cc:654] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.587404 13152 consensus_queue.cc:260] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.590220 13152 ts_tablet_manager.cc:1434] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:54.591218 13152 tablet_bootstrap.cc:492] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:54.591536 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857e7dd3fb21456ca68c71a481dd2f17" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:54.591782 13150 tablet_bootstrap.cc:492] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:54.592252 12960 raft_consensus.cc:2468] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 0.
I20260709 13:04:54.592782 13150 ts_tablet_manager.cc:1403] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.053s	user 0.032s	sys 0.003s
I20260709 13:04:54.596901 13150 raft_consensus.cc:359] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.597529 13152 tablet_bootstrap.cc:654] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.597687 13150 raft_consensus.cc:385] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.598177 13150 raft_consensus.cc:740] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.599103 13150 consensus_queue.cc:260] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.599817 13149 tablet_bootstrap.cc:492] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:54.600356 13149 ts_tablet_manager.cc:1403] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:04:54.601977 13150 ts_tablet_manager.cc:1434] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:54.603073 13150 tablet_bootstrap.cc:492] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:54.603426 13149 raft_consensus.cc:359] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.604243 13149 raft_consensus.cc:385] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.604530 13149 raft_consensus.cc:740] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.603626 13000 leader_election.cc:304] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:04:54.605654 13154 raft_consensus.cc:2804] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.605997 13154 raft_consensus.cc:493] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.606348 13154 raft_consensus.cc:3060] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.607242 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372857e85f894e04aede32b1b4ce5c10" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:54.610275 13150 tablet_bootstrap.cc:654] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.614686 13154 raft_consensus.cc:515] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.616386 13150 tablet_bootstrap.cc:492] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:54.616945 13150 ts_tablet_manager.cc:1403] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:04:54.618217 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857e7dd3fb21456ca68c71a481dd2f17" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:54.619127 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857e7dd3fb21456ca68c71a481dd2f17" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:54.619714 12960 raft_consensus.cc:3060] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.620357 13152 tablet_bootstrap.cc:492] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
W20260709 13:04:54.619736 12999 leader_election.cc:343] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.620949 13152 ts_tablet_manager.cc:1403] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.003s
I20260709 13:04:54.620492 13150 raft_consensus.cc:359] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.621740 13150 raft_consensus.cc:385] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.621943 13150 raft_consensus.cc:740] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
W20260709 13:04:54.622462 13000 leader_election.cc:343] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.622958 13000 leader_election.cc:304] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72bec038394a426c84cce96b38303bc1; no voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:54.622876 13150 consensus_queue.cc:260] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.624199 13149 consensus_queue.cc:260] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.625415 13154 leader_election.cc:290] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.626008 13154 raft_consensus.cc:2749] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.628361 13150 ts_tablet_manager.cc:1434] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:54.629537 12960 raft_consensus.cc:2468] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 1.
I20260709 13:04:54.629588 13150 tablet_bootstrap.cc:492] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:54.626255 13152 raft_consensus.cc:359] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.631580 13000 leader_election.cc:304] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:04:54.632645 13152 raft_consensus.cc:385] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.633013 13152 raft_consensus.cc:740] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.633800 13152 consensus_queue.cc:260] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.634929 13149 ts_tablet_manager.cc:1434] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 13:04:54.636049 13152 ts_tablet_manager.cc:1434] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 13:04:54.636251 13174 raft_consensus.cc:2804] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.636835 13174 raft_consensus.cc:697] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Becoming Leader. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:04:54.637310 13150 tablet_bootstrap.cc:654] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.637725 13174 consensus_queue.cc:237] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.639348 13152 tablet_bootstrap.cc:492] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:54.636073 13149 tablet_bootstrap.cc:492] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:54.646807 13152 tablet_bootstrap.cc:654] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.649096 13150 tablet_bootstrap.cc:492] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:54.649660 13150 ts_tablet_manager.cc:1403] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.012s
I20260709 13:04:54.650563 13149 tablet_bootstrap.cc:654] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.652829 13150 raft_consensus.cc:359] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.653683 13150 raft_consensus.cc:385] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.654019 13150 raft_consensus.cc:740] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.655290 13150 consensus_queue.cc:260] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.657239 13152 tablet_bootstrap.cc:492] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:54.657770 13152 ts_tablet_manager.cc:1403] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:04:54.659152 13150 ts_tablet_manager.cc:1434] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:54.660296 13150 tablet_bootstrap.cc:492] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:54.660739 13152 raft_consensus.cc:359] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.661530 13152 raft_consensus.cc:385] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.661840 13152 raft_consensus.cc:740] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.662602 13149 tablet_bootstrap.cc:492] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:54.663245 13149 ts_tablet_manager.cc:1403] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:04:54.662743 13152 consensus_queue.cc:260] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.665751 12858 catalog_manager.cc:5697] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72bec038394a426c84cce96b38303bc1 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "72bec038394a426c84cce96b38303bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.666603 13149 raft_consensus.cc:359] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.667367 13149 raft_consensus.cc:385] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.667690 13149 raft_consensus.cc:740] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.668412 13152 ts_tablet_manager.cc:1434] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:54.668722 13150 tablet_bootstrap.cc:654] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.668555 13149 consensus_queue.cc:260] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.669624 13152 tablet_bootstrap.cc:492] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:54.671274 13149 ts_tablet_manager.cc:1434] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:54.672365 13149 tablet_bootstrap.cc:492] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:54.678555 13152 tablet_bootstrap.cc:654] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.679987 13149 tablet_bootstrap.cc:654] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:54.693284 12906 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:54.699882 13174 raft_consensus.cc:493] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.700727 13174 raft_consensus.cc:515] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.704560 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e19c33830544651b79096f802e2ab27" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:54.705289 12960 raft_consensus.cc:2468] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 0.
I20260709 13:04:54.705353 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e19c33830544651b79096f802e2ab27" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:54.706777 13000 leader_election.cc:304] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
W20260709 13:04:54.707635 12999 leader_election.cc:343] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.708244 13173 raft_consensus.cc:2804] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.708563 13174 leader_election.cc:290] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.708894 13173 raft_consensus.cc:493] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.709563 13173 raft_consensus.cc:3060] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.713685 13152 tablet_bootstrap.cc:492] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:54.714556 13152 ts_tablet_manager.cc:1403] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.026s
I20260709 13:04:54.720031 13173 raft_consensus.cc:515] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.720660 13149 tablet_bootstrap.cc:492] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:54.721237 13150 tablet_bootstrap.cc:492] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:54.721256 13149 ts_tablet_manager.cc:1403] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.023s
I20260709 13:04:54.721868 13150 ts_tablet_manager.cc:1403] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.027s
I20260709 13:04:54.723218 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e19c33830544651b79096f802e2ab27" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:54.723860 12960 raft_consensus.cc:3060] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.719265 13152 raft_consensus.cc:359] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.724407 13152 raft_consensus.cc:385] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.724769 13152 raft_consensus.cc:740] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.725440 13150 raft_consensus.cc:359] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.727850 13150 raft_consensus.cc:385] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.728142 13173 leader_election.cc:290] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.728269 13150 raft_consensus.cc:740] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.729267 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e19c33830544651b79096f802e2ab27" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:54.726367 13157 raft_consensus.cc:493] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.729421 13150 consensus_queue.cc:260] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.730294 13157 raft_consensus.cc:515] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.732124 13150 ts_tablet_manager.cc:1434] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:54.732373 13157 leader_election.cc:290] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.733285 13150 tablet_bootstrap.cc:492] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:54.733778 12960 raft_consensus.cc:2468] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 1.
I20260709 13:04:54.735085 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e50340e84f48fb9e487a88c3bc584f" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:54.735502 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e50340e84f48fb9e487a88c3bc584f" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:54.736142 13109 raft_consensus.cc:2468] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 0.
W20260709 13:04:54.736621 12924 leader_election.cc:343] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.727278 13162 raft_consensus.cc:493] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.738236 13162 raft_consensus.cc:515] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
W20260709 13:04:54.738642 12999 leader_election.cc:343] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.725667 13152 consensus_queue.cc:260] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.737735 12924 leader_election.cc:304] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 72bec038394a426c84cce96b38303bc1
I20260709 13:04:54.740199 13155 raft_consensus.cc:2804] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.740736 13155 raft_consensus.cc:493] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.741180 13155 raft_consensus.cc:3060] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.741719 13150 tablet_bootstrap.cc:654] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.743237 13000 leader_election.cc:304] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:04:54.727061 13149 raft_consensus.cc:359] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.744832 13149 raft_consensus.cc:385] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.745267 13149 raft_consensus.cc:740] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.746122 13174 raft_consensus.cc:2804] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.746660 13174 raft_consensus.cc:697] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Becoming Leader. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:04:54.746790 13162 leader_election.cc:290] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:04:54.746302 13149 consensus_queue.cc:260] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.747534 13174 consensus_queue.cc:237] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.750857 13154 raft_consensus.cc:493] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.751391 13154 raft_consensus.cc:515] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.753683 13154 leader_election.cc:290] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.759121 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148102b2bce741609ec0150acefc71de" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:54.760193 13108 raft_consensus.cc:2468] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 0.
I20260709 13:04:54.763827 12999 leader_election.cc:304] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 
I20260709 13:04:54.765748 13154 raft_consensus.cc:2804] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.766278 13154 raft_consensus.cc:493] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.766582 13157 raft_consensus.cc:493] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.767186 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148102b2bce741609ec0150acefc71de" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:54.767295 13157 raft_consensus.cc:515] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.768330 12960 raft_consensus.cc:2468] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 0.
I20260709 13:04:54.770097 13157 leader_election.cc:290] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.766685 13154 raft_consensus.cc:3060] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.771237 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:54.771921 13035 raft_consensus.cc:2468] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 0.
I20260709 13:04:54.773674 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:54.774750 12924 leader_election.cc:304] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
W20260709 13:04:54.776660 12924 leader_election.cc:343] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.777534 13157 raft_consensus.cc:2804] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.777951 13157 raft_consensus.cc:493] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.778357 13157 raft_consensus.cc:3060] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.779163 13154 raft_consensus.cc:515] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.783913 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148102b2bce741609ec0150acefc71de" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:54.784593 12960 raft_consensus.cc:3060] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.794282 12960 raft_consensus.cc:2468] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 1.
I20260709 13:04:54.795665 13000 leader_election.cc:304] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:54.797022 13173 raft_consensus.cc:2804] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.797631 13173 raft_consensus.cc:697] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Becoming Leader. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:04:54.798766 13173 consensus_queue.cc:237] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.795382 13155 raft_consensus.cc:515] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.803128 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e50340e84f48fb9e487a88c3bc584f" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1"
W20260709 13:04:54.805480 12924 leader_election.cc:343] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.809603 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e50340e84f48fb9e487a88c3bc584f" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:54.810343 13108 raft_consensus.cc:3060] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.821493 12855 catalog_manager.cc:5697] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72bec038394a426c84cce96b38303bc1 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "72bec038394a426c84cce96b38303bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.822656 13154 leader_election.cc:290] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.824327 13157 raft_consensus.cc:515] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.824513 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "148102b2bce741609ec0150acefc71de" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:54.825505 13109 raft_consensus.cc:3060] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.831161 13108 raft_consensus.cc:2468] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 1.
I20260709 13:04:54.832744 12924 leader_election.cc:304] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 72bec038394a426c84cce96b38303bc1
I20260709 13:04:54.834297 13155 leader_election.cc:290] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.834980 13155 raft_consensus.cc:2804] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.835423 13155 raft_consensus.cc:697] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:04:54.836449 13155 consensus_queue.cc:237] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.845064 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:54.845834 13035 raft_consensus.cc:3060] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.847585 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614aad4af86416faef66125e8f51c1d" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:54.848412 12960 raft_consensus.cc:2468] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 0.
I20260709 13:04:54.849007 13109 raft_consensus.cc:2468] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 1.
I20260709 13:04:54.849879 13074 leader_election.cc:304] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:54.850907 13162 raft_consensus.cc:2804] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.851409 13162 raft_consensus.cc:493] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.851766 13162 raft_consensus.cc:3060] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.859153 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614aad4af86416faef66125e8f51c1d" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:54.860348 13034 raft_consensus.cc:2468] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 0.
I20260709 13:04:54.866318 13154 raft_consensus.cc:493] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.867161 13154 raft_consensus.cc:515] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.871186 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86afd0d3921f423c84482aee647f459a" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:54.872200 12960 raft_consensus.cc:2468] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 0.
I20260709 13:04:54.874155 13000 leader_election.cc:304] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:54.875245 13174 raft_consensus.cc:2804] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:54.875613 13174 raft_consensus.cc:493] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.875957 13174 raft_consensus.cc:3060] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.876276 13154 leader_election.cc:290] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.877337 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86afd0d3921f423c84482aee647f459a" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:54.877970 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:54.878298 13109 raft_consensus.cc:2468] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 0.
W20260709 13:04:54.879756 12924 leader_election.cc:343] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:54.880841 13162 raft_consensus.cc:515] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.883152 13162 leader_election.cc:290] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:04:54.884014 13035 raft_consensus.cc:2468] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 1.
I20260709 13:04:54.884727 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614aad4af86416faef66125e8f51c1d" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:54.885365 13034 raft_consensus.cc:3060] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.885414 12924 leader_election.cc:304] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:04:54.886536 13192 raft_consensus.cc:2804] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.836820 13157 leader_election.cc:290] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.899161 13152 ts_tablet_manager.cc:1434] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.184s	user 0.016s	sys 0.035s
I20260709 13:04:54.905174 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614aad4af86416faef66125e8f51c1d" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:54.906252 12960 raft_consensus.cc:3060] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.905375 12855 catalog_manager.cc:5697] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72bec038394a426c84cce96b38303bc1 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "72bec038394a426c84cce96b38303bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.916162 13185 raft_consensus.cc:493] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.916770 13185 raft_consensus.cc:515] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.918395 12960 raft_consensus.cc:2468] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 1.
I20260709 13:04:54.920046 13034 raft_consensus.cc:2468] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 1.
I20260709 13:04:54.921142 13074 leader_election.cc:304] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:54.922379 13162 raft_consensus.cc:2804] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.920224 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857e7dd3fb21456ca68c71a481dd2f17" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:54.937565 13185 leader_election.cc:290] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287)
I20260709 13:04:54.938519 13174 raft_consensus.cc:515] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.939790 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857e7dd3fb21456ca68c71a481dd2f17" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:54.940940 12960 raft_consensus.cc:2393] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in current term 1: Already voted for candidate 72bec038394a426c84cce96b38303bc1 in this term.
I20260709 13:04:54.946518 13074 leader_election.cc:304] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:54.947468 13149 ts_tablet_manager.cc:1434] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.226s	user 0.034s	sys 0.095s
I20260709 13:04:54.949350 13150 tablet_bootstrap.cc:492] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:54.949862 13150 ts_tablet_manager.cc:1403] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.217s	user 0.051s	sys 0.148s
I20260709 13:04:54.950628 13149 tablet_bootstrap.cc:492] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:54.951814 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86afd0d3921f423c84482aee647f459a" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:54.952677 12960 raft_consensus.cc:3060] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.952610 13150 raft_consensus.cc:359] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.953415 13150 raft_consensus.cc:385] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:54.953722 13150 raft_consensus.cc:740] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:54.954243 12858 catalog_manager.cc:5697] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 0 to 1, leader changed from <none> to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.958169 13149 tablet_bootstrap.cc:654] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.958535 13195 raft_consensus.cc:3060] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.944816 13152 tablet_bootstrap.cc:492] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:54.964756 13150 consensus_queue.cc:260] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.970222 13174 leader_election.cc:290] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:54.972029 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86afd0d3921f423c84482aee647f459a" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:54.972684 13108 raft_consensus.cc:3060] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:54.973670 12960 raft_consensus.cc:2468] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 1.
I20260709 13:04:54.944525 13162 raft_consensus.cc:697] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Becoming Leader. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Running, Role: LEADER
I20260709 13:04:54.976248 13162 consensus_queue.cc:237] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.977718 13150 ts_tablet_manager.cc:1434] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.004s
I20260709 13:04:54.963627 13192 raft_consensus.cc:697] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:04:54.980527 13000 leader_election.cc:304] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:54.981926 13174 raft_consensus.cc:2804] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:54.982331 13150 tablet_bootstrap.cc:492] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:54.981971 13192 consensus_queue.cc:237] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.976267 13152 tablet_bootstrap.cc:654] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.982546 13174 raft_consensus.cc:697] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Becoming Leader. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:04:54.986297 13174 consensus_queue.cc:237] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:54.989171 13195 raft_consensus.cc:2749] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:54.992395 13150 tablet_bootstrap.cc:654] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:54.998373 13162 raft_consensus.cc:493] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.996336 12858 catalog_manager.cc:5697] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:54.993018 13108 raft_consensus.cc:2468] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 1.
I20260709 13:04:55.003063 13149 tablet_bootstrap.cc:492] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:55.003796 13149 ts_tablet_manager.cc:1403] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.053s	user 0.029s	sys 0.006s
I20260709 13:04:54.999085 13162 raft_consensus.cc:515] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.007222 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18607ea39bb34537bce328b2f38349a6" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:55.007411 13149 raft_consensus.cc:359] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.008409 13149 raft_consensus.cc:385] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.007983 12855 catalog_manager.cc:5697] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72bec038394a426c84cce96b38303bc1 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "72bec038394a426c84cce96b38303bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:55.008756 13074 leader_election.cc:343] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.008759 13149 raft_consensus.cc:740] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.010145 13149 consensus_queue.cc:260] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.010833 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18607ea39bb34537bce328b2f38349a6" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
W20260709 13:04:55.013082 13073 leader_election.cc:343] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:55.013530 13073 leader_election.cc:304] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:55.013607 13149 ts_tablet_manager.cc:1434] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:04:55.014482 13195 raft_consensus.cc:2749] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.015281 13162 leader_election.cc:290] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:04:55.021597 13149 tablet_bootstrap.cc:492] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:55.024322 13152 tablet_bootstrap.cc:492] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:55.024919 13152 ts_tablet_manager.cc:1403] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.023s
I20260709 13:04:55.027256 13174 raft_consensus.cc:493] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.027818 13174 raft_consensus.cc:515] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.031572 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e50340e84f48fb9e487a88c3bc584f" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:55.032533 13108 raft_consensus.cc:2393] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72bec038394a426c84cce96b38303bc1 in current term 1: Already voted for candidate e92b0579b8f94357b3044fdf31da0237 in this term.
I20260709 13:04:55.034730 13174 leader_election.cc:290] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:55.034623 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e50340e84f48fb9e487a88c3bc584f" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:55.036598 13000 leader_election.cc:304] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72bec038394a426c84cce96b38303bc1; no voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:55.037773 13149 tablet_bootstrap.cc:654] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.038702 13174 raft_consensus.cc:3060] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.041919 13152 raft_consensus.cc:359] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.041779 12855 catalog_manager.cc:5697] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 0 to 1, leader changed from <none> to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.043103 13152 raft_consensus.cc:385] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.045367 13152 raft_consensus.cc:740] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.046808 13152 consensus_queue.cc:260] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.048918 13174 raft_consensus.cc:2749] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.055416 13152 ts_tablet_manager.cc:1434] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.003s
I20260709 13:04:55.056619 13152 tablet_bootstrap.cc:492] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:55.060761 13150 tablet_bootstrap.cc:492] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:55.061414 13150 ts_tablet_manager.cc:1403] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.009s
I20260709 13:04:55.063282 13152 tablet_bootstrap.cc:654] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.064739 13150 raft_consensus.cc:359] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.066821 13150 raft_consensus.cc:385] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.067271 13150 raft_consensus.cc:740] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.068186 13192 raft_consensus.cc:493] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.068718 13192 raft_consensus.cc:515] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.070300 13152 tablet_bootstrap.cc:492] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:55.070513 13149 tablet_bootstrap.cc:492] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:55.070755 13192 leader_election.cc:290] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:55.070860 13152 ts_tablet_manager.cc:1403] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.014s	user 0.014s	sys 0.000s
I20260709 13:04:55.071031 13149 ts_tablet_manager.cc:1403] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.056s	user 0.027s	sys 0.009s
I20260709 13:04:55.072412 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372857e85f894e04aede32b1b4ce5c10" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:55.072400 13150 consensus_queue.cc:260] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.073277 13035 raft_consensus.cc:2468] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 0.
I20260709 13:04:55.073839 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372857e85f894e04aede32b1b4ce5c10" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:55.073933 13152 raft_consensus.cc:359] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.074630 12924 leader_election.cc:304] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:55.075075 13150 ts_tablet_manager.cc:1434] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:04:55.075137 13152 raft_consensus.cc:385] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.075626 13192 raft_consensus.cc:2804] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.075681 13152 raft_consensus.cc:740] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.076210 13192 raft_consensus.cc:493] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.076618 13192 raft_consensus.cc:3060] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.076712 13152 consensus_queue.cc:260] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.077581 13108 raft_consensus.cc:2468] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 0.
I20260709 13:04:55.081207 13152 ts_tablet_manager.cc:1434] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:55.082140 13152 tablet_bootstrap.cc:492] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:55.084990 13192 raft_consensus.cc:515] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.087663 13149 raft_consensus.cc:359] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.088289 13152 tablet_bootstrap.cc:654] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.088419 13149 raft_consensus.cc:385] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.088606 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372857e85f894e04aede32b1b4ce5c10" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:55.089031 13149 raft_consensus.cc:740] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.089341 13035 raft_consensus.cc:3060] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.089850 13149 consensus_queue.cc:260] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.094532 13149 ts_tablet_manager.cc:1434] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:04:55.096843 13035 raft_consensus.cc:2468] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 1.
I20260709 13:04:55.097606 13152 tablet_bootstrap.cc:492] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:55.098147 12924 leader_election.cc:304] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:55.098158 13152 ts_tablet_manager.cc:1403] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:04:55.098174 13192 leader_election.cc:290] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:55.099140 13192 raft_consensus.cc:2804] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.100133 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372857e85f894e04aede32b1b4ce5c10" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:55.100798 13108 raft_consensus.cc:3060] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.101349 13152 raft_consensus.cc:359] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.101822 13152 raft_consensus.cc:385] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.100296 13192 raft_consensus.cc:697] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:04:55.101976 13152 raft_consensus.cc:740] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.102656 13152 consensus_queue.cc:260] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.102687 13192 consensus_queue.cc:237] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.104820 13152 ts_tablet_manager.cc:1434] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:55.109193 13108 raft_consensus.cc:2468] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 1.
I20260709 13:04:55.114192 12858 catalog_manager.cc:5697] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 0 to 1, leader changed from <none> to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.137669 13174 consensus_queue.cc:1048] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.148216 13108 raft_consensus.cc:3060] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.157311 13174 consensus_queue.cc:1048] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.208447 13174 consensus_queue.cc:1048] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.218290 13174 consensus_queue.cc:1048] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.237449 13174 raft_consensus.cc:493] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.237833 13174 raft_consensus.cc:515] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.239558 13174 leader_election.cc:290] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:55.240144 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18607ea39bb34537bce328b2f38349a6" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:55.240571 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18607ea39bb34537bce328b2f38349a6" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:55.240729 12960 raft_consensus.cc:2468] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 0.
I20260709 13:04:55.241179 13108 raft_consensus.cc:2468] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 0.
I20260709 13:04:55.241770 13000 leader_election.cc:304] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:55.242513 13174 raft_consensus.cc:2804] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:55.242878 13174 raft_consensus.cc:493] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.243152 13174 raft_consensus.cc:3060] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.248025 13173 consensus_queue.cc:1048] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.248883 13174 raft_consensus.cc:515] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.250751 13174 leader_election.cc:290] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:55.251756 12959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18607ea39bb34537bce328b2f38349a6" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:55.252399 12959 raft_consensus.cc:3060] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.252372 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18607ea39bb34537bce328b2f38349a6" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:55.253146 13108 raft_consensus.cc:3060] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.260679 13154 consensus_queue.cc:1048] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:55.262136 13108 raft_consensus.cc:2468] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 1.
I20260709 13:04:55.263844 12999 leader_election.cc:304] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 
I20260709 13:04:55.264456 12959 raft_consensus.cc:2468] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 1.
I20260709 13:04:55.265368 13188 raft_consensus.cc:2804] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.265934 13188 raft_consensus.cc:697] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Becoming Leader. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:04:55.267879 13188 consensus_queue.cc:237] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.278867 12858 catalog_manager.cc:5697] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72bec038394a426c84cce96b38303bc1 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "72bec038394a426c84cce96b38303bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.303400 13162 raft_consensus.cc:493] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.303988 13162 raft_consensus.cc:515] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.305691 13162 leader_election.cc:290] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:04:55.306483 12959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:55.306738 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:55.307546 13035 raft_consensus.cc:2393] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in current term 1: Already voted for candidate e92b0579b8f94357b3044fdf31da0237 in this term.
I20260709 13:04:55.308462 13073 leader_election.cc:304] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:55.309175 13162 raft_consensus.cc:3060] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.314285 13162 raft_consensus.cc:2749] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:55.386166 13192 consensus_queue.cc:1048] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.396881 13192 consensus_queue.cc:1048] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.402462 13188 consensus_queue.cc:1048] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.414549 13173 consensus_queue.cc:1048] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.445009 13192 consensus_queue.cc:1048] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.456746 13157 consensus_queue.cc:1048] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.522506 13162 consensus_queue.cc:1048] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.651134 13223 consensus_queue.cc:1048] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.658416 13194 consensus_queue.cc:1048] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.690559 13192 consensus_queue.cc:1048] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.694835 13035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "857e7dd3fb21456ca68c71a481dd2f17"
dest_uuid: "72bec038394a426c84cce96b38303bc1"
mode: GRACEFUL
new_leader_uuid: "e92b0579b8f94357b3044fdf31da0237"
 from {username='slave'} at 127.0.0.1:33978
I20260709 13:04:55.695449 13035 raft_consensus.cc:606] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Received request to transfer leadership to TS e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:55.716638 13109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2614aad4af86416faef66125e8f51c1d"
dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
mode: GRACEFUL
new_leader_uuid: "e92b0579b8f94357b3044fdf31da0237"
 from {username='slave'} at 127.0.0.1:58962
I20260709 13:04:55.717386 13109 raft_consensus.cc:606] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Received request to transfer leadership to TS e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:55.722738 13154 consensus_queue.cc:1048] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.724583 13035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e19c33830544651b79096f802e2ab27"
dest_uuid: "72bec038394a426c84cce96b38303bc1"
mode: GRACEFUL
new_leader_uuid: "e92b0579b8f94357b3044fdf31da0237"
 from {username='slave'} at 127.0.0.1:33978
I20260709 13:04:55.725301 13035 raft_consensus.cc:606] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Received request to transfer leadership to TS e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:55.735680 13188 consensus_queue.cc:1048] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:55.760334 12959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51e50340e84f48fb9e487a88c3bc584f"
dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
mode: GRACEFUL
new_leader_uuid: "72bec038394a426c84cce96b38303bc1"
 from {username='slave'} at 127.0.0.1:42450
I20260709 13:04:55.760991 12959 raft_consensus.cc:606] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Received request to transfer leadership to TS 72bec038394a426c84cce96b38303bc1
I20260709 13:04:55.767082 12959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0"
dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
mode: GRACEFUL
new_leader_uuid: "72bec038394a426c84cce96b38303bc1"
 from {username='slave'} at 127.0.0.1:42450
I20260709 13:04:55.767617 12959 raft_consensus.cc:606] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Received request to transfer leadership to TS 72bec038394a426c84cce96b38303bc1
I20260709 13:04:55.772353 13035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18607ea39bb34537bce328b2f38349a6"
dest_uuid: "72bec038394a426c84cce96b38303bc1"
mode: GRACEFUL
new_leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
 from {username='slave'} at 127.0.0.1:33978
I20260709 13:04:55.772863 13035 raft_consensus.cc:606] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Received request to transfer leadership to TS d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:04:55.877846 13192 raft_consensus.cc:993] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237: : Instructing follower 72bec038394a426c84cce96b38303bc1 to start an election
I20260709 13:04:55.878396 13157 raft_consensus.cc:1081] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Signalling peer 72bec038394a426c84cce96b38303bc1 to start an election
I20260709 13:04:55.879820 13035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0"
dest_uuid: "72bec038394a426c84cce96b38303bc1"
 from {username='slave'} at 127.0.0.1:33962
I20260709 13:04:55.880306 13035 raft_consensus.cc:493] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:55.880609 13035 raft_consensus.cc:3060] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.885512 13035 raft_consensus.cc:515] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.887326 13035 leader_election.cc:290] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 2 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:55.888056 12959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:55.888411 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:55.888751 12959 raft_consensus.cc:3055] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:55.889020 13109 raft_consensus.cc:3060] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.889122 12959 raft_consensus.cc:740] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:04:55.890062 12959 consensus_queue.cc:260] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.890693 13192 raft_consensus.cc:993] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237: : Instructing follower 72bec038394a426c84cce96b38303bc1 to start an election
I20260709 13:04:55.891243 13157 raft_consensus.cc:1081] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Signalling peer 72bec038394a426c84cce96b38303bc1 to start an election
I20260709 13:04:55.891355 12959 raft_consensus.cc:3060] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.892794 13035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51e50340e84f48fb9e487a88c3bc584f"
dest_uuid: "72bec038394a426c84cce96b38303bc1"
 from {username='slave'} at 127.0.0.1:33962
I20260709 13:04:55.893276 13035 raft_consensus.cc:493] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:55.893575 13035 raft_consensus.cc:3060] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.896369 13109 raft_consensus.cc:2468] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 2.
I20260709 13:04:55.898715 12959 raft_consensus.cc:2468] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 2.
I20260709 13:04:55.898671 12999 leader_election.cc:304] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 
I20260709 13:04:55.899773 13174 raft_consensus.cc:2804] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:55.900228 13035 raft_consensus.cc:515] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.900581 13174 raft_consensus.cc:697] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Becoming Leader. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:04:55.901640 13174 consensus_queue.cc:237] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.903200 13035 leader_election.cc:290] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 2 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:55.903487 12959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e50340e84f48fb9e487a88c3bc584f" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:55.904238 12959 raft_consensus.cc:3055] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:55.904608 12959 raft_consensus.cc:740] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:04:55.904939 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51e50340e84f48fb9e487a88c3bc584f" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:55.905542 13109 raft_consensus.cc:3060] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.905437 12959 consensus_queue.cc:260] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.907838 12959 raft_consensus.cc:3060] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:55.910916 12855 catalog_manager.cc:5697] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 reported cstate change: term changed from 1 to 2, leader changed from e92b0579b8f94357b3044fdf31da0237 (127.0.107.193) to 72bec038394a426c84cce96b38303bc1 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "72bec038394a426c84cce96b38303bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:55.912158 13109 raft_consensus.cc:2468] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 2.
I20260709 13:04:55.913213 12999 leader_election.cc:304] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 
I20260709 13:04:55.913908 13174 raft_consensus.cc:2804] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:55.914667 13174 raft_consensus.cc:697] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Becoming Leader. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:04:55.915006 12959 raft_consensus.cc:2468] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 2.
I20260709 13:04:55.915529 13174 consensus_queue.cc:237] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:55.926263 12855 catalog_manager.cc:5697] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 reported cstate change: term changed from 1 to 2, leader changed from e92b0579b8f94357b3044fdf31da0237 (127.0.107.193) to 72bec038394a426c84cce96b38303bc1 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "72bec038394a426c84cce96b38303bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.156819 13236 raft_consensus.cc:993] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3: : Instructing follower e92b0579b8f94357b3044fdf31da0237 to start an election
I20260709 13:04:56.157282 13237 raft_consensus.cc:1081] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Signalling peer e92b0579b8f94357b3044fdf31da0237 to start an election
I20260709 13:04:56.158900 12959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2614aad4af86416faef66125e8f51c1d"
dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
 from {username='slave'} at 127.0.0.1:42438
I20260709 13:04:56.159375 12959 raft_consensus.cc:493] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.159688 12959 raft_consensus.cc:3060] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.165164 12959 raft_consensus.cc:515] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:56.166831 12959 leader_election.cc:290] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 2 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:56.167819 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614aad4af86416faef66125e8f51c1d" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:56.168073 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2614aad4af86416faef66125e8f51c1d" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:56.168430 13035 raft_consensus.cc:3060] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.168663 13109 raft_consensus.cc:3055] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.169023 13109 raft_consensus.cc:740] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Running, Role: LEADER
I20260709 13:04:56.169766 13109 consensus_queue.cc:260] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:56.170765 13109 raft_consensus.cc:3060] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.173879 13035 raft_consensus.cc:2468] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 2.
I20260709 13:04:56.175380 12924 leader_election.cc:304] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:56.176199 13157 raft_consensus.cc:2804] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.176342 13109 raft_consensus.cc:2468] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 2.
I20260709 13:04:56.176759 13157 raft_consensus.cc:697] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:04:56.177631 13157 consensus_queue.cc:237] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:56.178913 13188 raft_consensus.cc:993] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1: : Instructing follower e92b0579b8f94357b3044fdf31da0237 to start an election
I20260709 13:04:56.179423 13174 raft_consensus.cc:1081] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Signalling peer e92b0579b8f94357b3044fdf31da0237 to start an election
I20260709 13:04:56.181001 12959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e19c33830544651b79096f802e2ab27"
dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
 from {username='slave'} at 127.0.0.1:42430
I20260709 13:04:56.181620 12959 raft_consensus.cc:493] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.181941 12959 raft_consensus.cc:3060] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.185371 12855 catalog_manager.cc:5697] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 1 to 2, leader changed from d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195) to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.188865 12959 raft_consensus.cc:515] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:56.190790 12959 leader_election.cc:290] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 2 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:56.192325 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e19c33830544651b79096f802e2ab27" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:56.192898 13109 raft_consensus.cc:3060] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.192945 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e19c33830544651b79096f802e2ab27" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:56.193730 13035 raft_consensus.cc:3055] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.194129 13035 raft_consensus.cc:740] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:04:56.196511 13174 raft_consensus.cc:993] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1: : Instructing follower d8c046fdca1e496fb8eb4ed1a5eb93c3 to start an election
I20260709 13:04:56.196427 13035 consensus_queue.cc:260] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:56.197052 13174 raft_consensus.cc:1081] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Signalling peer d8c046fdca1e496fb8eb4ed1a5eb93c3 to start an election
I20260709 13:04:56.197727 13035 raft_consensus.cc:3060] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.199083 13108 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18607ea39bb34537bce328b2f38349a6"
dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
 from {username='slave'} at 127.0.0.1:58956
I20260709 13:04:56.199728 13108 raft_consensus.cc:493] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.200116 13108 raft_consensus.cc:3060] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.201081 13109 raft_consensus.cc:2468] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 2.
I20260709 13:04:56.202371 12924 leader_election.cc:304] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:56.203239 13157 raft_consensus.cc:2804] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.203347 13035 raft_consensus.cc:2468] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 2.
I20260709 13:04:56.203761 13157 raft_consensus.cc:697] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:04:56.204671 13157 consensus_queue.cc:237] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:56.208539 13108 raft_consensus.cc:515] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:56.211830 12959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18607ea39bb34537bce328b2f38349a6" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:56.212209 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18607ea39bb34537bce328b2f38349a6" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:56.212502 12959 raft_consensus.cc:3060] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.212888 13035 raft_consensus.cc:3055] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.213263 13035 raft_consensus.cc:740] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:04:56.214202 13035 consensus_queue.cc:260] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:56.215441 13035 raft_consensus.cc:3060] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.215206 12855 catalog_manager.cc:5697] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 1 to 2, leader changed from 72bec038394a426c84cce96b38303bc1 (127.0.107.194) to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.218174 13108 leader_election.cc:290] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 2 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:04:56.223379 12959 raft_consensus.cc:2468] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 2.
I20260709 13:04:56.223795 13035 raft_consensus.cc:2468] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 2.
I20260709 13:04:56.224654 13074 leader_election.cc:304] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:56.225482 13237 raft_consensus.cc:2804] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.226063 13237 raft_consensus.cc:697] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 LEADER]: Becoming Leader. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Running, Role: LEADER
I20260709 13:04:56.226883 13237 consensus_queue.cc:237] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:56.233616 12855 catalog_manager.cc:5697] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 reported cstate change: term changed from 1 to 2, leader changed from 72bec038394a426c84cce96b38303bc1 (127.0.107.194) to d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.266139 13188 raft_consensus.cc:993] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1: : Instructing follower e92b0579b8f94357b3044fdf31da0237 to start an election
I20260709 13:04:56.266629 13173 raft_consensus.cc:1081] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Signalling peer e92b0579b8f94357b3044fdf31da0237 to start an election
I20260709 13:04:56.268074 12959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "857e7dd3fb21456ca68c71a481dd2f17"
dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
 from {username='slave'} at 127.0.0.1:42430
I20260709 13:04:56.268561 12959 raft_consensus.cc:493] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.268874 12959 raft_consensus.cc:3060] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.274148 12959 raft_consensus.cc:515] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:56.276284 12959 leader_election.cc:290] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 2 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:56.277108 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857e7dd3fb21456ca68c71a481dd2f17" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:56.277456 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857e7dd3fb21456ca68c71a481dd2f17" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:56.277812 13035 raft_consensus.cc:3055] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:56.278074 13108 raft_consensus.cc:3060] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.278239 13035 raft_consensus.cc:740] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:04:56.279139 13035 consensus_queue.cc:260] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:56.280382 13035 raft_consensus.cc:3060] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:56.285542 13108 raft_consensus.cc:2468] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 2.
I20260709 13:04:56.286692 12924 leader_election.cc:304] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:56.287451 13157 raft_consensus.cc:2804] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:56.287559 13035 raft_consensus.cc:2468] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 2.
I20260709 13:04:56.287863 13157 raft_consensus.cc:697] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:04:56.289131 13157 consensus_queue.cc:237] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:56.296079 12855 catalog_manager.cc:5697] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 1 to 2, leader changed from 72bec038394a426c84cce96b38303bc1 (127.0.107.194) to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.362592 13108 raft_consensus.cc:1275] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Refusing update from remote peer 72bec038394a426c84cce96b38303bc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.363916 13173 consensus_queue.cc:1048] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.372159 12959 raft_consensus.cc:1275] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Refusing update from remote peer 72bec038394a426c84cce96b38303bc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.373952 13188 consensus_queue.cc:1048] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.384474 13108 raft_consensus.cc:1275] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Refusing update from remote peer 72bec038394a426c84cce96b38303bc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.385697 13188 consensus_queue.cc:1048] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.392975 12959 raft_consensus.cc:1275] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Refusing update from remote peer 72bec038394a426c84cce96b38303bc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.394304 13173 consensus_queue.cc:1048] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:56.562799 12981 debug-util.cc:398] Leaking SignalData structure 0x7b08001c18c0 after lost signal to thread 434
W20260709 13:04:56.563779 12981 debug-util.cc:398] Leaking SignalData structure 0x7b0800153c40 after lost signal to thread 12892
I20260709 13:04:56.569736 13108 raft_consensus.cc:1275] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Refusing update from remote peer e92b0579b8f94357b3044fdf31da0237: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.571226 13157 consensus_queue.cc:1048] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.581111 13035 raft_consensus.cc:1275] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Refusing update from remote peer e92b0579b8f94357b3044fdf31da0237: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.583047 13192 consensus_queue.cc:1048] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.588457 13034 raft_consensus.cc:1275] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Refusing update from remote peer e92b0579b8f94357b3044fdf31da0237: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.590046 13157 consensus_queue.cc:1048] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.608580 13108 raft_consensus.cc:1275] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Refusing update from remote peer e92b0579b8f94357b3044fdf31da0237: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.612439 13192 consensus_queue.cc:1048] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.767920 12959 raft_consensus.cc:1275] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Refusing update from remote peer d8c046fdca1e496fb8eb4ed1a5eb93c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.769222 13237 consensus_queue.cc:1048] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.780893 13035 raft_consensus.cc:1275] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Refusing update from remote peer d8c046fdca1e496fb8eb4ed1a5eb93c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.782732 13248 consensus_queue.cc:1048] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.824574 13035 raft_consensus.cc:1275] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Refusing update from remote peer e92b0579b8f94357b3044fdf31da0237: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.826115 13192 consensus_queue.cc:1048] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.835629 13108 raft_consensus.cc:1275] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Refusing update from remote peer e92b0579b8f94357b3044fdf31da0237: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:56.836934 13157 consensus_queue.cc:1048] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:58.814664 12855 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41794:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:58.817680 12855 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:58.888737 12942 tablet_service.cc:1511] Processing CreateTablet for tablet d9f42b3009c248a4b07f601545875c3f (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:58.890152 13017 tablet_service.cc:1511] Processing CreateTablet for tablet d9f42b3009c248a4b07f601545875c3f (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:58.890823 12942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f42b3009c248a4b07f601545875c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.891863 13017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f42b3009c248a4b07f601545875c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.899259 13099 tablet_service.cc:1511] Processing CreateTablet for tablet 8de96c6d8fc641e8b472be1c3146c9a4 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:58.900923 13099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de96c6d8fc641e8b472be1c3146c9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.903295 13092 tablet_service.cc:1511] Processing CreateTablet for tablet d9f42b3009c248a4b07f601545875c3f (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:58.904704 13092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f42b3009c248a4b07f601545875c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.907927 13024 tablet_service.cc:1511] Processing CreateTablet for tablet 8de96c6d8fc641e8b472be1c3146c9a4 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:58.909390 13024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de96c6d8fc641e8b472be1c3146c9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.919797 13096 tablet_service.cc:1511] Processing CreateTablet for tablet 54e25603685841bf89ce1e8c78bddf60 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:58.920301 13097 tablet_service.cc:1511] Processing CreateTablet for tablet 450fa7305c554a31a729542706090034 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:58.921365 13093 tablet_service.cc:1511] Processing CreateTablet for tablet 26f3423d2a274defbf8568be672552c6 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:58.927443 13094 tablet_service.cc:1511] Processing CreateTablet for tablet a9c7183598204f2d98da018065caef29 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:58.923220 13098 tablet_service.cc:1511] Processing CreateTablet for tablet b7af97695358401d9fc3b9cc89ec92c2 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:58.925064 13095 tablet_service.cc:1511] Processing CreateTablet for tablet 7745df522d2141839ea33987c1152bbf (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:58.929967 13020 tablet_service.cc:1511] Processing CreateTablet for tablet b7af97695358401d9fc3b9cc89ec92c2 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:58.930291 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 54e25603685841bf89ce1e8c78bddf60 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:58.931572 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7af97695358401d9fc3b9cc89ec92c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.931738 13091 tablet_service.cc:1511] Processing CreateTablet for tablet 205f2dd19f4e4c9985d7e51dd1d7c922 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:58.932803 13023 tablet_service.cc:1511] Processing CreateTablet for tablet 450fa7305c554a31a729542706090034 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:58.935039 13021 tablet_service.cc:1511] Processing CreateTablet for tablet 26f3423d2a274defbf8568be672552c6 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:58.936383 13023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450fa7305c554a31a729542706090034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.938105 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 7745df522d2141839ea33987c1152bbf (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:58.938949 13025 tablet_service.cc:1511] Processing CreateTablet for tablet 205f2dd19f4e4c9985d7e51dd1d7c922 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:58.940616 13022 tablet_service.cc:1511] Processing CreateTablet for tablet a9c7183598204f2d98da018065caef29 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:58.941963 13097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450fa7305c554a31a729542706090034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.942611 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c7183598204f2d98da018065caef29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.942862 13095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7745df522d2141839ea33987c1152bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.946373 13091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205f2dd19f4e4c9985d7e51dd1d7c922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.950421 13096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e25603685841bf89ce1e8c78bddf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.952275 13093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f3423d2a274defbf8568be672552c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.954398 13094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c7183598204f2d98da018065caef29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.958411 13025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205f2dd19f4e4c9985d7e51dd1d7c922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.960836 13098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7af97695358401d9fc3b9cc89ec92c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.965938 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f3423d2a274defbf8568be672552c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.970507 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7745df522d2141839ea33987c1152bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.978325 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e25603685841bf89ce1e8c78bddf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.979220 12947 tablet_service.cc:1511] Processing CreateTablet for tablet 8de96c6d8fc641e8b472be1c3146c9a4 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:58.980785 12947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de96c6d8fc641e8b472be1c3146c9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.981508 12948 tablet_service.cc:1511] Processing CreateTablet for tablet b7af97695358401d9fc3b9cc89ec92c2 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:58.983181 12948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7af97695358401d9fc3b9cc89ec92c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.987154 12946 tablet_service.cc:1511] Processing CreateTablet for tablet 450fa7305c554a31a729542706090034 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:58.988709 12946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450fa7305c554a31a729542706090034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.990674 12949 tablet_service.cc:1511] Processing CreateTablet for tablet a9c7183598204f2d98da018065caef29 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:58.992208 12949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9c7183598204f2d98da018065caef29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.995424 12950 tablet_service.cc:1511] Processing CreateTablet for tablet 205f2dd19f4e4c9985d7e51dd1d7c922 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:58.996831 12950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205f2dd19f4e4c9985d7e51dd1d7c922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.998888 12945 tablet_service.cc:1511] Processing CreateTablet for tablet 54e25603685841bf89ce1e8c78bddf60 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:59.001194 12943 tablet_service.cc:1511] Processing CreateTablet for tablet 26f3423d2a274defbf8568be672552c6 (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:59.002429 12944 tablet_service.cc:1511] Processing CreateTablet for tablet 7745df522d2141839ea33987c1152bbf (DEFAULT_TABLE table=soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:59.006376 12943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26f3423d2a274defbf8568be672552c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.008033 12944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7745df522d2141839ea33987c1152bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.009517 12945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54e25603685841bf89ce1e8c78bddf60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:59.068657 13265 tablet_bootstrap.cc:492] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:59.080199 13266 tablet_bootstrap.cc:492] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:59.085251 13265 tablet_bootstrap.cc:654] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.109947 13266 tablet_bootstrap.cc:654] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.151798 13266 tablet_bootstrap.cc:492] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:59.152325 13266 ts_tablet_manager.cc:1403] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.014s
I20260709 13:04:59.152979 13268 tablet_bootstrap.cc:492] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:59.155735 13266 raft_consensus.cc:359] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.156824 13266 raft_consensus.cc:385] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.157168 13266 raft_consensus.cc:740] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.157975 13266 consensus_queue.cc:260] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.160887 13266 ts_tablet_manager.cc:1434] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:59.162249 13268 tablet_bootstrap.cc:654] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.163982 13265 tablet_bootstrap.cc:492] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:59.164551 13265 ts_tablet_manager.cc:1403] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.096s	user 0.004s	sys 0.009s
I20260709 13:04:59.168064 13265 raft_consensus.cc:359] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.168924 13265 raft_consensus.cc:385] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.169231 13265 raft_consensus.cc:740] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.170079 13265 consensus_queue.cc:260] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.181556 13268 tablet_bootstrap.cc:492] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:59.182228 13268 ts_tablet_manager.cc:1403] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.008s
I20260709 13:04:59.185554 13268 raft_consensus.cc:359] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.186344 13268 raft_consensus.cc:385] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.186657 13268 raft_consensus.cc:740] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.187522 13268 consensus_queue.cc:260] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.191398 13265 ts_tablet_manager.cc:1434] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.005s
I20260709 13:04:59.191915 13266 tablet_bootstrap.cc:492] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:59.194229 13265 tablet_bootstrap.cc:492] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:59.198191 13268 ts_tablet_manager.cc:1434] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:04:59.204797 13266 tablet_bootstrap.cc:654] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.205859 13268 tablet_bootstrap.cc:492] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:59.208218 13265 tablet_bootstrap.cc:654] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.217098 13266 tablet_bootstrap.cc:492] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:59.217638 13266 ts_tablet_manager.cc:1403] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.006s
I20260709 13:04:59.220824 13266 raft_consensus.cc:359] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.221539 13266 raft_consensus.cc:385] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.221832 13266 raft_consensus.cc:740] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.222638 13266 consensus_queue.cc:260] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.224949 13266 ts_tablet_manager.cc:1434] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:59.226168 13266 tablet_bootstrap.cc:492] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:59.229852 13268 tablet_bootstrap.cc:654] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.233283 13266 tablet_bootstrap.cc:654] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.240428 13265 tablet_bootstrap.cc:492] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:59.241118 13265 ts_tablet_manager.cc:1403] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.012s
I20260709 13:04:59.244884 13265 raft_consensus.cc:359] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.245635 13265 raft_consensus.cc:385] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.245643 13268 tablet_bootstrap.cc:492] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:59.246065 13265 raft_consensus.cc:740] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.246227 13266 tablet_bootstrap.cc:492] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:59.246345 13268 ts_tablet_manager.cc:1403] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.004s
I20260709 13:04:59.248070 13266 ts_tablet_manager.cc:1403] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 13:04:59.250658 13265 consensus_queue.cc:260] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.253368 13266 raft_consensus.cc:359] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.253983 13266 raft_consensus.cc:385] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.252193 13268 raft_consensus.cc:359] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.254360 13266 raft_consensus.cc:740] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.254746 13268 raft_consensus.cc:385] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.255092 13268 raft_consensus.cc:740] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.255540 13266 consensus_queue.cc:260] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.256043 13268 consensus_queue.cc:260] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.258345 13266 ts_tablet_manager.cc:1434] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:59.258553 13268 ts_tablet_manager.cc:1434] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:04:59.259392 13266 tablet_bootstrap.cc:492] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:59.262430 13265 ts_tablet_manager.cc:1434] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 13:04:59.266762 13266 tablet_bootstrap.cc:654] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.268074 13268 tablet_bootstrap.cc:492] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:59.277568 13268 tablet_bootstrap.cc:654] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.279356 13266 tablet_bootstrap.cc:492] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:59.279997 13266 ts_tablet_manager.cc:1403] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:04:59.284027 13266 raft_consensus.cc:359] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.285181 13266 raft_consensus.cc:385] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.285611 13266 raft_consensus.cc:740] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.286619 13267 raft_consensus.cc:493] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.286490 13266 consensus_queue.cc:260] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.287168 13267 raft_consensus.cc:515] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.289121 13266 ts_tablet_manager.cc:1434] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:59.289508 13267 leader_election.cc:290] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.292446 13265 tablet_bootstrap.cc:492] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:59.292704 13266 tablet_bootstrap.cc:492] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:59.295581 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450fa7305c554a31a729542706090034" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:59.297472 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450fa7305c554a31a729542706090034" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:59.298264 13109 raft_consensus.cc:2468] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 0.
W20260709 13:04:59.297636 12924 leader_election.cc:343] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.301297 12924 leader_election.cc:304] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 72bec038394a426c84cce96b38303bc1
I20260709 13:04:59.302485 13267 raft_consensus.cc:2804] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.302852 13267 raft_consensus.cc:493] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.303185 13267 raft_consensus.cc:3060] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.301237 13266 tablet_bootstrap.cc:654] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.310068 13268 tablet_bootstrap.cc:492] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:59.310725 13268 ts_tablet_manager.cc:1403] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.007s
I20260709 13:04:59.315692 13268 raft_consensus.cc:359] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.315811 13267 raft_consensus.cc:515] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.316507 13268 raft_consensus.cc:385] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.316833 13268 raft_consensus.cc:740] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.319834 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450fa7305c554a31a729542706090034" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:59.317691 13268 consensus_queue.cc:260] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.321043 13035 raft_consensus.cc:3060] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.322971 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450fa7305c554a31a729542706090034" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:59.323647 13109 raft_consensus.cc:3060] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.333345 13267 leader_election.cc:290] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.333740 13280 raft_consensus.cc:493] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.334049 13035 raft_consensus.cc:2468] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 1.
I20260709 13:04:59.334381 13280 raft_consensus.cc:515] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.336014 12924 leader_election.cc:304] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:59.336952 13280 leader_election.cc:290] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.336969 13267 raft_consensus.cc:2804] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.338240 12959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7745df522d2141839ea33987c1152bbf" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:59.338546 13267 raft_consensus.cc:697] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:04:59.338352 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7745df522d2141839ea33987c1152bbf" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:59.332504 13109 raft_consensus.cc:2468] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 1.
I20260709 13:04:59.336669 13265 tablet_bootstrap.cc:654] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:59.340123 12999 leader_election.cc:343] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:59.340761 13000 leader_election.cc:343] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.341204 13000 leader_election.cc:304] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72bec038394a426c84cce96b38303bc1; no voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:59.341212 13267 consensus_queue.cc:237] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.342242 13280 raft_consensus.cc:2749] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.344538 13268 ts_tablet_manager.cc:1434] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:04:59.352901 13268 tablet_bootstrap.cc:492] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:59.353875 13266 tablet_bootstrap.cc:492] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:59.354453 13266 ts_tablet_manager.cc:1403] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.008s
I20260709 13:04:59.357754 13266 raft_consensus.cc:359] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.358515 13266 raft_consensus.cc:385] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.358796 13266 raft_consensus.cc:740] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.363901 13265 tablet_bootstrap.cc:492] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:59.364647 13265 ts_tablet_manager.cc:1403] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.008s
I20260709 13:04:59.366852 13266 consensus_queue.cc:260] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.367496 12858 catalog_manager.cc:5697] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 0 to 1, leader changed from <none> to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.368196 13265 raft_consensus.cc:359] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.368990 13265 raft_consensus.cc:385] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.369269 13265 raft_consensus.cc:740] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.369426 13266 ts_tablet_manager.cc:1434] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:04:59.370556 13266 tablet_bootstrap.cc:492] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:59.369992 13265 consensus_queue.cc:260] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.377349 13265 ts_tablet_manager.cc:1434] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:59.377737 13266 tablet_bootstrap.cc:654] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.378434 13265 tablet_bootstrap.cc:492] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:59.385882 13265 tablet_bootstrap.cc:654] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.392241 13266 tablet_bootstrap.cc:492] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:59.392745 13266 ts_tablet_manager.cc:1403] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.009s
I20260709 13:04:59.393224 13268 tablet_bootstrap.cc:654] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.393844 13265 tablet_bootstrap.cc:492] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:59.394428 13265 ts_tablet_manager.cc:1403] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:04:59.395862 13266 raft_consensus.cc:359] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.396839 13266 raft_consensus.cc:385] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.397215 13266 raft_consensus.cc:740] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.397550 13265 raft_consensus.cc:359] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.398402 13265 raft_consensus.cc:385] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.398859 13265 raft_consensus.cc:740] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.398223 13266 consensus_queue.cc:260] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.399777 13265 consensus_queue.cc:260] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.401778 13266 ts_tablet_manager.cc:1434] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:59.403185 13266 tablet_bootstrap.cc:492] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:59.406616 13265 ts_tablet_manager.cc:1434] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:59.407877 13265 tablet_bootstrap.cc:492] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:59.409996 13266 tablet_bootstrap.cc:654] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.415840 13265 tablet_bootstrap.cc:654] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.428743 13266 tablet_bootstrap.cc:492] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:59.429217 13266 ts_tablet_manager.cc:1403] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.008s
I20260709 13:04:59.429361 13268 tablet_bootstrap.cc:492] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:59.429945 13268 ts_tablet_manager.cc:1403] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.008s
I20260709 13:04:59.433331 13268 raft_consensus.cc:359] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.433558 13266 raft_consensus.cc:359] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.434535 13266 raft_consensus.cc:385] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.434930 13266 raft_consensus.cc:740] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.434156 13268 raft_consensus.cc:385] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.435623 13268 raft_consensus.cc:740] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.435622 13266 consensus_queue.cc:260] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.436606 13268 consensus_queue.cc:260] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.438145 13266 ts_tablet_manager.cc:1434] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:04:59.439380 13266 tablet_bootstrap.cc:492] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:59.442277 13253 raft_consensus.cc:493] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.442950 13253 raft_consensus.cc:515] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.446080 12959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3423d2a274defbf8568be672552c6" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:59.446425 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3423d2a274defbf8568be672552c6" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:59.447412 13266 tablet_bootstrap.cc:654] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.448091 13265 tablet_bootstrap.cc:492] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:59.448589 13265 ts_tablet_manager.cc:1403] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.007s
W20260709 13:04:59.449458 13074 leader_election.cc:343] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.451805 13253 leader_election.cc:290] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:04:59.451778 13265 raft_consensus.cc:359] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.452628 13253 raft_consensus.cc:493] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.453682 13253 raft_consensus.cc:515] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.457885 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7af97695358401d9fc3b9cc89ec92c2" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:59.458940 13253 leader_election.cc:290] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
W20260709 13:04:59.459693 13074 leader_election.cc:343] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.461695 13266 tablet_bootstrap.cc:492] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:59.462175 13266 ts_tablet_manager.cc:1403] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
W20260709 13:04:59.462222 13073 leader_election.cc:343] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.462356 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7af97695358401d9fc3b9cc89ec92c2" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:59.463554 13073 leader_election.cc:304] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:59.464366 13253 raft_consensus.cc:493] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:59.464958 13073 leader_election.cc:343] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.464850 13266 raft_consensus.cc:359] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.464977 13253 raft_consensus.cc:515] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.452768 13265 raft_consensus.cc:385] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.465852 13266 raft_consensus.cc:385] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.465741 13073 leader_election.cc:304] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:59.466229 13265 raft_consensus.cc:740] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.466328 13266 raft_consensus.cc:740] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.466621 13289 raft_consensus.cc:2749] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.467188 13265 consensus_queue.cc:260] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.467240 13266 consensus_queue.cc:260] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.468528 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e25603685841bf89ce1e8c78bddf60" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:59.469161 12960 raft_consensus.cc:2468] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 0.
I20260709 13:04:59.469570 13266 ts_tablet_manager.cc:1434] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:59.469691 13265 ts_tablet_manager.cc:1434] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:04:59.470510 13266 tablet_bootstrap.cc:492] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Bootstrap starting.
I20260709 13:04:59.470752 13265 tablet_bootstrap.cc:492] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:59.476473 13280 raft_consensus.cc:493] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.477013 13280 raft_consensus.cc:515] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.478077 13265 tablet_bootstrap.cc:654] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.479103 13280 leader_election.cc:290] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.480279 13268 ts_tablet_manager.cc:1434] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 13:04:59.480785 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c7183598204f2d98da018065caef29" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:59.482329 13266 tablet_bootstrap.cc:654] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.482673 13109 raft_consensus.cc:2468] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 0.
I20260709 13:04:59.483964 12999 leader_election.cc:304] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 
I20260709 13:04:59.485080 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c7183598204f2d98da018065caef29" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
W20260709 13:04:59.486996 13000 leader_election.cc:343] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.491652 13280 raft_consensus.cc:2804] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.481542 13289 raft_consensus.cc:2749] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.492211 13280 raft_consensus.cc:493] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.493778 13280 raft_consensus.cc:3060] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.494254 13268 tablet_bootstrap.cc:492] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:59.498543 13074 leader_election.cc:304] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:59.507531 13268 tablet_bootstrap.cc:654] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.511730 13265 tablet_bootstrap.cc:492] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:59.512265 13265 ts_tablet_manager.cc:1403] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.005s
I20260709 13:04:59.514894 13288 raft_consensus.cc:493] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.515458 13288 raft_consensus.cc:515] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.516060 13265 raft_consensus.cc:359] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.516813 13265 raft_consensus.cc:385] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.517112 13265 raft_consensus.cc:740] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.512085 13289 raft_consensus.cc:2804] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.518252 13289 raft_consensus.cc:493] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.518999 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f42b3009c248a4b07f601545875c3f" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:59.523111 13253 leader_election.cc:290] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:04:59.520160 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f42b3009c248a4b07f601545875c3f" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:59.526600 12960 raft_consensus.cc:2468] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 0.
I20260709 13:04:59.522259 13289 raft_consensus.cc:3060] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:59.524715 13073 leader_election.cc:343] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.525462 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e25603685841bf89ce1e8c78bddf60" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:59.519549 13288 leader_election.cc:290] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
W20260709 13:04:59.530155 13073 leader_election.cc:343] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.517879 13265 consensus_queue.cc:260] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.532572 13265 ts_tablet_manager.cc:1434] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:04:59.533066 13074 leader_election.cc:304] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 72bec038394a426c84cce96b38303bc1
I20260709 13:04:59.534118 13265 tablet_bootstrap.cc:492] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:59.534343 13253 raft_consensus.cc:2804] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.534735 13253 raft_consensus.cc:493] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.535050 13253 raft_consensus.cc:3060] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.541441 13265 tablet_bootstrap.cc:654] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.543190 13253 raft_consensus.cc:515] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.546348 13268 tablet_bootstrap.cc:492] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:59.546936 13268 ts_tablet_manager.cc:1403] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.004s
I20260709 13:04:59.553515 13268 raft_consensus.cc:359] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.554814 13268 raft_consensus.cc:385] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.555187 13268 raft_consensus.cc:740] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.556139 13268 consensus_queue.cc:260] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.558948 13268 ts_tablet_manager.cc:1434] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:04:59.564765 13253 leader_election.cc:290] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:04:59.570274 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f42b3009c248a4b07f601545875c3f" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1"
W20260709 13:04:59.571892 13073 leader_election.cc:343] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.573985 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f42b3009c248a4b07f601545875c3f" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:59.574715 12960 raft_consensus.cc:3060] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.583570 12960 raft_consensus.cc:2468] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 1.
I20260709 13:04:59.584741 13268 tablet_bootstrap.cc:492] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:59.585675 13074 leader_election.cc:304] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 72bec038394a426c84cce96b38303bc1
I20260709 13:04:59.587754 13253 raft_consensus.cc:2804] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.588958 13253 raft_consensus.cc:697] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Becoming Leader. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Running, Role: LEADER
I20260709 13:04:59.589874 13253 consensus_queue.cc:237] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.585988 13280 raft_consensus.cc:515] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.590469 13289 raft_consensus.cc:515] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.600831 13265 tablet_bootstrap.cc:492] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:59.600904 13289 leader_election.cc:290] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:04:59.602067 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e25603685841bf89ce1e8c78bddf60" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:59.594610 13266 tablet_bootstrap.cc:492] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3: No bootstrap required, opened a new log
I20260709 13:04:59.603122 13266 ts_tablet_manager.cc:1403] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent bootstrapping tablet: real 0.133s	user 0.043s	sys 0.056s
W20260709 13:04:59.603762 13073 leader_election.cc:343] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.601456 13265 ts_tablet_manager.cc:1403] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.068s	user 0.023s	sys 0.014s
I20260709 13:04:59.604852 13268 tablet_bootstrap.cc:654] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.605571 12959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e25603685841bf89ce1e8c78bddf60" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:59.606299 12959 raft_consensus.cc:3060] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.608083 13265 raft_consensus.cc:359] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.621377 13265 raft_consensus.cc:385] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.621935 13265 raft_consensus.cc:740] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.600600 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c7183598204f2d98da018065caef29" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:59.622879 13265 consensus_queue.cc:260] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
W20260709 13:04:59.623558 13000 leader_election.cc:343] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.625460 13265 ts_tablet_manager.cc:1434] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.004s
I20260709 13:04:59.626585 13265 tablet_bootstrap.cc:492] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:59.635926 13265 tablet_bootstrap.cc:654] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.641081 13278 raft_consensus.cc:493] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.641726 13278 raft_consensus.cc:515] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.646668 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f2dd19f4e4c9985d7e51dd1d7c922" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:59.647387 13108 raft_consensus.cc:2468] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 0.
I20260709 13:04:59.648691 12999 leader_election.cc:304] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 
I20260709 13:04:59.649776 13188 raft_consensus.cc:2804] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.650193 13188 raft_consensus.cc:493] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.650588 13188 raft_consensus.cc:3060] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.653188 13265 tablet_bootstrap.cc:492] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:59.653972 13265 ts_tablet_manager.cc:1403] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.009s
I20260709 13:04:59.654811 13278 leader_election.cc:290] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.658085 13265 raft_consensus.cc:359] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.659229 13265 raft_consensus.cc:385] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.659276 12957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f2dd19f4e4c9985d7e51dd1d7c922" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:59.659778 13265 raft_consensus.cc:740] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.660132 12957 raft_consensus.cc:2468] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 0.
I20260709 13:04:59.660936 13265 consensus_queue.cc:260] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.663964 13265 ts_tablet_manager.cc:1434] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:59.666074 13265 tablet_bootstrap.cc:492] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237: Bootstrap starting.
I20260709 13:04:59.674551 13265 tablet_bootstrap.cc:654] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.686872 13188 raft_consensus.cc:515] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.690081 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f2dd19f4e4c9985d7e51dd1d7c922" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:59.690815 12960 raft_consensus.cc:3060] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.615561 12959 raft_consensus.cc:2468] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 1.
I20260709 13:04:59.617795 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c7183598204f2d98da018065caef29" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:59.698444 13109 raft_consensus.cc:3060] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.618602 13267 raft_consensus.cc:493] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.702353 13267 raft_consensus.cc:515] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.704650 13267 leader_election.cc:290] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.706581 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7af97695358401d9fc3b9cc89ec92c2" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:59.707466 13108 raft_consensus.cc:2468] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 0.
I20260709 13:04:59.706657 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7af97695358401d9fc3b9cc89ec92c2" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:59.708729 12924 leader_election.cc:304] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:59.709807 13034 raft_consensus.cc:2468] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 0.
I20260709 13:04:59.710290 13298 raft_consensus.cc:2804] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.712244 13298 raft_consensus.cc:493] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.712729 13298 raft_consensus.cc:3060] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.714449 13267 raft_consensus.cc:493] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.619014 13280 leader_election.cc:290] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.611137 13266 raft_consensus.cc:359] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.716205 13266 raft_consensus.cc:385] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.715215 13267 raft_consensus.cc:515] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.716496 13266 raft_consensus.cc:740] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.717267 13266 consensus_queue.cc:260] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.717751 13109 raft_consensus.cc:2468] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 1.
I20260709 13:04:59.718041 13267 leader_election.cc:290] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.719205 13288 raft_consensus.cc:493] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.719465 13266 ts_tablet_manager.cc:1434] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Time spent starting tablet: real 0.116s	user 0.006s	sys 0.000s
I20260709 13:04:59.719812 13288 raft_consensus.cc:515] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.723711 12957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7745df522d2141839ea33987c1152bbf" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:04:59.724448 12957 raft_consensus.cc:2468] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 0.
I20260709 13:04:59.724560 13288 leader_election.cc:290] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:04:59.726406 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7745df522d2141839ea33987c1152bbf" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:59.726982 13108 raft_consensus.cc:2468] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 0.
I20260709 13:04:59.725665 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7745df522d2141839ea33987c1152bbf" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:59.730520 12924 leader_election.cc:304] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:59.730649 13034 raft_consensus.cc:2468] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 0.
I20260709 13:04:59.727914 13267 raft_consensus.cc:493] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.731720 13157 raft_consensus.cc:2804] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.732108 13157 raft_consensus.cc:493] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.732084 13267 raft_consensus.cc:515] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.732662 13157 raft_consensus.cc:3060] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.742842 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7745df522d2141839ea33987c1152bbf" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:59.743580 13035 raft_consensus.cc:2468] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 0.
I20260709 13:04:59.747007 12960 raft_consensus.cc:2468] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 1.
I20260709 13:04:59.743952 13074 leader_election.cc:304] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:59.743561 13157 raft_consensus.cc:515] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.748601 13000 leader_election.cc:304] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:59.749492 13280 raft_consensus.cc:2804] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.749984 13280 raft_consensus.cc:697] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Becoming Leader. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:04:59.750809 13280 consensus_queue.cc:237] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.751518 13298 raft_consensus.cc:515] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.751955 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7745df522d2141839ea33987c1152bbf" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:59.752751 13035 raft_consensus.cc:3060] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.753557 13298 leader_election.cc:290] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.754669 13253 raft_consensus.cc:2804] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.755105 13253 raft_consensus.cc:493] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.755439 13253 raft_consensus.cc:3060] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.757382 13108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7af97695358401d9fc3b9cc89ec92c2" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:59.757956 13108 raft_consensus.cc:3060] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.759977 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7af97695358401d9fc3b9cc89ec92c2" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:59.760479 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3423d2a274defbf8568be672552c6" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:59.760660 13033 raft_consensus.cc:3060] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.762135 12999 leader_election.cc:304] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:59.763315 13278 raft_consensus.cc:2804] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.764767 13298 raft_consensus.cc:493] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.765035 13074 leader_election.cc:304] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 72bec038394a426c84cce96b38303bc1
I20260709 13:04:59.765337 13298 raft_consensus.cc:515] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.766162 13288 raft_consensus.cc:2804] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.766659 13288 raft_consensus.cc:697] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Becoming Leader. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Running, Role: LEADER
W20260709 13:04:59.770360 12924 leader_election.cc:343] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:59.790493 12906 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:59.852375 13278 raft_consensus.cc:697] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Becoming Leader. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:04:59.835239 13253 raft_consensus.cc:515] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.853713 13278 consensus_queue.cc:237] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.835179 12858 catalog_manager.cc:5697] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.834383 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de96c6d8fc641e8b472be1c3146c9a4" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:04:59.798298 13108 raft_consensus.cc:2468] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 1.
I20260709 13:04:59.828959 13298 leader_election.cc:290] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.796608 13107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7745df522d2141839ea33987c1152bbf" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:59.857865 12855 catalog_manager.cc:5697] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72bec038394a426c84cce96b38303bc1 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "72bec038394a426c84cce96b38303bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.790459 13188 leader_election.cc:290] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.790473 13288 consensus_queue.cc:237] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.865337 13265 tablet_bootstrap.cc:492] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237: No bootstrap required, opened a new log
I20260709 13:04:59.867139 13265 ts_tablet_manager.cc:1403] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237: Time spent bootstrapping tablet: real 0.201s	user 0.050s	sys 0.055s
I20260709 13:04:59.832109 13268 tablet_bootstrap.cc:492] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:59.796346 13267 leader_election.cc:290] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.864598 13253 leader_election.cc:290] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:04:59.790134 13035 raft_consensus.cc:2468] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 1.
I20260709 13:04:59.794345 13157 leader_election.cc:290] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.798990 13033 raft_consensus.cc:2468] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 1.
I20260709 13:04:59.796013 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3423d2a274defbf8568be672552c6" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:59.831744 13106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de96c6d8fc641e8b472be1c3146c9a4" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:04:59.836112 13105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f2dd19f4e4c9985d7e51dd1d7c922" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:59.872273 13268 ts_tablet_manager.cc:1403] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.288s	user 0.036s	sys 0.072s
I20260709 13:04:59.878438 13107 raft_consensus.cc:2393] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e92b0579b8f94357b3044fdf31da0237 in current term 1: Already voted for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in this term.
I20260709 13:04:59.880591 13105 raft_consensus.cc:3060] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.879926 13106 raft_consensus.cc:2468] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 0.
I20260709 13:04:59.889114 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7745df522d2141839ea33987c1152bbf" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:04:59.880144 13109 raft_consensus.cc:2468] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 0.
I20260709 13:04:59.890277 12960 raft_consensus.cc:2393] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in current term 1: Already voted for candidate e92b0579b8f94357b3044fdf31da0237 in this term.
I20260709 13:04:59.895638 13265 raft_consensus.cc:359] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.896479 13265 raft_consensus.cc:385] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.896799 13265 raft_consensus.cc:740] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.897656 13265 consensus_queue.cc:260] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.890127 13268 raft_consensus.cc:359] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.900185 13268 raft_consensus.cc:385] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.900504 13268 raft_consensus.cc:740] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.883634 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7745df522d2141839ea33987c1152bbf" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:59.901113 13105 raft_consensus.cc:2468] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 1.
I20260709 13:04:59.911862 12924 leader_election.cc:304] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:59.912227 13034 raft_consensus.cc:2393] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in current term 1: Already voted for candidate e92b0579b8f94357b3044fdf31da0237 in this term.
I20260709 13:04:59.913264 13267 raft_consensus.cc:2804] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.913856 13267 raft_consensus.cc:697] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:04:59.914902 13267 consensus_queue.cc:237] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.917273 13073 leader_election.cc:304] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237
I20260709 13:04:59.918169 13265 ts_tablet_manager.cc:1434] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:04:59.919193 13288 raft_consensus.cc:2749] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.917300 12924 leader_election.cc:304] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:59.921052 12924 leader_election.cc:304] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 72bec038394a426c84cce96b38303bc1
I20260709 13:04:59.921124 13304 raft_consensus.cc:2804] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.921761 13304 raft_consensus.cc:493] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.921972 13303 raft_consensus.cc:2804] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.922238 13304 raft_consensus.cc:3060] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.922510 13303 raft_consensus.cc:493] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.922967 13303 raft_consensus.cc:3060] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.903507 13268 consensus_queue.cc:260] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.925750 13268 ts_tablet_manager.cc:1434] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:04:59.930401 13298 consensus_queue.cc:1048] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:59.931674 13268 tablet_bootstrap.cc:492] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:59.941869 13304 raft_consensus.cc:515] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.944823 13304 leader_election.cc:290] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.945590 13268 tablet_bootstrap.cc:654] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:59.945434 12924 leader_election.cc:343] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.946813 12924 leader_election.cc:304] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:04:59.947670 13304 raft_consensus.cc:2804] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.948522 13304 raft_consensus.cc:697] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:04:59.948235 13303 raft_consensus.cc:515] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.949581 13304 consensus_queue.cc:237] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.954244 13303 leader_election.cc:290] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:04:59.957818 13303 consensus_queue.cc:1048] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:59.962816 13268 tablet_bootstrap.cc:492] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:04:59.963356 13268 ts_tablet_manager.cc:1403] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.006s
I20260709 13:04:59.966562 13268 raft_consensus.cc:359] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.967851 13268 raft_consensus.cc:385] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.967978 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de96c6d8fc641e8b472be1c3146c9a4" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:59.968303 13268 raft_consensus.cc:740] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.968510 13107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3423d2a274defbf8568be672552c6" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:04:59.968681 13109 raft_consensus.cc:3060] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.969164 13107 raft_consensus.cc:3060] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.969548 13268 consensus_queue.cc:260] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.973248 13268 ts_tablet_manager.cc:1434] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:04:59.974678 13268 tablet_bootstrap.cc:492] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:04:59.976593 13109 raft_consensus.cc:2468] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 1.
I20260709 13:04:59.977433 13107 raft_consensus.cc:2468] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 1.
I20260709 13:04:59.977567 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de96c6d8fc641e8b472be1c3146c9a4" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:59.982475 12856 catalog_manager.cc:5697] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 0 to 1, leader changed from <none> to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.983985 12924 leader_election.cc:304] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:04:59.979933 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3423d2a274defbf8568be672552c6" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:04:59.984938 13304 raft_consensus.cc:2804] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.985456 13304 raft_consensus.cc:697] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
W20260709 13:04:59.986308 12924 leader_election.cc:343] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:59.987383 12924 leader_election.cc:343] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.988443 12924 leader_election.cc:304] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 72bec038394a426c84cce96b38303bc1
I20260709 13:04:59.986581 13304 consensus_queue.cc:237] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:04:59.996232 13310 raft_consensus.cc:2804] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.996739 13310 raft_consensus.cc:697] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:04:59.997633 13310 consensus_queue.cc:237] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.005034 13268 tablet_bootstrap.cc:654] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.018749 12855 catalog_manager.cc:5697] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.040648 12858 catalog_manager.cc:5697] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72bec038394a426c84cce96b38303bc1 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "72bec038394a426c84cce96b38303bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.044035 13253 consensus_queue.cc:1048] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.077375 13268 tablet_bootstrap.cc:492] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:05:00.078016 13268 ts_tablet_manager.cc:1403] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.104s	user 0.038s	sys 0.029s
I20260709 13:05:00.081552 12858 catalog_manager.cc:5697] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 0 to 1, leader changed from <none> to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.082723 13268 raft_consensus.cc:359] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.083521 13268 raft_consensus.cc:385] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.083595 12858 catalog_manager.cc:5697] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 0 to 1, leader changed from <none> to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.083859 13268 raft_consensus.cc:740] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.085515 12858 catalog_manager.cc:5697] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 0 to 1, leader changed from <none> to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.086074 13268 consensus_queue.cc:260] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.088497 13268 ts_tablet_manager.cc:1434] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:00.089371 13268 tablet_bootstrap.cc:492] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1: Bootstrap starting.
I20260709 13:05:00.095726 13035 raft_consensus.cc:3060] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.104902 13268 tablet_bootstrap.cc:654] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:00.111510 13289 consensus_queue.cc:1048] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.113554 13268 tablet_bootstrap.cc:492] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1: No bootstrap required, opened a new log
I20260709 13:05:00.114171 13268 ts_tablet_manager.cc:1403] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 13:05:00.117144 13268 raft_consensus.cc:359] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.117934 13268 raft_consensus.cc:385] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:00.118264 13268 raft_consensus.cc:740] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Initialized, Role: FOLLOWER
I20260709 13:05:00.119184 13268 consensus_queue.cc:260] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.121745 13268 ts_tablet_manager.cc:1434] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:00.138388 13280 consensus_queue.cc:1048] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.153936 13280 consensus_queue.cc:1048] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.224174 13280 raft_consensus.cc:493] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.224684 13280 raft_consensus.cc:515] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.226523 13280 leader_election.cc:290] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:05:00.227433 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3423d2a274defbf8568be672552c6" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:05:00.227730 13105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3423d2a274defbf8568be672552c6" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:05:00.228703 13105 raft_consensus.cc:2393] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72bec038394a426c84cce96b38303bc1 in current term 1: Already voted for candidate e92b0579b8f94357b3044fdf31da0237 in this term.
I20260709 13:05:00.229732 12999 leader_election.cc:304] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72bec038394a426c84cce96b38303bc1; no voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237
I20260709 13:05:00.230453 13280 raft_consensus.cc:3060] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.235947 13280 raft_consensus.cc:2749] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.258256 13310 raft_consensus.cc:493] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.258836 13310 raft_consensus.cc:515] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.260622 13310 leader_election.cc:290] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:05:00.261806 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c7183598204f2d98da018065caef29" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72bec038394a426c84cce96b38303bc1" is_pre_election: true
I20260709 13:05:00.261806 13105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c7183598204f2d98da018065caef29" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:05:00.263141 13105 raft_consensus.cc:2393] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e92b0579b8f94357b3044fdf31da0237 in current term 1: Already voted for candidate 72bec038394a426c84cce96b38303bc1 in this term.
I20260709 13:05:00.264061 12924 leader_election.cc:304] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e92b0579b8f94357b3044fdf31da0237; no voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:05:00.266300 13304 raft_consensus.cc:3060] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.273715 13304 raft_consensus.cc:2749] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.275869 13105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9f42b3009c248a4b07f601545875c3f"
dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
mode: GRACEFUL
new_leader_uuid: "e92b0579b8f94357b3044fdf31da0237"
 from {username='slave'} at 127.0.0.1:58962
I20260709 13:05:00.276731 13105 raft_consensus.cc:606] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Received request to transfer leadership to TS e92b0579b8f94357b3044fdf31da0237
I20260709 13:05:00.285724 13105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54e25603685841bf89ce1e8c78bddf60"
dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
mode: GRACEFUL
new_leader_uuid: "e92b0579b8f94357b3044fdf31da0237"
 from {username='slave'} at 127.0.0.1:58962
I20260709 13:05:00.286401 13105 raft_consensus.cc:606] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Received request to transfer leadership to TS e92b0579b8f94357b3044fdf31da0237
I20260709 13:05:00.292330 13289 consensus_queue.cc:1048] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.298314 12959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26f3423d2a274defbf8568be672552c6"
dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
mode: GRACEFUL
new_leader_uuid: "72bec038394a426c84cce96b38303bc1"
 from {username='slave'} at 127.0.0.1:42450
I20260709 13:05:00.298955 12959 raft_consensus.cc:606] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Received request to transfer leadership to TS 72bec038394a426c84cce96b38303bc1
I20260709 13:05:00.300251 13288 raft_consensus.cc:993] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3: : Instructing follower e92b0579b8f94357b3044fdf31da0237 to start an election
I20260709 13:05:00.300776 13288 raft_consensus.cc:1081] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Signalling peer e92b0579b8f94357b3044fdf31da0237 to start an election
I20260709 13:05:00.304844 13035 raft_consensus.cc:3060] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.308606 12960 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54e25603685841bf89ce1e8c78bddf60"
dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
 from {username='slave'} at 127.0.0.1:42438
I20260709 13:05:00.309490 12960 raft_consensus.cc:493] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.309947 12960 raft_consensus.cc:3060] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.313160 12959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7af97695358401d9fc3b9cc89ec92c2"
dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
mode: GRACEFUL
new_leader_uuid: "72bec038394a426c84cce96b38303bc1"
 from {username='slave'} at 127.0.0.1:42450
I20260709 13:05:00.313934 12959 raft_consensus.cc:606] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Received request to transfer leadership to TS 72bec038394a426c84cce96b38303bc1
I20260709 13:05:00.318492 12960 raft_consensus.cc:515] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.320204 13253 consensus_queue.cc:1048] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.325080 12960 leader_election.cc:290] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 2 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:05:00.326088 13034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e25603685841bf89ce1e8c78bddf60" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:05:00.327077 13105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e25603685841bf89ce1e8c78bddf60" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:05:00.327801 13105 raft_consensus.cc:3055] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.328155 13105 raft_consensus.cc:740] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Running, Role: LEADER
I20260709 13:05:00.329070 13105 consensus_queue.cc:260] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.330390 13105 raft_consensus.cc:3060] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.335294 12959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7745df522d2141839ea33987c1152bbf"
dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
mode: GRACEFUL
new_leader_uuid: "72bec038394a426c84cce96b38303bc1"
 from {username='slave'} at 127.0.0.1:42450
I20260709 13:05:00.336089 12959 raft_consensus.cc:606] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Received request to transfer leadership to TS 72bec038394a426c84cce96b38303bc1
I20260709 13:05:00.342338 13105 raft_consensus.cc:2468] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 2.
I20260709 13:05:00.344473 12924 leader_election.cc:304] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 72bec038394a426c84cce96b38303bc1
I20260709 13:05:00.347078 13304 raft_consensus.cc:2804] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.347643 13304 raft_consensus.cc:697] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:05:00.348510 13304 consensus_queue.cc:237] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.357860 13035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "205f2dd19f4e4c9985d7e51dd1d7c922"
dest_uuid: "72bec038394a426c84cce96b38303bc1"
mode: GRACEFUL
new_leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
 from {username='slave'} at 127.0.0.1:33978
I20260709 13:05:00.358558 13035 raft_consensus.cc:606] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Received request to transfer leadership to TS d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:05:00.359647 12855 catalog_manager.cc:5697] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 1 to 2, leader changed from d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195) to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.385087 13280 consensus_queue.cc:1048] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.402329 13304 consensus_queue.cc:1048] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.402925 13306 consensus_queue.cc:1048] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.414739 13267 consensus_queue.cc:1048] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.419103 13267 consensus_queue.cc:1048] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.420480 13267 consensus_queue.cc:1048] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.448968 13304 raft_consensus.cc:993] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237: : Instructing follower 72bec038394a426c84cce96b38303bc1 to start an election
I20260709 13:05:00.449446 13304 raft_consensus.cc:1081] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Signalling peer 72bec038394a426c84cce96b38303bc1 to start an election
I20260709 13:05:00.452229 13306 raft_consensus.cc:493] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.452865 13306 raft_consensus.cc:515] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.457003 13033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26f3423d2a274defbf8568be672552c6"
dest_uuid: "72bec038394a426c84cce96b38303bc1"
 from {username='slave'} at 127.0.0.1:33962
I20260709 13:05:00.458125 13033 raft_consensus.cc:493] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.458515 13033 raft_consensus.cc:3060] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.459767 12959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de96c6d8fc641e8b472be1c3146c9a4" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e92b0579b8f94357b3044fdf31da0237" is_pre_election: true
I20260709 13:05:00.463897 13035 raft_consensus.cc:3060] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.461603 13267 consensus_queue.cc:1048] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.466660 13105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de96c6d8fc641e8b472be1c3146c9a4" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" is_pre_election: true
I20260709 13:05:00.467730 13105 raft_consensus.cc:2393] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72bec038394a426c84cce96b38303bc1 in current term 1: Already voted for candidate e92b0579b8f94357b3044fdf31da0237 in this term.
I20260709 13:05:00.468851 12999 leader_election.cc:304] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72bec038394a426c84cce96b38303bc1; no voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237
I20260709 13:05:00.469645 13306 leader_election.cc:290] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:05:00.474823 13033 raft_consensus.cc:515] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.478649 13033 leader_election.cc:290] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 2 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:05:00.482118 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3423d2a274defbf8568be672552c6" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:05:00.482782 13109 raft_consensus.cc:3060] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.484264 12959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26f3423d2a274defbf8568be672552c6" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:05:00.485031 12959 raft_consensus.cc:3055] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.485314 12959 raft_consensus.cc:740] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:05:00.486054 12959 consensus_queue.cc:260] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.488188 13304 raft_consensus.cc:993] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237: : Instructing follower 72bec038394a426c84cce96b38303bc1 to start an election
I20260709 13:05:00.488271 12959 raft_consensus.cc:3060] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.488592 13306 raft_consensus.cc:2749] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.488725 13304 raft_consensus.cc:1081] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Signalling peer 72bec038394a426c84cce96b38303bc1 to start an election
I20260709 13:05:00.489152 13310 consensus_queue.cc:1048] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.490881 13035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7745df522d2141839ea33987c1152bbf"
dest_uuid: "72bec038394a426c84cce96b38303bc1"
 from {username='slave'} at 127.0.0.1:33962
I20260709 13:05:00.491449 13035 raft_consensus.cc:493] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.491783 13035 raft_consensus.cc:3060] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.495221 13303 consensus_queue.cc:1048] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.498071 12959 raft_consensus.cc:2468] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 2.
I20260709 13:05:00.500896 13000 leader_election.cc:304] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:05:00.507192 13306 raft_consensus.cc:2804] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.507725 13035 raft_consensus.cc:515] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.508791 13306 raft_consensus.cc:697] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Becoming Leader. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:05:00.511020 13035 leader_election.cc:290] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 2 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:05:00.510911 13306 consensus_queue.cc:237] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.511904 12959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7745df522d2141839ea33987c1152bbf" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:05:00.511924 13107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7745df522d2141839ea33987c1152bbf" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:05:00.512566 12959 raft_consensus.cc:3055] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.512687 13107 raft_consensus.cc:3060] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.513000 12959 raft_consensus.cc:740] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:05:00.499655 13109 raft_consensus.cc:2468] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 2.
I20260709 13:05:00.513835 12959 consensus_queue.cc:260] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.515362 12959 raft_consensus.cc:3060] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.525624 13107 raft_consensus.cc:2468] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 2.
I20260709 13:05:00.532024 12999 leader_election.cc:304] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 
I20260709 13:05:00.532565 13303 raft_consensus.cc:993] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237: : Instructing follower 72bec038394a426c84cce96b38303bc1 to start an election
I20260709 13:05:00.532835 13280 raft_consensus.cc:2804] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.533087 13303 raft_consensus.cc:1081] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Signalling peer 72bec038394a426c84cce96b38303bc1 to start an election
I20260709 13:05:00.533443 13280 raft_consensus.cc:697] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Becoming Leader. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:05:00.534417 13280 consensus_queue.cc:237] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.537164 13032 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7af97695358401d9fc3b9cc89ec92c2"
dest_uuid: "72bec038394a426c84cce96b38303bc1"
 from {username='slave'} at 127.0.0.1:33962
I20260709 13:05:00.537832 13032 raft_consensus.cc:493] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.538239 13032 raft_consensus.cc:3060] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.537956 12858 catalog_manager.cc:5697] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 reported cstate change: term changed from 1 to 2, leader changed from e92b0579b8f94357b3044fdf31da0237 (127.0.107.193) to 72bec038394a426c84cce96b38303bc1 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "72bec038394a426c84cce96b38303bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.543272 13267 consensus_queue.cc:1048] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.548060 13032 raft_consensus.cc:515] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.549173 13034 raft_consensus.cc:1240] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Rejecting Update request from peer e92b0579b8f94357b3044fdf31da0237 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:00.555743 13267 consensus_queue.cc:1059] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.556851 13032 leader_election.cc:290] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 2 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:05:00.557126 13310 raft_consensus.cc:3055] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.557587 13310 raft_consensus.cc:740] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:05:00.558374 13310 consensus_queue.cc:260] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.559110 13106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7af97695358401d9fc3b9cc89ec92c2" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:05:00.559353 13310 raft_consensus.cc:3060] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.559141 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7af97695358401d9fc3b9cc89ec92c2" candidate_uuid: "72bec038394a426c84cce96b38303bc1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:05:00.561455 13288 raft_consensus.cc:993] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3: : Instructing follower e92b0579b8f94357b3044fdf31da0237 to start an election
I20260709 13:05:00.562011 13253 raft_consensus.cc:1081] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Signalling peer e92b0579b8f94357b3044fdf31da0237 to start an election
I20260709 13:05:00.563796 12957 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9f42b3009c248a4b07f601545875c3f"
dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
 from {username='slave'} at 127.0.0.1:42438
I20260709 13:05:00.564291 12957 raft_consensus.cc:493] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.564646 12957 raft_consensus.cc:3060] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.568954 12959 raft_consensus.cc:2468] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 2.
I20260709 13:05:00.577924 12960 raft_consensus.cc:2468] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72bec038394a426c84cce96b38303bc1 in term 2.
I20260709 13:05:00.581513 13000 leader_election.cc:304] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:05:00.582419 13306 raft_consensus.cc:2804] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.582890 13306 raft_consensus.cc:697] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Becoming Leader. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:05:00.581601 12957 raft_consensus.cc:515] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.583705 13306 consensus_queue.cc:237] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.586225 13032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f42b3009c248a4b07f601545875c3f" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:05:00.586817 13032 raft_consensus.cc:3060] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.588656 12858 catalog_manager.cc:5697] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 reported cstate change: term changed from 1 to 2, leader changed from e92b0579b8f94357b3044fdf31da0237 (127.0.107.193) to 72bec038394a426c84cce96b38303bc1 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "72bec038394a426c84cce96b38303bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.594594 13032 raft_consensus.cc:2468] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 2.
I20260709 13:05:00.601846 12924 leader_election.cc:304] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:05:00.601987 12957 leader_election.cc:290] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [CANDIDATE]: Term 2 election: Requested vote from peers 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751), d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195:41557)
I20260709 13:05:00.603741 13105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f42b3009c248a4b07f601545875c3f" candidate_uuid: "e92b0579b8f94357b3044fdf31da0237" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
I20260709 13:05:00.604286 13105 raft_consensus.cc:3055] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.604616 13105 raft_consensus.cc:740] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Running, Role: LEADER
I20260709 13:05:00.606492 13267 raft_consensus.cc:2804] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.607093 13267 raft_consensus.cc:697] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Becoming Leader. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:05:00.607959 13267 consensus_queue.cc:237] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.612557 12858 catalog_manager.cc:5697] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 reported cstate change: term changed from 1 to 2, leader changed from e92b0579b8f94357b3044fdf31da0237 (127.0.107.193) to 72bec038394a426c84cce96b38303bc1 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "72bec038394a426c84cce96b38303bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.605679 13105 consensus_queue.cc:260] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.618384 13105 raft_consensus.cc:3060] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.617097 12856 catalog_manager.cc:5697] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 reported cstate change: term changed from 1 to 2, leader changed from d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195) to e92b0579b8f94357b3044fdf31da0237 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e92b0579b8f94357b3044fdf31da0237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.627498 13105 raft_consensus.cc:2468] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b0579b8f94357b3044fdf31da0237 in term 2.
I20260709 13:05:00.765302 13301 raft_consensus.cc:993] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1: : Instructing follower d8c046fdca1e496fb8eb4ed1a5eb93c3 to start an election
I20260709 13:05:00.765817 13306 raft_consensus.cc:1081] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Signalling peer d8c046fdca1e496fb8eb4ed1a5eb93c3 to start an election
I20260709 13:05:00.767549 13105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "205f2dd19f4e4c9985d7e51dd1d7c922"
dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
 from {username='slave'} at 127.0.0.1:58956
I20260709 13:05:00.768170 13105 raft_consensus.cc:493] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.768558 13105 raft_consensus.cc:3060] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.776947 13105 raft_consensus.cc:515] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.779273 13105 leader_election.cc:290] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 2 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:05:00.780534 13032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f2dd19f4e4c9985d7e51dd1d7c922" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:05:00.780771 12960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f2dd19f4e4c9985d7e51dd1d7c922" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:05:00.781303 13032 raft_consensus.cc:3055] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.781452 12960 raft_consensus.cc:3060] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.781704 13032 raft_consensus.cc:740] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:05:00.782650 13032 consensus_queue.cc:260] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.784219 13032 raft_consensus.cc:3060] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.789623 12960 raft_consensus.cc:2468] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 2.
I20260709 13:05:00.791219 13074 leader_election.cc:304] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:05:00.791735 13032 raft_consensus.cc:2468] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 2.
I20260709 13:05:00.792150 13253 raft_consensus.cc:2804] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.792728 13253 raft_consensus.cc:697] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 LEADER]: Becoming Leader. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Running, Role: LEADER
I20260709 13:05:00.793566 13253 consensus_queue.cc:237] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:00.803470 12856 catalog_manager.cc:5697] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 reported cstate change: term changed from 1 to 2, leader changed from 72bec038394a426c84cce96b38303bc1 (127.0.107.194) to d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.920627 13105 raft_consensus.cc:1275] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Refusing update from remote peer e92b0579b8f94357b3044fdf31da0237: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.922623 13303 consensus_queue.cc:1048] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.936198 13032 raft_consensus.cc:3060] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.946699 13032 raft_consensus.cc:1275] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Refusing update from remote peer e92b0579b8f94357b3044fdf31da0237: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.948521 13303 consensus_queue.cc:1048] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.986478 13107 raft_consensus.cc:3060] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.994436 13107 raft_consensus.cc:1275] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Refusing update from remote peer 72bec038394a426c84cce96b38303bc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.995750 13301 consensus_queue.cc:1048] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:01.004526 12960 raft_consensus.cc:1275] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Refusing update from remote peer 72bec038394a426c84cce96b38303bc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.006542 13306 consensus_queue.cc:1048] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.025462 13107 raft_consensus.cc:1275] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Refusing update from remote peer 72bec038394a426c84cce96b38303bc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.027175 13306 consensus_queue.cc:1048] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.034695 13107 raft_consensus.cc:1275] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Refusing update from remote peer e92b0579b8f94357b3044fdf31da0237: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.048607 13304 consensus_queue.cc:1048] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.051699 12960 raft_consensus.cc:1275] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Refusing update from remote peer 72bec038394a426c84cce96b38303bc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.070780 13301 consensus_queue.cc:1048] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.072775 13032 raft_consensus.cc:1275] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Refusing update from remote peer e92b0579b8f94357b3044fdf31da0237: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.074517 13303 consensus_queue.cc:1048] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.093132 12960 raft_consensus.cc:1275] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Refusing update from remote peer 72bec038394a426c84cce96b38303bc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.094676 13301 consensus_queue.cc:1048] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.105881 13105 raft_consensus.cc:1275] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Refusing update from remote peer 72bec038394a426c84cce96b38303bc1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.108144 13341 consensus_queue.cc:1048] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.250314 13032 raft_consensus.cc:1275] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Refusing update from remote peer d8c046fdca1e496fb8eb4ed1a5eb93c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.251591 13253 consensus_queue.cc:1048] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.260313 12957 raft_consensus.cc:1275] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Refusing update from remote peer d8c046fdca1e496fb8eb4ed1a5eb93c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.261979 13343 consensus_queue.cc:1048] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.362601 12855 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41794:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:05:03.382944 12855 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41794:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:05:03.439910   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:05:03.575464 12924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41557, user_credentials={real_user=slave}} blocked reactor thread for 57512.9us
W20260709 13:05:03.630008 13378 log.cc:927] Time spent T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:05:03.663331 12924 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:41557, user_credentials={real_user=slave}} blocked reactor thread for 48582.9us
I20260709 13:05:03.717967 12955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54e25603685841bf89ce1e8c78bddf60"
dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
mode: GRACEFUL
new_leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
 from {username='slave'} at 127.0.0.1:55280
I20260709 13:05:03.644173 13393 tablet.cc:1724] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.719125 12955 raft_consensus.cc:606] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Received request to transfer leadership to TS d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:05:03.663951 13400 tablet.cc:1724] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.733330 13407 tablet.cc:1724] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:03.740744 13402 log.cc:927] Time spent T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:05:03.793283 13397 log.cc:927] Time spent T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:05:03.792663 13410 tablet.cc:1724] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.792877 13411 tablet.cc:1724] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.730114 13406 tablet.cc:1724] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.800611 13409 tablet.cc:1724] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.822640 13412 tablet.cc:1724] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.827705 13413 tablet.cc:1724] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.863445 13383 raft_consensus.cc:993] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237: : Instructing follower d8c046fdca1e496fb8eb4ed1a5eb93c3 to start an election
I20260709 13:05:03.864045 13383 raft_consensus.cc:1081] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Signalling peer d8c046fdca1e496fb8eb4ed1a5eb93c3 to start an election
I20260709 13:05:03.866458 13400 tablet.cc:1724] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.880548 13105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54e25603685841bf89ce1e8c78bddf60"
dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
 from {username='slave'} at 127.0.0.1:58950
I20260709 13:05:03.881558 13105 raft_consensus.cc:493] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.882117 13105 raft_consensus.cc:3060] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.899667 13414 tablet.cc:1724] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.897351 13406 tablet.cc:1724] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.930927 13393 tablet.cc:1724] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.934152 13415 tablet.cc:1724] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.941277 13413 tablet.cc:1724] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.946889 13417 tablet.cc:1724] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.947782 13393 tablet.cc:1724] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.953089 13410 tablet.cc:1724] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.956053 13407 tablet.cc:1724] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.969378 13410 tablet.cc:1724] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.971123 13414 tablet.cc:1724] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.973237 13033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9c7183598204f2d98da018065caef29"
dest_uuid: "72bec038394a426c84cce96b38303bc1"
mode: GRACEFUL
new_leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:05:03.973881 13033 raft_consensus.cc:606] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Received request to transfer leadership to TS d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:05:03.953815 13105 raft_consensus.cc:515] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:03.984215   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:05:03.984946   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:03.979058 13409 tablet.cc:1724] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.989290 13411 tablet.cc:1724] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:03.996034 13406 tablet.cc:1724] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:04.001284 13411 tablet.cc:1724] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:04.011161 13105 leader_election.cc:290] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 3 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:05:04.014014 13400 tablet.cc:1724] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:04.019800 13033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0"
dest_uuid: "72bec038394a426c84cce96b38303bc1"
mode: GRACEFUL
new_leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:05:04.020510 12958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e25603685841bf89ce1e8c78bddf60" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:05:04.020524 13033 raft_consensus.cc:606] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Received request to transfer leadership to TS d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:05:04.021188 12958 raft_consensus.cc:3055] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:04.021533 12958 raft_consensus.cc:740] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:05:04.022410 12958 consensus_queue.cc:260] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:04.023839 12958 raft_consensus.cc:3060] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.023917 13415 tablet.cc:1724] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:04.026499 13032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54e25603685841bf89ce1e8c78bddf60" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:05:04.027019 12955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e19c33830544651b79096f802e2ab27"
dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
mode: GRACEFUL
new_leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
 from {username='slave'} at 127.0.0.1:55280
I20260709 13:05:04.027211 13032 raft_consensus.cc:3060] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.027685 12955 raft_consensus.cc:606] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Received request to transfer leadership to TS d8c046fdca1e496fb8eb4ed1a5eb93c3
I20260709 13:05:04.031852   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:04.032518   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:04.045018 13032 raft_consensus.cc:2468] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 3.
I20260709 13:05:04.049598 13073 leader_election.cc:304] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 
I20260709 13:05:04.051007 13384 raft_consensus.cc:2804] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:04.051544 13384 raft_consensus.cc:697] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 LEADER]: Becoming Leader. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Running, Role: LEADER
I20260709 13:05:04.052384 13384 consensus_queue.cc:237] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:04.053472 12958 raft_consensus.cc:2468] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 3.
I20260709 13:05:04.068461 12858 catalog_manager.cc:5697] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 reported cstate change: term changed from 2 to 3, leader changed from e92b0579b8f94357b3044fdf31da0237 (127.0.107.193) to d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:04.076555 12856 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8: soft_deleted_table [id=cf24eb65eb06400796b7c473a98b80f6] alter complete (version 1)
I20260709 13:05:04.249868 13347 raft_consensus.cc:993] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237: : Instructing follower d8c046fdca1e496fb8eb4ed1a5eb93c3 to start an election
I20260709 13:05:04.250412 13391 raft_consensus.cc:1081] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Signalling peer d8c046fdca1e496fb8eb4ed1a5eb93c3 to start an election
I20260709 13:05:04.251802 13105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e19c33830544651b79096f802e2ab27"
dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
 from {username='slave'} at 127.0.0.1:58950
I20260709 13:05:04.252297 13105 raft_consensus.cc:493] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.252610 13105 raft_consensus.cc:3060] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.257568 13105 raft_consensus.cc:515] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:04.259205 13105 leader_election.cc:290] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 3 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:05:04.260084 12958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e19c33830544651b79096f802e2ab27" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:05:04.260205 13032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e19c33830544651b79096f802e2ab27" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:05:04.260823 12958 raft_consensus.cc:3055] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:04.260942 13032 raft_consensus.cc:3060] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.261132 12958 raft_consensus.cc:740] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e92b0579b8f94357b3044fdf31da0237, State: Running, Role: LEADER
I20260709 13:05:04.261956 12958 consensus_queue.cc:260] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:04.263013 12958 raft_consensus.cc:3060] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.266775 13032 raft_consensus.cc:2468] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 3.
I20260709 13:05:04.268024 13073 leader_election.cc:304] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 72bec038394a426c84cce96b38303bc1, d8c046fdca1e496fb8eb4ed1a5eb93c3; no voters: 
I20260709 13:05:04.268397 12958 raft_consensus.cc:2468] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 3.
I20260709 13:05:04.268764 13384 raft_consensus.cc:2804] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:04.269310 13384 raft_consensus.cc:697] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 LEADER]: Becoming Leader. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Running, Role: LEADER
I20260709 13:05:04.270205 13384 consensus_queue.cc:237] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:04.284251 12858 catalog_manager.cc:5697] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 reported cstate change: term changed from 2 to 3, leader changed from e92b0579b8f94357b3044fdf31da0237 (127.0.107.193) to d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:04.421043 13374 raft_consensus.cc:993] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1: : Instructing follower d8c046fdca1e496fb8eb4ed1a5eb93c3 to start an election
I20260709 13:05:04.421553 13346 raft_consensus.cc:1081] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Signalling peer d8c046fdca1e496fb8eb4ed1a5eb93c3 to start an election
I20260709 13:05:04.423022 13105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9c7183598204f2d98da018065caef29"
dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
 from {username='slave'} at 127.0.0.1:58956
I20260709 13:05:04.423458 13105 raft_consensus.cc:493] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.423712 13105 raft_consensus.cc:3060] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.430599 13105 raft_consensus.cc:515] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:04.432802 13105 leader_election.cc:290] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 2 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:05:04.433238 12958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c7183598204f2d98da018065caef29" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:05:04.433347 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9c7183598204f2d98da018065caef29" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:05:04.433936 12958 raft_consensus.cc:3060] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.433995 13033 raft_consensus.cc:3055] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:04.434499 13033 raft_consensus.cc:740] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:05:04.435141 13033 consensus_queue.cc:260] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:04.436072 13033 raft_consensus.cc:3060] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.439294 12958 raft_consensus.cc:2468] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 2.
I20260709 13:05:04.440325 13074 leader_election.cc:304] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:05:04.441133 13384 raft_consensus.cc:2804] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:04.441607 13384 raft_consensus.cc:697] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 LEADER]: Becoming Leader. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Running, Role: LEADER
I20260709 13:05:04.442173 13033 raft_consensus.cc:2468] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 2.
I20260709 13:05:04.442476 13384 consensus_queue.cc:237] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:04.449183 12858 catalog_manager.cc:5697] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 reported cstate change: term changed from 1 to 2, leader changed from 72bec038394a426c84cce96b38303bc1 (127.0.107.194) to d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:04.461283 13374 raft_consensus.cc:993] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1: : Instructing follower d8c046fdca1e496fb8eb4ed1a5eb93c3 to start an election
I20260709 13:05:04.461692 13346 raft_consensus.cc:1081] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Signalling peer d8c046fdca1e496fb8eb4ed1a5eb93c3 to start an election
I20260709 13:05:04.463164 13105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0"
dest_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3"
 from {username='slave'} at 127.0.0.1:58956
I20260709 13:05:04.463629 13105 raft_consensus.cc:493] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.463909 13105 raft_consensus.cc:3060] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.468801 13105 raft_consensus.cc:515] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:04.470501 13105 leader_election.cc:290] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 3 election: Requested vote from peers e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287), 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751)
I20260709 13:05:04.471143 12958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e92b0579b8f94357b3044fdf31da0237"
I20260709 13:05:04.471527 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4f4c4de0d548319dff3a2fae108ad0" candidate_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "72bec038394a426c84cce96b38303bc1"
I20260709 13:05:04.471747 12958 raft_consensus.cc:3060] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.472134 13033 raft_consensus.cc:3055] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:04.472434 13033 raft_consensus.cc:740] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72bec038394a426c84cce96b38303bc1, State: Running, Role: LEADER
I20260709 13:05:04.473111 13033 consensus_queue.cc:260] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:04.474103 13033 raft_consensus.cc:3060] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.477504 12958 raft_consensus.cc:2468] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 3.
I20260709 13:05:04.478734 13074 leader_election.cc:304] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d8c046fdca1e496fb8eb4ed1a5eb93c3, e92b0579b8f94357b3044fdf31da0237; no voters: 
I20260709 13:05:04.479672 13384 raft_consensus.cc:2804] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:04.480173 13384 raft_consensus.cc:697] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 LEADER]: Becoming Leader. State: Replica: d8c046fdca1e496fb8eb4ed1a5eb93c3, State: Running, Role: LEADER
I20260709 13:05:04.480394 13033 raft_consensus.cc:2468] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8c046fdca1e496fb8eb4ed1a5eb93c3 in term 3.
I20260709 13:05:04.481024 13384 consensus_queue.cc:237] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } }
I20260709 13:05:04.488866 12858 catalog_manager.cc:5697] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 reported cstate change: term changed from 2 to 3, leader changed from 72bec038394a426c84cce96b38303bc1 (127.0.107.194) to d8c046fdca1e496fb8eb4ed1a5eb93c3 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8c046fdca1e496fb8eb4ed1a5eb93c3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41557 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:04.579125 12958 raft_consensus.cc:1275] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 3 FOLLOWER]: Refusing update from remote peer d8c046fdca1e496fb8eb4ed1a5eb93c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:04.580322 13384 consensus_queue.cc:1048] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:04.589648 13033 raft_consensus.cc:1275] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1 [term 3 FOLLOWER]: Refusing update from remote peer d8c046fdca1e496fb8eb4ed1a5eb93c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:04.591364 13384 consensus_queue.cc:1048] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:04.787041 12958 raft_consensus.cc:1275] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 3 FOLLOWER]: Refusing update from remote peer d8c046fdca1e496fb8eb4ed1a5eb93c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:04.788352 13384 consensus_queue.cc:1048] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:04.792030 13033 raft_consensus.cc:1275] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 3 FOLLOWER]: Refusing update from remote peer d8c046fdca1e496fb8eb4ed1a5eb93c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:04.793751 13384 consensus_queue.cc:1048] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:04.893213 13033 raft_consensus.cc:1275] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 3 FOLLOWER]: Refusing update from remote peer d8c046fdca1e496fb8eb4ed1a5eb93c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:04.894620 13384 consensus_queue.cc:1048] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:04.903618 12958 raft_consensus.cc:1275] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 3 FOLLOWER]: Refusing update from remote peer d8c046fdca1e496fb8eb4ed1a5eb93c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:04.906296 13428 consensus_queue.cc:1048] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:05.001827 12958 raft_consensus.cc:1275] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Refusing update from remote peer d8c046fdca1e496fb8eb4ed1a5eb93c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:05.003937 13428 consensus_queue.cc:1048] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e92b0579b8f94357b3044fdf31da0237" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:05.015682 13033 raft_consensus.cc:1275] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Refusing update from remote peer d8c046fdca1e496fb8eb4ed1a5eb93c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:05.021140 13384 consensus_queue.cc:1048] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72bec038394a426c84cce96b38303bc1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:05.095958   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:05:05.100932   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:05:05.101409   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:05.106258   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:05:05.106666   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:06.137666   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:05:06.166772 13074 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 13:05:06.167392   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:06.168540   431 tablet_replica.cc:333] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.169379   431 raft_consensus.cc:2243] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.169982   431 raft_consensus.cc:2272] T 26f3423d2a274defbf8568be672552c6 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:06.170369 13074 consensus_peers.cc:597] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 -> Peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Couldn't send request to peer e92b0579b8f94357b3044fdf31da0237. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.172262   431 tablet_replica.cc:333] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.173048   431 raft_consensus.cc:2243] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.173501   431 raft_consensus.cc:2272] T 205f2dd19f4e4c9985d7e51dd1d7c922 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.175594   431 tablet_replica.cc:333] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.176177   431 raft_consensus.cc:2243] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.176604   431 raft_consensus.cc:2272] T 7745df522d2141839ea33987c1152bbf P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.178690   431 tablet_replica.cc:333] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.179425   431 raft_consensus.cc:2243] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.180225   431 raft_consensus.cc:2272] T 450fa7305c554a31a729542706090034 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.182458   431 tablet_replica.cc:333] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.183085   431 raft_consensus.cc:2243] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:06.183434 13000 consensus_peers.cc:597] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 -> Peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Couldn't send request to peer e92b0579b8f94357b3044fdf31da0237. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.183941   431 raft_consensus.cc:2272] T d9f42b3009c248a4b07f601545875c3f P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.186178   431 tablet_replica.cc:333] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.186890   431 raft_consensus.cc:2243] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.187371   431 raft_consensus.cc:2272] T b7af97695358401d9fc3b9cc89ec92c2 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.189414   431 tablet_replica.cc:333] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.190114   431 raft_consensus.cc:2243] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.190649   431 raft_consensus.cc:2272] T 18607ea39bb34537bce328b2f38349a6 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.192970   431 tablet_replica.cc:333] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.193559   431 raft_consensus.cc:2243] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.194080   431 raft_consensus.cc:2272] T a9c7183598204f2d98da018065caef29 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.195940   431 tablet_replica.cc:333] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.196688   431 raft_consensus.cc:2243] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.197192   431 raft_consensus.cc:2272] T 1f4f4c4de0d548319dff3a2fae108ad0 P e92b0579b8f94357b3044fdf31da0237 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.199312   431 tablet_replica.cc:333] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.199896   431 raft_consensus.cc:2243] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.200344   431 raft_consensus.cc:2272] T 3e19c33830544651b79096f802e2ab27 P e92b0579b8f94357b3044fdf31da0237 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.202605   431 tablet_replica.cc:333] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.203264   431 raft_consensus.cc:2243] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.203753   431 raft_consensus.cc:2272] T 51e50340e84f48fb9e487a88c3bc584f P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.206115   431 tablet_replica.cc:333] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.206925   431 raft_consensus.cc:2243] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.207535   431 raft_consensus.cc:2272] T 148102b2bce741609ec0150acefc71de P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.210903   431 tablet_replica.cc:333] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.211544   431 raft_consensus.cc:2243] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.212059   431 raft_consensus.cc:2272] T 54e25603685841bf89ce1e8c78bddf60 P e92b0579b8f94357b3044fdf31da0237 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.213973   431 tablet_replica.cc:333] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.214577   431 raft_consensus.cc:2243] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.215430   431 raft_consensus.cc:2272] T 2614aad4af86416faef66125e8f51c1d P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.217691   431 tablet_replica.cc:333] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.218345   431 raft_consensus.cc:2243] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.219159   431 raft_consensus.cc:2272] T 8de96c6d8fc641e8b472be1c3146c9a4 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.221114   431 tablet_replica.cc:333] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.221685   431 raft_consensus.cc:2243] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.222191   431 raft_consensus.cc:2272] T 86afd0d3921f423c84482aee647f459a P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.224278   431 tablet_replica.cc:333] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.224829   431 raft_consensus.cc:2243] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.225688   431 raft_consensus.cc:2272] T 857e7dd3fb21456ca68c71a481dd2f17 P e92b0579b8f94357b3044fdf31da0237 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.228112   431 tablet_replica.cc:333] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237: stopping tablet replica
I20260709 13:05:06.228618   431 raft_consensus.cc:2243] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.229426   431 raft_consensus.cc:2272] T 372857e85f894e04aede32b1b4ce5c10 P e92b0579b8f94357b3044fdf31da0237 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:06.274343 13074 consensus_peers.cc:597] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 -> Peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Couldn't send request to peer e92b0579b8f94357b3044fdf31da0237. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:06.274955 13074 consensus_peers.cc:597] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 -> Peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Couldn't send request to peer e92b0579b8f94357b3044fdf31da0237. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.296173   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:05:06.304647 13000 consensus_peers.cc:597] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 -> Peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Couldn't send request to peer e92b0579b8f94357b3044fdf31da0237. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:06.305086 13074 consensus_peers.cc:597] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 -> Peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Couldn't send request to peer e92b0579b8f94357b3044fdf31da0237. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:06.309336 13000 consensus_peers.cc:597] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 -> Peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Couldn't send request to peer e92b0579b8f94357b3044fdf31da0237. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.330430   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:05:06.360175   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:06.361017   431 tablet_replica.cc:333] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.361658   431 raft_consensus.cc:2243] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.362632   431 raft_consensus.cc:2272] T 26f3423d2a274defbf8568be672552c6 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.364627   431 tablet_replica.cc:333] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.365265   431 raft_consensus.cc:2243] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.365733   431 raft_consensus.cc:2272] T d9f42b3009c248a4b07f601545875c3f P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.367596   431 tablet_replica.cc:333] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.368148   431 raft_consensus.cc:2243] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.368607   431 raft_consensus.cc:2272] T 450fa7305c554a31a729542706090034 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.370405   431 tablet_replica.cc:333] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.370937   431 raft_consensus.cc:2243] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.371698   431 raft_consensus.cc:2272] T 7745df522d2141839ea33987c1152bbf P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.373625   431 tablet_replica.cc:333] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.374265   431 raft_consensus.cc:2243] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.375087   431 raft_consensus.cc:2272] T b7af97695358401d9fc3b9cc89ec92c2 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.376840   431 tablet_replica.cc:333] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.377403   431 raft_consensus.cc:2243] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.377856   431 raft_consensus.cc:2272] T 18607ea39bb34537bce328b2f38349a6 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.379978   431 tablet_replica.cc:333] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.380666   431 raft_consensus.cc:2243] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.381117   431 raft_consensus.cc:2272] T 3e19c33830544651b79096f802e2ab27 P 72bec038394a426c84cce96b38303bc1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.383152   431 tablet_replica.cc:333] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.383672   431 raft_consensus.cc:2243] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.384518   431 raft_consensus.cc:2272] T 51e50340e84f48fb9e487a88c3bc584f P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.386656   431 tablet_replica.cc:333] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.387202   431 raft_consensus.cc:2243] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.387616   431 raft_consensus.cc:2272] T a9c7183598204f2d98da018065caef29 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.389277   431 tablet_replica.cc:333] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.389812   431 raft_consensus.cc:2243] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.390245   431 raft_consensus.cc:2272] T 1f4f4c4de0d548319dff3a2fae108ad0 P 72bec038394a426c84cce96b38303bc1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.392107   431 tablet_replica.cc:333] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.392620   431 raft_consensus.cc:2243] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.393019   431 raft_consensus.cc:2272] T 54e25603685841bf89ce1e8c78bddf60 P 72bec038394a426c84cce96b38303bc1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.394755   431 tablet_replica.cc:333] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.395279   431 raft_consensus.cc:2243] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.395685   431 raft_consensus.cc:2272] T 2614aad4af86416faef66125e8f51c1d P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.397541   431 tablet_replica.cc:333] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.398101   431 raft_consensus.cc:2243] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.398880   431 raft_consensus.cc:2272] T 148102b2bce741609ec0150acefc71de P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.400871   431 tablet_replica.cc:333] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.401598   431 raft_consensus.cc:2243] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.402176   431 raft_consensus.cc:2272] T 372857e85f894e04aede32b1b4ce5c10 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.404927   431 tablet_replica.cc:333] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
W20260709 13:05:06.404945 13073 consensus_peers.cc:597] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 -> Peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Couldn't send request to peer 72bec038394a426c84cce96b38303bc1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.405566   431 raft_consensus.cc:2243] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.406061   431 raft_consensus.cc:2272] T 205f2dd19f4e4c9985d7e51dd1d7c922 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.407821   431 tablet_replica.cc:333] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.408336   431 raft_consensus.cc:2243] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.408757   431 raft_consensus.cc:2272] T 8de96c6d8fc641e8b472be1c3146c9a4 P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.410544   431 tablet_replica.cc:333] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.411098   431 raft_consensus.cc:2243] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.411854   431 raft_consensus.cc:2272] T 86afd0d3921f423c84482aee647f459a P 72bec038394a426c84cce96b38303bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.413722   431 tablet_replica.cc:333] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1: stopping tablet replica
I20260709 13:05:06.414212   431 raft_consensus.cc:2243] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.414636   431 raft_consensus.cc:2272] T 857e7dd3fb21456ca68c71a481dd2f17 P 72bec038394a426c84cce96b38303bc1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.442446   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:05:06.451448 13073 consensus_peers.cc:597] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 -> Peer 72bec038394a426c84cce96b38303bc1 (127.0.107.194:39751): Couldn't send request to peer 72bec038394a426c84cce96b38303bc1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.473623   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:05:06.486685 13074 consensus_peers.cc:597] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 -> Peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Couldn't send request to peer e92b0579b8f94357b3044fdf31da0237. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.506666   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:06.507496   431 tablet_replica.cc:333] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.508159   431 raft_consensus.cc:2243] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.508709   431 raft_consensus.cc:2272] T 26f3423d2a274defbf8568be672552c6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.510903   431 tablet_replica.cc:333] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.511521   431 raft_consensus.cc:2243] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.512351   431 raft_consensus.cc:2272] T 205f2dd19f4e4c9985d7e51dd1d7c922 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.514472   431 tablet_replica.cc:333] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.515120   431 raft_consensus.cc:2243] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.515609   431 raft_consensus.cc:2272] T d9f42b3009c248a4b07f601545875c3f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.517495   431 tablet_replica.cc:333] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.518193   431 raft_consensus.cc:2243] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.518653   431 raft_consensus.cc:2272] T 7745df522d2141839ea33987c1152bbf P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.520591   431 tablet_replica.cc:333] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.521179   431 raft_consensus.cc:2243] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.521749   431 raft_consensus.cc:2272] T 450fa7305c554a31a729542706090034 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.524439   431 tablet_replica.cc:333] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.525352   431 raft_consensus.cc:2243] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.526419   431 raft_consensus.cc:2272] T a9c7183598204f2d98da018065caef29 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:06.526458 13074 consensus_peers.cc:597] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 -> Peer e92b0579b8f94357b3044fdf31da0237 (127.0.107.193:38287): Couldn't send request to peer e92b0579b8f94357b3044fdf31da0237. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:06.528379   431 tablet_replica.cc:333] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.528968   431 raft_consensus.cc:2243] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.529727   431 raft_consensus.cc:2272] T 1f4f4c4de0d548319dff3a2fae108ad0 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.531781   431 tablet_replica.cc:333] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.532320   431 raft_consensus.cc:2243] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.532749   431 raft_consensus.cc:2272] T 372857e85f894e04aede32b1b4ce5c10 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.534801   431 tablet_replica.cc:333] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.535346   431 raft_consensus.cc:2243] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.535768   431 raft_consensus.cc:2272] T 51e50340e84f48fb9e487a88c3bc584f P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.537637   431 tablet_replica.cc:333] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.538457   431 raft_consensus.cc:2243] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.539326   431 raft_consensus.cc:2272] T 3e19c33830544651b79096f802e2ab27 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.541301   431 tablet_replica.cc:333] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.541842   431 raft_consensus.cc:2243] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.542302   431 raft_consensus.cc:2272] T 148102b2bce741609ec0150acefc71de P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.544391   431 tablet_replica.cc:333] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.544942   431 raft_consensus.cc:2243] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.545751   431 raft_consensus.cc:2272] T 54e25603685841bf89ce1e8c78bddf60 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.547653   431 tablet_replica.cc:333] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.548213   431 raft_consensus.cc:2243] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.548677   431 raft_consensus.cc:2272] T 2614aad4af86416faef66125e8f51c1d P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.550601   431 tablet_replica.cc:333] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.551134   431 raft_consensus.cc:2243] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.551560   431 raft_consensus.cc:2272] T b7af97695358401d9fc3b9cc89ec92c2 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.553280   431 tablet_replica.cc:333] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.553807   431 raft_consensus.cc:2243] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.554625   431 raft_consensus.cc:2272] T 18607ea39bb34537bce328b2f38349a6 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.556704   431 tablet_replica.cc:333] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.557245   431 raft_consensus.cc:2243] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.557686   431 raft_consensus.cc:2272] T 857e7dd3fb21456ca68c71a481dd2f17 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.559962   431 tablet_replica.cc:333] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.560496   431 raft_consensus.cc:2243] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.560945   431 raft_consensus.cc:2272] T 8de96c6d8fc641e8b472be1c3146c9a4 P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.562840   431 tablet_replica.cc:333] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3: stopping tablet replica
I20260709 13:05:06.563346   431 raft_consensus.cc:2243] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.563787   431 raft_consensus.cc:2272] T 86afd0d3921f423c84482aee647f459a P d8c046fdca1e496fb8eb4ed1a5eb93c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.604344   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:05:06.638171   431 master.cc:562] Master@127.0.107.254:32827 shutting down...
I20260709 13:05:06.661181   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:06.661734   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.662127   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 452e43f5b02f478da9eb516ec03671f8: stopping tablet replica
I20260709 13:05:06.682823   431 master.cc:584] Master@127.0.107.254:32827 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13181 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:05:06.737589   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:36473
I20260709 13:05:06.738827   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:06.744773 13444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.745009 13443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.745779 13446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:06.746557   431 server_base.cc:1061] running on GCE node
I20260709 13:05:06.747498   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:06.747720   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:06.747881   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602306747865 us; error 0 us; skew 500 ppm
I20260709 13:05:06.748399   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:06.750840   431 webserver.cc:533] Webserver started at http://127.0.107.254:40337/ using document root <none> and password file <none>
I20260709 13:05:06.751377   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:06.751595   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:06.751879   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:06.752988   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/master-0-root/instance:
uuid: "60eb7424d9e24f098cc6467d3b0fbf53"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-nr1f"
I20260709 13:05:06.757457   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:05:06.760908 13451 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:06.761682   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:06.762122   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/master-0-root
uuid: "60eb7424d9e24f098cc6467d3b0fbf53"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-nr1f"
I20260709 13:05:06.762395   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:06.778551   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:06.779811   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:06.819020   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:36473
I20260709 13:05:06.819211 13502 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:36473 every 8 connection(s)
I20260709 13:05:06.823398 13503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:06.835287 13503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53: Bootstrap starting.
I20260709 13:05:06.840278 13503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:06.844772 13503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53: No bootstrap required, opened a new log
I20260709 13:05:06.847029 13503 raft_consensus.cc:359] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60eb7424d9e24f098cc6467d3b0fbf53" member_type: VOTER }
I20260709 13:05:06.847448 13503 raft_consensus.cc:385] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:06.847680 13503 raft_consensus.cc:740] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60eb7424d9e24f098cc6467d3b0fbf53, State: Initialized, Role: FOLLOWER
I20260709 13:05:06.848269 13503 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60eb7424d9e24f098cc6467d3b0fbf53" member_type: VOTER }
I20260709 13:05:06.848734 13503 raft_consensus.cc:399] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:06.848958 13503 raft_consensus.cc:493] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:06.849242 13503 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:06.854141 13503 raft_consensus.cc:515] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60eb7424d9e24f098cc6467d3b0fbf53" member_type: VOTER }
I20260709 13:05:06.854691 13503 leader_election.cc:304] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60eb7424d9e24f098cc6467d3b0fbf53; no voters: 
I20260709 13:05:06.855820 13503 leader_election.cc:290] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:06.856200 13506 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:06.857582 13506 raft_consensus.cc:697] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [term 1 LEADER]: Becoming Leader. State: Replica: 60eb7424d9e24f098cc6467d3b0fbf53, State: Running, Role: LEADER
I20260709 13:05:06.858289 13506 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60eb7424d9e24f098cc6467d3b0fbf53" member_type: VOTER }
I20260709 13:05:06.858760 13503 sys_catalog.cc:565] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:06.863142 13508 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60eb7424d9e24f098cc6467d3b0fbf53. Latest consensus state: current_term: 1 leader_uuid: "60eb7424d9e24f098cc6467d3b0fbf53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60eb7424d9e24f098cc6467d3b0fbf53" member_type: VOTER } }
I20260709 13:05:06.863936 13508 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:06.865358 13507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60eb7424d9e24f098cc6467d3b0fbf53" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60eb7424d9e24f098cc6467d3b0fbf53" member_type: VOTER } }
I20260709 13:05:06.865964 13514 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:06.866011 13507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:06.871163 13514 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:06.874815   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:06.880221 13514 catalog_manager.cc:1383] Generated new cluster ID: 8b38bb0857f64c66b850e5a06c304dfb
I20260709 13:05:06.880453 13514 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:06.910981 13514 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:06.912268 13514 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:06.933838 13514 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53: Generated new TSK 0
I20260709 13:05:06.934508 13514 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:06.941708   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:06.948345 13524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:06.949301 13525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:06.951327   431 server_base.cc:1061] running on GCE node
W20260709 13:05:06.952026 13527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:06.952960   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:06.953184   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:06.953395   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602306953377 us; error 0 us; skew 500 ppm
I20260709 13:05:06.953912   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:06.956105   431 webserver.cc:533] Webserver started at http://127.0.107.193:38623/ using document root <none> and password file <none>
I20260709 13:05:06.956637   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:06.956847   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:06.957129   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:06.958240   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-0-root/instance:
uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-nr1f"
I20260709 13:05:06.963008   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:06.966600 13532 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:06.967406   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:06.967715   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-0-root
uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
format_stamp: "Formatted at 2026-07-09 13:05:06 on dist-test-slave-nr1f"
I20260709 13:05:06.968003   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:06.996433   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:06.997654   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:06.999137   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:07.001380   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:07.001607   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.001859   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:07.002077   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:07.046406   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34503
I20260709 13:05:07.046519 13594 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34503 every 8 connection(s)
I20260709 13:05:07.051559   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:07.058799 13599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.059233 13600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.062490 13602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.063532   431 server_base.cc:1061] running on GCE node
I20260709 13:05:07.064706   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:07.064935 13595 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36473
W20260709 13:05:07.064960   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:07.065361   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602307065341 us; error 0 us; skew 500 ppm
I20260709 13:05:07.065426 13595 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:07.066008   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:07.066357 13595 heartbeater.cc:507] Master 127.0.107.254:36473 requested a full tablet report, sending...
I20260709 13:05:07.068835 13468 ts_manager.cc:194] Registered new tserver with Master: 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503)
I20260709 13:05:07.068964   431 webserver.cc:533] Webserver started at http://127.0.107.194:44095/ using document root <none> and password file <none>
I20260709 13:05:07.069684   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:07.069909   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:07.070236   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:07.070897 13468 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57212
I20260709 13:05:07.071360   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-1-root/instance:
uuid: "c87b1b6aa93e412797a928d4d1e15361"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-nr1f"
I20260709 13:05:07.076328   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:05:07.079803 13607 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.080721   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:07.080983   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-1-root
uuid: "c87b1b6aa93e412797a928d4d1e15361"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-nr1f"
I20260709 13:05:07.081260   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:07.099954   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:07.101132   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:07.102648   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:07.104884   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:07.105068   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.105365   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:07.105499   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.144740   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:34745
I20260709 13:05:07.144850 13669 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:34745 every 8 connection(s)
I20260709 13:05:07.149556   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:07.156016 13673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:07.156795 13674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.160401   431 server_base.cc:1061] running on GCE node
W20260709 13:05:07.161542 13677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:07.162403 13670 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36473
I20260709 13:05:07.162693   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:07.162849 13670 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:07.163012   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:07.163337   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602307163321 us; error 0 us; skew 500 ppm
I20260709 13:05:07.163924 13670 heartbeater.cc:507] Master 127.0.107.254:36473 requested a full tablet report, sending...
I20260709 13:05:07.163971   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:07.166288 13468 ts_manager.cc:194] Registered new tserver with Master: c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:07.166917   431 webserver.cc:533] Webserver started at http://127.0.107.195:38023/ using document root <none> and password file <none>
I20260709 13:05:07.167454   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:07.167665   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:07.167829 13468 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57224
I20260709 13:05:07.167925   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:07.169469   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-2-root/instance:
uuid: "6cd14a97d8474cd697f65afab7060d9e"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-nr1f"
I20260709 13:05:07.173900   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:05:07.177361 13681 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.178193   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:07.178493   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-2-root
uuid: "6cd14a97d8474cd697f65afab7060d9e"
format_stamp: "Formatted at 2026-07-09 13:05:07 on dist-test-slave-nr1f"
I20260709 13:05:07.178804   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbZZDG1/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601903731679-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:07.190981   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:07.192202   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:07.193660   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:07.196095   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:07.196331   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.196576   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:07.196749   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:07.235195   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:33885
I20260709 13:05:07.235345 13743 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:33885 every 8 connection(s)
I20260709 13:05:07.249390 13744 heartbeater.cc:344] Connected to a master server at 127.0.107.254:36473
I20260709 13:05:07.249864 13744 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:07.250666 13744 heartbeater.cc:507] Master 127.0.107.254:36473 requested a full tablet report, sending...
I20260709 13:05:07.252720 13468 ts_manager.cc:194] Registered new tserver with Master: 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:07.252929   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014630672s
I20260709 13:05:07.254197 13468 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57240
I20260709 13:05:07.277915 13468 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57252:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:07.280681 13468 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:07.351830 13560 tablet_service.cc:1511] Processing CreateTablet for tablet 34cdcf3c9ba34308b40f98d78681fa17 (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:07.352517 13559 tablet_service.cc:1511] Processing CreateTablet for tablet 5790fec8993e48c98c2ab2d08153169a (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:07.353332 13560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cdcf3c9ba34308b40f98d78681fa17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.354048 13559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5790fec8993e48c98c2ab2d08153169a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.358793 13558 tablet_service.cc:1511] Processing CreateTablet for tablet 1972faeeb5c64367846cc2549d8cf7b4 (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:07.360292 13558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1972faeeb5c64367846cc2549d8cf7b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.374006 13557 tablet_service.cc:1511] Processing CreateTablet for tablet 3f59e2b34f9045c2b77dd1cb32149920 (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:07.375566 13557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f59e2b34f9045c2b77dd1cb32149920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.384320 13709 tablet_service.cc:1511] Processing CreateTablet for tablet 34cdcf3c9ba34308b40f98d78681fa17 (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:07.387590 13556 tablet_service.cc:1511] Processing CreateTablet for tablet d363ea55721b45cdaf704f9d5fd6a94d (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:07.389735 13556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d363ea55721b45cdaf704f9d5fd6a94d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.398255 13553 tablet_service.cc:1511] Processing CreateTablet for tablet d6370ad18eb24102b5108d3345a591fb (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:07.400357 13553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6370ad18eb24102b5108d3345a591fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.391638 13555 tablet_service.cc:1511] Processing CreateTablet for tablet c6769d88ce5c400b9629ad29c23a73dc (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:07.403256 13555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6769d88ce5c400b9629ad29c23a73dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.394462 13709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cdcf3c9ba34308b40f98d78681fa17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.407763 13552 tablet_service.cc:1511] Processing CreateTablet for tablet ea276e84e0824360bf5d1ae70c77e1ab (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:07.394968 13554 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9b4a15fd814be490b0d7dbb4d1afcc (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:07.409687 13552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea276e84e0824360bf5d1ae70c77e1ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.412813 13554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9b4a15fd814be490b0d7dbb4d1afcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.435732 13708 tablet_service.cc:1511] Processing CreateTablet for tablet 5790fec8993e48c98c2ab2d08153169a (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:07.436393 13706 tablet_service.cc:1511] Processing CreateTablet for tablet 3f59e2b34f9045c2b77dd1cb32149920 (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:07.437305 13708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5790fec8993e48c98c2ab2d08153169a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.439144 13707 tablet_service.cc:1511] Processing CreateTablet for tablet 1972faeeb5c64367846cc2549d8cf7b4 (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:07.440129 13706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f59e2b34f9045c2b77dd1cb32149920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.441300 13705 tablet_service.cc:1511] Processing CreateTablet for tablet d363ea55721b45cdaf704f9d5fd6a94d (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:07.442665 13705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d363ea55721b45cdaf704f9d5fd6a94d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.447145 13704 tablet_service.cc:1511] Processing CreateTablet for tablet c6769d88ce5c400b9629ad29c23a73dc (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:07.448578 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6769d88ce5c400b9629ad29c23a73dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.451212 13703 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9b4a15fd814be490b0d7dbb4d1afcc (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:07.452613 13703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9b4a15fd814be490b0d7dbb4d1afcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.454921 13702 tablet_service.cc:1511] Processing CreateTablet for tablet d6370ad18eb24102b5108d3345a591fb (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:07.456341 13702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6370ad18eb24102b5108d3345a591fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.457919 13701 tablet_service.cc:1511] Processing CreateTablet for tablet ea276e84e0824360bf5d1ae70c77e1ab (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:07.459276 13701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea276e84e0824360bf5d1ae70c77e1ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.465256 13635 tablet_service.cc:1511] Processing CreateTablet for tablet 34cdcf3c9ba34308b40f98d78681fa17 (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:07.466404 13707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1972faeeb5c64367846cc2549d8cf7b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.466722 13635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34cdcf3c9ba34308b40f98d78681fa17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.467412 13632 tablet_service.cc:1511] Processing CreateTablet for tablet 3f59e2b34f9045c2b77dd1cb32149920 (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:07.468777 13632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f59e2b34f9045c2b77dd1cb32149920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.472879 13633 tablet_service.cc:1511] Processing CreateTablet for tablet 1972faeeb5c64367846cc2549d8cf7b4 (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:07.474311 13633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1972faeeb5c64367846cc2549d8cf7b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.479077 13631 tablet_service.cc:1511] Processing CreateTablet for tablet d363ea55721b45cdaf704f9d5fd6a94d (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:07.480566 13631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d363ea55721b45cdaf704f9d5fd6a94d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.482378 13630 tablet_service.cc:1511] Processing CreateTablet for tablet c6769d88ce5c400b9629ad29c23a73dc (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:07.483772 13630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6769d88ce5c400b9629ad29c23a73dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.486351 13634 tablet_service.cc:1511] Processing CreateTablet for tablet 5790fec8993e48c98c2ab2d08153169a (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:07.487772 13634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5790fec8993e48c98c2ab2d08153169a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.492205 13629 tablet_service.cc:1511] Processing CreateTablet for tablet 1d9b4a15fd814be490b0d7dbb4d1afcc (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:07.495386 13629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d9b4a15fd814be490b0d7dbb4d1afcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.503463 13628 tablet_service.cc:1511] Processing CreateTablet for tablet d6370ad18eb24102b5108d3345a591fb (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:07.504957 13628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6370ad18eb24102b5108d3345a591fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.508029 13627 tablet_service.cc:1511] Processing CreateTablet for tablet ea276e84e0824360bf5d1ae70c77e1ab (DEFAULT_TABLE table=test-workload [id=92122cb60bd940208263f4e8b4c09578]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:07.509907 13627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea276e84e0824360bf5d1ae70c77e1ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:07.551142 13760 tablet_bootstrap.cc:492] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:07.562947 13759 tablet_bootstrap.cc:492] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:07.597954 13761 tablet_bootstrap.cc:492] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:07.606416 13761 tablet_bootstrap.cc:654] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.606953 13759 tablet_bootstrap.cc:654] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.617086 13761 tablet_bootstrap.cc:492] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:07.617830 13761 ts_tablet_manager.cc:1403] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.020s	user 0.003s	sys 0.008s
I20260709 13:05:07.618572 13760 tablet_bootstrap.cc:654] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.620877 13759 tablet_bootstrap.cc:492] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:07.621505 13759 ts_tablet_manager.cc:1403] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.004s
I20260709 13:05:07.621192 13761 raft_consensus.cc:359] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.622121 13761 raft_consensus.cc:385] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.622511 13761 raft_consensus.cc:740] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.623411 13760 tablet_bootstrap.cc:492] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:07.623942 13760 ts_tablet_manager.cc:1403] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.073s	user 0.003s	sys 0.009s
I20260709 13:05:07.623327 13761 consensus_queue.cc:260] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.625038 13759 raft_consensus.cc:359] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.625771 13670 heartbeater.cc:499] Master 127.0.107.254:36473 was elected leader, sending a full tablet report...
I20260709 13:05:07.625895 13759 raft_consensus.cc:385] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.626484 13761 ts_tablet_manager.cc:1434] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:05:07.626488 13759 raft_consensus.cc:740] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.626637 13760 raft_consensus.cc:359] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:07.627488 13760 raft_consensus.cc:385] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.627739 13761 tablet_bootstrap.cc:492] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:07.627802 13760 raft_consensus.cc:740] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.628098 13759 consensus_queue.cc:260] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.629078 13760 consensus_queue.cc:260] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:07.636514 13761 tablet_bootstrap.cc:654] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.638252 13759 ts_tablet_manager.cc:1434] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.011s
I20260709 13:05:07.639201 13595 heartbeater.cc:499] Master 127.0.107.254:36473 was elected leader, sending a full tablet report...
I20260709 13:05:07.639657 13759 tablet_bootstrap.cc:492] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:07.644464 13760 ts_tablet_manager.cc:1434] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.020s	user 0.013s	sys 0.001s
I20260709 13:05:07.645339 13744 heartbeater.cc:499] Master 127.0.107.254:36473 was elected leader, sending a full tablet report...
W20260709 13:05:07.648957 13671 tablet.cc:2406] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:07.649869 13759 tablet_bootstrap.cc:654] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.655278 13761 tablet_bootstrap.cc:492] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:07.655818 13761 ts_tablet_manager.cc:1403] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.014s
I20260709 13:05:07.658779 13761 raft_consensus.cc:359] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.659492 13760 tablet_bootstrap.cc:492] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:07.659509 13761 raft_consensus.cc:385] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.660211 13761 raft_consensus.cc:740] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.661145 13761 consensus_queue.cc:260] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.666105 13761 ts_tablet_manager.cc:1434] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:05:07.667121 13761 tablet_bootstrap.cc:492] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:07.670095 13760 tablet_bootstrap.cc:654] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.673585 13761 tablet_bootstrap.cc:654] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.686388 13761 tablet_bootstrap.cc:492] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:07.686915 13761 ts_tablet_manager.cc:1403] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 13:05:07.689821 13761 raft_consensus.cc:359] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:07.690626 13761 raft_consensus.cc:385] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.690785 13759 tablet_bootstrap.cc:492] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:07.690939 13761 raft_consensus.cc:740] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.691656 13759 ts_tablet_manager.cc:1403] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.026s
I20260709 13:05:07.691960 13761 consensus_queue.cc:260] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:07.694334 13761 ts_tablet_manager.cc:1434] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:07.695314 13761 tablet_bootstrap.cc:492] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:07.695710 13759 raft_consensus.cc:359] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.696825 13759 raft_consensus.cc:385] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.697238 13759 raft_consensus.cc:740] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.698586 13759 consensus_queue.cc:260] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.702123 13761 tablet_bootstrap.cc:654] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.704684 13759 ts_tablet_manager.cc:1434] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 13:05:07.707849 13759 tablet_bootstrap.cc:492] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:07.714794 13760 tablet_bootstrap.cc:492] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:07.715641 13760 ts_tablet_manager.cc:1403] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.056s	user 0.041s	sys 0.003s
I20260709 13:05:07.716329 13759 tablet_bootstrap.cc:654] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.718995 13760 raft_consensus.cc:359] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.719818 13760 raft_consensus.cc:385] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.719921 13761 tablet_bootstrap.cc:492] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:07.720172 13760 raft_consensus.cc:740] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.720520 13761 ts_tablet_manager.cc:1403] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.005s
I20260709 13:05:07.721637 13759 tablet_bootstrap.cc:492] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:07.720963 13760 consensus_queue.cc:260] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.722303 13759 ts_tablet_manager.cc:1403] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 13:05:07.723675 13760 ts_tablet_manager.cc:1434] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:07.723454 13761 raft_consensus.cc:359] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.724231 13761 raft_consensus.cc:385] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.724524 13761 raft_consensus.cc:740] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.724681 13760 tablet_bootstrap.cc:492] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:07.725302 13759 raft_consensus.cc:359] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.725392 13761 consensus_queue.cc:260] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.726254 13759 raft_consensus.cc:385] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.726639 13759 raft_consensus.cc:740] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.727547 13759 consensus_queue.cc:260] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.730387 13761 ts_tablet_manager.cc:1434] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:05:07.731222 13760 tablet_bootstrap.cc:654] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.731551 13761 tablet_bootstrap.cc:492] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:07.731583 13759 ts_tablet_manager.cc:1434] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:07.732782 13759 tablet_bootstrap.cc:492] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:07.739137 13759 tablet_bootstrap.cc:654] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.741744 13761 tablet_bootstrap.cc:654] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.754477 13759 tablet_bootstrap.cc:492] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:07.755013 13759 ts_tablet_manager.cc:1403] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 13:05:07.758157 13759 raft_consensus.cc:359] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.758914 13759 raft_consensus.cc:385] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.759214 13759 raft_consensus.cc:740] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.761258 13759 consensus_queue.cc:260] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.762984 13761 tablet_bootstrap.cc:492] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:07.763556 13761 ts_tablet_manager.cc:1403] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.009s
I20260709 13:05:07.764950 13760 tablet_bootstrap.cc:492] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:07.765530 13759 ts_tablet_manager.cc:1434] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:07.765579 13760 ts_tablet_manager.cc:1403] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.025s
I20260709 13:05:07.766788 13759 tablet_bootstrap.cc:492] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:07.766577 13761 raft_consensus.cc:359] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.767416 13761 raft_consensus.cc:385] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.767740 13761 raft_consensus.cc:740] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.768675 13761 consensus_queue.cc:260] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.769342 13760 raft_consensus.cc:359] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.770246 13760 raft_consensus.cc:385] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.770583 13760 raft_consensus.cc:740] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.771166 13761 ts_tablet_manager.cc:1434] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:07.771667 13760 consensus_queue.cc:260] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.772338 13761 tablet_bootstrap.cc:492] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:07.776479 13759 tablet_bootstrap.cc:654] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.779420 13761 tablet_bootstrap.cc:654] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.781559 13760 ts_tablet_manager.cc:1434] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:07.788295 13760 tablet_bootstrap.cc:492] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:07.788434 13759 tablet_bootstrap.cc:492] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:07.789088 13759 ts_tablet_manager.cc:1403] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 13:05:07.790550 13761 tablet_bootstrap.cc:492] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:07.791121 13761 ts_tablet_manager.cc:1403] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:05:07.792459 13759 raft_consensus.cc:359] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.793051 13759 raft_consensus.cc:385] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.793242 13759 raft_consensus.cc:740] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.793896 13759 consensus_queue.cc:260] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.793958 13761 raft_consensus.cc:359] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.794876 13761 raft_consensus.cc:385] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.795190 13761 raft_consensus.cc:740] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.795977 13761 consensus_queue.cc:260] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.797024 13760 tablet_bootstrap.cc:654] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.797716 13759 ts_tablet_manager.cc:1434] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:05:07.798856 13759 tablet_bootstrap.cc:492] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:07.804313 13761 ts_tablet_manager.cc:1434] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:05:07.805362 13759 tablet_bootstrap.cc:654] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.805898 13761 tablet_bootstrap.cc:492] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:07.808930 13760 tablet_bootstrap.cc:492] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:07.809609 13760 ts_tablet_manager.cc:1403] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:05:07.810011 13765 raft_consensus.cc:493] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.810725 13765 raft_consensus.cc:515] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:07.813660 13760 raft_consensus.cc:359] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.814687 13760 raft_consensus.cc:385] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.815146 13760 raft_consensus.cc:740] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.816391 13760 consensus_queue.cc:260] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.817013 13765 leader_election.cc:290] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:07.817238 13759 tablet_bootstrap.cc:492] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:07.817937 13765 raft_consensus.cc:493] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.818130 13759 ts_tablet_manager.cc:1403] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.011s
I20260709 13:05:07.818746 13765 raft_consensus.cc:515] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.821499 13765 leader_election.cc:290] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:07.822319 13765 raft_consensus.cc:493] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.821833 13759 raft_consensus.cc:359] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.823755 13759 raft_consensus.cc:385] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.824157 13759 raft_consensus.cc:740] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.824954 13759 consensus_queue.cc:260] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.827407 13759 ts_tablet_manager.cc:1434] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:07.828413 13759 tablet_bootstrap.cc:492] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:07.829553 13760 ts_tablet_manager.cc:1434] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:05:07.823726 13765 raft_consensus.cc:515] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.830804 13760 tablet_bootstrap.cc:492] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:07.832617 13765 leader_election.cc:290] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:07.837462 13759 tablet_bootstrap.cc:654] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.840193 13761 tablet_bootstrap.cc:654] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.840840 13760 tablet_bootstrap.cc:654] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.848605 13767 raft_consensus.cc:493] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.848817 13760 tablet_bootstrap.cc:492] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:07.849462 13760 ts_tablet_manager.cc:1403] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.002s
I20260709 13:05:07.849179 13767 raft_consensus.cc:515] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:07.851095 13761 tablet_bootstrap.cc:492] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:07.851646 13761 ts_tablet_manager.cc:1403] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.002s
I20260709 13:05:07.858448 13570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:07.859184 13569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:07.860219 13767 leader_election.cc:290] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:07.860839 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea276e84e0824360bf5d1ae70c77e1ab" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:07.861836 13568 raft_consensus.cc:2468] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 0.
I20260709 13:05:07.862933 13761 raft_consensus.cc:359] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.863785 13761 raft_consensus.cc:385] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.864158 13761 raft_consensus.cc:740] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
W20260709 13:05:07.864711 13610 leader_election.cc:343] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:07.865746 13610 leader_election.cc:343] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.866619 13610 leader_election.cc:304] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:07.867429 13765 raft_consensus.cc:2804] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:07.867790 13765 raft_consensus.cc:493] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.868157 13765 raft_consensus.cc:3060] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.868206 13760 raft_consensus.cc:359] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.869096 13760 raft_consensus.cc:385] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:07.869478 13516 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:07.869377 13760 raft_consensus.cc:740] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.872131 13760 consensus_queue.cc:260] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.872614 13759 tablet_bootstrap.cc:492] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:07.873615 13759 ts_tablet_manager.cc:1403] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.045s	user 0.026s	sys 0.010s
I20260709 13:05:07.874495 13760 ts_tablet_manager.cc:1434] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:07.874665 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:07.875414 13719 raft_consensus.cc:2468] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 0.
I20260709 13:05:07.875595 13760 tablet_bootstrap.cc:492] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:07.876281 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:07.877341 13759 raft_consensus.cc:359] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:07.877364 13717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea276e84e0824360bf5d1ae70c77e1ab" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:07.878306 13759 raft_consensus.cc:385] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.878496 13717 raft_consensus.cc:2468] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 0.
I20260709 13:05:07.878703 13759 raft_consensus.cc:740] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.879527 13718 raft_consensus.cc:2468] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 0.
I20260709 13:05:07.879590 13759 consensus_queue.cc:260] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:07.881379 13608 leader_election.cc:304] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:07.882517 13760 tablet_bootstrap.cc:654] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.882663 13759 ts_tablet_manager.cc:1434] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:07.882663 13782 raft_consensus.cc:2804] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:07.883613 13782 raft_consensus.cc:493] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.883955 13782 raft_consensus.cc:3060] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.884402 13759 tablet_bootstrap.cc:492] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:07.890702 13608 leader_election.cc:304] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:07.891301 13759 tablet_bootstrap.cc:654] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.891670 13781 raft_consensus.cc:2804] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:07.892124 13781 raft_consensus.cc:493] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.892506 13766 raft_consensus.cc:493] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.892519 13781 raft_consensus.cc:3060] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.893267 13766 raft_consensus.cc:515] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.915889 13782 raft_consensus.cc:515] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.918370 13781 raft_consensus.cc:515] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:07.919076 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:07.920694 13781 leader_election.cc:290] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
W20260709 13:05:07.920887 13610 leader_election.cc:343] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:07.921564 13761 consensus_queue.cc:260] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.922554 13759 tablet_bootstrap.cc:492] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:07.923142 13759 ts_tablet_manager.cc:1403] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.009s
I20260709 13:05:07.922919 13781 raft_consensus.cc:493] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.925482 13781 raft_consensus.cc:515] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.927006 13765 raft_consensus.cc:515] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.927616 13759 raft_consensus.cc:359] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.928570 13759 raft_consensus.cc:385] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.928897 13759 raft_consensus.cc:740] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.929354 13765 leader_election.cc:290] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:07.929723 13759 consensus_queue.cc:260] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.930408 13781 leader_election.cc:290] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:07.933622 13570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d363ea55721b45cdaf704f9d5fd6a94d" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:07.934321 13570 raft_consensus.cc:2468] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 0.
I20260709 13:05:07.935015 13761 ts_tablet_manager.cc:1434] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.000s
I20260709 13:05:07.935655 13569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea276e84e0824360bf5d1ae70c77e1ab" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:07.936102 13761 tablet_bootstrap.cc:492] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:07.936270 13569 raft_consensus.cc:3060] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.937449 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:07.938709 13610 leader_election.cc:304] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:07.939661 13765 raft_consensus.cc:2804] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:07.940056 13765 raft_consensus.cc:493] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.940194 13782 leader_election.cc:290] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:07.940459 13765 raft_consensus.cc:3060] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.945164 13761 tablet_bootstrap.cc:654] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:07.941605 13568 raft_consensus.cc:3060] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.955497 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:07.956844 13645 raft_consensus.cc:2393] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6cd14a97d8474cd697f65afab7060d9e in current term 1: Already voted for candidate c87b1b6aa93e412797a928d4d1e15361 in this term.
I20260709 13:05:07.966987 13570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:07.969314 13782 raft_consensus.cc:493] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.969904 13782 raft_consensus.cc:515] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.971271 13684 leader_election.cc:304] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:07.972084 13782 leader_election.cc:290] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:07.972941 13767 raft_consensus.cc:3060] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.977968 13570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9b4a15fd814be490b0d7dbb4d1afcc" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:07.979115 13570 raft_consensus.cc:2468] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 0.
I20260709 13:05:07.978102 13766 leader_election.cc:290] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:07.986284 13760 tablet_bootstrap.cc:492] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:07.986913 13760 ts_tablet_manager.cc:1403] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.112s	user 0.027s	sys 0.008s
I20260709 13:05:07.989877 13760 raft_consensus.cc:359] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:07.990679 13760 raft_consensus.cc:385] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:07.990964 13760 raft_consensus.cc:740] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:07.986279 13610 leader_election.cc:304] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:07.992686 13782 raft_consensus.cc:2804] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:07.993053 13782 raft_consensus.cc:493] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.993415 13782 raft_consensus.cc:3060] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:07.999326 13569 raft_consensus.cc:2468] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:08.000721 13610 leader_election.cc:304] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:08.001652 13793 raft_consensus.cc:2804] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.002312 13793 raft_consensus.cc:697] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:08.003407 13793 consensus_queue.cc:237] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.004047 13767 raft_consensus.cc:2749] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:08.007066 13765 raft_consensus.cc:515] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.008486 13760 consensus_queue.cc:260] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.011493 13760 ts_tablet_manager.cc:1434] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:05:08.012616 13760 tablet_bootstrap.cc:492] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:08.012997 13759 ts_tablet_manager.cc:1434] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.089s	user 0.036s	sys 0.037s
I20260709 13:05:08.016975 13782 raft_consensus.cc:515] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.018743 13759 tablet_bootstrap.cc:492] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:08.019605 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:08.024044 13569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d363ea55721b45cdaf704f9d5fd6a94d" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:08.024807 13569 raft_consensus.cc:3060] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.024904 13759 tablet_bootstrap.cc:654] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.028884 13719 raft_consensus.cc:2468] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:08.030812 13765 leader_election.cc:290] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.031644 13718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea276e84e0824360bf5d1ae70c77e1ab" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:08.032682 13717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d363ea55721b45cdaf704f9d5fd6a94d" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:08.035241 13718 raft_consensus.cc:3060] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.035307 13717 raft_consensus.cc:2468] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 0.
I20260709 13:05:08.033771 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:08.036317 13716 raft_consensus.cc:3060] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.036224 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1972faeeb5c64367846cc2549d8cf7b4" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:08.037073 13715 raft_consensus.cc:2468] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 0.
I20260709 13:05:08.038424 13533 leader_election.cc:304] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:08.038676 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9b4a15fd814be490b0d7dbb4d1afcc" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:08.039430 13795 raft_consensus.cc:2804] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.039914 13795 raft_consensus.cc:493] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.040333 13795 raft_consensus.cc:3060] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.041553 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d363ea55721b45cdaf704f9d5fd6a94d" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:08.042268 13715 raft_consensus.cc:3060] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.043774 13718 raft_consensus.cc:2468] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:08.007076 13568 raft_consensus.cc:2468] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:08.043718 13716 raft_consensus.cc:2468] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:08.046068 13610 leader_election.cc:304] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:08.046296 13761 tablet_bootstrap.cc:492] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:08.047400 13761 ts_tablet_manager.cc:1403] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.112s	user 0.009s	sys 0.007s
I20260709 13:05:08.049345 13795 raft_consensus.cc:515] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.050390 13715 raft_consensus.cc:2468] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:08.050508 13761 raft_consensus.cc:359] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.051365 13761 raft_consensus.cc:385] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.051635 13761 raft_consensus.cc:740] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.053087 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1972faeeb5c64367846cc2549d8cf7b4" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:08.053561 13569 raft_consensus.cc:2468] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:08.053815 13716 raft_consensus.cc:3060] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.054553 13795 leader_election.cc:290] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Requested vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.055286 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1972faeeb5c64367846cc2549d8cf7b4" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:08.055752 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1972faeeb5c64367846cc2549d8cf7b4" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:08.057757 13759 tablet_bootstrap.cc:492] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:08.058274 13759 ts_tablet_manager.cc:1403] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.040s	user 0.002s	sys 0.015s
I20260709 13:05:08.059567 13782 leader_election.cc:290] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.060684 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9b4a15fd814be490b0d7dbb4d1afcc" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:08.062728 13759 raft_consensus.cc:359] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.063602 13759 raft_consensus.cc:385] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.063827 13759 raft_consensus.cc:740] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.061754 13761 consensus_queue.cc:260] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.064962 13759 consensus_queue.cc:260] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.066308 13761 ts_tablet_manager.cc:1434] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:05:08.066978 13759 ts_tablet_manager.cc:1434] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:08.067255 13761 tablet_bootstrap.cc:492] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:08.071805 13760 tablet_bootstrap.cc:654] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.072060 13761 tablet_bootstrap.cc:654] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.061547 13782 raft_consensus.cc:2804] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.075011 13782 raft_consensus.cc:697] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:08.076268 13782 consensus_queue.cc:237] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:08.062295 13568 raft_consensus.cc:3060] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.117832 13610 leader_election.cc:304] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
W20260709 13:05:08.056764 13608 leader_election.cc:343] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.126973 13793 raft_consensus.cc:2804] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.128233 13761 tablet_bootstrap.cc:492] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:08.128070 13793 raft_consensus.cc:697] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
W20260709 13:05:08.124454 13608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:33885, user_credentials={real_user=slave}} blocked reactor thread for 67559.4us
I20260709 13:05:08.134542 13766 raft_consensus.cc:493] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.135445 13766 raft_consensus.cc:515] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.140348 13568 raft_consensus.cc:2468] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:08.121897 13795 raft_consensus.cc:493] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.142122 13795 raft_consensus.cc:515] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.144532 13610 leader_election.cc:304] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:08.146008 13765 raft_consensus.cc:2804] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.147224 13795 leader_election.cc:290] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.147878 13765 raft_consensus.cc:697] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:08.148779 13766 leader_election.cc:290] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.148238 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5790fec8993e48c98c2ab2d08153169a" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:08.150401 13608 leader_election.cc:304] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61
W20260709 13:05:08.151793 13533 leader_election.cc:343] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.129567 13761 ts_tablet_manager.cc:1403] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.006s
I20260709 13:05:08.151916 13781 raft_consensus.cc:2804] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.153035 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6370ad18eb24102b5108d3345a591fb" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:08.147128 13793 consensus_queue.cc:237] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
W20260709 13:05:08.155560 13534 leader_election.cc:343] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.149514 13765 consensus_queue.cc:237] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.160421 13719 raft_consensus.cc:2468] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 0.
I20260709 13:05:08.160677 13464 catalog_manager.cc:5697] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 0 to 1, leader changed from <none> to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.170533 13533 leader_election.cc:304] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:08.171849 13766 raft_consensus.cc:2804] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.172364 13766 raft_consensus.cc:493] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.170912 13760 tablet_bootstrap.cc:492] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:08.172851 13766 raft_consensus.cc:3060] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.173197 13716 raft_consensus.cc:2468] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 1.
W20260709 13:05:08.177145 13534 leader_election.cc:343] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.177978 13533 leader_election.cc:304] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:08.174806 13782 raft_consensus.cc:493] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.180433 13795 raft_consensus.cc:2804] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.181308 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6370ad18eb24102b5108d3345a591fb" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:08.181135 13782 raft_consensus.cc:515] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.172842 13761 raft_consensus.cc:359] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.180459 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5790fec8993e48c98c2ab2d08153169a" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:08.182331 13645 raft_consensus.cc:2468] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 0.
I20260709 13:05:08.183843 13644 raft_consensus.cc:2468] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 0.
I20260709 13:05:08.182919 13761 raft_consensus.cc:385] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.185696 13761 raft_consensus.cc:740] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.187616 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9b4a15fd814be490b0d7dbb4d1afcc" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:08.189270 13781 raft_consensus.cc:697] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:08.192449 13760 ts_tablet_manager.cc:1403] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.180s	user 0.012s	sys 0.004s
I20260709 13:05:08.194419 13761 consensus_queue.cc:260] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.197754 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6769d88ce5c400b9629ad29c23a73dc" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:08.194685 13781 consensus_queue.cc:237] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.198621 13534 leader_election.cc:304] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:08.201548 13782 leader_election.cc:290] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.201049 13568 raft_consensus.cc:2468] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 0.
I20260709 13:05:08.211838 13610 leader_election.cc:304] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:08.214347 13782 raft_consensus.cc:2804] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.215473 13782 raft_consensus.cc:493] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.215940 13782 raft_consensus.cc:3060] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.227788 13760 raft_consensus.cc:359] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.229084 13760 raft_consensus.cc:385] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.229453 13760 raft_consensus.cc:740] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.234944 13761 ts_tablet_manager.cc:1434] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.001s
W20260709 13:05:08.239126 13608 leader_election.cc:343] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.239851 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6769d88ce5c400b9629ad29c23a73dc" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
W20260709 13:05:08.241572 13608 leader_election.cc:343] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.249543 13795 raft_consensus.cc:697] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:08.250072 13760 consensus_queue.cc:260] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.250538 13809 raft_consensus.cc:2804] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:08.251219 13809 raft_consensus.cc:493] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.251068 13795 consensus_queue.cc:237] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.251422 13766 raft_consensus.cc:515] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.251870 13809 raft_consensus.cc:3060] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.255148 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6370ad18eb24102b5108d3345a591fb" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:08.255884 13716 raft_consensus.cc:3060] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.264473 13782 raft_consensus.cc:515] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.266350 13760 ts_tablet_manager.cc:1434] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.073s	user 0.009s	sys 0.004s
I20260709 13:05:08.267295 13716 raft_consensus.cc:2468] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 1.
I20260709 13:05:08.268172 13760 tablet_bootstrap.cc:492] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:08.272877 13533 leader_election.cc:304] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:08.253751 13766 leader_election.cc:290] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Requested vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.278119 13766 raft_consensus.cc:2804] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.278604 13766 raft_consensus.cc:697] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:08.279821 13766 consensus_queue.cc:237] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
W20260709 13:05:08.282763 13534 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:34745, user_credentials={real_user=slave}} blocked reactor thread for 84263.9us
I20260709 13:05:08.269414 13782 leader_election.cc:290] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.270200 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6769d88ce5c400b9629ad29c23a73dc" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:08.284929 13568 raft_consensus.cc:3060] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.285275 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6370ad18eb24102b5108d3345a591fb" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:08.286052 13645 raft_consensus.cc:3060] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.270491 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6769d88ce5c400b9629ad29c23a73dc" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
W20260709 13:05:08.291378 13608 leader_election.cc:343] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:08.300853 13645 raft_consensus.cc:2468] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 1.
I20260709 13:05:08.302799 13568 raft_consensus.cc:2468] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:08.308111 13610 leader_election.cc:304] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:08.309533 13781 raft_consensus.cc:2804] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.310289 13781 raft_consensus.cc:697] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:08.311761 13781 consensus_queue.cc:237] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.313233 13809 raft_consensus.cc:515] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.301422 13760 tablet_bootstrap.cc:654] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.299974 13465 catalog_manager.cc:5697] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.317070 13809 leader_election.cc:290] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Requested vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.317073 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5790fec8993e48c98c2ab2d08153169a" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:08.317914 13645 raft_consensus.cc:3060] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.318434 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5790fec8993e48c98c2ab2d08153169a" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:08.319100 13719 raft_consensus.cc:3060] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.330739 13645 raft_consensus.cc:2468] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 1.
I20260709 13:05:08.332242 13534 leader_election.cc:304] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:08.332963 13809 raft_consensus.cc:2804] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.333262 13719 raft_consensus.cc:2468] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 1.
I20260709 13:05:08.333658 13809 raft_consensus.cc:697] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:08.334954 13809 consensus_queue.cc:237] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.343879 13760 tablet_bootstrap.cc:492] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:08.344481 13760 ts_tablet_manager.cc:1403] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.013s
I20260709 13:05:08.346997 13760 raft_consensus.cc:359] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.347587 13760 raft_consensus.cc:385] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.347824 13760 raft_consensus.cc:740] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.348896 13760 consensus_queue.cc:260] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.351298 13760 ts_tablet_manager.cc:1434] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:08.350585 13464 catalog_manager.cc:5697] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.352732 13760 tablet_bootstrap.cc:492] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:08.352908 13464 catalog_manager.cc:5697] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.358979 13760 tablet_bootstrap.cc:654] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.363862 13760 tablet_bootstrap.cc:492] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:08.364370 13760 ts_tablet_manager.cc:1403] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:05:08.366304 13465 catalog_manager.cc:5697] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 0 to 1, leader changed from <none> to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.367380 13760 raft_consensus.cc:359] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.368119 13760 raft_consensus.cc:385] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.368541 13760 raft_consensus.cc:740] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.368608 13465 catalog_manager.cc:5697] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 0 to 1, leader changed from <none> to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.369338 13760 consensus_queue.cc:260] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.370780 13465 catalog_manager.cc:5697] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 0 to 1, leader changed from <none> to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.371599 13760 ts_tablet_manager.cc:1434] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:08.372545 13465 catalog_manager.cc:5697] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 0 to 1, leader changed from <none> to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.373790 13465 catalog_manager.cc:5697] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 0 to 1, leader changed from <none> to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.427233 13767 raft_consensus.cc:493] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.427737 13767 raft_consensus.cc:515] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.429625 13767 leader_election.cc:290] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:08.430667 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9b4a15fd814be490b0d7dbb4d1afcc" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:08.430945 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9b4a15fd814be490b0d7dbb4d1afcc" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:08.431551 13568 raft_consensus.cc:2393] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6cd14a97d8474cd697f65afab7060d9e in current term 1: Already voted for candidate c87b1b6aa93e412797a928d4d1e15361 in this term.
I20260709 13:05:08.432723 13684 leader_election.cc:304] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:08.433326 13767 raft_consensus.cc:3060] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.439857 13767 raft_consensus.cc:2749] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:08.480237 13809 raft_consensus.cc:493] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.480933 13809 raft_consensus.cc:515] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.483552 13809 leader_election.cc:290] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.483736 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:08.484242 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:08.485221 13719 raft_consensus.cc:2393] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29d2cbebb8f2464f8dddefda1adaaf61 in current term 1: Already voted for candidate c87b1b6aa93e412797a928d4d1e15361 in this term.
I20260709 13:05:08.486253 13533 leader_election.cc:304] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61; no voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:08.486905 13809 raft_consensus.cc:3060] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.492419 13809 raft_consensus.cc:2749] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:08.500097 13781 consensus_queue.cc:1048] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.504344 13781 raft_consensus.cc:493] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.504920 13781 raft_consensus.cc:515] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.507553 13781 leader_election.cc:290] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.507853 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1972faeeb5c64367846cc2549d8cf7b4" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:08.508541 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1972faeeb5c64367846cc2549d8cf7b4" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:08.509481 13719 raft_consensus.cc:2393] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c87b1b6aa93e412797a928d4d1e15361 in current term 1: Already voted for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in this term.
I20260709 13:05:08.511200 13608 leader_election.cc:304] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:08.512333 13805 raft_consensus.cc:3060] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.514357 13765 consensus_queue.cc:1048] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.526574 13805 raft_consensus.cc:2749] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:08.552103 13645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17"
dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
mode: GRACEFUL
new_leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
 from {username='slave'} at 127.0.0.1:41916
I20260709 13:05:08.552749 13645 raft_consensus.cc:606] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Received request to transfer leadership to TS 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:08.556388 13805 consensus_queue.cc:1048] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.565927 13645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920"
dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
mode: GRACEFUL
new_leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
 from {username='slave'} at 127.0.0.1:41916
I20260709 13:05:08.566591 13645 raft_consensus.cc:606] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Received request to transfer leadership to TS 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:08.568128 13781 consensus_queue.cc:1048] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.594977 13767 raft_consensus.cc:493] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.595489 13767 raft_consensus.cc:515] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.597673 13568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6370ad18eb24102b5108d3345a591fb"
dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
mode: GRACEFUL
new_leader_uuid: "c87b1b6aa93e412797a928d4d1e15361"
 from {username='slave'} at 127.0.0.1:41026
I20260709 13:05:08.598469 13568 raft_consensus.cc:606] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Received request to transfer leadership to TS c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:08.598709 13569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6769d88ce5c400b9629ad29c23a73dc" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:08.598937 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6769d88ce5c400b9629ad29c23a73dc" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:08.599661 13569 raft_consensus.cc:2393] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6cd14a97d8474cd697f65afab7060d9e in current term 1: Already voted for candidate c87b1b6aa93e412797a928d4d1e15361 in this term.
I20260709 13:05:08.597688 13767 leader_election.cc:290] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:08.601994 13683 leader_election.cc:304] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:08.602852 13767 raft_consensus.cc:3060] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.605468 13645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea276e84e0824360bf5d1ae70c77e1ab"
dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
mode: GRACEFUL
new_leader_uuid: "6cd14a97d8474cd697f65afab7060d9e"
 from {username='slave'} at 127.0.0.1:41916
I20260709 13:05:08.606212 13645 raft_consensus.cc:606] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Received request to transfer leadership to TS 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:08.609241 13767 raft_consensus.cc:2749] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:08.629750 13805 consensus_queue.cc:1048] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.641724 13781 consensus_queue.cc:1048] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.642743 13805 consensus_queue.cc:1048] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.652228 13805 raft_consensus.cc:993] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361: : Instructing follower 29d2cbebb8f2464f8dddefda1adaaf61 to start an election
I20260709 13:05:08.652711 13805 raft_consensus.cc:1081] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Signalling peer 29d2cbebb8f2464f8dddefda1adaaf61 to start an election
I20260709 13:05:08.655951 13568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920"
dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
 from {username='slave'} at 127.0.0.1:41012
I20260709 13:05:08.657991 13568 raft_consensus.cc:493] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.658437 13568 raft_consensus.cc:3060] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.658209 13765 consensus_queue.cc:1048] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.669445 13568 raft_consensus.cc:515] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.674328 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:08.674973 13645 raft_consensus.cc:3055] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.675331 13645 raft_consensus.cc:740] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:08.675447 13568 leader_election.cc:290] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 2 election: Requested vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.675635 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:08.676463 13719 raft_consensus.cc:3060] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.676191 13645 consensus_queue.cc:260] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.677860 13645 raft_consensus.cc:3060] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.684741 13765 consensus_queue.cc:1048] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.685058 13719 raft_consensus.cc:2468] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 2.
I20260709 13:05:08.685475 13645 raft_consensus.cc:2468] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 2.
I20260709 13:05:08.686540 13533 leader_election.cc:304] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:08.687738 13809 raft_consensus.cc:2804] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.688282 13809 raft_consensus.cc:697] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:08.689352 13809 consensus_queue.cc:237] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.691576 13766 consensus_queue.cc:1048] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.704053 13795 raft_consensus.cc:993] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61: : Instructing follower c87b1b6aa93e412797a928d4d1e15361 to start an election
I20260709 13:05:08.703465 13466 catalog_manager.cc:5697] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 1 to 2, leader changed from c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194) to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.704622 13795 raft_consensus.cc:1081] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Signalling peer c87b1b6aa93e412797a928d4d1e15361 to start an election
I20260709 13:05:08.710638 13805 consensus_queue.cc:1048] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.710876 13795 consensus_queue.cc:1048] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.715656 13644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6370ad18eb24102b5108d3345a591fb"
dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
 from {username='slave'} at 127.0.0.1:41908
I20260709 13:05:08.716279 13644 raft_consensus.cc:493] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.716692 13644 raft_consensus.cc:3060] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.722709 13805 consensus_queue.cc:1048] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.732092 13781 consensus_queue.cc:1048] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.736480 13644 raft_consensus.cc:515] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.740384 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6370ad18eb24102b5108d3345a591fb" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:08.741034 13568 raft_consensus.cc:3055] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.741376 13568 raft_consensus.cc:740] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:08.742354 13568 consensus_queue.cc:260] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.744029 13568 raft_consensus.cc:3060] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.746734 13645 raft_consensus.cc:1240] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Rejecting Update request from peer 29d2cbebb8f2464f8dddefda1adaaf61 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:08.754326 13644 leader_election.cc:290] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:08.755796 13568 raft_consensus.cc:2468] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:08.757442 13610 leader_election.cc:304] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:08.756242 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6370ad18eb24102b5108d3345a591fb" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:08.758507 13781 raft_consensus.cc:2804] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.758680 13716 raft_consensus.cc:3060] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.759122 13781 raft_consensus.cc:697] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:08.760221 13781 consensus_queue.cc:237] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:08.769275 13716 raft_consensus.cc:2468] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:08.771766 13795 consensus_queue.cc:1048] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.773419 13464 catalog_manager.cc:5697] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 1 to 2, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.784188 13810 consensus_queue.cc:1048] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:08.809628 13810 consensus_queue.cc:1048] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.822111 13810 consensus_queue.cc:1048] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:08.991276 13781 raft_consensus.cc:993] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361: : Instructing follower 6cd14a97d8474cd697f65afab7060d9e to start an election
I20260709 13:05:08.991879 13765 raft_consensus.cc:1081] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Signalling peer 6cd14a97d8474cd697f65afab7060d9e to start an election
I20260709 13:05:08.992132 13781 raft_consensus.cc:993] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361: : Instructing follower 29d2cbebb8f2464f8dddefda1adaaf61 to start an election
I20260709 13:05:08.992831 13805 raft_consensus.cc:1081] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Signalling peer 29d2cbebb8f2464f8dddefda1adaaf61 to start an election
I20260709 13:05:08.993763 13716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea276e84e0824360bf5d1ae70c77e1ab"
dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
 from {username='slave'} at 127.0.0.1:33168
I20260709 13:05:08.994458 13716 raft_consensus.cc:493] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.994539 13568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17"
dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
 from {username='slave'} at 127.0.0.1:41012
I20260709 13:05:08.994864 13716 raft_consensus.cc:3060] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.995157 13568 raft_consensus.cc:493] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.995566 13568 raft_consensus.cc:3060] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.002949 13568 raft_consensus.cc:515] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:09.002949 13716 raft_consensus.cc:515] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:09.005452 13568 leader_election.cc:290] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 2 election: Requested vote from peers 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:09.006341 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:09.006997 13719 raft_consensus.cc:3060] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.007164 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:09.007370 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea276e84e0824360bf5d1ae70c77e1ab" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:09.007815 13645 raft_consensus.cc:3055] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.008000 13568 raft_consensus.cc:3060] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.008190 13645 raft_consensus.cc:740] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:09.009178 13645 consensus_queue.cc:260] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:09.010511 13645 raft_consensus.cc:3060] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.011508 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea276e84e0824360bf5d1ae70c77e1ab" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:09.012240 13644 raft_consensus.cc:3055] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.012645 13644 raft_consensus.cc:740] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:09.013852 13644 consensus_queue.cc:260] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:09.014729 13719 raft_consensus.cc:2468] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 2.
I20260709 13:05:09.015060 13644 raft_consensus.cc:3060] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.005470 13716 leader_election.cc:290] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:09.015513 13568 raft_consensus.cc:2468] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 2.
I20260709 13:05:09.016335 13533 leader_election.cc:304] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:09.016711 13684 leader_election.cc:304] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:09.017630 13767 raft_consensus.cc:2804] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.018090 13810 raft_consensus.cc:2804] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.018849 13810 raft_consensus.cc:697] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:09.019871 13810 consensus_queue.cc:237] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:09.022385 13645 raft_consensus.cc:2468] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 2.
I20260709 13:05:09.023279 13644 raft_consensus.cc:2468] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 2.
I20260709 13:05:09.025591 13767 raft_consensus.cc:697] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 2 LEADER]: Becoming Leader. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Running, Role: LEADER
I20260709 13:05:09.026481 13767 consensus_queue.cc:237] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:09.030099 13464 catalog_manager.cc:5697] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 1 to 2, leader changed from c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194) to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.036094 13466 catalog_manager.cc:5697] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e reported cstate change: term changed from 1 to 2, leader changed from c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194) to 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6cd14a97d8474cd697f65afab7060d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.141021 13716 raft_consensus.cc:1275] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Refusing update from remote peer 29d2cbebb8f2464f8dddefda1adaaf61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.142372 13810 consensus_queue.cc:1048] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.149830 13644 raft_consensus.cc:1275] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Refusing update from remote peer 29d2cbebb8f2464f8dddefda1adaaf61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.151327 13795 consensus_queue.cc:1048] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.243891 13716 raft_consensus.cc:1275] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.245208 13781 consensus_queue.cc:1048] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.252038 13568 raft_consensus.cc:1275] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.253577 13782 consensus_queue.cc:1048] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.456581 13644 raft_consensus.cc:1275] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Refusing update from remote peer 6cd14a97d8474cd697f65afab7060d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.457912 13767 consensus_queue.cc:1048] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.466219 13568 raft_consensus.cc:1275] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Refusing update from remote peer 6cd14a97d8474cd697f65afab7060d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.467886 13767 consensus_queue.cc:1048] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:09.568830 13644 raft_consensus.cc:1275] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Refusing update from remote peer 29d2cbebb8f2464f8dddefda1adaaf61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.570140 13809 consensus_queue.cc:1048] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.579027 13716 raft_consensus.cc:1275] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Refusing update from remote peer 29d2cbebb8f2464f8dddefda1adaaf61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.581096 13766 consensus_queue.cc:1048] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:11.643672 13464 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44706:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:11.646667 13464 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:11.703142 13553 tablet_service.cc:1511] Processing CreateTablet for tablet 10d5ee21f56246a29c533a4de05c7489 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:11.703985 13633 tablet_service.cc:1511] Processing CreateTablet for tablet 10d5ee21f56246a29c533a4de05c7489 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:11.704773 13553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d5ee21f56246a29c533a4de05c7489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.705619 13633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d5ee21f56246a29c533a4de05c7489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.709131 13557 tablet_service.cc:1511] Processing CreateTablet for tablet 943f8ea3304144259be44f5f6c24fc5b (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:11.709802 13704 tablet_service.cc:1511] Processing CreateTablet for tablet 10d5ee21f56246a29c533a4de05c7489 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:11.711192 13704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d5ee21f56246a29c533a4de05c7489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.710712 13557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 943f8ea3304144259be44f5f6c24fc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.713626 13560 tablet_service.cc:1511] Processing CreateTablet for tablet a032cb3fe74548bd9b4e906868e36780 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:11.715022 13560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a032cb3fe74548bd9b4e906868e36780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.716717 13703 tablet_service.cc:1511] Processing CreateTablet for tablet 943f8ea3304144259be44f5f6c24fc5b (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:11.717167 13708 tablet_service.cc:1511] Processing CreateTablet for tablet a032cb3fe74548bd9b4e906868e36780 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:11.720018 13555 tablet_service.cc:1511] Processing CreateTablet for tablet 7913e288893b4e64b2a3de4c48e14566 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:11.743882 13555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7913e288893b4e64b2a3de4c48e14566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.747707 13709 tablet_service.cc:1511] Processing CreateTablet for tablet e6cae46e260b44d1be168af32741a927 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:11.720471 13705 tablet_service.cc:1511] Processing CreateTablet for tablet 7913e288893b4e64b2a3de4c48e14566 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:11.750072 13706 tablet_service.cc:1511] Processing CreateTablet for tablet 4887520213fb46aca97a33b873744d4f (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:11.752171 13630 tablet_service.cc:1511] Processing CreateTablet for tablet f331d902773d4eefb048904ac2054d64 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:11.753638 13630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f331d902773d4eefb048904ac2054d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.755280 13632 tablet_service.cc:1511] Processing CreateTablet for tablet b8f626b37da743e9a5a292eca013e549 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:11.756628 13632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f626b37da743e9a5a292eca013e549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.759308 13635 tablet_service.cc:1511] Processing CreateTablet for tablet e6cae46e260b44d1be168af32741a927 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:11.723415 13634 tablet_service.cc:1511] Processing CreateTablet for tablet 943f8ea3304144259be44f5f6c24fc5b (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:11.725232 13628 tablet_service.cc:1511] Processing CreateTablet for tablet a032cb3fe74548bd9b4e906868e36780 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:11.761662 13627 tablet_service.cc:1511] Processing CreateTablet for tablet 4887520213fb46aca97a33b873744d4f (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:11.763778 13552 tablet_service.cc:1511] Processing CreateTablet for tablet 4887520213fb46aca97a33b873744d4f (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:11.765177 13552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4887520213fb46aca97a33b873744d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.767364 13554 tablet_service.cc:1511] Processing CreateTablet for tablet e6cae46e260b44d1be168af32741a927 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:11.768832 13554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6cae46e260b44d1be168af32741a927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.727259 13702 tablet_service.cc:1511] Processing CreateTablet for tablet f331d902773d4eefb048904ac2054d64 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:11.728870 13631 tablet_service.cc:1511] Processing CreateTablet for tablet 7913e288893b4e64b2a3de4c48e14566 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:11.770221 13708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a032cb3fe74548bd9b4e906868e36780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.770481 13635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6cae46e260b44d1be168af32741a927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.731559 13707 tablet_service.cc:1511] Processing CreateTablet for tablet b8f626b37da743e9a5a292eca013e549 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:11.735065 13860 tablet_bootstrap.cc:492] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:11.771226 13629 tablet_service.cc:1511] Processing CreateTablet for tablet 8672ee2b1af7424bb262d0c8589a8cbb (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:11.771217 13631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7913e288893b4e64b2a3de4c48e14566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.734862 13556 tablet_service.cc:1511] Processing CreateTablet for tablet f331d902773d4eefb048904ac2054d64 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:11.773932 13629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8672ee2b1af7424bb262d0c8589a8cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.774914 13556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f331d902773d4eefb048904ac2054d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.776196 13634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 943f8ea3304144259be44f5f6c24fc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.772536 13559 tablet_service.cc:1511] Processing CreateTablet for tablet b8f626b37da743e9a5a292eca013e549 (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:11.737905 13701 tablet_service.cc:1511] Processing CreateTablet for tablet 8672ee2b1af7424bb262d0c8589a8cbb (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:11.779285 13628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a032cb3fe74548bd9b4e906868e36780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.779311 13559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f626b37da743e9a5a292eca013e549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.781620 13627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4887520213fb46aca97a33b873744d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.788034 13709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6cae46e260b44d1be168af32741a927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.788975 13706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4887520213fb46aca97a33b873744d4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.790390 13707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f626b37da743e9a5a292eca013e549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.794363 13705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7913e288893b4e64b2a3de4c48e14566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.798422 13701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8672ee2b1af7424bb262d0c8589a8cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.802488 13703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 943f8ea3304144259be44f5f6c24fc5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.805186 13702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f331d902773d4eefb048904ac2054d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.816406 13553 tablet_service.cc:1511] Processing CreateTablet for tablet 8672ee2b1af7424bb262d0c8589a8cbb (DEFAULT_TABLE table=soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:11.821921 13553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8672ee2b1af7424bb262d0c8589a8cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.830205 13860 tablet_bootstrap.cc:654] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:11.861003 13533 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:33885, user_credentials={real_user=slave}} blocked reactor thread for 101097us
I20260709 13:05:11.896442 13860 tablet_bootstrap.cc:492] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:11.897032 13860 ts_tablet_manager.cc:1403] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.000s
I20260709 13:05:11.904353 13860 raft_consensus.cc:359] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:11.905067 13860 raft_consensus.cc:385] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.905375 13860 raft_consensus.cc:740] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
W20260709 13:05:11.906689 13516 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:11.940209 13860 consensus_queue.cc:260] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:11.943892 13860 ts_tablet_manager.cc:1434] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:05:11.945626 13860 tablet_bootstrap.cc:492] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:11.953140 13860 tablet_bootstrap.cc:654] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.967201 13864 tablet_bootstrap.cc:492] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:11.969275 13863 tablet_bootstrap.cc:492] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:11.974714 13864 tablet_bootstrap.cc:654] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.980918 13863 tablet_bootstrap.cc:654] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.990361 13864 tablet_bootstrap.cc:492] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:11.990583 13860 tablet_bootstrap.cc:492] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:11.990911 13864 ts_tablet_manager.cc:1403] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.000s
I20260709 13:05:11.991107 13860 ts_tablet_manager.cc:1403] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.005s
I20260709 13:05:11.994004 13861 raft_consensus.cc:493] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.994189 13864 raft_consensus.cc:359] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:11.995038 13864 raft_consensus.cc:385] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.994655 13861 raft_consensus.cc:515] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:11.995385 13864 raft_consensus.cc:740] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.995365 13860 raft_consensus.cc:359] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:11.996294 13860 raft_consensus.cc:385] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.996639 13860 raft_consensus.cc:740] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.996847 13863 tablet_bootstrap.cc:492] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:11.996429 13864 consensus_queue.cc:260] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:11.997481 13860 consensus_queue.cc:260] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:11.997558 13863 ts_tablet_manager.cc:1403] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.007s
I20260709 13:05:11.999415 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:12.006954 13863 raft_consensus.cc:359] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.002349 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:12.002444 13861 leader_election.cc:290] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
W20260709 13:05:12.007859 13533 leader_election.cc:343] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.999862 13860 ts_tablet_manager.cc:1434] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:05:11.999267 13864 ts_tablet_manager.cc:1434] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
W20260709 13:05:12.009371 13534 leader_election.cc:343] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.009716 13860 tablet_bootstrap.cc:492] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:12.009799 13864 tablet_bootstrap.cc:492] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:12.009992 13534 leader_election.cc:304] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61; no voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:12.011444 13861 raft_consensus.cc:2749] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.007862 13863 raft_consensus.cc:385] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.014400 13863 raft_consensus.cc:740] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.015364 13863 consensus_queue.cc:260] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.017647 13864 tablet_bootstrap.cc:654] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.018520 13863 ts_tablet_manager.cc:1434] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:05:12.021093 13863 tablet_bootstrap.cc:492] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:12.028044 13863 tablet_bootstrap.cc:654] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.031375 13860 tablet_bootstrap.cc:654] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.064819 13863 tablet_bootstrap.cc:492] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:12.064877 13860 tablet_bootstrap.cc:492] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:12.065280 13864 tablet_bootstrap.cc:492] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:12.065485 13863 ts_tablet_manager.cc:1403] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.023s
I20260709 13:05:12.065555 13860 ts_tablet_manager.cc:1403] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.021s
I20260709 13:05:12.065893 13864 ts_tablet_manager.cc:1403] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.031s
I20260709 13:05:12.068151 13863 raft_consensus.cc:359] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.068864 13863 raft_consensus.cc:385] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.069114 13863 raft_consensus.cc:740] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.069257 13860 raft_consensus.cc:359] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.069804 13863 consensus_queue.cc:260] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.070233 13860 raft_consensus.cc:385] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.070657 13860 raft_consensus.cc:740] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.070854 13861 raft_consensus.cc:493] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.071370 13861 raft_consensus.cc:515] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.071467 13860 consensus_queue.cc:260] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.072173 13863 ts_tablet_manager.cc:1434] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:12.073347 13863 tablet_bootstrap.cc:492] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:12.074180 13860 ts_tablet_manager.cc:1434] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:12.069929 13864 raft_consensus.cc:359] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.074690 13864 raft_consensus.cc:385] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.074753 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943f8ea3304144259be44f5f6c24fc5b" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:12.075091 13864 raft_consensus.cc:740] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.075281 13860 tablet_bootstrap.cc:492] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:12.076105 13864 consensus_queue.cc:260] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.076828 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943f8ea3304144259be44f5f6c24fc5b" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:12.078270 13716 raft_consensus.cc:2468] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 0.
I20260709 13:05:12.081387 13533 leader_election.cc:304] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
W20260709 13:05:12.082898 13534 leader_election.cc:343] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.083424 13860 tablet_bootstrap.cc:654] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.083750 13810 raft_consensus.cc:2804] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.084173 13810 raft_consensus.cc:493] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.084517 13810 raft_consensus.cc:3060] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.086059 13861 leader_election.cc:290] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.093516 13864 ts_tablet_manager.cc:1434] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:05:12.098349 13863 tablet_bootstrap.cc:654] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.105713 13864 tablet_bootstrap.cc:492] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:12.116482 13864 tablet_bootstrap.cc:654] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.109347 13810 raft_consensus.cc:515] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.123071 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943f8ea3304144259be44f5f6c24fc5b" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
W20260709 13:05:12.124996 13534 leader_election.cc:343] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.128072 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943f8ea3304144259be44f5f6c24fc5b" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:12.128878 13716 raft_consensus.cc:3060] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.138195 13810 leader_election.cc:290] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Requested vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.144456 13716 raft_consensus.cc:2468] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 1.
I20260709 13:05:12.144901 13860 tablet_bootstrap.cc:492] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:12.145505 13860 ts_tablet_manager.cc:1403] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.040s
I20260709 13:05:12.145639 13863 tablet_bootstrap.cc:492] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:12.146296 13863 ts_tablet_manager.cc:1403] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.030s
I20260709 13:05:12.146559 13533 leader_election.cc:304] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:12.148195 13810 raft_consensus.cc:2804] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.148614 13860 raft_consensus.cc:359] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.149108 13810 raft_consensus.cc:697] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:12.149426 13860 raft_consensus.cc:385] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.149811 13860 raft_consensus.cc:740] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.149672 13863 raft_consensus.cc:359] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.150208 13810 consensus_queue.cc:237] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.150738 13863 raft_consensus.cc:385] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.150739 13860 consensus_queue.cc:260] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.151445 13863 raft_consensus.cc:740] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.152444 13863 consensus_queue.cc:260] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.153493 13860 ts_tablet_manager.cc:1434] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:12.154623 13860 tablet_bootstrap.cc:492] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:12.155072 13863 ts_tablet_manager.cc:1434] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:12.156199 13863 tablet_bootstrap.cc:492] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:12.159878 13864 tablet_bootstrap.cc:492] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:12.160467 13864 ts_tablet_manager.cc:1403] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.012s
I20260709 13:05:12.161543 13860 tablet_bootstrap.cc:654] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.163589 13864 raft_consensus.cc:359] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.164538 13864 raft_consensus.cc:385] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.164829 13864 raft_consensus.cc:740] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.165634 13864 consensus_queue.cc:260] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.167975 13864 ts_tablet_manager.cc:1434] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:12.164108 13466 catalog_manager.cc:5697] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.168968 13863 tablet_bootstrap.cc:654] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.173262 13860 tablet_bootstrap.cc:492] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:12.173842 13860 ts_tablet_manager.cc:1403] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:05:12.175824 13864 tablet_bootstrap.cc:492] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:12.177590 13860 raft_consensus.cc:359] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.178622 13860 raft_consensus.cc:385] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.182906 13860 raft_consensus.cc:740] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.184482 13864 tablet_bootstrap.cc:654] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.184156 13860 consensus_queue.cc:260] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.188871 13860 ts_tablet_manager.cc:1434] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:05:12.190570 13860 tablet_bootstrap.cc:492] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:12.201741 13860 tablet_bootstrap.cc:654] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.227025 13860 tablet_bootstrap.cc:492] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:12.227555 13860 ts_tablet_manager.cc:1403] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.005s
I20260709 13:05:12.231179 13860 raft_consensus.cc:359] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.232167 13860 raft_consensus.cc:385] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.232545 13860 raft_consensus.cc:740] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.233721 13860 consensus_queue.cc:260] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.236814 13860 ts_tablet_manager.cc:1434] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:12.239569 13880 raft_consensus.cc:493] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.240341 13880 raft_consensus.cc:515] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.242736 13880 leader_election.cc:290] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.245527 13863 tablet_bootstrap.cc:492] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:12.246105 13863 ts_tablet_manager.cc:1403] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.058s
I20260709 13:05:12.247643 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8672ee2b1af7424bb262d0c8589a8cbb" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:12.248391 13864 tablet_bootstrap.cc:492] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:12.248903 13864 ts_tablet_manager.cc:1403] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.073s	user 0.030s	sys 0.034s
I20260709 13:05:12.248936 13863 raft_consensus.cc:359] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.249693 13863 raft_consensus.cc:385] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.249939 13863 raft_consensus.cc:740] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
W20260709 13:05:12.250346 13608 leader_election.cc:343] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.250700 13863 consensus_queue.cc:260] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.252074 13864 raft_consensus.cc:359] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.252807 13864 raft_consensus.cc:385] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.253073 13864 raft_consensus.cc:740] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.253281 13863 ts_tablet_manager.cc:1434] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:05:12.253973 13846 raft_consensus.cc:493] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.253814 13864 consensus_queue.cc:260] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.254418 13863 tablet_bootstrap.cc:492] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:12.254558 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8672ee2b1af7424bb262d0c8589a8cbb" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
W20260709 13:05:12.256338 13610 leader_election.cc:343] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.254467 13846 raft_consensus.cc:515] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.256868 13610 leader_election.cc:304] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:12.259698 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:12.259991 13864 ts_tablet_manager.cc:1434] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.004s
I20260709 13:05:12.260416 13568 raft_consensus.cc:2468] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 0.
I20260709 13:05:12.261184 13864 tablet_bootstrap.cc:492] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:12.260991 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:12.262059 13863 tablet_bootstrap.cc:654] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.262382 13684 leader_election.cc:304] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
W20260709 13:05:12.263053 13683 leader_election.cc:343] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.263650 13810 raft_consensus.cc:493] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.263849 13882 raft_consensus.cc:2804] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.264611 13882 raft_consensus.cc:493] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.264204 13810 raft_consensus.cc:515] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.265094 13882 raft_consensus.cc:3060] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.266724 13810 leader_election.cc:290] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.267954 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887520213fb46aca97a33b873744d4f" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:12.268355 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887520213fb46aca97a33b873744d4f" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:12.268760 13864 tablet_bootstrap.cc:654] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.268647 13716 raft_consensus.cc:2468] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 0.
I20260709 13:05:12.270051 13533 leader_election.cc:304] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:12.270269 13846 leader_election.cc:290] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
W20260709 13:05:12.270848 13534 leader_election.cc:343] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.271190 13880 raft_consensus.cc:2749] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.271732 13810 raft_consensus.cc:2804] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.272186 13810 raft_consensus.cc:493] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.272518 13810 raft_consensus.cc:3060] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.274271 13882 raft_consensus.cc:515] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.277607 13882 leader_election.cc:290] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:12.277935 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
W20260709 13:05:12.279601 13683 leader_election.cc:343] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.279625 13810 raft_consensus.cc:515] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.280768 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:12.281389 13568 raft_consensus.cc:3060] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.283113 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887520213fb46aca97a33b873744d4f" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:12.284965 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887520213fb46aca97a33b873744d4f" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
W20260709 13:05:12.284971 13534 leader_election.cc:343] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.285651 13716 raft_consensus.cc:3060] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.290198 13860 tablet_bootstrap.cc:492] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:12.293205 13716 raft_consensus.cc:2468] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 1.
I20260709 13:05:12.294647 13533 leader_election.cc:304] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:12.295595 13871 raft_consensus.cc:2804] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.296068 13871 raft_consensus.cc:697] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:12.296892 13871 consensus_queue.cc:237] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.297601 13860 tablet_bootstrap.cc:654] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.298568 13568 raft_consensus.cc:2468] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 1.
I20260709 13:05:12.304147 13684 leader_election.cc:304] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:12.305809 13846 raft_consensus.cc:2804] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.306473 13846 raft_consensus.cc:697] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 1 LEADER]: Becoming Leader. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Running, Role: LEADER
I20260709 13:05:12.307619 13846 consensus_queue.cc:237] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.308454 13810 leader_election.cc:290] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Requested vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.315014 13860 tablet_bootstrap.cc:492] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:12.320451 13860 ts_tablet_manager.cc:1403] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.000s
I20260709 13:05:12.324898 13860 raft_consensus.cc:359] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.326195 13860 raft_consensus.cc:385] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.326668 13860 raft_consensus.cc:740] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.327705 13860 consensus_queue.cc:260] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.331038 13860 ts_tablet_manager.cc:1434] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:05:12.336640 13860 tablet_bootstrap.cc:492] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:12.344054 13880 raft_consensus.cc:493] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.344718 13880 raft_consensus.cc:515] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.346012 13860 tablet_bootstrap.cc:654] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.345690 13467 catalog_manager.cc:5697] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.347990 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d902773d4eefb048904ac2054d64" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:12.348902 13880 leader_election.cc:290] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.349125 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d902773d4eefb048904ac2054d64" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
W20260709 13:05:12.350188 13610 leader_election.cc:343] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:12.351380 13608 leader_election.cc:343] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.351821 13608 leader_election.cc:304] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:12.352911 13880 raft_consensus.cc:2749] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.363236 13860 tablet_bootstrap.cc:492] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:12.368462 13860 ts_tablet_manager.cc:1403] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.007s
I20260709 13:05:12.369885 13864 tablet_bootstrap.cc:492] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:12.370543 13864 ts_tablet_manager.cc:1403] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.110s	user 0.047s	sys 0.047s
I20260709 13:05:12.371475 13863 tablet_bootstrap.cc:492] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:12.371429 13860 raft_consensus.cc:359] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.372144 13863 ts_tablet_manager.cc:1403] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.118s	user 0.024s	sys 0.049s
I20260709 13:05:12.372267 13860 raft_consensus.cc:385] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.372628 13860 raft_consensus.cc:740] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.373320 13860 consensus_queue.cc:260] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.373454 13464 catalog_manager.cc:5697] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6cd14a97d8474cd697f65afab7060d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.374892 13860 ts_tablet_manager.cc:1434] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:12.375787 13860 tablet_bootstrap.cc:492] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61: Bootstrap starting.
I20260709 13:05:12.375653 13863 raft_consensus.cc:359] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.378450 13863 raft_consensus.cc:385] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.378748 13863 raft_consensus.cc:740] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.379499 13863 consensus_queue.cc:260] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.382961 13860 tablet_bootstrap.cc:654] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.384406 13863 ts_tablet_manager.cc:1434] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:12.385345 13863 tablet_bootstrap.cc:492] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:12.386394 13880 raft_consensus.cc:493] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.386958 13880 raft_consensus.cc:515] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.389096 13880 leader_election.cc:290] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.390820 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
W20260709 13:05:12.392340 13608 leader_election.cc:343] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.392846 13864 raft_consensus.cc:359] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.393718 13864 raft_consensus.cc:385] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.393368 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:12.394155 13864 raft_consensus.cc:740] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.394505 13568 raft_consensus.cc:2468] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 0.
I20260709 13:05:12.395272 13864 consensus_queue.cc:260] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.396512 13610 leader_election.cc:304] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:12.398280 13864 ts_tablet_manager.cc:1434] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:05:12.398519 13880 raft_consensus.cc:2804] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.399019 13880 raft_consensus.cc:493] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.399386 13880 raft_consensus.cc:3060] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.399605 13864 tablet_bootstrap.cc:492] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:12.399873 13863 tablet_bootstrap.cc:654] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.408032 13864 tablet_bootstrap.cc:654] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.414250 13878 raft_consensus.cc:493] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.415061 13878 raft_consensus.cc:515] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.416921 13880 raft_consensus.cc:515] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.418947 13810 raft_consensus.cc:493] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.420284 13810 raft_consensus.cc:515] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.421161 13846 raft_consensus.cc:493] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.421411 13569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:12.422168 13569 raft_consensus.cc:3060] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.421860 13846 raft_consensus.cc:515] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.419250 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:12.425562 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6cae46e260b44d1be168af32741a927" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:12.418016 13878 leader_election.cc:290] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.426362 13645 raft_consensus.cc:2468] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 0.
I20260709 13:05:12.419531 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:12.427551 13568 raft_consensus.cc:2393] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c87b1b6aa93e412797a928d4d1e15361 in current term 1: Already voted for candidate 6cd14a97d8474cd697f65afab7060d9e in this term.
I20260709 13:05:12.428232 13683 leader_election.cc:304] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:12.429203 13882 raft_consensus.cc:2804] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.429615 13882 raft_consensus.cc:493] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.429944 13846 leader_election.cc:290] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:12.430414 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6cae46e260b44d1be168af32741a927" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:12.430856 13610 leader_election.cc:304] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:12.431254 13568 raft_consensus.cc:2468] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 0.
I20260709 13:05:12.431795 13878 raft_consensus.cc:3060] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.429961 13882 raft_consensus.cc:3060] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.432312 13880 leader_election.cc:290] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.433068 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:12.431308 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8672ee2b1af7424bb262d0c8589a8cbb" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
W20260709 13:05:12.435019 13608 leader_election.cc:343] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.436098 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8672ee2b1af7424bb262d0c8589a8cbb" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
W20260709 13:05:12.436374 13533 leader_election.cc:343] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.436779 13645 raft_consensus.cc:2468] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 0.
I20260709 13:05:12.437734 13810 leader_election.cc:290] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.438238 13534 leader_election.cc:304] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:12.439121 13810 raft_consensus.cc:2804] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.439502 13810 raft_consensus.cc:493] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.439857 13810 raft_consensus.cc:3060] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.440464 13864 tablet_bootstrap.cc:492] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:12.441883 13864 ts_tablet_manager.cc:1403] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.001s
I20260709 13:05:12.443044 13860 tablet_bootstrap.cc:492] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61: No bootstrap required, opened a new log
I20260709 13:05:12.440598 13878 raft_consensus.cc:2749] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.443619 13860 ts_tablet_manager.cc:1403] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.010s
I20260709 13:05:12.443277 13882 raft_consensus.cc:515] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.446488 13864 raft_consensus.cc:359] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.446942 13860 raft_consensus.cc:359] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.447194 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6cae46e260b44d1be168af32741a927" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:12.447628 13860 raft_consensus.cc:385] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.447321 13864 raft_consensus.cc:385] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.431295 13569 raft_consensus.cc:2468] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:12.447943 13568 raft_consensus.cc:3060] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.447983 13860 raft_consensus.cc:740] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.448592 13864 raft_consensus.cc:740] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.449018 13860 consensus_queue.cc:260] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.449402 13864 consensus_queue.cc:260] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.451692 13610 leader_election.cc:304] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:12.453269 13878 raft_consensus.cc:2804] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.457630 13878 raft_consensus.cc:697] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:12.458806 13864 ts_tablet_manager.cc:1434] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:05:12.459895 13860 ts_tablet_manager.cc:1434] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 13:05:12.460258 13864 tablet_bootstrap.cc:492] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:12.458724 13878 consensus_queue.cc:237] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.463021 13863 tablet_bootstrap.cc:492] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:12.463624 13863 ts_tablet_manager.cc:1403] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.006s
I20260709 13:05:12.466557 13863 raft_consensus.cc:359] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.467257 13863 raft_consensus.cc:385] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.467559 13863 raft_consensus.cc:740] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.469831 13882 leader_election.cc:290] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:12.470630 13810 raft_consensus.cc:515] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.470947 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6cae46e260b44d1be168af32741a927" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:12.471591 13645 raft_consensus.cc:3060] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.473251 13568 raft_consensus.cc:2468] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 1.
I20260709 13:05:12.473754 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8672ee2b1af7424bb262d0c8589a8cbb" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:12.474464 13644 raft_consensus.cc:3060] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.474612 13684 leader_election.cc:304] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:12.475584 13882 raft_consensus.cc:2804] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.476038 13882 raft_consensus.cc:697] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 1 LEADER]: Becoming Leader. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Running, Role: LEADER
I20260709 13:05:12.476828 13882 consensus_queue.cc:237] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.479518 13645 raft_consensus.cc:2468] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 1.
I20260709 13:05:12.483348 13644 raft_consensus.cc:2468] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 1.
I20260709 13:05:12.485091 13864 tablet_bootstrap.cc:654] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.486280 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8672ee2b1af7424bb262d0c8589a8cbb" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
W20260709 13:05:12.488340 13533 leader_election.cc:343] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.485533 13810 leader_election.cc:290] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Requested vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.490522 13534 leader_election.cc:304] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:12.490669 13810 raft_consensus.cc:493] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.491232 13810 raft_consensus.cc:515] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.491668 13861 raft_consensus.cc:2804] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.492154 13861 raft_consensus.cc:697] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:12.492964 13861 consensus_queue.cc:237] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.493448 13810 leader_election.cc:290] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.468297 13863 consensus_queue.cc:260] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.494498 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d902773d4eefb048904ac2054d64" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:12.495487 13644 raft_consensus.cc:2468] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 0.
I20260709 13:05:12.496387 13863 ts_tablet_manager.cc:1434] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:05:12.496742 13534 leader_election.cc:304] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:12.497490 13863 tablet_bootstrap.cc:492] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:12.496887 13466 catalog_manager.cc:5697] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195). New cstate: current_term: 1 leader_uuid: "6cd14a97d8474cd697f65afab7060d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.497762 13810 raft_consensus.cc:2804] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.497926 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d902773d4eefb048904ac2054d64" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:12.498342 13810 raft_consensus.cc:493] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.498690 13810 raft_consensus.cc:3060] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:12.499508 13533 leader_election.cc:343] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.506789 13810 raft_consensus.cc:515] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.509814 13863 tablet_bootstrap.cc:654] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.509917 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d902773d4eefb048904ac2054d64" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:12.510757 13644 raft_consensus.cc:3060] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.519652 13644 raft_consensus.cc:2468] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 1.
I20260709 13:05:12.519184 13466 catalog_manager.cc:5697] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 0 to 1, leader changed from <none> to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.520860 13534 leader_election.cc:304] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:12.521744 13871 raft_consensus.cc:2804] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.522271 13871 raft_consensus.cc:697] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:12.523208 13871 consensus_queue.cc:237] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.526327 13863 tablet_bootstrap.cc:492] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:12.526902 13863 ts_tablet_manager.cc:1403] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.008s
I20260709 13:05:12.528566 13810 leader_election.cc:290] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Requested vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.529385 13810 raft_consensus.cc:493] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.529604 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d902773d4eefb048904ac2054d64" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:12.529817 13810 raft_consensus.cc:515] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
W20260709 13:05:12.531020 13533 leader_election.cc:343] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.532907 13810 leader_election.cc:290] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.532248 13467 catalog_manager.cc:5697] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.533898 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f626b37da743e9a5a292eca013e549" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:12.534577 13716 raft_consensus.cc:2468] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 0.
I20260709 13:05:12.535229 13863 raft_consensus.cc:359] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.535907 13533 leader_election.cc:304] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:12.536265 13863 raft_consensus.cc:385] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.536706 13863 raft_consensus.cc:740] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.537218 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f626b37da743e9a5a292eca013e549" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:12.536791 13810 raft_consensus.cc:2804] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.540138 13810 raft_consensus.cc:493] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.540930 13810 raft_consensus.cc:3060] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.537923 13863 consensus_queue.cc:260] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.545670 13863 ts_tablet_manager.cc:1434] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 13:05:12.537864 13644 raft_consensus.cc:2468] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 0.
I20260709 13:05:12.546734 13863 tablet_bootstrap.cc:492] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:12.548728 13864 tablet_bootstrap.cc:492] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:12.549365 13864 ts_tablet_manager.cc:1403] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.089s	user 0.021s	sys 0.018s
I20260709 13:05:12.551573 13810 raft_consensus.cc:515] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.552722 13864 raft_consensus.cc:359] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.553413 13863 tablet_bootstrap.cc:654] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.553620 13864 raft_consensus.cc:385] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.554131 13864 raft_consensus.cc:740] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.554975 13864 consensus_queue.cc:260] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.556512 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f626b37da743e9a5a292eca013e549" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:12.557076 13716 raft_consensus.cc:3060] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.559046 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f626b37da743e9a5a292eca013e549" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:12.559645 13644 raft_consensus.cc:3060] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.567493 13716 raft_consensus.cc:2468] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 1.
I20260709 13:05:12.569743 13810 leader_election.cc:290] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Requested vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.575100 13533 leader_election.cc:304] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:12.579082 13864 ts_tablet_manager.cc:1434] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:05:12.579803 13810 raft_consensus.cc:2804] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.580493 13644 raft_consensus.cc:2468] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 1.
I20260709 13:05:12.581496 13810 raft_consensus.cc:697] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:12.582499 13810 consensus_queue.cc:237] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.583060 13863 tablet_bootstrap.cc:492] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:12.583592 13863 ts_tablet_manager.cc:1403] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.002s
I20260709 13:05:12.586736 13864 tablet_bootstrap.cc:492] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:12.586488 13863 raft_consensus.cc:359] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.587157 13863 raft_consensus.cc:385] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.587419 13863 raft_consensus.cc:740] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.588081 13863 consensus_queue.cc:260] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.588766 13878 raft_consensus.cc:493] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.589483 13878 raft_consensus.cc:515] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.593076 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:12.593415 13864 tablet_bootstrap.cc:654] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.593708 13568 raft_consensus.cc:2468] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 0.
I20260709 13:05:12.594185 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:12.595088 13719 raft_consensus.cc:2468] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 0.
I20260709 13:05:12.597177 13878 leader_election.cc:290] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.601729 13610 leader_election.cc:304] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:12.609193 13465 catalog_manager.cc:5697] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.606350 13882 raft_consensus.cc:493] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.611493 13882 raft_consensus.cc:515] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.610486 13880 raft_consensus.cc:2804] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.614303 13880 raft_consensus.cc:493] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.614692 13880 raft_consensus.cc:3060] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.605669 13863 ts_tablet_manager.cc:1434] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:05:12.619738 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d902773d4eefb048904ac2054d64" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:12.621798 13863 tablet_bootstrap.cc:492] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361: Bootstrap starting.
I20260709 13:05:12.631146 13863 tablet_bootstrap.cc:654] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.632650 13864 tablet_bootstrap.cc:492] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:12.633227 13864 ts_tablet_manager.cc:1403] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.015s
I20260709 13:05:12.634982 13882 leader_election.cc:290] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:12.636160 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d902773d4eefb048904ac2054d64" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:12.636998 13644 raft_consensus.cc:2393] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6cd14a97d8474cd697f65afab7060d9e in current term 1: Already voted for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in this term.
I20260709 13:05:12.636759 13864 raft_consensus.cc:359] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.637791 13864 raft_consensus.cc:385] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.638180 13864 raft_consensus.cc:740] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.638381 13683 leader_election.cc:304] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:12.639909 13882 raft_consensus.cc:3060] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.646339 13864 consensus_queue.cc:260] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.652052 13864 ts_tablet_manager.cc:1434] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.002s
I20260709 13:05:12.653127 13864 tablet_bootstrap.cc:492] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e: Bootstrap starting.
I20260709 13:05:12.659616 13864 tablet_bootstrap.cc:654] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.659209 13880 raft_consensus.cc:515] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.662283 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:12.662616 13882 raft_consensus.cc:2749] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.662863 13568 raft_consensus.cc:3060] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.667645 13716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:12.666755 13466 catalog_manager.cc:5697] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.668236 13716 raft_consensus.cc:3060] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.668846 13568 raft_consensus.cc:2468] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:12.670071 13610 leader_election.cc:304] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:12.670992 13878 raft_consensus.cc:2804] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.671461 13878 raft_consensus.cc:697] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:12.672271 13878 consensus_queue.cc:237] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.675652 13716 raft_consensus.cc:2468] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:12.677994 13880 leader_election.cc:290] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 1 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.681363 13863 tablet_bootstrap.cc:492] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361: No bootstrap required, opened a new log
I20260709 13:05:12.682107 13863 ts_tablet_manager.cc:1403] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.010s
I20260709 13:05:12.684680 13864 tablet_bootstrap.cc:492] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e: No bootstrap required, opened a new log
I20260709 13:05:12.685285 13864 ts_tablet_manager.cc:1403] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.012s
I20260709 13:05:12.684927 13863 raft_consensus.cc:359] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.685967 13863 raft_consensus.cc:385] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.686278 13863 raft_consensus.cc:740] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.686944 13863 consensus_queue.cc:260] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.688427 13864 raft_consensus.cc:359] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.689133 13863 ts_tablet_manager.cc:1434] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:12.689178 13864 raft_consensus.cc:385] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.689872 13864 raft_consensus.cc:740] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.689181 13466 catalog_manager.cc:5697] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 0 to 1, leader changed from <none> to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.690491 13864 consensus_queue.cc:260] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.692404 13864 ts_tablet_manager.cc:1434] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:12.706018 13882 consensus_queue.cc:1048] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.717752 13645 raft_consensus.cc:3060] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.726517 13810 consensus_queue.cc:1048] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.729636 13907 consensus_queue.cc:1048] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.751098 13810 consensus_queue.cc:1048] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.803108 13907 raft_consensus.cc:493] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.803623 13907 raft_consensus.cc:515] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.805492 13907 leader_election.cc:290] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:12.806280 13568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" is_pre_election: true
I20260709 13:05:12.806617 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:12.807003 13568 raft_consensus.cc:2393] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6cd14a97d8474cd697f65afab7060d9e in current term 1: Already voted for candidate c87b1b6aa93e412797a928d4d1e15361 in this term.
I20260709 13:05:12.808025 13683 leader_election.cc:304] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:12.808734 13907 raft_consensus.cc:3060] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.814756 13907 raft_consensus.cc:2749] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.861194 13810 consensus_queue.cc:1048] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.866909 13644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489"
dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
mode: GRACEFUL
new_leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
 from {username='slave'} at 127.0.0.1:41916
I20260709 13:05:12.867530 13644 raft_consensus.cc:606] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Received request to transfer leadership to TS 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:12.878789 13644 raft_consensus.cc:3060] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.883133 13645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780"
dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
mode: GRACEFUL
new_leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
 from {username='slave'} at 127.0.0.1:41916
I20260709 13:05:12.883842 13645 raft_consensus.cc:606] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Received request to transfer leadership to TS 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:12.889461 13914 consensus_queue.cc:1048] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.894881 13907 consensus_queue.cc:1048] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.897717 13878 consensus_queue.cc:1048] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.903781 13716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566"
dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
mode: GRACEFUL
new_leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
 from {username='slave'} at 127.0.0.1:36658
I20260709 13:05:12.904500 13716 raft_consensus.cc:606] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 1 LEADER]: Received request to transfer leadership to TS 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:12.909459 13878 consensus_queue.cc:1048] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.915093 13569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f331d902773d4eefb048904ac2054d64"
dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
mode: GRACEFUL
new_leader_uuid: "c87b1b6aa93e412797a928d4d1e15361"
 from {username='slave'} at 127.0.0.1:41026
I20260709 13:05:12.916155 13880 raft_consensus.cc:993] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361: : Instructing follower 29d2cbebb8f2464f8dddefda1adaaf61 to start an election
I20260709 13:05:12.916810 13880 raft_consensus.cc:1081] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Signalling peer 29d2cbebb8f2464f8dddefda1adaaf61 to start an election
I20260709 13:05:12.920178 13570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780"
dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
 from {username='slave'} at 127.0.0.1:41012
I20260709 13:05:12.920720 13570 raft_consensus.cc:493] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:12.921092 13570 raft_consensus.cc:3060] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.915863 13569 raft_consensus.cc:606] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Received request to transfer leadership to TS c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:12.944496 13716 raft_consensus.cc:3060] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.950682 13882 consensus_queue.cc:1048] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.954088 13914 consensus_queue.cc:1048] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.954368 13568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8f626b37da743e9a5a292eca013e549"
dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
mode: GRACEFUL
new_leader_uuid: "c87b1b6aa93e412797a928d4d1e15361"
 from {username='slave'} at 127.0.0.1:41026
I20260709 13:05:12.954970 13568 raft_consensus.cc:606] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Received request to transfer leadership to TS c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:12.961033 13570 raft_consensus.cc:515] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.965497 13569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8672ee2b1af7424bb262d0c8589a8cbb"
dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
mode: GRACEFUL
new_leader_uuid: "c87b1b6aa93e412797a928d4d1e15361"
 from {username='slave'} at 127.0.0.1:41026
I20260709 13:05:12.966315 13569 raft_consensus.cc:606] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Received request to transfer leadership to TS c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:12.967377 13645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:12.968321 13645 raft_consensus.cc:3055] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:12.968699 13645 raft_consensus.cc:740] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:12.969884 13645 consensus_queue.cc:260] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:12.971788 13645 raft_consensus.cc:3060] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:12.974017 13719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6cae46e260b44d1be168af32741a927"
dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
mode: GRACEFUL
new_leader_uuid: "c87b1b6aa93e412797a928d4d1e15361"
 from {username='slave'} at 127.0.0.1:36658
I20260709 13:05:12.974952 13719 raft_consensus.cc:606] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 1 LEADER]: Received request to transfer leadership to TS c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:12.988622 13569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4887520213fb46aca97a33b873744d4f"
dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
mode: GRACEFUL
new_leader_uuid: "6cd14a97d8474cd697f65afab7060d9e"
 from {username='slave'} at 127.0.0.1:41026
I20260709 13:05:12.989396 13569 raft_consensus.cc:606] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Received request to transfer leadership to TS 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:12.992532 13810 consensus_queue.cc:1048] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.994469 13871 consensus_queue.cc:1048] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.998416 13570 leader_election.cc:290] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 2 election: Requested vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:12.999735 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:13.000460 13719 raft_consensus.cc:3060] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.001048 13645 raft_consensus.cc:2468] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 2.
I20260709 13:05:13.005316 13907 raft_consensus.cc:993] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e: : Instructing follower c87b1b6aa93e412797a928d4d1e15361 to start an election
I20260709 13:05:13.005914 13882 raft_consensus.cc:1081] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 1 LEADER]: Signalling peer c87b1b6aa93e412797a928d4d1e15361 to start an election
I20260709 13:05:13.007866 13644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6cae46e260b44d1be168af32741a927"
dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
 from {username='slave'} at 127.0.0.1:41904
I20260709 13:05:13.008441 13644 raft_consensus.cc:493] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.008822 13644 raft_consensus.cc:3060] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.011888 13810 consensus_queue.cc:1048] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.015965 13810 consensus_queue.cc:1048] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.016971 13644 raft_consensus.cc:515] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.019986 13569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6cae46e260b44d1be168af32741a927" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:13.020711 13569 raft_consensus.cc:3060] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.025231 13719 raft_consensus.cc:2468] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 2.
I20260709 13:05:13.026674 13533 leader_election.cc:304] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:13.028558 13810 raft_consensus.cc:2804] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.029848 13569 raft_consensus.cc:2468] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:13.029953 13810 raft_consensus.cc:697] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:13.031200 13810 consensus_queue.cc:237] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.031523 13610 leader_election.cc:304] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:13.033041 13644 leader_election.cc:290] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:13.034636 13880 raft_consensus.cc:2804] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.035197 13880 raft_consensus.cc:697] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:13.036036 13880 consensus_queue.cc:237] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.043393 13466 catalog_manager.cc:5697] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 1 to 2, leader changed from c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194) to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.048413 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6cae46e260b44d1be168af32741a927" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:13.049237 13715 raft_consensus.cc:3055] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.049582 13715 raft_consensus.cc:740] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Running, Role: LEADER
I20260709 13:05:13.049763 13914 consensus_queue.cc:1048] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.050752 13715 consensus_queue.cc:260] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.052148 13715 raft_consensus.cc:3060] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.058907 13914 raft_consensus.cc:993] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61: : Instructing follower c87b1b6aa93e412797a928d4d1e15361 to start an election
I20260709 13:05:13.059654 13871 raft_consensus.cc:1081] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Signalling peer c87b1b6aa93e412797a928d4d1e15361 to start an election
I20260709 13:05:13.060179 13715 raft_consensus.cc:2468] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:13.062726 13642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8672ee2b1af7424bb262d0c8589a8cbb"
dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
 from {username='slave'} at 127.0.0.1:41908
I20260709 13:05:13.063392 13642 raft_consensus.cc:493] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.063784 13642 raft_consensus.cc:3060] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.070922 13466 catalog_manager.cc:5697] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 1 to 2, leader changed from 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195) to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.072212 13642 raft_consensus.cc:515] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.078696 13914 raft_consensus.cc:993] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61: : Instructing follower c87b1b6aa93e412797a928d4d1e15361 to start an election
I20260709 13:05:13.078852 13642 leader_election.cc:290] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:13.079232 13914 raft_consensus.cc:1081] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Signalling peer c87b1b6aa93e412797a928d4d1e15361 to start an election
I20260709 13:05:13.079838 13569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8672ee2b1af7424bb262d0c8589a8cbb" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:13.080492 13569 raft_consensus.cc:3055] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.080765 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8672ee2b1af7424bb262d0c8589a8cbb" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:13.081465 13719 raft_consensus.cc:3060] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.080796 13569 raft_consensus.cc:740] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:13.087848 13569 consensus_queue.cc:260] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.091295 13719 raft_consensus.cc:2468] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:13.093145 13642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f331d902773d4eefb048904ac2054d64"
dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
 from {username='slave'} at 127.0.0.1:41908
I20260709 13:05:13.093840 13642 raft_consensus.cc:493] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.094257 13642 raft_consensus.cc:3060] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.094300 13861 raft_consensus.cc:993] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61: : Instructing follower c87b1b6aa93e412797a928d4d1e15361 to start an election
I20260709 13:05:13.094911 13914 raft_consensus.cc:1081] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Signalling peer c87b1b6aa93e412797a928d4d1e15361 to start an election
I20260709 13:05:13.089143 13569 raft_consensus.cc:3060] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.099978 13644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8f626b37da743e9a5a292eca013e549"
dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
 from {username='slave'} at 127.0.0.1:41908
I20260709 13:05:13.103061 13644 raft_consensus.cc:493] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.103577 13644 raft_consensus.cc:3060] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.104166 13608 leader_election.cc:304] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:13.106428 13880 raft_consensus.cc:2804] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.106902 13880 raft_consensus.cc:697] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:13.107702 13880 consensus_queue.cc:237] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.108047 13569 raft_consensus.cc:2468] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:13.110333 13642 raft_consensus.cc:515] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.111581 13645 raft_consensus.cc:1240] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Rejecting Update request from peer 29d2cbebb8f2464f8dddefda1adaaf61 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:13.113901 13642 leader_election.cc:290] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:13.114133 13569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d902773d4eefb048904ac2054d64" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:13.114785 13569 raft_consensus.cc:3055] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.115104 13569 raft_consensus.cc:740] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:13.115830 13719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d902773d4eefb048904ac2054d64" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:13.115900 13569 consensus_queue.cc:260] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.116662 13719 raft_consensus.cc:3060] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.117364 13569 raft_consensus.cc:3060] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.117940 13644 raft_consensus.cc:515] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.124850 13719 raft_consensus.cc:2468] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:13.125195 13569 raft_consensus.cc:2468] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:13.126194 13608 leader_election.cc:304] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:13.126927 13644 leader_election.cc:290] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:13.127413 13880 raft_consensus.cc:2804] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.127950 13880 raft_consensus.cc:697] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:13.128708 13880 consensus_queue.cc:237] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.129982 13569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f626b37da743e9a5a292eca013e549" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:13.130414 13846 raft_consensus.cc:993] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e: : Instructing follower 29d2cbebb8f2464f8dddefda1adaaf61 to start an election
I20260709 13:05:13.130657 13569 raft_consensus.cc:3055] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.130893 13846 raft_consensus.cc:1081] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 1 LEADER]: Signalling peer 29d2cbebb8f2464f8dddefda1adaaf61 to start an election
I20260709 13:05:13.131134 13569 raft_consensus.cc:740] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:13.132120 13569 consensus_queue.cc:260] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.132345 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f626b37da743e9a5a292eca013e549" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:13.133427 13570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566"
dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
 from {username='slave'} at 127.0.0.1:41022
I20260709 13:05:13.133817 13715 raft_consensus.cc:3060] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.134006 13570 raft_consensus.cc:493] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.134508 13570 raft_consensus.cc:3060] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.138543 13569 raft_consensus.cc:3060] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.141667 13570 raft_consensus.cc:515] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.147534 13569 raft_consensus.cc:2468] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:13.147553 13715 raft_consensus.cc:2468] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:13.148679 13610 leader_election.cc:304] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:13.144714 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:13.149617 13849 raft_consensus.cc:2804] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.149937 13644 raft_consensus.cc:3060] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.150139 13849 raft_consensus.cc:697] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:13.151075 13849 consensus_queue.cc:237] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.151782 13570 leader_election.cc:290] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 2 election: Requested vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:13.156000 13644 raft_consensus.cc:2468] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 2.
I20260709 13:05:13.156450 13467 catalog_manager.cc:5697] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 1 to 2, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.158527 13534 leader_election.cc:304] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:13.158582 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:13.159504 13715 raft_consensus.cc:3055] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.159605 13871 raft_consensus.cc:2804] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.160002 13715 raft_consensus.cc:740] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Running, Role: LEADER
I20260709 13:05:13.160260 13871 raft_consensus.cc:697] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:13.160974 13715 consensus_queue.cc:260] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.161119 13871 consensus_queue.cc:237] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.162375 13715 raft_consensus.cc:3060] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.159526 13467 catalog_manager.cc:5697] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 1 to 2, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.169278 13715 raft_consensus.cc:2468] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 2.
I20260709 13:05:13.172219 13466 catalog_manager.cc:5697] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 1 to 2, leader changed from 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195) to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.178769 13467 catalog_manager.cc:5697] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 1 to 2, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.192699 13878 consensus_queue.cc:1048] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.204537 13849 consensus_queue.cc:1048] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.212448 13880 raft_consensus.cc:993] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361: : Instructing follower 29d2cbebb8f2464f8dddefda1adaaf61 to start an election
I20260709 13:05:13.212949 13880 raft_consensus.cc:1081] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Signalling peer 29d2cbebb8f2464f8dddefda1adaaf61 to start an election
I20260709 13:05:13.214484 13570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489"
dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
 from {username='slave'} at 127.0.0.1:41012
I20260709 13:05:13.215000 13570 raft_consensus.cc:493] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.215319 13570 raft_consensus.cc:3060] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.221113 13570 raft_consensus.cc:515] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.223893 13570 leader_election.cc:290] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 2 election: Requested vote from peers c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:13.224237 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:13.224489 13715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489" candidate_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:13.224915 13644 raft_consensus.cc:3055] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.225011 13715 raft_consensus.cc:3060] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.225278 13644 raft_consensus.cc:740] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:13.226109 13644 consensus_queue.cc:260] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.227339 13644 raft_consensus.cc:3060] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.232434 13715 raft_consensus.cc:2468] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 2.
I20260709 13:05:13.233963 13644 raft_consensus.cc:2468] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29d2cbebb8f2464f8dddefda1adaaf61 in term 2.
I20260709 13:05:13.233956 13533 leader_election.cc:304] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:13.235181 13871 raft_consensus.cc:2804] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.235646 13871 raft_consensus.cc:697] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 LEADER]: Becoming Leader. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:13.236356 13871 consensus_queue.cc:237] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.242520 13466 catalog_manager.cc:5697] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 reported cstate change: term changed from 1 to 2, leader changed from c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194) to 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.348788 13810 raft_consensus.cc:993] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61: : Instructing follower 6cd14a97d8474cd697f65afab7060d9e to start an election
I20260709 13:05:13.349267 13871 raft_consensus.cc:1081] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Signalling peer 6cd14a97d8474cd697f65afab7060d9e to start an election
I20260709 13:05:13.350836 13715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4887520213fb46aca97a33b873744d4f"
dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
 from {username='slave'} at 127.0.0.1:33170
I20260709 13:05:13.351336 13715 raft_consensus.cc:493] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.351702 13715 raft_consensus.cc:3060] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.356712 13715 raft_consensus.cc:515] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.358493 13715 leader_election.cc:290] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:13.359719 13644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887520213fb46aca97a33b873744d4f" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:13.359601 13570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4887520213fb46aca97a33b873744d4f" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:13.360385 13644 raft_consensus.cc:3060] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.360508 13570 raft_consensus.cc:3055] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.360917 13570 raft_consensus.cc:740] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:13.361568 13570 consensus_queue.cc:260] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.362576 13570 raft_consensus.cc:3060] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.365384 13644 raft_consensus.cc:2468] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 2.
I20260709 13:05:13.366685 13683 leader_election.cc:304] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:13.367518 13882 raft_consensus.cc:2804] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.367949 13882 raft_consensus.cc:697] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 2 LEADER]: Becoming Leader. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Running, Role: LEADER
I20260709 13:05:13.368247 13570 raft_consensus.cc:2468] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 2.
I20260709 13:05:13.368741 13882 consensus_queue.cc:237] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:13.375651 13466 catalog_manager.cc:5697] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e reported cstate change: term changed from 1 to 2, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6cd14a97d8474cd697f65afab7060d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:13.424197 13715 raft_consensus.cc:1275] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Refusing update from remote peer 29d2cbebb8f2464f8dddefda1adaaf61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.425417 13871 consensus_queue.cc:1048] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.432664 13644 raft_consensus.cc:1275] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Refusing update from remote peer 29d2cbebb8f2464f8dddefda1adaaf61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.434768 13914 consensus_queue.cc:1048] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.508872 13715 raft_consensus.cc:1275] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.510246 13849 consensus_queue.cc:1048] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.515400 13719 raft_consensus.cc:1275] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.518216 13570 raft_consensus.cc:1275] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.520076 13878 consensus_queue.cc:1048] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.521436 13878 consensus_queue.cc:1048] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.532596 13570 raft_consensus.cc:1275] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.534476 13880 consensus_queue.cc:1048] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.564366 13570 raft_consensus.cc:1275] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.565666 13880 consensus_queue.cc:1048] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.573807 13719 raft_consensus.cc:1275] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.575480 13930 consensus_queue.cc:1048] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.621824 13644 raft_consensus.cc:1275] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Refusing update from remote peer 29d2cbebb8f2464f8dddefda1adaaf61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.623041 13810 consensus_queue.cc:1048] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.632372 13715 raft_consensus.cc:1275] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Refusing update from remote peer 29d2cbebb8f2464f8dddefda1adaaf61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.633770 13914 consensus_queue.cc:1048] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.637408 13644 raft_consensus.cc:1275] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Refusing update from remote peer 29d2cbebb8f2464f8dddefda1adaaf61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.638906 13810 consensus_queue.cc:1048] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.646544 13715 raft_consensus.cc:1275] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Refusing update from remote peer 29d2cbebb8f2464f8dddefda1adaaf61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.656095 13810 consensus_queue.cc:1048] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.689638 13719 raft_consensus.cc:1275] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.690958 13930 consensus_queue.cc:1048] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.698581 13570 raft_consensus.cc:1275] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.700369 13930 consensus_queue.cc:1048] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.783193 13644 raft_consensus.cc:1275] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Refusing update from remote peer 6cd14a97d8474cd697f65afab7060d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.784523 13882 consensus_queue.cc:1048] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:13.792461 13570 raft_consensus.cc:1275] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Refusing update from remote peer 6cd14a97d8474cd697f65afab7060d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:13.794293 13846 consensus_queue.cc:1048] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:15.993088 13466 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44706:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:05:16.187721 13466 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44706:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:05:16.270412   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:16.380539 13642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d9b4a15fd814be490b0d7dbb4d1afcc"
dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
mode: GRACEFUL
new_leader_uuid: "6cd14a97d8474cd697f65afab7060d9e"
 from {username='slave'} at 127.0.0.1:60654
I20260709 13:05:16.381400 13642 raft_consensus.cc:606] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Received request to transfer leadership to TS 6cd14a97d8474cd697f65afab7060d9e
W20260709 13:05:16.517602 13959 log.cc:927] Time spent T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361: Append to log took a long time: real 0.098s	user 0.000s	sys 0.004s
W20260709 13:05:16.524266 13973 log.cc:927] Time spent T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:05:16.571662 13983 tablet.cc:1724] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.570371 13989 tablet.cc:1724] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:16.595480 13974 log.cc:927] Time spent T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
W20260709 13:05:16.607370 13671 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:f331d902773d4eefb048904ac2054d64)
I20260709 13:05:16.570838 13990 tablet.cc:1724] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.570369 13988 tablet.cc:1724] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.621855 13993 tablet.cc:1724] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.628284 13995 tablet.cc:1724] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.625427 13987 tablet.cc:1724] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.633069 13992 tablet.cc:1724] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.706171 13996 raft_consensus.cc:993] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361: : Instructing follower 6cd14a97d8474cd697f65afab7060d9e to start an election
W20260709 13:05:16.706848 13671 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:7913e288893b4e64b2a3de4c48e14566)
W20260709 13:05:16.707731 13671 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:7913e288893b4e64b2a3de4c48e14566)
I20260709 13:05:16.708052 13943 raft_consensus.cc:1081] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Signalling peer 6cd14a97d8474cd697f65afab7060d9e to start an election
I20260709 13:05:16.728915 14001 tablet.cc:1724] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.734515 14003 tablet.cc:1724] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.744248 14001 tablet.cc:1724] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.751207 13997 tablet.cc:1724] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.761857 13714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d9b4a15fd814be490b0d7dbb4d1afcc"
dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
 from {username='slave'} at 127.0.0.1:33168
I20260709 13:05:16.762544 13983 tablet.cc:1724] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.768566 13989 tablet.cc:1724] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.762593 13714 raft_consensus.cc:493] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:16.788571 13714 raft_consensus.cc:3060] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.803270 13988 tablet.cc:1724] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.806991 13990 tablet.cc:1724] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.808694 13997 tablet.cc:1724] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.809306 13566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5790fec8993e48c98c2ab2d08153169a"
dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
mode: GRACEFUL
new_leader_uuid: "6cd14a97d8474cd697f65afab7060d9e"
 from {username='slave'} at 127.0.0.1:46588
I20260709 13:05:16.809983 13566 raft_consensus.cc:606] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Received request to transfer leadership to TS 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:16.811532   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:16.812161   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:16.820811 13714 raft_consensus.cc:515] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:16.822953 13983 tablet.cc:1724] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.825381 13992 tablet.cc:1724] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.825552 13988 tablet.cc:1724] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.826632 13995 tablet.cc:1724] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.829516 14004 tablet.cc:1724] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.830626 13993 tablet.cc:1724] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.840786 13989 tablet.cc:1724] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.843415 13983 tablet.cc:1724] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.847419 13714 leader_election.cc:290] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:16.848186 13566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9b4a15fd814be490b0d7dbb4d1afcc" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:16.849231 13643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d9b4a15fd814be490b0d7dbb4d1afcc" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:16.864051 13566 raft_consensus.cc:3060] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.864235 13643 raft_consensus.cc:3055] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:16.864672 13643 raft_consensus.cc:740] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:16.849356 14003 tablet.cc:1724] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.865415 13643 consensus_queue.cc:260] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:16.869935 13643 raft_consensus.cc:3060] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.874142 13566 raft_consensus.cc:2468] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 2.
I20260709 13:05:16.875587 13684 leader_election.cc:304] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:16.876479 13846 raft_consensus.cc:2804] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:16.876937 13846 raft_consensus.cc:697] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 2 LEADER]: Becoming Leader. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Running, Role: LEADER
I20260709 13:05:16.877741 13846 consensus_queue.cc:237] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:16.892315 14004 tablet.cc:1724] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:16.895208 13643 raft_consensus.cc:2468] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 2.
I20260709 13:05:16.911274 13466 catalog_manager.cc:5697] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e reported cstate change: term changed from 1 to 2, leader changed from c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194) to 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6cd14a97d8474cd697f65afab7060d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.919283 13467 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53: soft_deleted_table [id=fe1f1c067b7a495a9c5bc1b1d49641f5] alter complete (version 1)
W20260709 13:05:17.113597 13591 debug-util.cc:398] Leaking SignalData structure 0x7b08001f9320 after lost signal to thread 434
W20260709 13:05:17.114655 13591 debug-util.cc:398] Leaking SignalData structure 0x7b0800064ae0 after lost signal to thread 13502
W20260709 13:05:17.117074 13591 debug-util.cc:398] Leaking SignalData structure 0x7b080027bbe0 after lost signal to thread 13743
I20260709 13:05:17.256179 13871 raft_consensus.cc:993] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61: : Instructing follower 6cd14a97d8474cd697f65afab7060d9e to start an election
I20260709 13:05:17.256930 13962 raft_consensus.cc:1081] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Signalling peer 6cd14a97d8474cd697f65afab7060d9e to start an election
I20260709 13:05:17.258636 13714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5790fec8993e48c98c2ab2d08153169a"
dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
 from {username='slave'} at 127.0.0.1:33170
I20260709 13:05:17.259181 13714 raft_consensus.cc:493] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.259490 13714 raft_consensus.cc:3060] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.265290 13714 raft_consensus.cc:515] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:17.268095 13566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5790fec8993e48c98c2ab2d08153169a" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29d2cbebb8f2464f8dddefda1adaaf61"
I20260709 13:05:17.267282 13714 leader_election.cc:290] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:17.268514 13643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5790fec8993e48c98c2ab2d08153169a" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:17.268756 13566 raft_consensus.cc:3055] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.269212 13566 raft_consensus.cc:740] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29d2cbebb8f2464f8dddefda1adaaf61, State: Running, Role: LEADER
I20260709 13:05:17.269243 13643 raft_consensus.cc:3060] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.270085 13566 consensus_queue.cc:260] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:17.270960 13566 raft_consensus.cc:3060] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.276496 13566 raft_consensus.cc:2468] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 2.
I20260709 13:05:17.277459 13643 raft_consensus.cc:2468] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 2.
I20260709 13:05:17.277639 13684 leader_election.cc:304] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e; no voters: 
I20260709 13:05:17.278687 13846 raft_consensus.cc:2804] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.279102 13846 raft_consensus.cc:697] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [term 2 LEADER]: Becoming Leader. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Running, Role: LEADER
I20260709 13:05:17.279927 13846 consensus_queue.cc:237] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:17.288214 13466 catalog_manager.cc:5697] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e reported cstate change: term changed from 1 to 2, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195). New cstate: current_term: 2 leader_uuid: "6cd14a97d8474cd697f65afab7060d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.434283 13643 raft_consensus.cc:1275] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Refusing update from remote peer 6cd14a97d8474cd697f65afab7060d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.435607 13846 consensus_queue.cc:1048] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.450311 13566 raft_consensus.cc:1275] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Refusing update from remote peer 6cd14a97d8474cd697f65afab7060d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.451922 13846 consensus_queue.cc:1048] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.820672 13567 raft_consensus.cc:1275] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Refusing update from remote peer 6cd14a97d8474cd697f65afab7060d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.822214 13846 consensus_queue.cc:1048] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.846421 13643 raft_consensus.cc:1275] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Refusing update from remote peer 6cd14a97d8474cd697f65afab7060d9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.848496 14021 consensus_queue.cc:1048] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:17.907230   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:05:17.911237 13610 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:05:17.915431 13610 consensus_peers.cc:597] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:17.944370   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:17.945376   431 tablet_replica.cc:333] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.946434   431 raft_consensus.cc:2243] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.947152   431 raft_consensus.cc:2272] T f331d902773d4eefb048904ac2054d64 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.949187   431 tablet_replica.cc:333] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.949793   431 raft_consensus.cc:2243] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.950294   431 raft_consensus.cc:2272] T e6cae46e260b44d1be168af32741a927 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.952144   431 tablet_replica.cc:333] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.952929   431 raft_consensus.cc:2243] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.953730   431 raft_consensus.cc:2272] T 7913e288893b4e64b2a3de4c48e14566 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.955638   431 tablet_replica.cc:333] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.956221   431 raft_consensus.cc:2243] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.956759   431 raft_consensus.cc:2272] T b8f626b37da743e9a5a292eca013e549 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.958632   431 tablet_replica.cc:333] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.959161   431 raft_consensus.cc:2243] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.959585   431 raft_consensus.cc:2272] T 4887520213fb46aca97a33b873744d4f P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.961395   431 tablet_replica.cc:333] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.962181   431 raft_consensus.cc:2243] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.963161   431 raft_consensus.cc:2272] T a032cb3fe74548bd9b4e906868e36780 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.965608   431 tablet_replica.cc:333] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.966243   431 raft_consensus.cc:2243] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.966770   431 raft_consensus.cc:2272] T 8672ee2b1af7424bb262d0c8589a8cbb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.968559   431 tablet_replica.cc:333] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.969199   431 raft_consensus.cc:2243] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.969679   431 raft_consensus.cc:2272] T d6370ad18eb24102b5108d3345a591fb P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.971622   431 tablet_replica.cc:333] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.972215   431 raft_consensus.cc:2243] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.973186   431 raft_consensus.cc:2272] T 10d5ee21f56246a29c533a4de05c7489 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.975123   431 tablet_replica.cc:333] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.975713   431 raft_consensus.cc:2243] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.976502   431 raft_consensus.cc:2272] T 34cdcf3c9ba34308b40f98d78681fa17 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.978971   431 tablet_replica.cc:333] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.979548   431 raft_consensus.cc:2243] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.979984   431 raft_consensus.cc:2272] T 5790fec8993e48c98c2ab2d08153169a P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.984047   431 tablet_replica.cc:333] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.985049   431 raft_consensus.cc:2243] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.985733   431 raft_consensus.cc:2272] T d363ea55721b45cdaf704f9d5fd6a94d P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.989092   431 tablet_replica.cc:333] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.990002   431 raft_consensus.cc:2243] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:17.991140   431 raft_consensus.cc:2272] T 3f59e2b34f9045c2b77dd1cb32149920 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.994331   431 tablet_replica.cc:333] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.995190   431 raft_consensus.cc:2243] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:17.995786   431 raft_consensus.cc:2272] T ea276e84e0824360bf5d1ae70c77e1ab P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:17.999091   431 tablet_replica.cc:333] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:17.999917   431 raft_consensus.cc:2243] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.000505   431 raft_consensus.cc:2272] T c6769d88ce5c400b9629ad29c23a73dc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.003587   431 tablet_replica.cc:333] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:18.004441   431 raft_consensus.cc:2243] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.005098   431 raft_consensus.cc:2272] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 29d2cbebb8f2464f8dddefda1adaaf61 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:18.006645 13610 consensus_peers.cc:597] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:18.008708   431 tablet_replica.cc:333] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:18.009686   431 raft_consensus.cc:2243] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.010900   431 raft_consensus.cc:2272] T 943f8ea3304144259be44f5f6c24fc5b P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.013989   431 tablet_replica.cc:333] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61: stopping tablet replica
I20260709 13:05:18.014793   431 raft_consensus.cc:2243] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:18.016027   431 raft_consensus.cc:2272] T 1972faeeb5c64367846cc2549d8cf7b4 P 29d2cbebb8f2464f8dddefda1adaaf61 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:18.026942 13684 consensus_peers.cc:597] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:18.035080 13684 consensus_peers.cc:597] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:18.055198 13610 consensus_peers.cc:597] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:18.099169 13610 consensus_peers.cc:597] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:18.196127 13610 consensus_peers.cc:597] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:18.196988 13610 consensus_peers.cc:597] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:18.235328 13684 consensus_peers.cc:597] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:18.271543 13610 consensus_peers.cc:597] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:18.407615 13684 consensus_peers.cc:597] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.039952 14021 raft_consensus.cc:493] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.040939 14021 raft_consensus.cc:515] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.043347 14021 leader_election.cc:290] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:19.044771 13641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
W20260709 13:05:19.047731 13684 leader_election.cc:336] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.048189 13684 leader_election.cc:304] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:19.048997 14021 raft_consensus.cc:2749] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:19.053311   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 13591)
I20260709 13:05:19.066882 14021 raft_consensus.cc:493] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.067965 14021 raft_consensus.cc:515] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.070782 14021 leader_election.cc:290] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:19.072336 13641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943f8ea3304144259be44f5f6c24fc5b" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
W20260709 13:05:19.075875 13684 leader_election.cc:336] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.076314 13684 leader_election.cc:304] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:19.077055 14021 raft_consensus.cc:2749] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:19.122994 14021 raft_consensus.cc:493] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.123625 14021 raft_consensus.cc:515] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.125669 14021 leader_election.cc:290] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:19.127079 13641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
W20260709 13:05:19.129622 13684 leader_election.cc:336] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.130010 13684 leader_election.cc:304] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:19.130702 14021 raft_consensus.cc:2749] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.157426 14021 raft_consensus.cc:493] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.158108 14021 raft_consensus.cc:515] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.160529 14021 leader_election.cc:290] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:19.161204 13641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1972faeeb5c64367846cc2549d8cf7b4" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
W20260709 13:05:19.163990 13684 leader_election.cc:336] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.164507 13684 leader_election.cc:304] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:19.165328 14021 raft_consensus.cc:2749] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:19.181248 14027 raft_consensus.cc:493] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.181954 14027 raft_consensus.cc:515] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.184068 14027 leader_election.cc:290] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:19.185453 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
W20260709 13:05:19.188498 13610 leader_election.cc:336] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.188975 13610 leader_election.cc:304] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:19.189757 14027 raft_consensus.cc:2749] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.235716 14027 raft_consensus.cc:493] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.236429 14027 raft_consensus.cc:515] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.238783 14027 leader_election.cc:290] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:19.240007 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1972faeeb5c64367846cc2549d8cf7b4" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:19.240792 13714 raft_consensus.cc:2468] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:19.242095 13608 leader_election.cc:304] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 
W20260709 13:05:19.242660 13610 leader_election.cc:336] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.242933 14027 raft_consensus.cc:2804] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:19.243396 14027 raft_consensus.cc:493] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.243685 14027 raft_consensus.cc:3060] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.251492 14027 raft_consensus.cc:515] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.253165 14027 leader_election.cc:290] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:19.254367 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1972faeeb5c64367846cc2549d8cf7b4" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:19.255024 13714 raft_consensus.cc:3060] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:19.257447 13610 leader_election.cc:336] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.260622 14021 raft_consensus.cc:493] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.261422 14021 raft_consensus.cc:515] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.263695 13714 raft_consensus.cc:2468] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:19.265070 14021 leader_election.cc:290] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:19.265316 13608 leader_election.cc:304] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:19.266255 13641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:19.266685 14027 raft_consensus.cc:493] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.267704 14031 raft_consensus.cc:2804] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.267462 14027 raft_consensus.cc:515] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.268250 14031 raft_consensus.cc:697] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:19.269572 14031 consensus_queue.cc:237] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.270241 14027 leader_election.cc:290] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:19.271449 13717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:19.272101 13717 raft_consensus.cc:2468] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
W20260709 13:05:19.274813 13684 leader_election.cc:336] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.275418 13684 leader_election.cc:304] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, c87b1b6aa93e412797a928d4d1e15361
I20260709 13:05:19.276248 14021 raft_consensus.cc:2749] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.277364 13608 leader_election.cc:304] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:19.278342 13941 raft_consensus.cc:2804] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:19.278684 13941 raft_consensus.cc:493] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.279155 13941 raft_consensus.cc:3060] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:19.280992 13610 leader_election.cc:336] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.288908 13464 catalog_manager.cc:5697] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 1 to 2, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.293349 13941 raft_consensus.cc:515] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.297257 13941 leader_election.cc:290] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:19.298009 14031 raft_consensus.cc:493] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.298993 14031 raft_consensus.cc:515] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
W20260709 13:05:19.299862 13610 leader_election.cc:336] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.303875 14031 leader_election.cc:290] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
W20260709 13:05:19.307858 13610 leader_election.cc:336] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.309921 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7913e288893b4e64b2a3de4c48e14566" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:19.310835 13714 raft_consensus.cc:3060] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.311677 13717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943f8ea3304144259be44f5f6c24fc5b" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:19.312549 13717 raft_consensus.cc:2468] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 1.
I20260709 13:05:19.313915 13608 leader_election.cc:304] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:19.315156 13941 raft_consensus.cc:2804] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:19.315846 13941 raft_consensus.cc:493] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.316231 13941 raft_consensus.cc:3060] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.323468 14031 raft_consensus.cc:493] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.324347 14031 raft_consensus.cc:515] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:19.327492 14031 leader_election.cc:290] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:19.327759 13717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:19.328387 13714 raft_consensus.cc:2468] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 3.
I20260709 13:05:19.329327 14031 raft_consensus.cc:493] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.326841 13941 raft_consensus.cc:515] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.330087 14031 raft_consensus.cc:515] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
W20260709 13:05:19.331180 13610 leader_election.cc:336] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.331645 13610 leader_election.cc:304] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61, 6cd14a97d8474cd697f65afab7060d9e
I20260709 13:05:19.332412 14027 raft_consensus.cc:2749] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.332350 14031 leader_election.cc:290] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:19.333807 13717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:19.334657 13717 raft_consensus.cc:2468] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:19.335911 13608 leader_election.cc:304] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:19.336870 13941 leader_election.cc:290] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
W20260709 13:05:19.338824 13610 leader_election.cc:336] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
W20260709 13:05:19.339437 13610 leader_election.cc:336] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.339701 14031 raft_consensus.cc:2804] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:19.340193 14031 raft_consensus.cc:493] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.340190 13717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "943f8ea3304144259be44f5f6c24fc5b" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:19.340889 13608 leader_election.cc:304] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:19.341135 14031 raft_consensus.cc:3060] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.341372 13717 raft_consensus.cc:3060] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:19.342140 13941 raft_consensus.cc:2804] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:19.343050 13941 raft_consensus.cc:697] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 3 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:19.344221 13941 consensus_queue.cc:237] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.351694 13717 raft_consensus.cc:2468] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:19.353238 13608 leader_election.cc:304] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:19.353382 14031 raft_consensus.cc:515] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.354476 14027 raft_consensus.cc:2804] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:19.357913 14031 leader_election.cc:290] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:19.361666 13714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a032cb3fe74548bd9b4e906868e36780" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:19.362432 13714 raft_consensus.cc:3060] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:19.362735 13610 leader_election.cc:336] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.366385 13941 raft_consensus.cc:493] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.367111 13941 raft_consensus.cc:515] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.369313 14021 raft_consensus.cc:493] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.369735 13941 leader_election.cc:290] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:19.370075 14021 raft_consensus.cc:515] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.373224 13641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:19.373878 13641 raft_consensus.cc:2468] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 2.
I20260709 13:05:19.374648 13464 catalog_manager.cc:5697] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 2 to 3, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.375413 13683 leader_election.cc:304] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 
W20260709 13:05:19.376590 13684 leader_election.cc:336] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.376726 14022 raft_consensus.cc:2804] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:19.377099 14022 raft_consensus.cc:493] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.377386 14022 raft_consensus.cc:3060] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.378507 13717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e" is_pre_election: true
I20260709 13:05:19.379233 13717 raft_consensus.cc:2468] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 2.
I20260709 13:05:19.380460 13608 leader_election.cc:304] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 
I20260709 13:05:19.382413 14021 leader_election.cc:290] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:19.383737 14039 raft_consensus.cc:2804] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:19.384207 14039 raft_consensus.cc:493] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.384559 14039 raft_consensus.cc:3060] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:19.385677 13610 leader_election.cc:336] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.386842 14027 raft_consensus.cc:697] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:19.388039 14027 consensus_queue.cc:237] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.394737 14039 raft_consensus.cc:515] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.400098 14039 leader_election.cc:290] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195:33885)
I20260709 13:05:19.401147 13714 raft_consensus.cc:2468] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 3.
I20260709 13:05:19.401261 13717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d5ee21f56246a29c533a4de05c7489" candidate_uuid: "c87b1b6aa93e412797a928d4d1e15361" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6cd14a97d8474cd697f65afab7060d9e"
I20260709 13:05:19.402093 13717 raft_consensus.cc:3060] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.402065 14022 raft_consensus.cc:515] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.402730 13608 leader_election.cc:304] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:19.405577 13641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f59e2b34f9045c2b77dd1cb32149920" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:19.406256 13641 raft_consensus.cc:3060] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:19.409490 13684 leader_election.cc:336] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.403817 14039 raft_consensus.cc:2804] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:19.410868 14039 raft_consensus.cc:697] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 3 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:19.412171 14039 consensus_queue.cc:237] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
W20260709 13:05:19.413273 13610 leader_election.cc:336] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.414989 13717 raft_consensus.cc:2468] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c87b1b6aa93e412797a928d4d1e15361 in term 3.
I20260709 13:05:19.416453 13608 leader_election.cc:304] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:19.417573 14027 raft_consensus.cc:2804] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:19.418181 14027 raft_consensus.cc:697] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 3 LEADER]: Becoming Leader. State: Replica: c87b1b6aa93e412797a928d4d1e15361, State: Running, Role: LEADER
I20260709 13:05:19.419261 14027 consensus_queue.cc:237] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.425180 13641 raft_consensus.cc:2468] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 3.
I20260709 13:05:19.429850 14022 leader_election.cc:290] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:19.429893 13464 catalog_manager.cc:5697] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 1 to 2, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.431598 13683 leader_election.cc:304] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:19.432857 14022 raft_consensus.cc:2804] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:19.434316 14022 raft_consensus.cc:697] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 3 LEADER]: Becoming Leader. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Running, Role: LEADER
I20260709 13:05:19.435433 14022 consensus_queue.cc:237] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } }
I20260709 13:05:19.448491 13464 catalog_manager.cc:5697] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e reported cstate change: term changed from 2 to 3, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "6cd14a97d8474cd697f65afab7060d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.449286 13466 catalog_manager.cc:5697] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 2 to 3, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.450862 13466 catalog_manager.cc:5697] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 reported cstate change: term changed from 2 to 3, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c87b1b6aa93e412797a928d4d1e15361" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.465535 14022 raft_consensus.cc:493] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.466346 14022 raft_consensus.cc:515] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:19.468864 14022 leader_election.cc:290] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:19.470240 13641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361" is_pre_election: true
I20260709 13:05:19.471706 13641 raft_consensus.cc:2468] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 2.
I20260709 13:05:19.473006 13683 leader_election.cc:304] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 
W20260709 13:05:19.473625 13684 leader_election.cc:336] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.473883 14022 raft_consensus.cc:2804] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:19.474388 14022 raft_consensus.cc:493] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 29d2cbebb8f2464f8dddefda1adaaf61)
I20260709 13:05:19.474789 14022 raft_consensus.cc:3060] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.483207 14022 raft_consensus.cc:515] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:19.485445 14022 leader_election.cc:290] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 election: Requested vote from peers 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503), c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745)
I20260709 13:05:19.486855 13641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34cdcf3c9ba34308b40f98d78681fa17" candidate_uuid: "6cd14a97d8474cd697f65afab7060d9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c87b1b6aa93e412797a928d4d1e15361"
I20260709 13:05:19.487530 13641 raft_consensus.cc:3060] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:19.489766 13684 leader_election.cc:336] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111)
I20260709 13:05:19.495800 13641 raft_consensus.cc:2468] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cd14a97d8474cd697f65afab7060d9e in term 3.
I20260709 13:05:19.497215 13683 leader_election.cc:304] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cd14a97d8474cd697f65afab7060d9e, c87b1b6aa93e412797a928d4d1e15361; no voters: 29d2cbebb8f2464f8dddefda1adaaf61
I20260709 13:05:19.498234 14022 raft_consensus.cc:2804] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:19.498809 14022 raft_consensus.cc:697] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 3 LEADER]: Becoming Leader. State: Replica: 6cd14a97d8474cd697f65afab7060d9e, State: Running, Role: LEADER
I20260709 13:05:19.499832 14022 consensus_queue.cc:237] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } }
I20260709 13:05:19.509894 13466 catalog_manager.cc:5697] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e reported cstate change: term changed from 2 to 3, leader changed from 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193) to 6cd14a97d8474cd697f65afab7060d9e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "6cd14a97d8474cd697f65afab7060d9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29d2cbebb8f2464f8dddefda1adaaf61" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.791834 13717 raft_consensus.cc:1275] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.793574 14027 consensus_queue.cc:1048] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:19.809003 13714 raft_consensus.cc:1275] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:19.811715 14027 consensus_queue.cc:1048] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:05:19.813160 13610 consensus_peers.cc:597] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.813390 13714 raft_consensus.cc:1275] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:19.816262 14039 consensus_queue.cc:1048] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:05:19.833838 13610 consensus_peers.cc:597] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:19.843603 13610 consensus_peers.cc:597] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.902702 13641 raft_consensus.cc:1275] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Refusing update from remote peer 6cd14a97d8474cd697f65afab7060d9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:19.904325 13960 consensus_queue.cc:1048] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:19.920434 13684 consensus_peers.cc:597] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:19.928995 13684 consensus_peers.cc:597] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:19.942531 13717 raft_consensus.cc:1275] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:19.944257 14039 consensus_queue.cc:1048] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:19.958000 13610 consensus_peers.cc:597] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:20.014232 13610 consensus_peers.cc:597] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.021588 13641 raft_consensus.cc:1275] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Refusing update from remote peer 6cd14a97d8474cd697f65afab7060d9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:20.023070 14022 consensus_queue.cc:1048] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c87b1b6aa93e412797a928d4d1e15361" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:20.041900 13717 raft_consensus.cc:1275] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Refusing update from remote peer c87b1b6aa93e412797a928d4d1e15361: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:20.043799 14039 consensus_queue.cc:1048] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cd14a97d8474cd697f65afab7060d9e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:05:20.053961   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 13591)
W20260709 13:05:20.243242 13610 consensus_peers.cc:597] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.325418 13610 consensus_peers.cc:597] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.370339 13684 consensus_peers.cc:597] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.429337 13610 consensus_peers.cc:597] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.466428 13610 consensus_peers.cc:597] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.617018 13610 consensus_peers.cc:597] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.668123 13610 consensus_peers.cc:597] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.693151 13610 consensus_peers.cc:597] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.719309 13684 consensus_peers.cc:597] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:20.789484 13684 consensus_peers.cc:597] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:20.816480   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:05:20.879793   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:05:20.907806   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:20.908700   431 tablet_replica.cc:333] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.909955   431 raft_consensus.cc:2243] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.911108   431 raft_consensus.cc:2272] T 943f8ea3304144259be44f5f6c24fc5b P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.914425   431 tablet_replica.cc:333] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.915114   431 raft_consensus.cc:2243] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.915962   431 raft_consensus.cc:2272] T 10d5ee21f56246a29c533a4de05c7489 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.919387   431 tablet_replica.cc:333] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.920235   431 raft_consensus.cc:2243] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.920851   431 raft_consensus.cc:2272] T 4887520213fb46aca97a33b873744d4f P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.923278   431 tablet_replica.cc:333] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.923858   431 raft_consensus.cc:2243] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.924816   431 raft_consensus.cc:2272] T b8f626b37da743e9a5a292eca013e549 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.928400   431 tablet_replica.cc:333] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.929175   431 raft_consensus.cc:2243] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.930258   431 raft_consensus.cc:2272] T f331d902773d4eefb048904ac2054d64 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.932647   431 tablet_replica.cc:333] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.933265   431 raft_consensus.cc:2243] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.934178   431 raft_consensus.cc:2272] T a032cb3fe74548bd9b4e906868e36780 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.936444   431 tablet_replica.cc:333] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.937098   431 raft_consensus.cc:2243] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.937885   431 raft_consensus.cc:2272] T 1972faeeb5c64367846cc2549d8cf7b4 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.940513   431 tablet_replica.cc:333] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.941350   431 raft_consensus.cc:2243] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.941984   431 raft_consensus.cc:2272] T 5790fec8993e48c98c2ab2d08153169a P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.944707   431 tablet_replica.cc:333] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.945528   431 raft_consensus.cc:2243] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.946550   431 raft_consensus.cc:2272] T d363ea55721b45cdaf704f9d5fd6a94d P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:20.948016 13683 consensus_peers.cc:597] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e -> Peer c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745): Couldn't send request to peer c87b1b6aa93e412797a928d4d1e15361. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:20.949211   431 tablet_replica.cc:333] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.949892   431 raft_consensus.cc:2243] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.950781   431 raft_consensus.cc:2272] T 7913e288893b4e64b2a3de4c48e14566 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.953364   431 tablet_replica.cc:333] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.954339   431 raft_consensus.cc:2243] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.955209   431 raft_consensus.cc:2272] T e6cae46e260b44d1be168af32741a927 P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.957942   431 tablet_replica.cc:333] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.958829   431 raft_consensus.cc:2243] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.959983   431 raft_consensus.cc:2272] T 8672ee2b1af7424bb262d0c8589a8cbb P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.963011   431 tablet_replica.cc:333] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.963532   431 raft_consensus.cc:2243] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.964522   431 raft_consensus.cc:2272] T d6370ad18eb24102b5108d3345a591fb P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.966924   431 tablet_replica.cc:333] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.967413   431 raft_consensus.cc:2243] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:20.968199   431 raft_consensus.cc:2272] T c6769d88ce5c400b9629ad29c23a73dc P c87b1b6aa93e412797a928d4d1e15361 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.970461   431 tablet_replica.cc:333] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.970988   431 raft_consensus.cc:2243] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.971423   431 raft_consensus.cc:2272] T ea276e84e0824360bf5d1ae70c77e1ab P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.973498   431 tablet_replica.cc:333] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.973937   431 raft_consensus.cc:2243] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.974390   431 raft_consensus.cc:2272] T 3f59e2b34f9045c2b77dd1cb32149920 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.976766   431 tablet_replica.cc:333] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.977222   431 raft_consensus.cc:2243] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.977631   431 raft_consensus.cc:2272] T 34cdcf3c9ba34308b40f98d78681fa17 P c87b1b6aa93e412797a928d4d1e15361 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:20.979617   431 tablet_replica.cc:333] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361: stopping tablet replica
I20260709 13:05:20.980063   431 raft_consensus.cc:2243] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:20.980569   431 raft_consensus.cc:2272] T 1d9b4a15fd814be490b0d7dbb4d1afcc P c87b1b6aa93e412797a928d4d1e15361 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.021891   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:05:21.031901 13683 consensus_peers.cc:597] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e -> Peer c87b1b6aa93e412797a928d4d1e15361 (127.0.107.194:34745): Couldn't send request to peer c87b1b6aa93e412797a928d4d1e15361. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34745: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:21.063771   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:05:21.099176   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:21.100003   431 tablet_replica.cc:333] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.101130   431 raft_consensus.cc:2243] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.101650   431 raft_consensus.cc:2272] T a032cb3fe74548bd9b4e906868e36780 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.103920   431 tablet_replica.cc:333] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.104585   431 raft_consensus.cc:2243] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.105016   431 raft_consensus.cc:2272] T f331d902773d4eefb048904ac2054d64 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.107235   431 tablet_replica.cc:333] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.107738   431 raft_consensus.cc:2243] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.108230   431 raft_consensus.cc:2272] T 10d5ee21f56246a29c533a4de05c7489 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.110566   431 tablet_replica.cc:333] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.111130   431 raft_consensus.cc:2243] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.111749   431 raft_consensus.cc:2272] T b8f626b37da743e9a5a292eca013e549 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.114092   431 tablet_replica.cc:333] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.114668   431 raft_consensus.cc:2243] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:21.115577   431 raft_consensus.cc:2272] T 4887520213fb46aca97a33b873744d4f P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.117941   431 tablet_replica.cc:333] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.118607   431 raft_consensus.cc:2243] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.119210   431 raft_consensus.cc:2272] T e6cae46e260b44d1be168af32741a927 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.121593   431 tablet_replica.cc:333] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.122251   431 raft_consensus.cc:2243] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.122753   431 raft_consensus.cc:2272] T 7913e288893b4e64b2a3de4c48e14566 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.124881   431 tablet_replica.cc:333] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.125416   431 raft_consensus.cc:2243] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:21.126298   431 raft_consensus.cc:2272] T ea276e84e0824360bf5d1ae70c77e1ab P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.128319   431 tablet_replica.cc:333] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.128866   431 raft_consensus.cc:2243] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.129336   431 raft_consensus.cc:2272] T c6769d88ce5c400b9629ad29c23a73dc P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.131649   431 tablet_replica.cc:333] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.132359   431 raft_consensus.cc:2243] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:21.133280   431 raft_consensus.cc:2272] T 1d9b4a15fd814be490b0d7dbb4d1afcc P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:21.135512 13684 consensus_peers.cc:597] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e -> Peer 29d2cbebb8f2464f8dddefda1adaaf61 (127.0.107.193:34503): Couldn't send request to peer 29d2cbebb8f2464f8dddefda1adaaf61. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:21.136241   431 tablet_replica.cc:333] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.136828   431 raft_consensus.cc:2243] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.137274   431 raft_consensus.cc:2272] T d363ea55721b45cdaf704f9d5fd6a94d P 6cd14a97d8474cd697f65afab7060d9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.139410   431 tablet_replica.cc:333] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.139901   431 raft_consensus.cc:2243] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:21.140635   431 raft_consensus.cc:2272] T 5790fec8993e48c98c2ab2d08153169a P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.142850   431 tablet_replica.cc:333] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.143339   431 raft_consensus.cc:2243] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.143771   431 raft_consensus.cc:2272] T 8672ee2b1af7424bb262d0c8589a8cbb P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.145812   431 tablet_replica.cc:333] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.146378   431 raft_consensus.cc:2243] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.146780   431 raft_consensus.cc:2272] T d6370ad18eb24102b5108d3345a591fb P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.148722   431 tablet_replica.cc:333] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.149183   431 raft_consensus.cc:2243] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.149580   431 raft_consensus.cc:2272] T 943f8ea3304144259be44f5f6c24fc5b P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.151628   431 tablet_replica.cc:333] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.152086   431 raft_consensus.cc:2243] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:21.152437   431 raft_consensus.cc:2272] T 1972faeeb5c64367846cc2549d8cf7b4 P 6cd14a97d8474cd697f65afab7060d9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.154320   431 tablet_replica.cc:333] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.154769   431 raft_consensus.cc:2243] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:21.155483   431 raft_consensus.cc:2272] T 3f59e2b34f9045c2b77dd1cb32149920 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.157367   431 tablet_replica.cc:333] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e: stopping tablet replica
I20260709 13:05:21.157805   431 raft_consensus.cc:2243] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:21.158581   431 raft_consensus.cc:2272] T 34cdcf3c9ba34308b40f98d78681fa17 P 6cd14a97d8474cd697f65afab7060d9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.198729   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:05:21.235603   431 master.cc:562] Master@127.0.107.254:36473 shutting down...
I20260709 13:05:21.259938   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:21.260546   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:21.260912   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 60eb7424d9e24f098cc6467d3b0fbf53: stopping tablet replica
I20260709 13:05:21.282791   431 master.cc:584] Master@127.0.107.254:36473 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (14605 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (27786 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (417445 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:05:21.347134   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 334 messages since previous log ~4 seconds ago
I20260709 13:05:21.347421   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 334 messages since previous log ~4 seconds ago
I20260709 13:05:21.347612   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 333 messages since previous log ~4 seconds ago
I20260709 13:05:21.347895   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~39 seconds ago
I20260709 13:05:21.348104   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~39 seconds ago
I20260709 13:05:21.348366   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~196 seconds ago
I20260709 13:05:21.348639   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 110 messages since previous log ~3 seconds ago
I20260709 13:05:21.348963   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 52 messages since previous log ~13 seconds ago
